DATA ENGINEER

Role Overview

Data Engineer at NMDC Group.

Role Purpose

Design, develop, and maintain efficient data pipelines that process data from multiple sources to support real-time and batch data requirements. Ensure data integrity, compliance, and performance across the organization while collaborating with senior leadership and junior team members.

Key Responsibilities

Data Pipeline Design and Development

• Design, develop, and maintain efficient data pipelines to process data from multiple sources, supporting real-time and batch data requirements.
• Implement ETL/ELT processes for data ingestion, transformation, and storage that align with business unit needs and Corporate IT standards.
• Help integrate data from various sources, including third-party systems and ERP data, ensuring seamless flow between the business unit and Corporate IT infrastructure.
• Support the Senior Data Architect in implementing scalable data models and optimizing pipeline performance.
• Identify opportunities to enhance pipeline efficiency and reduce latency, especially for real-time data applications.

Data Quality and Governance

• Assist in implementing data validation and monitoring tools to maintain data accuracy, consistency, and reliability across the platform.
• Ensure data processes and pipelines comply with Corporate IT's data governance, security, and compliance standards.

Documentation and Reporting

• Create and update documentation for data flows, transformations, and processes to ensure transparency and compliance with corporate standards.
• Perform data analysis and reporting to assist in operational decision-making and performance optimization.

Professional Development

• Stay updated with industry trends and implement new technologies to enhance data infrastructure.
• Provide mentorship and support to Junior Data Engineers.