Data Platform Engineer

Role Overview

Data Platform Engineer at BlackStone eIT. This is a full-time position working with the company's data engineering team to design, build, and maintain scalable data platforms that support data processing and analytics needs.

Company Overview

BlackStone eIT is a dynamic organization focused on advancing its data capabilities through modern technology and infrastructure.

Role Purpose

You will design, build, and maintain scalable data platforms that support the company's data processing and analytics needs. You will collaborate with data engineers, analysts, and other stakeholders to develop efficient data pipelines, ensure data quality, and contribute to the overall data infrastructure architecture.

Key Responsibilities

Pipeline Development & Maintenance

• Develop and maintain data pipelines for ingestion, processing, and storage of large datasets
• Implement ETL/ELT processes to transform raw data into usable formats
• Optimize database performance and monitor platform health

Data Quality & Governance

• Ensure data quality, consistency, and reliability across platforms
• Assist in the design and implementation of data governance and security measures
• Understand and apply data security, governance, and quality best practices

Collaboration & Requirements Analysis

• Collaborate with cross-functional teams to understand data requirements and deliver solutions
• Work effectively in a team environment and communicate findings clearly

Documentation & Operations

• Document data infrastructure and processes for operational clarity

Qualifications & Experience

• Bachelor's degree in Computer Science, Information Technology, or a related field
• 3+ years of experience in data engineering or data platform development
• Proficiency in SQL and experience with relational databases such as PostgreSQL or MySQL
• Familiarity with data pipeline and ETL tools such as Apache Airflow, Azure Data Factory, or similar
• Experience with cloud platforms (AWS, Azure, or Google Cloud)
• Knowledge of Python or another programming or scripting language for data processing

Skills & Competencies

• Python — async data pipelines, background jobs, scripting
• PostgreSQL — schema design, migrations (Alembic), query optimization
• Azure Data Lake Storage and Synapse Analytics
• dbt — transformation, testing, documentation
• Apache Airflow or Azure Data Factory
• Data quality frameworks (Great Expectations, dbt tests, or custom)
• Observability — structured logging, alerting, Azure Monitor or Prometheus/Grafana
• Microsoft Graph API — SharePoint, M365 data extraction
• Redis — queue management, caching
• Docker — containerized pipeline jobs
• SQL — advanced analytical queries, window functions, performance tuning
• Strong analytical and problem-solving skills

Additional Information

• Paid Time Off
• Performance Bonus
• Training & Development