وصف الوظيفة
Role Overview
Lead Data Engineer at DeepLight, a specialist AI and data consultancy based in the UAE.
Company Overview
DeepLight AI partners with clients across a range of industries to design and deliver tailored data, analytics, and AI solutions. The firm helps organizations turn complex data into secure, scalable, and actionable business capability by understanding business context, existing technology landscape, and strategic goals to design solutions that integrate effectively into enterprise architecture.
Role Purpose
The Lead Data Engineer is the primary technical authority driving data engineering for high-profile client engagements. This hands-on leadership role balances rapid delivery with long-term engineering rigor, makes pragmatic architectural decisions, and serves as a trusted technical advisor to client stakeholders while mentoring the next generation of talent.
Key Responsibilities
End-to-End Delivery
- Architect, build, and deploy production-grade data pipelines, lakehouses, and analytics-ready datasets.
- Turn complex business problems into clear technical designs, delivery roadmaps, and actionable engineering tasks.
- Stay hands-on: solve tough technical challenges, perform code reviews, and jump in on production issue resolution.
Engineering Standards & Quality
- Establish and champion best-in-class standards for code quality, testing, CI/CD, documentation, and data governance.
- Build resilient, monitored, and secure data pipelines designed for scale and enterprise compliance.
- Drive operational excellence across version control, automated testing, runbooks, and platform monitoring.
Leadership & Mentorship
- Coach and mentor mid and senior level engineers, fostering a high-performance culture grounded in technical discipline and continuous growth.
- Partner directly with client architects, data scientists, and business leaders, translating complex technical choices into clear business value.
- Bridge the gap between complex data science and actionable business value as the face of the firm.
Stakeholder Communication
- Build trust with high-level stakeholders and articulate the "why" behind technical decisions.
- Effectively "sell" your vision and present cutting-edge solutions to client leadership.
- Navigate client environments and guide stakeholders through complex technical choices.
Qualifications & Experience
- Advanced proficiency in Python and SQL with a proven track record of delivering end-to-end ETL/ELT pipelines and scalable data architectures.
- Hands-on expertise with at least one major cloud provider (AWS, Azure, GCP) and deep proficiency in platforms including Databricks, Snowflake, Microsoft Fabric, Synapse, BigQuery, or Redshift.
- Deep understanding of data lakes, lakehouses, warehouses, streaming vs. batch processing, orchestration, and production monitoring.
Skills & Competencies
- Solid grasp of data privacy, access control, encryption, schema management, and enterprise data quality frameworks.
- Strong understanding of how robust data engineering enables advanced analytics, machine learning, and Generative AI applications.
- Excellent communication skills with the ability to navigate client environments, guide stakeholders, and balance delivery pace with technical quality.
- World-class technical mastery in your field of specialization.
- Compelling communication and ability to persuade stakeholders about technical vision and strategy.
Additional Information
- Competitive salary.
- Comprehensive personal health insurance.
- Full Individual Visa Sponsorship.
- Professional development and certification support.
- Subscription reimbursement relating to your role.
- Opportunity to work on cutting-edge AI projects.
- Monthly Employee Incentive program.
- Career advancement opportunities in a rapidly growing AI company.
- DeepLight AI is committed to fostering an inclusive environment and ensuring the application and interview process is accessible, predictable, and fair for all candidates. Reasonable adjustments are available and will not impact hiring decisions.