وصف الوظيفة
Role Overview
Data Engineer at Artefact, a data service provider specialising in data consulting and data-driven digital marketing. Location not specified in source.
Company Overview
Artefact is a new generation of data service provider dedicated to transforming data into business impact across the entire value chain of organisations. The Data Consulting team has more than 400 consultants covering data marketing, data governance, strategy consulting, and product ownership. The company is experiencing skyrocketing growth.
Role Purpose
As a Data Engineer, you will craft and maintain robust data pipelines using Python and SQL to ensure efficient extraction, transformation, and loading (ETL) of data across systems and platforms.
Key Responsibilities
Data Pipeline Development
- Build and optimise data pipelines to facilitate seamless data flow across systems and platforms.
Database Management
- Manage databases and ensure their integrity.
- Implement data storage and retrieval solutions.
Cloud Services Integration
- Leverage cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
Machine Learning Integration
- Collaborate with teams to integrate machine learning models into data pipelines for enhanced data processing.
Real-Time Data Processing
- Implement and work with Spark and Kafka for real-time data processing and analytics.
Qualifications & Experience
- 2–5 years of experience as a Data Engineer.
- Minimum of a bachelor's degree in Computer Science, Electronics, or Communication Engineering.
- Proven experience with Data Pipelines and ETL.
- Experience with Cloud Services including MS Azure, GCP, and AWS.
- Proven experience with ML Modeling, Spark, and Kafka.
- Demonstrated experience working with business stakeholders either internally or externally.
Skills & Competencies
- Proficiency in Python and SQL.
- Proficiency in database management.
- Strong problem-solving skills and solution-oriented mindset.
- Excellent communication skills to collaborate effectively within teams and with stakeholders.
- Strong business acumen with an interest in business-facing roles.
- Adaptability and start-up mentality to thrive in a dynamic environment.
Additional Information
Artefact values innovation, believing that impacting projects and innovation can come from anyone. The company operates on principles of taking action rather than simply describing approaches, and emphasises bringing talented people together to win collectively and learn from one another.