About the role
Summary The primary function of the Data Engineer role is to design, develop, and maintain scalable data pipelines on the Databricks platform to facilitate the energy transition for retail customers in Belgium. This role aims to support the implementation of the Databricks platform within the context of an AWS environment, enabling efficient data processing for various projects.
Main Responsibilities:
Core duty description: This role involves managing and optimizing data processes to support various business projects.
- Design, develop, and maintain scalable data pipelines on the Databricks platform.
- Manage data ingestion processes from various sources into the Databricks environment.
- Implement and optimize ETL (Extract, Transform, Load) processes to ensure efficient data transformation and integration.
- Ensure data quality, integrity, and security across all data pipelines.
- Monitor and troubleshoot data pipeline performance, implementing necessary maintenance and updates.
- Document data pipeline processes, technical specifications, and best practices.
- Conduct knowledge transfer to the Data Engineer team responsible for managing the platform in the future.
Key Requirements:
- Strong skills in SQL and relevant programming languages (e.g., Python).
- Proven expertise in Databricks and AWS services.
- K.modal expertise in Databricks to support BI activities (Kimball modeling).
- Analytical mindset with attention to detail.
- Strong communication and collaboration skills.
Nice to Have:
- Experience in Datawarehouse or Lakehouse projects.
- Additional programming languages beyond SQL and Python.
- Experience with data quality management tools.
Other Details:
- Location: Belgium
- Team Structure: Reporting to a Project Lead and a Tech Lead/Data Architect.
- Qualifications: Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
- Experience: Minimum 3 years in SQL and Data warehousing, and 2 years with Databricks.
- Languages: Fluent in Dutch or French and English.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at emagine was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.