About the role
This role leads a team of data engineers supporting a cloud-based data platform that enables large-scale analytics and machine learning workloads. Success requires strong leadership, deep expertise in Spark on AWS EMR, and the ability to design scalable, governed data solutions.
Client Details
Our client is a technology-focused organisation operating a modern cloud data environment. The team works closely with business and technical stakeholders to deliver data, analytics, and machine learning capabilities through scalable engineering solutions.
Description
- Lead and develop a team of data engineers, providing coaching to strengthen technical capability and delivery excellence.
- Offer hands-on technical direction by defining engineering best practices, reviewing solution designs and code, and promoting high-quality outcomes.
- Propose and detail solution designs that align with established architecture standards, governance requirements, and delivery frameworks.
- Communicate technical approaches effectively to stakeholders and project teams, explaining key design choices and associated trade-offs.
- Guide the development and optimisation of Apache Spark workloads on AWS EMR for both batch and real-time data processing.
- Oversee the design and management of streaming API solutions supporting real-time ingestion, consumption, and data delivery.
- Support self-service data access for data science users through curated data assets and governed delivery mechanisms, recommending suitable implementation approaches.
- Advocate strong MLOps practices, including model deployment, monitoring, and lifecycle support within the platform environment.
- Contribute to the delivery of lightweight user-facing and service-layer components using React and Node.js within a Backend-for-Frontend architecture.
- Collaborate with stakeholders, data science teams, and platform specialists to convert business requirements into scalable, secure, and cost-efficient solutions.
- Drive best practices in data governance, covering data quality, lineage, integrity, and security throughout the data lifecycle.
- Participate in emerging AI and generative AI-related initiatives, contributing ideas and technical input where appropriate.
Profile
- Bachelor's degree in Computer Science, Engineering, Data Science, or a related technical discipline, or equivalent industry experience.
- At least 6 years of experience in data engineering, including demonstrated experience leading and mentoring engineering teams.
- Strong technical leadership capabilities with experience establishing standards, mentoring engineers, and reviewing designs and code.
- Ability to communicate and present technical solutions effectively to both technical and non-technical audiences.
- Proven hands-on expertise with Apache Spark running on AWS EMR, including pipeline architecture, performance optimisation, and cost management.
- Experience designing and supporting streaming API services for real-time data ingestion, consumption, and API-driven delivery.
- Solid experience across AWS data services including S3, Glue, Lake Formation, Athena, Redshift, Step Functions, and Lambda.
- Proficiency in Python, with additional expertise in technologies such as React and Node.js within a Backend-for-Frontend architecture preferred.
- Ability to contribute solution concepts and detailed designs within defined architecture standards, delivery patterns, and governance frameworks.
- Understanding of MLOps principles and experience supporting self-service capabilities for data science teams.
- Experience with streaming and messaging technologies such as Kafka or Spark Streaming, along with strong SQL and data modelling skills.
- Interest in or exposure to AI and generative AI technologies is advantageous but not a primary requirement.
- Excellent communication, stakeholder engagement, and coaching abilities.
- Fluent Cantonese and English language skills are required; Mandarin is an advantage.
- Previous experience within a consulting, professional services, or technology services environment is preferred.
Job Offer
- Competitive monthly salary.
- Usual contractor benefits offered by the organization.
If you are interested in this Data Engineer Lead role in Hong Kong, we encourage you to apply.
To apply online please click the 'Apply' button below. For a confidential discussion about this role please contact Cathy Li on +85225306137.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Michael Page International (HK) Ltd was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.