Managing a cross-functional team, the Data Engineering Manager leads the development and maintenance of frameworks and platform capabilities for data pipelines and analytics solutions. This role involves taking design ownership of projects, overseeing daily team activities, and contributing to community-of-practice programs. The team collaborates with stakeholders to address data challenges and create valuable data assets.
Responsibilities
Lead and manage a team of data engineers, providing technical guidance and mentorship
Take design leadership over individual projects, owning architecture decisions end-to-end
Take charge of day-to-day team activities including scrum ceremonies, sprint planning, and backlog management
Oversee the development and operation of modern data engineering solutions, including data ingestion, processing, integration, and governance
Collaborate with stakeholders to identify business needs and develop solutions
Develop and maintain shared frameworks for data engineering with broader organisational scope
Contribute to the onboarding of new data engineers, analysts, product owners, and other team members
Contribute to community-of-practice enablement programs, including internal upskilling, certification, training, and knowledge-sharing
Act as a data owner and functional subject matter expert for assigned areas, supporting data product certification and lineage maturity
Ensure platform stability and operational SLAs; drive reduction in operational noise and manual intervention
Extend DevOps capabilities for deploying and operating data solutions
Work closely with product owners and stakeholders to identify and mitigate potential data challenges
Support the adoption of AI and LLM-based tooling to improve engineering efficiency and data quality
Requirements
Bachelor's degree or higher in Computer Science, Statistics, Business, Information Technology, or a related field
5+ years of experience in data engineering or a related discipline
At least 2 years in a technical lead or team lead capacity
Proven track record delivering and supporting software and data engineering capabilities in a fast-paced, dynamic environment
Experience contributing to shared frameworks within the data domain, and creating data assets used in mission-critical applications
Intermediate data design skills: data modelling, schema design, and pipeline architecture for enterprise-scale solutions
Core Python proficiency, including object-oriented programming, reusable library design, and clean scalable code
Advanced SQL, including window functions, query optimisation, and complex transformation logic beyond basic CRUD operations
Millions of jobs, with real people getting hired every day
200,000+
New jobs added daily
7,000,000+
Verified job listings
1,000,000+
Tailored applications submitted
Intermediate DevOps and cloud (Azure, AWS, or GCP), including CI/CD pipeline ownership, deployment practices, and cloud cost awareness
Experience with Agile methodologies; hands-on experience running scrum ceremonies
Experience with automated testing and data testing frameworks; able to design and enforce test coverage across pipelines and data assets
5+ years building enterprise data solutions with a proven track record delivering high-quality pipelines and analytics products
Understanding of data warehousing concepts and architecture patterns such as medallion architecture and dimensional modelling
Awareness of data product concepts including lineage, certification, and operational telemetry
Experience implementing data quality frameworks, including validation, profiling, and monitoring, to ensure integrity and consistency across data systems
Experience working in environments where data engineering capabilities are shared as platform services, not built in isolation
Strong collaborator and team player, with the ability to work effectively with business stakeholders and cross-functional teams
Strong analytical thinker; able to troubleshoot complex pipeline issues, optimise performance, and identify improvement opportunities across data systems
Clear point of view on data engineering best practices and the ability to bring others along
Effective communicator who can translate technical decisions into business language
Embraces change and is passionate about driving innovation and continuous improvement
Believes in a non-hierarchical culture of collaboration, transparency, safety, and trust
Not afraid to take risks and try new approaches; willing to learn from failure and use it to drive growth
Invested in the growth of others; sees enabling teammates as part of their own success
Nice to have:
Experience with dbt
Familiarity with modern orchestration and transformation tooling (Dagster, dbt, and Snowflake experience strongly preferred)
