About the role
We're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products.
Working alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies.
If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.
Skills and experience required
Core skills
- 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
- Strong Python and SQL skills.
- Hands-on experience with Generative AI and Large Language Models (LLMs).
- Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
- Experience building and deploying production-ready ML solutions.
- Strong understanding of data pipelines, validation, and quality frameworks.
- Experience integrating APIs and cloud-based AI services.
Soft skills
- Strong problem-solving and analytical skills.
- Comfortable owning solutions end-to-end.
- Excellent communication and stakeholder management.
- Experience working in Agile, cross-functional teams.
- Consulting or customer-facing experience is a plus.
What you will do
- Build and maintain scalable data pipelines and workflows.
- Develop evaluation frameworks for GenAI and LLM applications.
- Create and maintain golden datasets for model testing.
- Evaluate and benchmark LLM performance.
- Build ML-assisted tools to improve delivery and automation.
- Deploy production-ready AI solutions.
- Work closely with delivery teams to solve technical challenges.
- Continuously improve data quality, automation, and operational efficiency.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Acuity Analytics was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.