About the role
About The Role As an AI Engineer, you will design, train, evaluate, and deploy ML models with a strong emphasis on LLM training pipelines and measurable model performance improvement. You will build data and evaluation workflows that connect model development to training data quality, annotation guidelines compliance, and QA evaluation.
What You Will Do
- Build and iterate on ML/LLM systems from prototype to production
- Develop evaluation harnesses for offline and online testing, including prompt evaluation and LLM evaluation
- Implement RLHF-style feedback loops using human preference data when required
- Improve training data quality by defining labeling strategy, validation checks, and annotation guidelines
- Partner with QA evaluation and data labeling teams to reduce noise and bias
- Optimize inference latency and cost
- Document experiments, metrics, and rollouts
Required Qualifications
- Mid-Senior experience building ML systems
- Strong Python engineering
- Hands-on deep learning with PyTorch or equivalent
- Experience with model evaluation and metrics
- Familiarity with LLM training pipelines and/or NLP systems
- Comfort collaborating remotely across product, engineering, and data operations
Preferred Qualifications
- Experience with RLHF, preference data, or reward modeling
- MLOps experience (CI/CD for ML, model registry, monitoring)
- Experience with data labeling and QA evaluation processes
- Experience with RAG and vector databases
Remote Work This role is Remote and full-time. Collaboration includes async documentation, clear experiment writeups, and structured evaluation reviews.
Pay Competitive hourly rate: $30–$50 per hour (USD).
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Rex.zone was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.
