About the role
Role Overview
Rex.zone is hiring for remote, full-time data labeling work supporting AI/ML training and evaluation pipelines. You will create high-quality labeled datasets and perform structured evaluations that improve model performance across real-world workflows.
What You’ll Do
- Produce accurate labels for NLP tasks (classification, summarization, intent labeling) and Named Entity Recognition (NER)
- Contribute to RLHF workflows by ranking/scoring model outputs using defined rubrics
- Perform prompt evaluation, response grading, and factuality/safety checks for LLM evaluation
- Execute QA evaluation: audits, error taxonomy tracking, and resolving label disagreements
- Follow annotation guidelines with high consistency and document edge cases to improve clarity
Requirements
- Experience in data labeling/data annotation or AI/ML evaluation workflows
- High attention to detail and strong guideline compliance
- Comfort with QA processes and structured feedback loops
- Proficiency in English for reading guidelines and documenting decisions
Nice to Have
- Prior RLHF, rubric-based LLM grading, or prompt evaluation experience
- Familiarity with annotation tools (e.g., Label Studio or similar)
- Understanding of training data quality and inter-annotator agreement concepts
Pay
Competitive hourly rate: $30–$50/hr.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Rex.zone was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.