About the role
About The Role Online generalist jobs at Rex.zone are remote, full-time AI data operations roles supporting LLM training pipelines through data labeling, RLHF evaluation, prompt evaluation, QA evaluation, and content safety labeling. You will follow clear rubrics and annotation guidelines to deliver high-quality training and evaluation data.
Key Responsibilities
- Perform data labeling across NLP and computer vision tasks (text classification, NER, image tagging)
- Complete RLHF and QA evaluation on model responses using scoring rubrics
- Conduct prompt evaluation for helpfulness, correctness, tone, and safety
- Apply content safety labeling policies (hate, harassment, self-harm, sexual content) as needed
- Maintain training data quality via spot checks, peer review, and escalation of edge cases
- Track throughput, accuracy, and rework rates; support dataset auditing and de-duplication checks
Required Qualifications
- Experience in remote operations, QA, moderation, data annotation, or structured review workflows
- Strong written communication and policy-based decision making
- Comfort switching between task types (classification, ranking, extraction, evaluation)
- Reliable internet access and ability to meet full-time availability expectations
Preferred Qualifications
- Exposure to RLHF, prompt evaluation, or LLM evaluation
- Experience with annotation tools, taxonomy design, or NER workflows
- Understanding of common NLP/CV tasks and trust & safety policy enforcement
How Work Is Evaluated
- Annotation guidelines compliance and training data quality
- Consistency in RLHF scoring and evaluation rationales
- Turnaround time, reliability, and escalation quality
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Rex.zone was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.