About the role
Remote STEM Jobs in Canada (Full Time) Rex.zone connects mid-senior engineers and STEM professionals to real-world AI/ML training workflows, including LLM evaluation, RLHF-style preference ranking, data labeling, QA evaluation, and prompt evaluation. You will help improve model performance by producing and reviewing high-quality training data and enforcing annotation guidelines compliance.
What You Will Do
- Contribute to training data quality through labeling, review, and adjudication
- Perform RLHF-style preference ranking and helpfulness/harmlessness evaluations
- Execute prompt evaluation and response grading for large language model evaluation
- Apply annotation guidelines, document edge cases, and support rubric adherence
- Run QA evaluation workflows, track defects, and recommend process improvements
- Support NLP tasks (e.g., named entity recognition, taxonomy tagging)
- Support computer vision annotation (e.g., bounding boxes, polygons, classification)
- Support content safety labeling (policy categories, risk scoring, refusals)
- Collaborate with teams across AI labs, tech startups, annotation vendors, and BPO operations
Required Qualifications
- Mid-senior experience in STEM or engineering
- Strong analytical writing and attention to detail for evaluation rubrics
- Familiarity with AI/ML concepts, LLM behavior, and model failure modes
- Experience with data labeling, QA evaluation, or guideline-driven review
- Ability to work full-time remotely with reliable internet and secure work practices
Preferred Qualifications
- Exposure to RLHF, prompt evaluation, and rubric-based grading
- Experience with NLP and/or computer vision annotation
- Experience with content safety labeling and policy enforcement
- Comfort using annotation platforms, spreadsheets, and issue trackers
- Ability to mentor peers on annotation guidelines compliance and training data quality
How To Apply Apply via Rex.zone and highlight your STEM/engineering background, guideline-driven work, and examples that improved training data quality or model performance.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Rex.zone was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.