About This Role
This remote role involves reviewing and evaluating AI outputs within journalist specialist operations workflows. The successful candidate will grade workflow correctness, ensure policy adherence, identify operational risks, and document appropriate next steps to aid the modeling team's training.
Responsibilities
- Review AI outputs against current journalist specialist operations workflows, playbooks, and firm policy for Journalist assignments
- Grade tone, escalation logic, and stakeholder fit on a structured rubric
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags
- Capture the right next step so the modeling team can train on it
- Adjudicate disputed treatments against published playbooks or firm guidance
- Maintain reviewer-quality scores in inter-rater calibration cycles
Requirements
- Direct working experience in journalist specialist operations on real teams for Journalist work
- Comfort applying multi-page rubrics consistently across long batches
- Clear written reasoning that names the policy or workflow being applied
- Strong attention to detail and the ability to flag when a prompt itself is the problem
- Reliable async availability for at least 10 hours per week
- Applicants must be authorized to work from US
Nice to have:
- Prior experience training, calibrating, or QA-ing operations teams
- Familiarity with AI-assisted workflow tooling and its failure modes
- Bilingual experience for cross-region operations
Benefits
- Independent specialist contractor
Important Details
- Work model: Remote; US-eligible
- Employment type: CONTRACTOR
Application Process
- Apply through AuraOne's specialist intake for role-specific routing and review
- Final project scope, schedule, and contractor terms are confirmed before placement