About This Role
This remote engineering role focuses on evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write unit tests for the model, and explain fixes to help the modeling team address gaps. It is a contract position for experienced engineers to grade outputs as a code reviewer would, ensuring generated code compiles, passes tests, and handles edge cases.
Responsibilities
- Run and reproduce candidate code outputs in a sandboxed environment for Game Developer assignments
- Grade game development solutions for correctness, complexity, idiomatic style, and edge-case handling
- Write minimal failing tests that demonstrate a bug a model output missed
- Compare paired solutions and rank them with a written rationale tied to the rubric
- Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores
- Document recurring code-generation failures so the modeling team can target them
- Calibrate against gold-standard reviews to keep inter-rater agreement above target
Requirements
- Strong day-job engineering experience – able to read, run, and debug unfamiliar code for Game Developer work
- Comfort writing concise unit tests that capture a single failure mode
- Familiarity with at least one of: pytest, Jest, JUnit, Go test, RSpec, or equivalent
- Clear written reasoning – review notes must convince another senior engineer
- Reliable async availability for at least 10 hours per week
- Applicants must be authorized to work from US
Nice to have:
- Prior code-review or technical-interview-grading experience
- Open-source contributions or a public portfolio that demonstrates production-quality code
- Experience with the target language's standard tooling, linters, and idiomatic style guides
- Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns
Important Details
- Work model: Remote, Independent specialist contractor
Application Process
- Apply through AuraOne's specialist intake for role-specific routing and review
- Final project scope, schedule, and contractor terms are confirmed before placement
About the Company
AuraOne pairs experienced engineers with its modeling team to grade AI outputs.