About This Role
As a JavaScript Engineer, you will contribute to building LLM evaluation and training datasets aimed at addressing realistic software engineering challenges. This role is ideal for experienced software engineers who are familiar with high-quality public GitHub repositories and are eager to engage in hands-on software engineering work.
Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluate unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
- Lead a team of junior engineers to collaborate on projects.
Requirements
- Minimum 3+ years of overall experience.
- Strong experience in JavaScript / TypeScript.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Nice to have:
- Previous participation in LLM research or evaluation projects.
- Experience building or testing developer tools or automation agents.
Benefits
- Work in a fully remote environment.
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
Important Details
- Commitments Required: At least 4 hours per day and a minimum of 20 hours per week with an overlap of 4 hours with PST.
- Employment type: Contractor assignment (no medical/paid leave).
Application Process
- After applying, you will receive an email with a login link. Please use that link to access the portal and complete your profile.
