About the role
Position: LLM - AI Quality Analyst (Personalization) - Chinese
Type: Short-Term Contractor Assignment (4 months)
Compensation: $15 - $20 per hour
Location: Remote
Commitment: Up to 40 hours per week with 4 hours overlap with PST
Role Responsibilities
- Design and execute creative multi-turn conversational prompts based on personal context and experiences.
- Evaluate AI responses for personalization quality, relevance, helpfulness, and alignment with the user's intent.
- Analyze responses for Grounding, identifying unsupported claims, incorrect personalization, flawed inferences, and hallucinations.
- Assess Integration quality to ensure personal information is incorporated naturally without unnecessary overnarration.
Requirements
- 1+ year of relevant experience in data annotation, AI quality evaluation, content moderation, or a related analytical role.
- Chinese proficiency, with the ability to read and write Chinese at a high level, as Chinese is the focus language for the project.
- Exceptional analytical thinking and ability to evaluate nuanced and ambiguous AI responses.
- Experience or demonstrated ability in creative prompt engineering and multi-turn conversational testing.
- Strong understanding of personalization concepts, including identifying incorrect personalization, poor inferences, and forced connections.
Application Process
- Apply via Easy Apply
- Check email for next steps
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Crossing Hurdles was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.