About the role
AI Prompt Engineer Jobs in India (Remote, Full-Time) — Rex.zone Design, test, and optimize prompts and evaluation workflows that improve LLM performance in real production pipelines. You will collaborate with engineers and researchers to build prompt libraries, run A/B tests, define rubrics, and improve reliability, groundedness, and safety across assistants, copilots, agents, and RAG systems.
Key Responsibilities
- Own prompt lifecycle management: writing, debugging, versioning, and prompt library maintenance
- Design prompt evaluation plans using rubrics for accuracy, completeness, instruction following, tone, and policy compliance
- Create RLHF-style preference/ranking data with clear rationales to support instruction tuning workflows
- Translate product requirements into system prompts, developer prompts, and user prompt patterns
- Improve grounding and reduce hallucinations using RAG strategies and citation/traceability constraints
- Create annotation guidelines and support QA evaluation (edge cases, escalation paths, consistency checks)
- Monitor quality metrics (pass rate, inter-annotator agreement, regression failures) across releases
- Support safety alignment: red-teaming prompts, jailbreak resistance, and sensitive data leakage prevention
Required Qualifications
- 3+ years in software engineering, ML/NLP workflows, or applied LLM prompt engineering
- Strong structured writing for precise instructions and multi-step constraints
- Experience with LLM evaluation: rubrics, pairwise ranking, golden sets, adversarial testing
- Familiarity with RLHF concepts and human feedback loops
- Working knowledge of Python and experimentation tooling (notebooks, scripts, JSON, APIs)
Preferred Qualifications
- Experience with RAG pipelines, vector search, embeddings evaluation, and grounded answer validation
- Knowledge of content safety labeling, policy taxonomy, and prompt-based guardrails
- Experience with LLM observability/eval tooling (regression suites, eval harnesses)
Compensation Competitive hourly rate: $30–$50/hr FAQs
- What does an AI prompt engineer do? They design and optimize prompts, build templates/system instructions, run evaluations and A/B tests, and create feedback data to improve reliability and safety.
- Is this role remote? Yes, this posting is marked Remote and designed for distributed collaboration while targeting candidates based in India.
Millions of jobs, with real people getting hired every day
Questions, answered
Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.
Yes. This role at Rex.zone was screened before publishing – we confirmed the employer before listing it.
The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.
This position can be done from anywhere, with no in-office requirement.
Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.