About This Role
This specialist advisory role within the Exams team offers an exciting opportunity to shape the future of assessment at the RCR. Working with exam managers, chairs, examiners, and senior stakeholders, you will provide expertise to ensure assessments remain valid, reliable, and fair, meeting regulatory expectations. You will bridge assessment data and decision-making, using insights from exam performance data to strengthen assessment practices.
Responsibilities
- Analyse exam and candidate performance data to identify trends, emerging risks, and opportunities for improvement
- Lead longitudinal analysis across the exam portfolio, looking at item, paper, and candidate performance over time
- Provide expert psychometric advice to support the review, development, and improvement of RCR examinations
- Review assessment and standard-setting methodologies, recommending improvements that strengthen validity, reliability, and fairness
- Turn complex psychometric analysis into clear, practical insights and recommendations for examiners, Boards, and senior stakeholders
- Support examiner training, helping colleagues develop their understanding and confidence in psychometric principles and assessment decision-making
- Provide psychometric expertise to support regulatory submissions, reviews, and assurance activity
- Strengthen the approach to assessment data, reporting, and governance, ensuring information provided to internal Boards and regulators is robust and auditable
- Keep abreast of developments in psychometric practice and identify opportunities to introduce new methodologies and approaches
Requirements
- A Master’s degree or PhD in Psychometrics, Statistics, Psychology, or a related quantitative field
- Strong experience of data analysis and reporting, including working with large datasets and statistical analysis packages
- Strong knowledge of psychometric principles and the confidence to apply them to practical assessment challenges
- The ability to interpret complex data, identify meaningful trends, and turn your findings into clear, evidence-based recommendations
- Excellent communication skills, with the ability to explain complex statistical concepts clearly to both technical and non-technical audiences
- A collaborative approach and the confidence to advise, influence, and constructively challenge stakeholders
- A commitment to equality and diversity, continued professional development, and maintaining a high level of specialist knowledge
Benefits
- Make a difference to the lives of Doctors and medical specialties
- Modern working environment with home-working equipment provided
- Generous annual leave, plus the option to buy up to 5 extra days
