Jobs

A faster, smarter way to find better-fit jobs, stay on top of every application, and focus on interviews.

Legal
  • Privacy Policy
  • Terms & Conditions
  • Refund Policy
Resources
  • About Us
  • Help Center
  • How to Cancel
  • Customer Support
JobAssist
Copyright © 2025-2026 JobAssist™. All rights reserved. All trademarks referenced herein are the properties of their respective owners.
Psychometrician at Royal College of Physicians and Surgeons of Canada
FAQ

Questions, answered.

Click "Apply with JobAssist" – we tailor your resume and application to this role and submit it for your approval.

Yes. This role at Royal College of Physicians and Surgeons of Canada was screened before publishing – we confirmed the employer before listing it.

The employer didn't disclose a salary range for this listing. JobAssist shows pay whenever it's available.

This position can be done from anywhere, with no in-office requirement.

Yes – every application is tailored from your profile and this job's requirements, and you can review and edit before it's sent.

Home›Jobs›Science & R&D›Psychometrician
Royal College of Physicians and Surgeons of Canada logo

Psychometrician

Royal College of Physicians and Surgeons of Canada

RemoteFull timeMid level$104,000-$156,000Posted today
Apply with JobAssist

About the role

Exams Quality Assurance (EQA)

Permanent

Today, the Royal College has over 55,000 members and the vision remains to advance the learning for specialist physicians to deliver the best health care for all. The Royal College partners and collaborates to lead the evolution of specialty medical education and standards; support specialist physicians, learners and teams to continuously improve; and advocate for excellence in specialty medicine by supporting innovation, well-being, equity and person-centered care. We are a national, nonprofit organization established in 1929 by a special Act of Parliament to oversee the medical education of specialists in Canada.

Role Overview

Reporting to the Manager, Exam Quality and Analytics, the Psychometrician supports the assessments of specialty physicians by providing advice that guides and informs the direction of exam development, exam quality improvement, and assessment practices to ensure fair and valid assessments.

The psychometrician is responsible for applying expert knowledge of testing, educational and psychological measurement, and assessments to support the mission of the Royal College of assessing specialty physicians. They contribute to the strategic direction of exam development, exam quality improvement, and assessment methodologies/practices. The psychometrician provides expertise regarding the technical measurement aspects of assessments. They apply expert knowledge as a psychometrics professional with an in-depth understanding of statistical and/or other analysis techniques designed to support psychometric and other research projects of broad scope and complexity.

Typical Day-to-Day Responsibilities

  • Contributes to the conceptualization and development of Royal College exam preparation resources (EPR) and exams based on an understanding of each medical specialty by providing expertise in psychometric measurement principles and quantitative analysis to ensure the utility, validity, and reliability of Royal College exams.
  • Provides expert advice and sets the direction of EPR and exam development, exam quality, and assessment practices (e.g., standard setting, rater calibration) by leading the development of position papers, best practices, policies, procedures, and examination/assessment tools based on identified needs to ensure that the exams continue to adhere to acceptable professional standards for certification assessment.
  • Leads quantitative research activities by overseeing the collection, analyzing, and reporting of data, collaborating with project teams, and writing reports to ensure the continued quality, reliability, and validity of Royal College exams.
  • Leads the production of and/or produces psychometric reports that present examination result information by overseeing the collecting, transforming, and formatting of examination data to inform stakeholders (candidates, boards, committees, Royal College leadership, legal) of exam results and performance.

Job details

Workplace

Remote

Employment

Full time

Seniority

Mid level

Headquarters

Ottawa, Ontario

Salary

$104,000-$156,000

Posted

Posted today

About company

Headquarters

Ottawa, Ontario

Open jobs

1

Millions of jobs, with real people getting hired every day

200,000+
New jobs added daily
7,000,000+
Verified job listings
1,000,000+
Tailored applications submitted
  • Provides oversight and expertise on the development of EPR & exam quality improvements and assessment practices by collaborating and maintaining liaison with fellows, medical educators, and organizations involved in medical education/assessment to improve examination and assessment approaches and methods.
  • Counsels stakeholders (boards, committees, Royal College leadership and staff, legal) on how to address the evolving needs of the exams by researching and suggesting new and innovative psychometric techniques to influence exam boards/committees in determining the most appropriate and optimal methodologies to be used for their examinations.
  • Leads research initiatives and academic publication within the milieu of examinations and/or assessment practices by producing works grounded in relevant theories and applies applicable methodological approaches to publish and disseminate research.
  • Collaborates and maintains liaison with fellows, medical educators, and sister and international organizations involved in medical education to organize and advance effective assessment approaches and methods by attending and/or presenting at conferences, collaborating on research projects, and publishing research.

    • Qualifications

    • Level of education, training, and experience equivalent to a Ph.D. with expertise in evaluation in education, 3 years of demonstrated experience in assessment.
    • Operational testing experience in high stakes assessment and computer-based testing.
    • Advanced understanding of, and the ability to use, statistical analysis software and databases.
    • Demonstrated experience in developing and implementing assessment initiatives.
    • Demonstrated ability in developing evaluation tools, policies, and initiatives.
    • Writing, communication and interpersonal skills for concise and clear expression and the ability to lead interactive educational activities.
    • Efficiency and skill in assimilating, organizing and outlining information and statistical material and in the use of computer technology.
    • Organizational and time-management skills to deal with concurrent activities, the management of multiple priorities and the meeting of deadlines.
    • Superior analytical skills, accuracy, and careful attention to detail in handling quantitative material.
    • Capacity for independent action and problem-solving.
    • Travel: Occasional 2-5 times per year.

    Application Process

    Please apply through our UKG recruitment platform with your résumé, covering letter and salary expectations by August 3, 2026.

    The Royal College invites applications from all qualified applicants. The Royal College is strongly committed to employment equity and diversity in the workplace and encourages applications from Black, racialized/visible minorities, Indigenous/Aboriginal people, women, persons with disabilities, and 2SLGBTQIA+ persons.

    We sincerely thank all applicants for their interest; however, we will only contact those under consideration. An eligibility list may be established for similar positions of various tenures. The list will be retained for a maximum period of 18 months.

    The Royal College supports a hybrid work environment which includes a combination of working both onsite in Ottawa and from home.

    The Royal College will provide support in its recruitment processes to applicants with disabilities, including accommodation that considers an applicant’s accessibility needs. If you require accommodations during the interview process, please contact careers@royalcollege.ca.

    Please note that the job advertisement will no longer be available once the position has closed.

    Royal College of Physicians and Surgeons of Canada logoRoyal College of Physicians and Surgeons of Canada