About This Role
This senior role on the Research & Psychometrics team involves providing psychometric oversight, analysis, and consultation for assessments measuring the competency of occupational therapy professionals. The Senior Psychometrician supports certification programs through operational psychometric work, including practice analysis and standard setting, and conducts applied research to improve assessments and processes. The role operates with minimal supervision, plans work independently, and contributes to complex projects as a subject matter expert.
Responsibilities
- Design and conduct practice analysis and competency modeling studies to identify and define the knowledge, skills, competencies, and other requirements for effective occupational therapy practice
- Develop and validate competency frameworks and related models that support certification and assessment programs
- Develop examination specifications and content outlines based on empirical practice analysis findings
- Establish passing standards using appropriate psychometric methods to support valid score interpretations and defensible classification decisions
- Perform advanced psychometric and statistical analyses, including Rasch calibrations, DIF analyses, equating, scaling, and other related methodologies, to support assessment quality and fairness
- Develop and implement scoring processes and algorithms and design and generate score reports that provide meaningful feedback to test-takers and other relevant parties
- Design, program, and implement AI-driven tools and solutions to support psychometric analysis, exam development, and operational efficiency across assessment programs
- Research, develop, and evaluate innovative item types and assessment methods to enhance the measurement of knowledge, skills, abilities, and competencies relevant to occupational therapy practice
- Explore emerging technologies and advances in assessment science to identify opportunities to strengthen assessment programs and measurement practices
- Conduct psychometric research to improve assessment instruments and practices and to support evidence-based decision-making
- Prepare technical documentation and reports by summarizing complex psychometric and statistical information and clearly communicate findings to technical and nontechnical audiences, orally, in writing, and through data visualization
- Manage large datasets and databases to support psychometric analyses, reporting, and research while ensuring data integrity, documentation, and reproducibility
- Provide psychometric consultation on the design, development, interpretation, and use of assessments that measure the competencies of occupational therapy professionals
- Work collaboratively with colleagues and provide education, guidance, and consultation to internal teams on measurement-related principles and practices, to support valid and fair assessments