Psychometrician, Measurement & Testing

About This Role

This psychometrician role supports the operational activities of the Measurement & Testing team, applying Item Response Theory principles and methodologies to examination projects. The position involves supporting psychometric operations and research, including test design, adaptive testing, and standard setting, and requires intermediate programming skills in R, Python, or SQL.

Responsibilities

• Support psychometric operational tasks, including IRT calibration, differential item functioning analyses, standard setting, panel reviews, data analyses, and test security under the guidance of senior psychometric staff and management
• Assist in streamlining psychometrics workflow to meet both internal and external deadlines
• Support research projects concerning the performance of NCSBN examinations and possible improvements
• Assist in developing psychometric software (e.g., scoring, standard setting, automated test assembly, machine learning techniques, and test security measures) to support ongoing operational efforts and new research initiatives
• Write, interpret, and maintain code base in Python and R for daily psychometric operations
• Facilitate data visualization and reporting solutions using Databricks, Power BI, Shiny, Dash, or other similar technologies
• Work collaboratively with colleagues and cross-functional teams to deliver high-quality results on time
• Support effective teamwork
• Perform other duties as assigned

Requirements

• PhD in educational measurement and testing, psychometrics, or a related field
• At least 1 year of relevant experience (dissertation research and internship experience could be acceptable) required for level 1 position
• Additional years of experience (at least 3 years) required for an advanced-level position
• Able to take directions from senior staff to achieve program goals and operational tasks
• Excellent organizational skills and able to handle multiple projects simultaneously
• Experience with managing large datasets
• Strong attention to detail and commitment to data integrity
• Proficiency with SQL/R/Python
• Strong analytical, problem-solving, and decision-making skills

Nice to have:

• Familiarity with IRT models and computer adaptive testing
• Excellent written and oral business communications skills, and experience with academic writing

Benefits

• Competitive benefits package with plan options to meet individual needs

Important Details

• Schedule: Hybrid (2 days per week on-site, 3 days per week remote)
• Travel: Less than 10% of total time, including attendance at conferences and client meetings