This senior-level role combines expertise in psychometrics, educational measurement, quantitative methods, and applied data science with strategic leadership. The Psychometrician and Data Manager will lead the design, validation, analysis, and strategic use of data across educational implementation initiatives, overseeing the organization's measurement framework and data systems to ensure scientific rigor, validity, reliability, equity, accessibility, and usability.
Responsibilities
Lead the design, validation, analysis, and strategic use of data across educational implementation initiatives
Oversee the organization's measurement framework and data systems
Serve as the scientific and technical lead for the Multitudes Project across research, education, and product initiatives
Translate complex statistical findings into actionable insights
Collaborate across multidisciplinary teams
Contribute to assessment development
Oversee data infrastructure
Mentor analysts
Ensure data quality, governance, and regulatory compliance across multiple institutional partners
Lead the organizational data architecture and analytics strategy
Build scalable systems for data collection, management, quality control, visualization, and reporting
Oversee complex statistical analyses and interpretation of longitudinal and intervention data
Develop dashboards, technical reports, white papers, and presentations for internal and external stakeholders
Translate data into actionable recommendations for program improvement, policy, and research dissemination
Collaborate with interdisciplinary teams, including neuroscientists, literacy researchers, educators, clinicians, and software developers
Contribute to grant writing, research publications, conference presentations, and external partnerships
Support the development of innovative measures that integrate educational, cognitive, and behavioral data
Help establish Multitudes as a national leader in evidence-based measurement and evaluation
Build and mentor a high-performing analytics and research team
Establish best practices for data governance, reproducibility, documentation, and ethical data use
Supervise external research and evaluation partners as needed
Provide psychometric and measurement leadership for the development, validation, refinement, and scaling of Multitudes assessments and related measurement systems
Support the research team in designing and overseeing studies of reliability, validity, measurement invariance, item functioning, growth, and sensitivity to intervention effects
Apply appropriate modern psychometric and statistical approaches, including Item Response Theory (IRT), Classical Test Theory, multilevel and structural equation modeling, latent growth modeling, and Bayesian methods
Millions of jobs, with real people getting hired every day
200,000+
New jobs added daily
7,000,000+
Verified job listings
1,000,000+
Tailored applications submitted
Help ensure that assessments and measurement approaches are culturally responsive, equitable, and appropriate for multilingual and diverse student populations
Lead data strategy, analytics, and research collaboration
Develop scalable approaches to data collection, management, quality assurance, analysis, visualization, and reporting
Oversee analyses of large-scale longitudinal and intervention datasets
Translate findings into actionable recommendations for assessment refinement, program improvement, policy, and research dissemination
Support the development of innovative measures integrating educational, cognitive, behavioral, and other relevant data
Strengthen research and analytics infrastructure and organizational capacity by establishing best practices for data governance, reproducibility, documentation, ethical data use, fairness, and bias evaluation
Requirements
Bachelor's degree in a related area and five or more years of relevant experience, including three or more years of supervisory experience and/or equivalent experience/training
5+ years of advanced experience in psychometrics and quantitative research
Experience managing large and complex datasets
Strong communication skills with the ability to explain technical findings to non-technical audiences
Familiarity with highly complex logical data design and data mapping or data conversion
Experience building and leading multidisciplinary research and analytics teams
Demonstrated ability to work with others from diverse backgrounds
Demonstrated effective communication and interpersonal skills
Demonstrated service orientation skills
Demonstrated ability to communicate technical information to technical and non-technical personnel at various levels in the organization
Self-motivated and works independently and as part of a team
Strong organizational skills
Demonstrated advanced problem-solving skills
Able to learn effectively and meet deadlines
Advanced analytical and design skills, including the ability to abstract information requirements from real-world processes to understand information flows in computer systems
Ability to represent relevant information in abstract models
Critical thinking skills and attention to detail
Demonstrated skill in managing technical staff
Requires critical thinking, persuasion/negotiation, mentoring, leadership/management, problem solving, human resources policies and procedures relating to management responsibilities, verbal and written communication, quantitative abilities, analytical, strong technical database systems skills
Demonstrated expertise in assessment development, IRT and advanced statistical modeling, longitudinal data analysis, validation studies, and educational or behavioral measurement
Strong programming and analytic skills in R, Python, SAS, or SPSS
Nice to have:
PhD in Psychometrics, Quantitative Psychology, Educational Measurement, Statistics, Biostatistics, or related field
Experience in data integration and the specification of data services
Experience in literacy, language development, bilingual education, neuroscience
Experience working with schools, universities, nonprofit organizations, or public-sector initiatives
Familiarity with AI-enabled educational technologies, digital assessment platforms, and predictive analytics
About the Company
Multitudes is a State of California-funded initiative that bridges neuroscience and education to identify reading difficulties, including dyslexia, in early childhood and support timely intervention. It has developed English and Spanish screening instruments and is expanding into mathematics, additional languages, and other domains related to brain health. Multitudes is part of the UCSF Dyslexia Center within the Edward and Pearl Fein Memory and Aging Center, which brings together neuroscientists, clinicians, geneticists, and educators to improve diagnosis, intervention, and lifelong outcomes for individuals with learning differences. The Department of Neurology, where the center is housed, is one of the nation's leading academic neurology departments, with over $120 million in annual operations and the highest NIH funding among U.S. neurology departments; its mission is to deliver exceptional clinical care, conduct transformative research, and educate future leaders in neurology and neuroscience.
``
