Psychometrician

Job Description

At Instructure, we believe in the power of people to grow and succeed throughout their lives. Our goal is to amplify that power by creating intuitive products that simplify learning and personal development, facilitate meaningful relationships, and inspire people to go further in their educations and careers. We do this by giving smart, creative, passionate people opportunities to create awesome. We are seeking a highly skilled, motivated, and passionate Psychometrician to join our innovative assessment team. The successful candidate will play a crucial role in the development, analysis, and validation of educational assessments ranging from formative to predictive in nature. As a Psychometrician, you will ensure our assessments are high-quality, fair, reliable, and valid, contributing to the advancement of educational measurement and research.

What you will be doing

• Data Analysis and Validation:
• Conduct statistical analyses to evaluate the reliability, validity, and fairness of assessments (maintain item pValues, field testing items, etc.)
• Perform item analysis, differential item functioning (DIF) analysis, and other psychometric evaluations.
• Evaluate criterion, proficiency predictive validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance and proficiency levels on high-stakes assessments.
• Evaluate consequential validity evidence to provide insights to internal and external stakeholders.
• Evaluate p validity evidence and provide actionable insights for internal stakeholders to ensure student performance on assessments predicts performance on high-stakes assessments.
• Analyze test data to generate reports and provide actionable insights for internal and external stakeholders.
• Research and Methodology:
• Conduct validity studies in partnership with the Research team for specific districts/institutions and markets.
• Stay current on advancements in psychometric methods and educational measurement as well as state assessment requirements, suggesting new and revised assessment methodologies.
• Partner with Research and Products to contribute to scholarly publications and/or conference proposals.
• Partner with product managers and team to inform assessment strategy
• Technical Documentation:
• Prepare technical reports and documentation detailing psychometric analyses, methodologies, and findings.
• Ensure clear communication of complex statistical concepts to non-technical audiences.
• Quality Assurance:
• Participate in quality assurance processes to ensure the accuracy and integrity of assessment data and results.
• Collaborate with software developers to implement and refine automated scoring and analysis systems.
• Training and Support:
• Provide training and support to internal teams and external partners on psychometric principles and best practices.
• Assist in the development of training materials and resources.

What you will need to know/have

• A doctoral degree (Ph.D. or Ed.D.) in Psychometrics, Educational Measurement, Quantitative Psychology, or a related field.
• At least 3 years of experience in psychometrics, educational measurement, or a related field, preferably within an educational assessment company or academic setting.
• Experience with item response theory (IRT), classical test theory (CTT), and other psychometric models.
• Proficiency in statistical software and programming languages (e.g., Python, R, Stata).
• Strong analytical, problem-solving, critical thinking, time management and organizational skills.
• Excellent written and verbal communication skills.
• Ability to work collaboratively in a team-oriented environment.
• Ability to translate complex technical and psychometrics research and statistical information into team-facing and user-facing results, actionable plans, and recommendations.
• A passion for education and a drive to improve assessment materials and experiences for educators and learners

Get in on all the awesome at Instructure!

• Competitive salary, equity and 401k.
• Medical, dental, disability, and life insurance.
• HSA program, vision, voluntary life, and AD&D.
• Tuition reimbursement.
• Paid time off, 11 paid holidays, and flexible work schedules.
• LifeStyle Spending Account

$100,000 - $140,000 a year We’ve always believed in hiring the most awesome people and treating them right. We know that the more diverse we are, the more diverse our ideas will be and when we openly welcome those ideas, our environment is better and our business is stronger. At Instructure we participate in E-Verify and yes, in case you didn't catch it from the above, we are an Equal Opportunity Employer. All Instructure employees are required to successfully pass a background check upon being hired. Apply for this job