Psychometrician I

About the Team  

The SAT Psychometrics, Analytics and Research (SPAR) team, as part of the larger Psychometrics team, supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. SPAR primarily partners with the College Readiness Assessment’s SAT Suite of Assessments with operational excellence and best-in-class measurement solutions. Our work ensures that students and other stakeholders can make informed decisions about college and career pathways. 

About the Opportunity   

As Psychometrician I you will play a pivotal role in shaping the future of millions of students by enhancing the SAT Suite of Assessments. Your work will directly impact the quality and accuracy of these assessments, ensuring they provide reliable and valid measures of student performance, aiding the ability of students to make informed decisions about their college and career pathways. By developing and leveraging advanced psychometric analyses, you will provide critical insights that help maintain the integrity and effectiveness of the assessments. Additionally, your psychometric operational and research work will contribute to the continuous improvement of assessment tools, ensuring they remain relevant and effective in guiding students towards successful futures. 

In this role, you will:  

Operational Psychometrics (60%) 

• Design and execute routine operational psychometric analyses for College Board assessments as assigned, including but not limited to item calibration and pretest analyses, DIF, and standard-setting, using standard and customized psychometric analysis tools and statistical software packages  

• Lead the development and improvement of operational processes 

• Apply evolving technologies, such as GenAI and other machine learning approaches, to enhance operational processes and address measurement challenges 

• Independently conduct quality assurance and quality control procedures and identify opportunities for improvement of quality and efficiency of workflow 

• Independently develop analysis code, documentation, and implementation of statistical and reporting systems  

• Be responsible for the design, quality, and execution of technical reports for internal and external clients  

Psychometric Research (30%) 

• Independently conduct research consistent with the research agenda for the program and Psychometrics  

• Conduct research that advances the team’s ability to leverage and apply advancing technologies, for example GenAI, to our operational and research processes 

• Create and deliver presentations of research to internal and external audiences  

• Have papers accepted to major measurement conferences (such as NCME) where you are the first author and primary presenter at the conference  

• Be a named author in a professional publication in a peer-reviewed journal  

Collaboration and Communication (10%) 

• Represent the quality and credibility of SAT Suite assessments to internal and external stakeholders (e.g., state partners, technical advisory committees) 

• Collaborate with other College Board divisions by providing technical consulting for external research on product development and enhancements 

About You  

You have:  

• A Doctorate in Psychometrics, educational measurement or a related field  

• At least three years of post-PhD experience in the field of psychometrics 

• Experience in an operational setting with item adaptive testing, response theory, classical test theory, equating, item and test analyses, DIF, standard setting, and other psychometric analyses is required 

• Operational experience with multiple statistical analysis tools (e.g., SAS, R, Python, flexMIRT, and GENOVA) 

• Demonstrated ability to design and conduct psychometric analyses, research studies, and complex statistical analyses 

• Demonstrated ability to leverage advanced technologies, such as GenAI or machine learning models, to improve operational efficiency 

• Ability to quickly and accurately work with new datasets and assessment data.  

• Ability to work in a collaborative environment that emphasizes quality, rigor, adaptability, and critical thinking  

• Excellent organizational, time management, and detail orientation skills  

• Excellent oral and written communication skills, including technical presentation, public speaking, interpersonal, and writing and editing skills  

• Strong problem-solving skills 

• The ability to travel 2-4 times a year to College Board offices or on behalf of College Board business 

• Authorization to work in the United States 

• If the role requires any physical requirements: lifting boxes, packing items, standing for long periods of time, etc, please make sure it is noted here. 

About Our Process   

• Application review will begin immediately and will continue until the position is filled   

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live presentation, a panel interview, a conversation with leadership and reference checks.    

Our approach to Compensation 

College Board offers a competitive benefits and compensation program that attracts top talent looking to make a difference in education. As a self-sustaining non-profit, we believe in compensating employees fairly in relation to each other, their qualifications, their impact, and the relevant market.  

The hiring range for a new employee in this position is $96,000 to $145,000. College Board differentiates salaries by location so where you live will narrow the portion of this range in which you can expect a salary.  

Your salary will be carefully determined based on your location, relevant experience, the external labor market, and the pay of College Board employees in similar roles. College Board strives to provide our best offer up front based on this criteria.  

You can expect to have transparent conversations about benefits and compensation with our recruiters throughout your application process. 

What makes College Board an Employer of Choice 

College Board is motivated and positioned to positively impact the educational and career trajectories of millions of students a year, our culture is pivotal to our ability to fulfill this mission.  

Our culture is grounded in our Operating Principles and Manager Expectations that create the conditions for employees to do their best work while living their best lives. Our Operating Principles guide how we interact with each other, translating what we value and believe into concrete actions that allow us to pursue our mission and purpose. Candidates should expect to hear more about our Operating Principles throughout the interview process. (Link to career’s page when added)  

• Prioritize and Simplify  

• Say and Receive  

• Go for Greatness  

• Lead as One College Board  

In addition to modeling the Operating Principles, managers at College Board are also responsible for ensuring their team can live out the Operating Principles and delivering on four Manager Expectations. Candidates applying for management roles will hear more about these expectations throughout the interview process:  

• Ensure Strategic Alignment  

• Hire Top Talent  

• Optimize Performance  

• Unlock Potential   

In addition to offering a strong culture, College Board offers its employees fantastic benefits including:   

• A comprehensive package that supports the well-being of employees and their families and promotes education. Our robust benefits package includes health, dental, and vision insurance, generous paid time off, paid parental leave, fertility benefits, pet insurance, tuition assistance, retirement benefits, and more 

• Recognition of exceptional performance through annual bonuses, opportunities for merit and market raises, and opportunities for promotion based on increased scope of responsibility and outcomes 

• Annual matching contributions (up to 10% of your annual salary) towards TIAA retirement plans  

• A job that matters, a team that cares, and a place to learn, innovate and thrive 

• The ability to work in a remote or hybrid environment. Most roles, unless designated, have the option to be remote or hybrid if they live close to College Board offices. Hybrid employees go into offices every Tuesday and Wednesday 

• Learning and growth opportunities: we offer formal and informal ways to lead through your superpowers, sharpen your strengths, and meet your development goals 

• Impact beyond our walls: We know that our impact is strongest together. Our College Board Cares program offers all staff up to $1,000 annual match against partner non-profit organizations