Foundations in Applied Measurement in Education

FAME 2 Classical Test Theory and Item Response Theory

Provides a broad overview of technical aspects of constructing measures, starting with a brief overview of Classical Test Theory and Item Response Theory, highlighting key differences between them. Participants will learn to evaluate how different data and metrics can contribute evidence about the validity and reliability of measures, with an initial focus on the quality assurance of assessment tasks and test questions. The course ends with practical exercises where participants will interpret a range of psychometric analysis outputs giving due consideration to measurement error.

FAME 3 Item and test analysis using ACER ConQuest®

Involves conducting and interpreting a psychometric analysis of a multiple-choice assessment using ACER ConQuest® software to inform refinements to an existing measure. It analyses assessment items where partial credit scoring applies. Participants apply both the Rasch model and the one parameter logistic (IRT) model. Participants will work with models for dichotomous and for polytomous data.

FAME 4 Differential Item Functioning (DIF)

Explores important validity and comparability questions through an Item Response Theory paradigm by introducing participants to Differential Item Functioning (DIF) and requiring them to undertake a DIF analysis using ACER ConQuest®.

FAME 5 Test equating

Explores test equating methods using the one parameter logistic (IRT) model. Participants will learn to equate 2 assessments on a common measurement scale through common item equating.

FAME 6 Automated psychometric analysis reports with conquestr

Introduces participants to the conquestr package that interfaces with ACER ConQuest® software. Participants will use R and RStudio with conquestr output to produce an automated and reproducible psychometric analysis and reporting workflow for quality assuring multiple-choice assessments.