ACE-Expert case studies
ACE-Expert · Put your knowledge to work in context.
ACE-Expert is an advanced professional credential for people who build, maintain, and defend certification and licensure exam programs. Where an entry-level testing credential focuses on item writing or exam administration, this one targets the judgment calls that sit above that work: how a program is governed, how items are developed and reviewed, how response data are analyzed, how a cut score is set and defended, how security and fairness are protected, and how the whole program is evaluated and improved. The ACE-Expert case studies are 5 cases and about 2,773 words.
1The Disappearing Distractors: Item Bank Drift After a Content Update
A certification program for industrial hygienists updated its reference standard in March. In April, the psychometric team reviewed 120 four-option items that had been flagged because their distractor selection rates changed.
541 words, about 3 min2The Angoff Panel That Disagreed With Itself
A behavioral-health licensure board convened a 12-member standard-setting panel using a modified Angoff method on a 160-item exam. Panelists rated items in three rounds.
557 words, about 3 min3Exposure Creep on a Retired Form
A nursing specialty exam reuses a 40-item equating block across forms. After a form is retired, its items remain in the live pool as unscored pretest items for two cycles.
571 words, about 3 min4When the Blueprint and the Job Analysis Disagree
A facilities-management certification conducts a job-task analysis (JTA) every five years. The 2024 JTA surveyed 640 practitioners and identified 14 domains.
588 words, about 3 min5The Item That Everyone Flags but Nobody Can Fix
A governance committee reviews item-level fairness flags monthly. One item on a professional-ethics exam has been flagged by three separate review processes: a candidate comment alleging cultural bias, a DIF analysis showing a C-level difference for one subgroup, and a content reviewer noting the scenario assumes a legal framework common in one country.
516 words, about 3 min