ACE-Expert study guide
ACE-Expert · Work through your exam, one topic at a time.
ACE-Expert is an advanced professional credential for people who build, maintain, and defend certification and licensure exam programs. Where an entry-level testing credential focuses on item writing or exam administration, this one targets the judgment calls that sit above that work: how a program is governed, how items are developed and reviewed, how response data are analyzed, how a cut score is set and defended, how security and fairness are protected, and how the whole program is evaluated and improved. The ACE-Expert study guide has 6 sections and about 1,460 words.
01Exam Development and Governance
Certification exam development begins with a defensible job/task analysis (JTA) that defines the knowledge, skills, and abilities (KSAs) required for competent practice. The JTA results drive the test blueprint (content outline), which specifies the number of items per domain and cognitive level.
277 words, about 1 min02Item and Question Development
High-quality items are clear, concise, and measure a single cognitive objective. The stem should present a complete problem, and options (distractors) must be plausible and homogeneous in length and grammar.
257 words, about 1 min03Psychometric Analysis and Scoring
Psychometrics ensures exam scores are reliable and valid. Key concepts include reliability (consistency, e.g., Cronbach’s alpha, KR-20), validity (evidence supporting score interpretation), and item statistics : difficulty (p-value) and discrimination (point-biserial or D-index) .
251 words, about 1 min04Standard Setting and Cut Score Validation
The cut score (passing standard) separates competent from non-competent candidates. Standard-setting methods are test-centered (e.g., Angoff, modified Angoff, Yes/No) or examinee-centered (e.g., contrasting groups, borderline group).
246 words, about 1 min05Test Security and Fairness
Test security protects the integrity of exam content and scores. Threats include item exposure , cheating , test compromise , and unauthorized access .
227 words, about 1 min06Program Evaluation and Quality Improvement
Certification programs must continuously evaluate effectiveness and improve. Program evaluation uses frameworks like Kirkpatrick’s four levels (reaction, learning, behavior, results) or CIPP (context, input, process, product).
202 words, about 1 min