First 50 of 200 questions. Each one lists the choices, the correct answer, and an explanation. The checker at the top of this page saves progress in this browser when it is available.
Continue in the practice tool above to load more questions, 50 at a time.
Question 1Exam Development and Governance
Which document formally defines the scope, structure, and scoring of a certification exam and serves as the blueprint for item writers?
- The item bank style guide
- The exam blueprint or test specification Correct answer.
- The proctoring policy
- The candidate handbook
Explanation
The exam blueprint (test specification) documents the content domains, their weights, cognitive levels, and item counts that govern exam construction. Item writers and reviewers use it to ensure coverage and balance. Other documents support delivery or administration rather than exam design.
Question 2Exam Development and Governance
A certification program wants each exam form to cover the same content domains in the same proportions. Which practice best supports this?
- Selecting only the newest items for each form
- Assigning item quotas per domain based on blueprint weights Correct answer.
- Letting each candidate receive a unique fixed set of items
- Randomly sampling items from the entire bank for each form
Explanation
Blueprint-weighted quotas ensure every form reflects the same domain proportions, supporting comparable content validity across forms. Random or ad hoc selection can produce forms that vary in coverage. Quotas are a standard control in form assembly.
Question 3Exam Development and Governance
In classical test theory, which statistic describes the proportion of candidates who answer an item correctly?
- The discrimination index
- The reliability coefficient
- The item difficulty (p-value) Correct answer.
- The standard error of measurement
Explanation
The p-value, or difficulty index, is the proportion of examinees answering an item correctly. It ranges from 0 to 1 and informs whether an item is too easy or too hard. Discrimination and reliability are separate psychometric concepts.
Question 4Exam Development and Governance
What is the primary purpose of a subject matter expert (SME) panel in exam development?
- To approve marketing materials
- To administer the exam to candidates
- To manage the registration database
- To set the passing standard and validate content relevance Correct answer.
Explanation
SME panels provide content expertise for activities such as standard setting, item review, and job analysis validation. Their judgments anchor exam content and cut scores to real-world practice. Administrative and marketing functions fall outside their scope.
Question 5Exam Development and Governance
Which activity is performed during a job/task analysis (JTA) to establish the foundation of a certification exam?
- Surveying practitioners to rate task importance and frequency Correct answer.
- Reviewing item distractors for plausibility
- Calculating the cut score from pilot data
- Publishing candidate score reports
Explanation
A JTA collects ratings from practicing professionals on the importance, frequency, and criticality of tasks to define the content domain. These results drive the blueprint. Cut scores, item review, and reporting occur later in the lifecycle.
Question 6Exam Development and Governance
An item shows a discrimination index near zero. What is the most appropriate interpretation?
- The item is too easy for the population
- The item fails to distinguish stronger from weaker candidates Correct answer.
- The item has an ideal difficulty level
- The item should be assigned a higher point value
Explanation
A discrimination index near zero means high and low performers answer the item at similar rates, indicating the item does not differentiate ability. Such items are candidates for revision or removal. Difficulty is measured separately by the p-value.
Question 7Exam Development and Governance
Which standard-setting method asks panelists to estimate the probability that a minimally competent candidate would answer each item correctly?
- The contrasting-groups method
- The Hofstee method
- The Bookmark method
- The Angoff method Correct answer.
Explanation
The Angoff method has judges estimate, for each item, the likelihood a borderline candidate answers correctly; these probabilities are summed to derive a cut score. Bookmark uses an ordered item booklet, contrasting-groups uses actual performance of known groups, and Hofstee uses policy constraints.
Question 8Exam Development and Governance
A test item contains two answer choices that are essentially synonyms. What is the most likely effect on item quality?
- It makes the item suitable for a higher cognitive level
- It increases the item's discrimination
- It improves the item's p-value reliability
- It reduces the number of plausible distractors Correct answer.
Explanation
When two options mean the same thing, neither can function as a distinct distractor, effectively reducing the item to fewer plausible choices. This weakens the item's ability to discriminate and should be corrected during review.
Question 9Exam Development and Governance
Which psychometric model estimates a candidate's ability and item characteristics on a common latent scale?
- Item response theory Correct answer.
- Criterion-referenced scoring
- Generalizability theory
- Classical test theory
Explanation
Item response theory (IRT) models the probability of a correct response as a function of latent ability and item parameters on a shared scale. This supports equating and adaptive testing. Classical test theory and generalizability theory use different frameworks.
Question 10Exam Development and Governance
Why is item exposure control important in a computer-based certification exam?
- It limits overexposure of items to protect bank security and validity Correct answer.
- It ensures every candidate receives identical items
- It eliminates the need for equating
- It guarantees a fixed pass rate
Explanation
Exposure controls cap how often items are administered so that content does not become widely known, which protects security and score validity. Candidates still receive different forms, and equating remains necessary. Exposure control is not a mechanism for setting pass rates.
Question 11Exam Development and Governance
During an item review, a SME flags an item as testing content outside the current blueprint. What is the most appropriate action?
- Remove or revise the item to align with the blueprint Correct answer.
- Lower the item's point value
- Revise the blueprint to include the content
- Retain the item because it is technically accurate
Explanation
Items must align with the blueprint to preserve content validity; off-blueprint items are removed or revised. Changing the blueprint to fit an item inverts the governance process and is inappropriate. Point weighting does not fix misalignment.
Question 12Exam Development and Governance
Which of the following best describes the role of a fairness review in exam development?
- Reducing the number of items on the exam
- Ensuring that all candidates pass at equal rates
- Replacing psychometric analysis with SME judgment
- Confirming that items avoid construct-irrelevant barriers for subgroups Correct answer.
Explanation
Fairness review examines items for bias and construct-irrelevant content that could disadvantage groups for reasons unrelated to the target knowledge. It supports validity and defensibility. It does not mandate equal pass rates or replace statistical analysis.
Question 13Exam Development and Governance
An exam program conducts equating between two forms. What is the primary goal of this process?
- To place scores from different forms on a comparable scale Correct answer.
- To reduce the number of items needed
- To eliminate the need for a passing standard
- To increase the average score on the new form
Explanation
Equating adjusts scores so that results from different forms are comparable in difficulty and can be interpreted on the same scale. It does not aim to raise scores or change exam length. A passing standard is still required.
Question 14Exam Development and Governance
Which document typically records the rationale, history, and statistics for each item across its lifecycle?
- The candidate agreement
- The marketing brief
- The item metadata record Correct answer.
- The proctor log
Explanation
An item metadata record tracks authorship, review history, statistics, and revision notes so that governance decisions are auditable. Other documents serve administration or business functions and do not capture item-level history.
Question 15Exam Development and Governance
A program wants to verify that its exam remains current between full job analyses. Which governance practice is most appropriate?
- Conducting periodic subject matter expert content reviews Correct answer.
- Increasing the passing score annually
- Removing all items older than one year
- Freezing the blueprint indefinitely
Explanation
Periodic SME content reviews detect outdated or drifted content and inform targeted updates between full job analyses. Freezing the blueprint or mass-removing items risks validity loss. Adjusting cut scores is unrelated to content currency.
Question 16Exam Development and Governance
What does a reliability coefficient of 0.90 for an exam indicate?
- The exam has high content validity
- Ninety percent of candidates will pass
- Scores are highly consistent across replications Correct answer.
- Items are evenly distributed across domains
Explanation
Reliability reflects the consistency of scores; a value of 0.90 indicates strong internal consistency or stability. It says nothing about pass rates, content coverage, or validity, which are separate properties.
Question 17Exam Development and Governance
Which of the following is the best example of a governance control for exam content security?
- Allowing SMEs to share items on public forums
- Storing items in shared drives without version control
- Publishing all items after each administration
- Restricting item bank access to authorized roles with audit logs Correct answer.
Explanation
Role-based access with audit logging limits who can view or modify items and creates a traceable record, protecting bank security. Publishing items or sharing on forums destroys security. Uncontrolled storage invites leaks and version errors.
Question 18Exam Development and Governance
What is the purpose of a beta or pilot administration in exam development?
- To collect item statistics before operational use Correct answer.
- To finalize the marketing plan
- To replace standard setting
- To certify candidates officially
Explanation
Pilot administrations gather empirical data such as difficulty and discrimination so that items can be evaluated and refined before operational scoring. They are not used for official certification decisions. Standard setting and marketing are separate activities.
Question 19Exam Development and Governance
A test specification requires 30 percent of items at the application cognitive level, but a form contains only 10 percent. What is the most significant consequence?
- The form may not validly represent the intended construct Correct answer.
- The exam length must be doubled
- The reliability coefficient becomes exactly zero
- The cut score automatically increases
Explanation
Cognitive-level quotas are part of the blueprint; failing to meet them means the form underrepresents intended skills, threatening construct validity. Cut scores and length are not automatically altered, and reliability is not reduced to zero.
Question 20Exam Development and Governance
Which statement best describes the distinction between validity and reliability in certification testing?
- Validity concerns the appropriateness of score interpretations; reliability concerns score consistency Correct answer.
- Reliability must be established before validity can ever be considered
- Both terms describe the same psychometric property
- Validity is about consistency; reliability is about accuracy of interpretation
Explanation
Validity addresses whether score interpretations and uses are appropriate for the intended purpose, while reliability addresses consistency of measurement. Reliability is necessary but not sufficient for validity. The two are distinct though related concepts.
Question 21Exam Development and Governance
An item bank uses a hierarchical classification scheme aligned to the blueprint. What is the primary benefit of this structure?
- It removes the need for SME review
- It automatically sets the passing standard
- It enables precise content coverage and targeted form assembly Correct answer.
- It guarantees high item discrimination
Explanation
A hierarchical taxonomy tied to the blueprint lets form assemblers select items to meet domain and sub-domain quotas precisely. It does not ensure statistical quality, replace review, or determine cut scores.
Question 22Exam Development and Governance
A candidate challenges an exam score. Which governance response best reflects defensible practice?
- Delete the candidate's item responses
- Provide a documented review process with defined criteria and records Correct answer.
- Deny the challenge without documentation
- Immediately change the score to satisfy the candidate
Explanation
A documented, criteria-based review process with retained records supports fairness and defensibility. Ad hoc score changes or denial without documentation undermine governance. Retaining response data is essential for review.
Question 23Exam Development and Governance
Which practice best supports defensibility of SME judgments in standard setting?
- Keeping the standard-setting method confidential from all stakeholders
- Documenting training, judgments, and rationale for the chosen method Correct answer.
- Using a single expert's opinion to set the cut score
- Adjusting the cut score after seeing candidate results
Explanation
Documenting panelist training, individual judgments, and the rationale for the method creates an audit trail that supports defensibility. Relying on one person, hiding methodology, or post hoc adjustment weakens the process.
Question 24Exam Development and Governance
What is the primary function of a distractor analysis during item review?
- To set the passing standard
- To confirm that incorrect options attract some candidates and are plausible Correct answer.
- To determine the exam's cognitive-level mix
- To measure the exam's overall reliability
Explanation
Distractor analysis examines how often each incorrect option is chosen to verify plausibility and functioning. Nonfunctioning distractors may be revised. Reliability, cut scores, and cognitive mix are determined by other processes.
Question 25Exam Development and Governance
A program introduces a new exam form with a different difficulty profile than prior forms. Which governance step is most important before operational use?
- Lowering the cut score to match the new form
- Publishing the new form's items for transparency
- Equating the new form to the existing scale Correct answer.
- Increasing the number of items on the new form
Explanation
Equating places the new form on the established score scale so that results remain comparable despite difficulty differences. Adjusting cut scores or length does not address comparability. Publishing items would compromise security.
Question 26Exam Development and Governance
During a standard-setting session, panelists repeatedly discuss their individual ratings with one another before submitting final judgments. Which governance concern does this behavior most directly raise?
- The panel has exceeded the number of rounds permitted by the test blueprint
- The panel is likely to produce a cut score that is too lenient for the profession
- The judgments may be unduly influenced by dominant panel members rather than reflecting independent professional opinion Correct answer.
- The panel has inadvertently converted a modified-Angoff study into a bookmark study
Explanation
Standard-setting judgments derive their defensibility from independent, documented expert opinion; open discussion can let a vocal minority or high-status member sway others. Controlled, structured interaction is acceptable, but uncontrolled deliberation undermines the independence of the ratings. Governance therefore requires documented procedures that limit and record panel interaction.
Question 27Exam Development and Governance
A certification board wants an auditable record showing that each exam form was assembled to match the approved content outline. Which artifact most directly serves this purpose?
- A candidate score report showing the pass/fail decision
- A list of the subject matter experts who participated in the job analysis
- A form assembly report mapping each item to outline areas and cognitive levels Correct answer.
- An item-writing style guide distributed to subject matter experts
Explanation
A form assembly report documents the blueprint targets and the actual composition of each assembled form, giving auditors direct evidence of alignment. Style guides, score reports, and panel rosters support other governance purposes but do not demonstrate form-to-blueprint match. Defensible programs retain these assembly records for each form produced.
Question 28Exam Development and Governance
An exam program adopts a policy that every item must pass two independent subject matter expert reviews plus a psychometric screen before entering the live bank. Which governance objective does this policy primarily advance?
- Reducing the cost of item production per accepted item
- Shortening the interval between item writing and live administration
- Ensuring only items meeting quality and accuracy criteria reach candidates Correct answer.
- Increasing the number of items available for each form
Explanation
Mandatory multi-stage review before bank entry is a quality gate that keeps flawed or inaccurate items away from candidates. The policy trades speed and volume for confidence in item quality. Governance frameworks define such gates to make acceptance decisions consistent and reviewable.
Question 29Exam Development and Governance
A program manager proposes publishing the full text of every live exam item on the organization's public website to demonstrate transparency. Which governance response is most appropriate?
- Approve the plan because transparency always strengthens defensibility
- Approve the plan only if items are removed from the live bank afterward
- Reject the plan because candidates are not permitted to see item content under any circumstances
- Reject the plan because item exposure would compromise exam security and score validity Correct answer.
Explanation
Live item content is a protected asset; public release would allow memorization and coaching, eroding the validity of score interpretations. Transparency is normally served by publishing the blueprint, policies, and technical documentation instead. Retired or practice items can be released safely, but active items cannot.
Question 30Exam Development and Governance
A psychometrician reports that a form's observed cut score shifted after a scoring error was corrected, and the program must decide whether prior score decisions should be revisited. Which governance principle should guide this decision?
- Decisions should favor the outcome that minimizes appeals from candidates
- Decisions should be deferred until the next scheduled form revision
- Decisions should be made case by case by the program manager to preserve flexibility
- Decisions should follow a pre-established, documented policy for score corrections that treats affected candidates consistently Correct answer.
Explanation
Score-integrity decisions are defensible when they follow written policy applied uniformly to all affected candidates. Ad hoc handling invites inconsistency and challenges to fairness. The policy should specify notification, remediation, and documentation steps in advance.
Question 31Item and Question Development
Which statement best describes the purpose of a test blueprint in item development?
- It records the psychometric statistics of items after a pilot administration
- It defines the content and cognitive coverage a test should have before items are written Correct answer.
- It specifies the software used to deliver the exam
- It lists the answer key and scoring rubric for each constructed-response item
Explanation
A blueprint (test specification) is a plan created before item writing that maps content areas and cognitive levels to the intended number or weight of items. It guides coverage and prevents over- or under-sampling of topics. Post-hoc statistics and delivery logistics are separate concerns.
Question 32Item and Question Development
An item writer wants to measure whether a candidate can apply a formula to a novel scenario. Which item type is most appropriate?
- A true/false item about whether the formula exists
- A multiple-choice item presenting a new case and requiring the calculation Correct answer.
- A matching item pairing formulas with their authors
- A recall question asking for the formula's name
Explanation
Application-level measurement requires the candidate to use knowledge in a new context, which a scenario-based calculation item does. Recall and matching formats target memory of facts rather than transfer. True/false items rarely capture applied reasoning.
Question 33Item and Question Development
What is the primary function of a distractor in a multiple-choice item?
- To shorten the reading load of the stem
- To provide a plausible but incorrect response that attracts lower-ability candidates Correct answer.
- To reward partial knowledge with partial credit
- To give candidates a hint about the correct answer
Explanation
Distractors are incorrect options designed to be attractive to candidates who lack the targeted knowledge, so that response patterns reveal misconceptions. They should be plausible, not trick questions, and never hint at the key. Partial credit is not a function of distractors in standard MC items.
Question 34Item and Question Development
Which stem wording is least likely to introduce construct-irrelevant difficulty?
- All of the following are true except:
- Which of the following is NOT a characteristic of a valid contract?
- According to the module, which statement best describes consideration? Correct answer.
- Select the exception to the rule stated in the previous item.
Explanation
A positively worded stem that asks for the best description keeps the task focused on the content. Negatively worded stems and cross-item references add reading and memory load unrelated to the construct. "All of the following are true except" combines a negative frame with a complex option set.
Question 35Item and Question Development
A subject-matter expert writes an item with a stem that is three sentences long and options that are each a full paragraph. What is the most likely consequence?
- The item will have higher discrimination because it is more realistic
- The item will be immune to guessing effects
- The item will be easier because more context is provided
- The item will measure reading comprehension more than the intended construct Correct answer.
Explanation
Excessive stem and option length increases verbal load, so performance depends partly on reading ability rather than the target knowledge. This is construct-irrelevant variance. Longer items are not automatically more discriminating or easier.
Question 36Item and Question Development
In an item-writing guideline, options should be:
- Phrased as complete sentences regardless of the stem
- Ordered by increasing length with the key placed last
- Written so that only the key contains technical terminology
- Grammatically parallel and similar in length and complexity Correct answer.
Explanation
Parallel grammatical structure and comparable length prevent form-based cues that let candidates guess the key. Placing the key last or making it distinctive are classic flaws. Options should also be homogeneous in content and tone.
Question 37Item and Question Development
An item has a difficulty (p-value) of 0.95 and a point-biserial discrimination of 0.05. What is the most reasonable interpretation?
- The item has strong discrimination but poor reliability
- The item is too easy and provides little information about candidate differences Correct answer.
- The item is too hard and should be simplified
- The item is well targeted and should be retained as is
Explanation
A p-value near 0.95 means almost everyone answers correctly, and a near-zero point-biserial indicates the item does not separate higher- from lower-ability candidates. Such items contribute little measurement information. Difficulty and discrimination are separate indices, and neither supports retention here.
Question 38Item and Question Development
Which practice best supports fairness in item writing?
- Including humor that relies on shared cultural references
- Avoiding content that depends on knowledge of a particular group's culture unless it is part of the construct Correct answer.
- Increasing reading level to challenge all candidates equally
- Using references to regional landmarks to make items feel concrete
Explanation
Items should not require knowledge tied to a specific group unless that knowledge is part of what is being measured. Otherwise the item introduces construct-irrelevant variance that disadvantages some candidates. Cultural references, regional landmarks, and in-group humor all create such threats.
Question 39Item and Question Development
A candidate with strong content knowledge answers an item incorrectly because the stem contains an ambiguous phrase. This is an example of:
- Construct-irrelevant variance Correct answer.
- Guessing effect
- Construct underrepresentation
- Ceiling effect
Explanation
Construct-irrelevant variance occurs when factors unrelated to the intended construct, such as ambiguous wording, influence scores. The candidate's content knowledge is adequate, but the wording penalizes them. Underrepresentation concerns missing content, not wording effects.
Question 40Item and Question Development
Which of the following best describes an item that exhibits a "cueing" flaw?
- The item uses a scenario-based stem
- The stem and key share a word or phrase that gives away the answer Correct answer.
- The item requires multi-step reasoning
- The item has four plausible distractors
Explanation
Cueing occurs when grammatical or verbal overlap between the stem and the key signals the correct answer, letting candidates respond without knowing the content. Plausible distractors and multi-step reasoning are strengths, not flaws. Scenario stems are a legitimate format.
Question 41Item and Question Development
An item writer is developing options for a quantitative item. Which set of options is best designed?
- 12, 14, 16, 18
- 10, 12, 25, 100
- 10, 20, 30, 40
- 10, 12, 14, 16 Correct answer.
Explanation
Good numeric options are close in magnitude so that estimation alone cannot eliminate them, while remaining plausible. Evenly spaced wide ranges (10, 20, 30, 40) are easy to rule out, and extreme outliers (25, 100) stand out. Closely spaced plausible values require actual computation.
Question 42Item and Question Development
What is the main risk of using "all of the above" as an option?
- It reduces the number of options to three
- It makes the item too difficult for high-ability candidates
- It can allow candidates to answer correctly based on partial knowledge Correct answer.
- It increases the reading level of the item
Explanation
With "all of the above," a candidate who knows that two options are true can select the key without evaluating the remaining option. This lets partial knowledge produce a correct response, undermining measurement. The option does not primarily affect reading level or difficulty in the intended direction.
Question 43Item and Question Development
Which item format is most appropriate for assessing a candidate's ability to organize a multi-step procedure?
- A constructed-response task requiring sequencing of steps Correct answer.
- A fill-in-the-blank item for a single term
- A single true/false statement
- A four-option multiple-choice item asking for a definition
Explanation
Constructed-response formats allow candidates to demonstrate the full sequence of reasoning, which is central to procedural organization. True/false, definition-based MC, and single-term fill-in items capture isolated facts. Format should match the cognitive demand of the objective.
Question 44Item and Question Development
An item's point-biserial discrimination is negative. What is the most likely explanation?
- The key is correct and the item is simply hard
- The item is miskeyed or the distractor attracting high-ability candidates is flawed Correct answer.
- The item has too many options
- The item is too easy for the population
Explanation
A negative point-biserial means higher-scoring candidates are more likely to miss the item, which typically indicates a miskey or a distractor that attracts knowledgeable candidates. Difficulty alone does not produce negative discrimination. The item should be reviewed before use.
Question 45Item and Question Development
Which of the following stems best aligns with an analysis-level objective?
- Given two proposals, which conclusion is best supported by the data provided? Correct answer.
- Define the term 'opportunity cost'
- State the formula for net present value
- List the three stages of the process
Explanation
Analysis-level objectives require candidates to examine relationships and draw supported conclusions from given information. Defining, listing, and stating formulas are recall-level tasks. The scenario-based stem matches the higher cognitive demand.
Question 46Item and Question Development
When writing a stem, the best practice is to:
- State the problem completely and place the blank or question at the end Correct answer.
- Embed the answer within the stem so options can be short
- Use as few words as possible regardless of clarity
- Include the key in the stem to reduce reading time
Explanation
A well-written stem presents the full problem so the candidate knows what is being asked before reading the options. The blank or question should come at the end so options complete a coherent thought. Embedding or including the answer defeats the item's purpose.
Question 47Item and Question Development
A test blueprint specifies 30% of items at the application level, but the assembled form contains 10% application items. What is the most direct consequence?
- The test will underrepresent the intended cognitive domain and misrepresent candidate ability Correct answer.
- The test will be easier to score
- The test will have lower reliability due to fewer items overall
- The test will have a higher ceiling
Explanation
When the form deviates from the blueprint's cognitive-level targets, the test no longer measures the intended construct in the intended proportions. This is a form of construct underrepresentation and can distort inferences about candidate ability. Item count and scoring logistics are separate issues.
Question 48Item and Question Development
Which of the following is the best example of a plausible distractor for an item about identifying a valid contract element?
- A joke answer included to lighten the item
- A commonly confused but incorrect element that reflects a known misconception Correct answer.
- A statement that is obviously false to anyone who has read the material
- A restatement of the correct answer in different words
Explanation
Effective distractors reflect misconceptions that candidates actually hold, so they attract those who have not fully mastered the content. Obviously false or joke options are rarely chosen and reduce discrimination. A restatement of the key creates two correct answers.
Question 49Item and Question Development
A candidate answers an item correctly by eliminating three options that are clearly wrong, despite not knowing the content. This response is best described as:
- Partial knowledge Correct answer.
- Item bias
- Construct-irrelevant variance
- Guessing
Explanation
Eliminating implausible options reflects partial knowledge rather than random guessing, because the candidate uses some information to narrow the field. Random guessing involves no basis for selection. Construct-irrelevant variance and bias concern factors unrelated to the construct.
Question 50Item and Question Development
Which of the following is a recommended practice when writing options for a multiple-choice item?
- Keep options homogeneous in content and grammatical form Correct answer.
- Vary the number of options from item to item to reduce predictability
- Use 'always' and 'never' in all options to increase precision
- Make the correct option noticeably longer to ensure completeness
Explanation
Homogeneous options in content and grammar prevent form-based cues and keep the focus on substance. Making the key longer or using absolute terms creates detectable patterns. Varying option counts unpredictably can complicate scoring and comparability.