Suspected Cheating During Exam Administration
A proctored exam is delivered at 50 test centers worldwide. During a single administration window, 2000 candidates take the exam. After the window, psychometric analysis reveals that 15 candidates from 3 test centers have unusually similar response patterns: their responses match on 95% of items, including many items that are typically missed by low-ability candidates but answered correctly by these candidates. The probability of such similarity by chance is less than 1 in 10,000. The exam is high-stakes for licensure. The test centers in question are in different countries. The candidates are not known to each other. The exam security policy states that any candidate suspected of cheating will have their scores withheld pending investigation. The investigation process typically takes 60 days. Candidates are told scores will be released within 45 days.
1. What steps should the testing program take immediately upon discovering the anomalous response patterns?
Read the worked answer
The program should first verify the anomaly using additional statistical analyses (e.g., K-index, erasure analysis if computer-based, or similarity indices) and rule out legitimate causes such as collusion or item exposure. They should also check for test center irregularities (e.g., proctor misconduct, technology issues). If the anomaly persists, the program should initiate a formal investigation according to policy. This includes notifying the candidates that their scores are under review, withholding scores, and gathering evidence (e.g., video surveillance, seating charts, proctor reports). Because the candidates are from different centers and not known to each other, it may indicate a security breach (e.g., leaked items) or organized cheating. The program should also examine whether the items involved were compromised (e.g., exposed on the internet) and consider invalidating those items for all candidates if they were compromised. Communication with candidates should be timely and factual, avoiding accusations. The program should also review its security protocols at the affected centers.
2. How should the program balance the need for a thorough investigation with the 45-day score release promise, and what are the fairness considerations?
Read the worked answer
The program should prioritize the integrity of the exam while minimizing harm to innocent candidates. They can release scores for the 1985 unaffected candidates within 45 days, while withholding the 15 under investigation. For the 15, the program should expedite the investigation as much as possible, but 60 days may be needed. They should communicate to the 15 that their scores are delayed due to a review, without disclosing details. Fairness requires that the investigation be unbiased and that candidates have an opportunity to respond to allegations. If the investigation cannot be completed within a reasonable time (e.g., 60 days), the program should consider provisional score release with caveats, but that may risk certifying cheaters. Alternatively, they could offer a retest at no cost if the investigation is inconclusive. The program should also ensure that the investigation does not disproportionately impact candidates from certain regions. Document all decisions and maintain confidentiality.