Cornerstone Residential: A Miskeyed Item, a Proctor Flag, and an Accommodation Request
Cornerstone Residential requires every new leasing consultant to complete a six-hour online course covering fair housing and HUD recertification, then pass a 50-item timed exam with a passing score of 80%. The same exam is used as a selection hurdle for the assistant manager role. In the latest cohort of 14 candidates, nine failed. Item 27, a double-negative question about the 140% rule, was missed by 12 of 14, and its point-biserial correlation is negative. One candidate was flagged by the remote proctoring vendor for 'frequent gaze aversion' and 'a second voice in the room'; the hiring manager wants to reject her. Another candidate submitted an accommodation request for 50% additional time based on ADHD; the platform's only option is a 10-minute extension. A third candidate's connection dropped twice, and the attempt shows 11 unanswered items.
1. Nine of 14 candidates failed and item 27 was missed by nearly everyone. What should be done before any candidate is disqualified?
Read the worked answer
The results should be treated as an exam defect until proven otherwise.
Item analysis. A p-value around 0.14 combined with a negative point-biserial correlation is the classic signature of a miskeyed or ambiguous item: the strongest candidates are choosing the same wrong answer for a defensible reason. Pull item 27, have a subject-matter expert review the intended answer against the actual text, and check for the double negative. If it is miskeyed, rescore every attempt in the cohort and correct the item bank with version control.
Whole-exam review. Recheck the remaining items against the training objectives. If the course did not teach what items 18 to 30 tested, the failure rate is a training problem, not a candidate problem.
Cut score. An arbitrary 80% is hard to defend. Document how the passing standard was set (modified Angoff with SMEs, or contrasting groups) and whether 80% matches the competency needed to work unsupervised.
Consistency. Apply any correction to the entire cohort, not just the candidate you like. Re-test after remediation where the material was not covered. Keep the item statistics, the SME review notes, and the rescoring record; they are the evidence that the process was job-related and consistently applied.
2. How should the proctor flag, the accommodation request, and the dropped connection each be handled?
Read the worked answer
Proctor flag. A flag is an anomaly indicator, not a finding. Review the recording, check the timestamps against the connection log, and ask the candidate for an explanation before making any decision. 'Gaze aversion' is weak evidence on its own and is frequently caused by reading off-screen or a second monitor that the system mis-located. Do not reject on a single unverified automated flag; inconsistent treatment of flagged candidates is itself a liability.
Accommodation request. ADHD can qualify as a disability, and extended time is a standard accommodation. Provide 1.5x time in the platform or a separately proctored session, keep medical documentation in a confidential file separate from the personnel file, and do not alter the passing standard. The vendor's 10-minute limit is a configuration problem, not a legal defense; escalate to the vendor or run the session manually. Engage in the interactive process and confirm the arrangement in writing.
Dropped connection. The attempt is not valid evidence of ability with 11 unanswered items. Invalidate and reschedule on a stable connection or in person. Do not score unanswered items as incorrect and then reject the candidate for a technical failure.
3. If Cornerstone rejects candidates on the basis of this exam, what records and process steps are required?
Read the worked answer
Adverse action. If the decision relies on a report from a third-party vendor such as a proctoring or background firm, the FCRA applies: send a pre-adverse action notice with a copy of the report and the summary of rights, allow a reasonable response period (commonly about five business days), then send the adverse action notice with the required disclosures if the decision stands.
Test records. Under the Uniform Guidelines on Employee Selection Procedures, retain test records, scoring keys, and applicant flow data by race, sex, and ethnicity for at least two years. Adverse impact analysis on pass rates is only possible if the data were kept.
Validity. Because the exam is a hiring hurdle for assistant managers, not just a training sign-off, it needs a defensible link to the job: a job analysis, SME content review, and documentation that the scored competencies are performed on the job.
Consistency and notice. Tell candidates the format and how to request an accommodation before the test, not after. Apply the same cut score and the same review process to everyone, and keep version-controlled records of every change to items, keys, and scoring.