Twelve disputed items and pressure to lower the cut-off
You sit on the result-review committee for a screening test of 100 multiple-choice questions with four options and negative marking of 0.25 for each wrong answer; 5,000 candidates appeared. At a cut-off of 40 marks the pass rate is 22%, against 46% and 44% in the two previous cycles. Scrutiny shows that 12 General Knowledge items were keyed to option (b), but subject experts now agree that option (d) is equally defensible in 7 of those items and that the remaining 5 items had no correct option printed at all. Of the 5,000 candidates, 1,800 chose (d) on at least one of the 7 contested items; 2,300 left at least one of the 5 defective items blank. There are 150 posts and the Commission's rule is to call candidates to interview on a 1:3 ratio. A note on file from a junior officer proposes lowering the cut-off to 35 so that the interview list can be filled.
1. How should the 12 disputed items be treated, and what is the arithmetic effect of your choice?
Read the worked answer
Treat the two groups differently, because the harm is different. For the 7 contested items, credit both (b) and (d) and cancel the negative marking for those who chose (d). A candidate who chose (d) presently scores minus 0.25; credited, he scores plus 1 - a swing of 1.25 marks per contested item, up to 8.75 marks for someone who chose (d) on all seven. Candidates who chose (b) are unaffected, and those who chose (a) or (c) keep their penalty, so the correction is targeted and does not flatten the ranking.
For the 5 items with no correct option, drop them and score everyone out of 95, then express the cut-off proportionally: 40 out of 100 becomes 38 out of 95. Awarding full marks on these five to all candidates looks generous but is arithmetically the same as adding 5 to every score, which leaves the ranking and the effective cut-off unchanged while inflating every transcript. Dropping and rescaling is honest; a bonus is cosmetic. After recomputation, re-rank and publish the revised key with the reasons for each item.
2. Should the cut-off be lowered to 35 to fill the 1:3 interview list?
Read the worked answer
No. A cut-off is a standard of competence; a 1:3 ratio is an administrative target for how many candidates to interview. Confusing the two is exactly how a merit list becomes a quota of convenience. If after recomputation fewer than 450 candidates clear 40, the correct sequence is: (1) publish the corrected result and the real number of passers; (2) place all passers on the interview list even if that is fewer than 450, since 3 per post is a ceiling, not a floor; (3) if the shortfall is severe and posts will lapse, ask the Commission in writing for a documented relaxation with reasons, applying it to all candidates equally and recording it in the minutes.
Lowering to 35 by note on file would also be indefensible against the previous two cycles, where the same posts were filled at 40. The 22% pass rate is explained by the 12 defective items and by a harder paper, both of which are addressed by the correction, not by moving the bar. The committee should state that plainly in its report.
3. How do you present the outcome so that it survives challenge by unsuccessful candidates and by the press?
Read the worked answer
Publish four things together: the corrected answer key with the 7 items double-keyed and the 5 defective items deleted and identified by number; the revised marking formula, including the 95-item rescaling and the treatment of negative marking; each candidate's individual score with an item-wise breakdown available on request; and the final cut-off with the number of passers and the rule used to build the interview list. Add a short statement that the defect was found in internal scrutiny before results were declared, not after complaint.
What to avoid: releasing only a pass rate, refusing to disclose item numbers, or saying the matter is 'under process'. Each invites the inference of concealment. Also keep the working papers - expert opinions on the 7 items, the printer's proof, and the committee minutes - because a tribunal will ask who decided and when. The test of a defensible result is not that nobody complains, but that every complaint can be answered from the file within a day.