Moderation Discrepancy Across Two Classes
Two teachers deliver the same Women's Studies course. Ms. Rivera's class of 19 has a mean score of 68 on the major school-assessment task; Mr. Chen's class of 21 has a mean of 57. Both used the same task sheet and rubric. At moderation, samples show that Ms. Rivera's students wrote longer reports with more references, while Mr. Chen's students wrote shorter reports but several made sharper analytical points. The rubric rewards 'depth of analysis' and 'use of evidence' but does not specify length or minimum references. Mr. Chen suspects Ms. Rivera's class had more feedback cycles; Ms. Rivera suspects Mr. Chen applied the analysis criterion more harshly. Neither has documented their feedback rounds or annotation decisions.
1. Diagnose the likely causes of the 11-point gap and explain what moderation should do about it.
Read the worked answer
An 11-point mean difference is large enough to require explanation before results are finalised. Possible causes fall into three categories:
Task and rubric interpretation. The rubric rewards depth and evidence but is silent on length and reference counts. If Ms. Rivera's students inferred that longer reports score better, and her marking rewarded length implicitly, the two classes were effectively assessed against different standards. Mr. Chen's suspicion of harsher application of the analysis criterion is the mirror image of the same problem.
Opportunity to learn. Different numbers of feedback cycles mean different opportunities to improve. If Ms. Rivera ran three drafts and Mr. Chen one, the gap partly reflects delivery, not student ability. This is an equity issue within the school's assessment program.
Marking inconsistency. Without documented annotations, neither teacher can demonstrate how the rubric was applied to borderline scripts.
Moderation should re-mark a stratified sample - high, middle, and low scripts from both classes - against the rubric, with both teachers present. Where they disagree, they should articulate what 'depth of analysis' looks like in a script and record the agreed interpretation. The goal is a shared standard, not an averaged score.
2. What should the school do after moderation to prevent recurrence, and how should students be informed?
Read the worked answer
Prevention requires documentation and calibration, not blame.
Actions:
- Annotate the rubric with exemplars of weak, sound, and strong analysis, agreed jointly and stored for future years.
- Standardise feedback cycles - specify a minimum number of draft opportunities across all classes, so opportunity to learn does not depend on which teacher a student is assigned.
- Remove or define ambiguous signals - if length and reference counts are not criteria, say so explicitly to students and markers.
- Calibrate before marking, not only after: both teachers mark the same two scripts at the start of the task and compare.
- Keep moderation records so that decisions can be audited.
Informing students: results may be adjusted where moderation shows inconsistency, and schools should explain that moderation is a quality process, not a punishment. Students should be told the criteria in plain language, including that quality of analysis matters more than length. If scores change, the school should communicate the reason and the process for appeal. Transparency protects trust in the assessment and signals that fairness is taken seriously.