An off-task student in a group role-play and a two-rater discrepancy
A Year 9 Chinese elective at an Australian secondary school has 30 students in the final three weeks of a unit. The summative task is a group role-play (four students, 4–5 minutes) assessed on a five-band rubric for pronunciation, fluency, vocabulary and grammar, task completion, and interaction. One group reports that Jason, a confident but off-task student, has been on his phone during three planning lessons, has not learned his lines, and is derailing rehearsals; Jason says the group will not let him talk. Separately, a recorded individual speaking task by Mia was scored 82 by the class teacher and 64 by a colleague; both used the same rubric, and the recording is available. The head of department wants scores finalised by Friday and says not to make it complicated.
1. How should the teacher respond to the situation with Jason and his group, while preserving the fairness of the group assessment?
Read the worked answer
The teacher should separate behaviour from assessment. First, gather the group's account and Jason's account in a short, structured conversation, and check the planning-lesson records rather than relying on impressions. Second, make the group's operating rules explicit: each member has a named role and at least two speaking turns; rehearsals are phone-free unless the phone is the script. Third, give Jason a concrete, bounded role that uses his confidence, for example opening the exchange and handling one question, and require a short rehearsal check the next lesson. Fourth, keep an individual accountability component, such as a one-minute individual follow-up question after the group performance, so a student cannot free-ride on the group's score. If Jason still does not prepare, the teacher should apply the school's usual behaviour process and consider an individual alternative task rather than lowering the group's mark.
The reasoning is that group work needs both positive interdependence and individual accountability. Punishing the group would be unfair; ignoring the behaviour would teach the group that contribution does not matter. A documented, proportionate response also protects the teacher if the grade is challenged.
2. How should the teacher resolve the 82 versus 64 discrepancy on Mia's recording, and what should the final score be?
Read the worked answer
The teacher should treat the discrepancy as a moderation problem, not a negotiation. First, both raters independently re-listen to the recording with the rubric in front of them and mark each criterion separately, without seeing each other's totals. Second, they compare criterion by criterion: if the gap is driven by one criterion, such as fluency, they should identify the specific descriptors and the evidence in the recording. Third, they should listen together to a third, already-moderated sample to calibrate the standard. Fourth, they should agree a final score and record the rationale.
The final score should be the moderated score supported by the evidence, not an automatic average, because averaging two unequally defensible judgements can hide a rater error. If the evidence shows, for example, that Mia's pauses were mostly strategic and her interaction moves were strong, the higher band on fluency and interaction is defensible, and the final score may be closer to 80. If the evidence shows frequent breakdowns in pronunciation that impeded understanding, the lower band is defensible. The teacher should also check whether one rater was scoring effort or improvement rather than the recorded performance. The outcome must be documented and, if possible, a third rater should be used for future high-stakes tasks.
3. What should the teacher change in the assessment design next term, given this term's problems?
Read the worked answer
Three changes follow from the incidents. First, build individual accountability into group tasks: a short individual oral component, a peer contribution log, or a viva question after the performance. Second, moderate before scoring, not after: hold a 30-minute calibration session with two or three recorded samples at different bands, and use a criterion-by-criterion spreadsheet so discrepancies are visible. Third, separate the behaviour-management plan from the assessment schedule: publish rehearsal expectations, phone rules and checkpoints at the start of the unit, so problems are addressed before the summative task.
A fourth change is to reconsider the group role-play's weighting. If interaction is a criterion, the group format is appropriate, but it should not carry the whole speaking mark. The teacher should also record all performances, with consent, because recordings make moderation and appeals evidence-based. These changes are within the teacher's control and do not require extra timetable time if the calibration is folded into an existing department meeting.