Facts With Expiry Dates: Building a Reusable Pakistan Studies Quiz
You sit on a three-member committee preparing a 20-item Pakistan studies quiz for 60 intermediate students. The inter-college round is in three days and the same paper will be reused at next year's round. The draft sheet contains: 'Punjab has 36 districts' (taken from a 1998 census atlas), 'Pakistan's population is 21 crore' (from the 2017 census results), and a Senate seat count copied from a 2015 almanac. A colleague forwards a WhatsApp message claiming a new province has been approved and wants an item on it. You have internet access, but the college library's reference set stops at 2015. One committee member argues that because the answer key is printed, any dispute should be settled by 'whatever the book says'.
1. Rank the three drafted items by risk of becoming wrong within twelve months, and state what you would do with each and with the WhatsApp item.
Read the worked answer
Ranking by decay risk.
- Population - changes at every census, and a 2017 figure is already stale against the 2023 digital census. Highest risk.
- Districts - change by executive notification, often between one annual round and the next. High risk, unpredictable timing.
- Senate seats - change only by constitutional amendment. Lower risk, but a 2015 almanac is still the wrong authority.
Decisions.
- Population: stop testing the number. Either print a small table in the stem and ask a skill question (rank these four provinces by share of population), so the figure travels with the item, or drop it.
- Districts: replace the count with recognition of long-established districts, or write the source and date into the stem ('according to the 2023 census…'). A bare number will be wrong next year.
- Senate: re-verify against an official source or drop; an almanac is not an authority for a figure that an amendment can move.
- WhatsApp claim: no item until it appears in the Gazette or on an official government site. A forward is a lead, not a source.
- On 'whatever the book says': that is a rule for consistency, not for truth. Where the printed book is an atlas from 1998, recency and official provenance outrank print.
2. On quiz day a student challenges an answer in front of the hall. Set out the procedure you would follow on the spot and afterwards, and how you would future-proof the paper for next year's reuse.
Read the worked answer
On the spot (under two minutes).
- Thank the student, take the challenge in writing on a slip with name, item number and reason, and tell the hall that no marks will be changed verbally.
- Do not debate the answer in front of 60 students: either you are certain, in which case say the key stands pending review, or you are not, in which case say so. Both are defensible; improvisation is not.
- Mark the item number on your own copy and collect all slips at the end.
Afterwards. Publish the key with the source and date for each disputed item within 48 hours. If a key is wrong, credit all defensible answers, not only the challenger's. Record the correction in a moderation note so the decision is auditable.
Future-proofing for reuse.
- Put a version line on the paper: 'figures as of [month, year]'.
- Keep an item register with, for each fact-based item: source, date checked, and an expiry review date three months before the next round.
- Tag each item static/volatile; a reusable paper should carry no more than a handful of volatile items, and those should be re-verified, not reprinted.