The 'Chemical-Free' Cleaner Pilot
At a middle school, the PTA proposes switching to a 'plant-based, chemical-free' cleaner. A parent cites a pilot: over 3 weeks, classrooms cleaned with the new product had 18% fewer student absences than classrooms cleaned with the district's standard disinfectant. The pilot covered 6 classrooms using the new product and 6 using the standard product, but the new-product rooms were all in the newly renovated wing, which has a new HVAC system and 12 more square feet per student. The parent also notes the product label says 'no harsh chemicals.' The principal asks the science department to advise before the school board votes.
1. Is the parent's causal claim ('the new cleaner reduced absences') justified by the pilot? Explain what the data do and do not show.
Read the worked answer
No. The pilot shows an association, not a causal effect.
- The 18% difference could easily be produced by the renovated wing's HVAC system, which changes ventilation and airborne pathogen load.
- The new-wing rooms also have more space per student, reducing crowding and transmission.
- The pilot had only 6 rooms per condition, no randomization, and no baseline absence data, so ordinary week-to-week variation could produce an 18% gap.
- 'Chemical-free' is a marketing phrase, not an efficacy or safety finding. Water is a chemical; 'natural' does not mean nontoxic.
What the data do show: the new-wing rooms had lower absence during those 3 weeks. They do not isolate the cleaner as the cause. A defensible conclusion is 'the pilot is consistent with a benefit but is confounded and too small to decide.'
2. Design a study the school could realistically run to test the cleaner's effect on illness-related absence. Name at least three controls and one outcome measure.
Read the worked answer
Design sketch:
- Randomly assign classrooms within the same wing to new cleaner vs standard disinfectant. Randomization breaks the link between treatment and room quality.
- Keep HVAC, grade level, class size, and cleaning schedule identical across arms.
- Use identical unlabeled bottles and have custodial staff follow a written protocol so expectations do not bias application.
- Run a crossover or alternate-week design if only one wing is available.
Outcome measure: laboratory-confirmed or nurse-verified respiratory or gastrointestinal absence, not all absence. All-cause absence includes vacations, sports, and appointments and dilutes any effect.
Also record daily attendance, surface microbial samples, and room temperature/humidity. Pre-register the outcome and analysis, and run at least a full semester. Replicate in a second school before making a district-wide claim.
3. How should the norms of science-transparent methods, replication, peer review, and skepticism-shape the board's decision, given the pilot is local and unpublished?
Read the worked answer
Scientific norms change how much weight the evidence carries, not whether the board may act.
- Transparency: the pilot's methods must be documented so others can check for confounds such as the wing effect. Unpublished local data are weak evidence.
- Replication: one 3-week, 12-room pilot is a single result. Independent replication in another school is needed before claiming a health benefit.
- Peer review: not required for a local purchase, but district science staff or an outside reviewer should critique the design.
- Skepticism: the burden of proof is on the causal claim. Extraordinary claims about absence rates require stronger designs.
The board can still choose the cleaner for cost, odor, or irritant reasons under uncertainty. What it should not do is advertise a proven 18% health benefit. Scientific caution and policy action are compatible; overstating the evidence is not.