Research, Data Literacy, and Continuous Improvement
This domain tests how candidates use evidence to improve social-education programs. Expect questions on research questions, qualitative and quantitative methods, sampling, consent, data quality, triangulation, interpretation, disaggregation, and continuous-improvement cycles such as plan-do-study-act.
Core rules
- Start with a focused question and specify what evidence would answer it. Match method to question: surveys for prevalence, interviews for meaning, observations for practice.
- Sampling affects claims. Convenience samples and small groups limit generalization; report limits honestly.
- Protect participants through consent, confidentiality, secure storage, and minimal data collection.
- Triangulate across sources to strengthen interpretation. Check missing data and measurement definitions before comparing groups.
- Disaggregate to find inequities, but suppress small cells and avoid identifying individuals.
- Continuous improvement uses small tests, explicit predictions, measured results, and documented adaptations.
Worked example
Attendance in a weekend civic workshop falls. The coordinator first checks definitions and missing records. She compares attendance by session, transport access, and language group, then interviews a few non-attenders and reviews reminder timing. She predicts that earlier reminders plus transport support will raise attendance. A two-week PDSA test shows improvement for one group but not another; she adapts rather than declaring universal success.
Traps
Correlation is not causation. Small samples, cherry-picked quotes, and ignored missing data weaken conclusions. Do not change measures mid-cycle without documenting it. Avoid overgeneralizing from one site, exposing small groups, or using data to blame participants rather than improve conditions.