A program result with an uncertain cause
A school counseling team introduces a small-group study-support program and later observes higher course-completion rates among participants. The team has no random assignment, and students who joined also received additional classroom support. One presentation slide states that the counseling group alone caused the improvement. Another slide lists only the number of sessions delivered and calls that number the student outcome. The program wants to communicate useful findings without either discarding the observed change or overstating its meaning. Relevant information includes the baseline, recruitment, other services, attendance and the actual completion measure. This fictional case does not supply a current certification blueprint, legal reporting rule or national program benchmark. It asks for evaluation and responsible use of school data.
1. What should the evaluation distinguish?
Read the worked answer
Session counts describe activity. Course completion is an outcome measure, but the observed change cannot by itself isolate the counseling group’s causal effect from recruitment or other support.
2. How should findings be used?
Read the worked answer
Report the actual comparison and limits, examine who was reached and consider a stronger evaluation. Use the findings to refine feasible support rather than announce an unsupported guarantee.