More sessions and a claim about effectiveness
A community service reports that it delivered twice as many sessions as last year. Its manager announces that participant wellbeing must therefore have doubled. The evaluation file contains attendance records and a voluntary satisfaction questionnaire completed mainly by people who attended the final session. No baseline wellbeing measure or comparison group is available, and several participants stopped attending because transport was difficult. Staff want to know whether the service should be expanded and which barriers should be addressed first. The exercise does not supply a randomized design or assume that dissatisfied participants had the same probability of responding. The learner must distinguish what the existing evidence establishes from what requires additional measurement or a stronger design.
1. What can the records establish?
Read the worked answer
They document activity and selected respondents’ reported experience. More sessions are outputs and do not demonstrate a doubled wellbeing outcome.
2. How can evaluation improve?
Read the worked answer
Define relevant outcomes, gather baseline and follow-up evidence where appropriate, examine dropout and access barriers, and use a comparison or other defensible design without overstating causality.