Audience Reception and the Limits of Survey Evidence
A Year 11 class is planning a short film for a school screening. They surveyed 60 students and found 72% preferred comedy, 18% drama, 10% horror. Based on this, the class decided to make a comedy. Their teacher points out that the survey respondents were mostly from the media class itself, that the question was 'What genre do you prefer?' with no context about length or setting, and that the screening audience will include parents and teachers, not just students. The class also has a 4-minute runtime limit and one student who wants to make a horror film argues the survey 'proves' comedy is the safe choice.
1. Assess the validity of the survey as evidence for the class's decision. Identify at least three specific weaknesses.
Read the worked answer
Validity problems:
- Sampling bias. The 60 respondents are mostly media students, not the actual screening audience (which includes parents and teachers). A self-selected, convenience sample cannot support claims about a broader audience.
- Question design. 'What genre do you prefer?' is abstract. Preference for a genre in general does not predict enjoyment of a specific 4-minute student film. The question also offers no 'no preference' or 'depends' option, forcing a choice.
- Ecological validity. The survey measures stated preference, not behaviour. People often say they like comedy but respond to a well-made drama in context. The screening setting (school, mixed ages, short runtime) is not represented in the question.
- Small numbers. 10% horror is 6 people. A swing of 2 respondents changes the ranking. The '72%' looks decisive but rests on a weak base.
Judgement: the survey is weak evidence, not proof. The horror student is wrong to say it 'proves' comedy is safe; the comedy majority is wrong to treat 72% as decisive. The class should gather better evidence (ask about specific films, include parents, test a 30-second sample) or make a creative decision and defend it on grounds other than a flawed poll.
2. The class must choose one genre within a 4-minute limit for a mixed-age school audience. Recommend a decision-making process that is more defensible than the survey.
Read the worked answer
Recommended process:
- Define the actual audience. The screening audience is students, parents and teachers. Gather a small, purposive sample from each group (e.g. 10 per group) rather than 60 media students.
- Ask behavioural, not abstract, questions. Show two 30-second clips (one comedy, one horror) and ask which they would want to watch for 4 minutes, and why. This measures response, not stated genre loyalty.
- Apply production constraints as a filter. A 4-minute horror needs atmosphere, sound design and pacing; a 4-minute comedy needs timing and performance. Ask which the class can execute well in the available time. A weak horror is worse than a competent comedy.
- Check suitability for the setting. Horror in a mixed-age school screening may raise content concerns. That is a legitimate constraint, not censorship.
- Decide and justify. Choose a genre, state the evidence and the constraints, and accept that the decision is a judgement, not a proof.
Judgement: the exam rewards recognising that audience research informs decisions but does not make them. The class should use evidence to reduce uncertainty, then take responsibility for the creative choice.