Two Reviews of the Same Documentary
Students watch a short Chinese documentary about a village that has built a homestay tourism industry. Review A, published in a state-affiliated outlet, praises the village's 'revitalisation' and quotes a village official saying incomes have tripled. Review B, from an independent online magazine, interviews two residents who say the income figures exclude households that could not afford to renovate, and that young people still leave. A student concludes: 'Review A is biased because it is state-affiliated; Review B is objective because it includes ordinary people's voices.' The teacher asks the class to interrogate this reasoning rather than accept it.
1. Critique the student's reasoning and explain what a more defensible evaluation of the two reviews would involve.
Read the worked answer
The student uses source identity as a shortcut to credibility: state affiliation → biased; inclusion of ordinary voices → objective. Both inferences are unsafe.
First, affiliation is relevant context but not a verdict. Review A's claim (incomes tripled) may be accurate for the population it measures; the issue is the scope of the claim and the absence of dissenting voices, not the outlet's ownership. The analysis should ask: what is the evidence base, who is quoted, what is omitted?
Second, Review B's use of resident testimony does not make it objective. Testimony is selected too - two residents are not the village. Review B may be accurate and still partial, or may select voices that support a pre-existing critical angle.
A more defensible evaluation compares the two on specific dimensions: the population each income claim covers, the number and position of sources, whether counter-evidence is acknowledged, and the framing language (revitalisation vs. exclusion). It should also consider purpose and audience: a state-affiliated outlet may be writing to promote a policy model, an independent magazine to critique it - both purposes shape selection without automatically falsifying facts.
2. The class must write a judgement: which review gives a more reliable picture of the village's economic change? Write a model judgement of about 120 words.
Read the worked answer
Neither review alone is reliable, but Review B provides the more defensible account of economic change because it specifies who is excluded from the income figures. Review A's claim that incomes tripled is not necessarily false, but without a stated population it cannot be assessed; a village-average figure can rise while some households stagnate. Review B supplies that missing dimension by identifying households unable to afford renovation and by noting continued out-migration, which qualifies the success narrative.
However, Review B's evidence is thin: two residents cannot represent the village, and its critical framing may lead it to under-report genuine gains. The more reliable picture would combine A's aggregate data with B's distributional detail. Judging reliability therefore requires asking what each review measures and omits, not which source is more trustworthy in principle.