The Three-Month Fluency Post: Evaluating a Language Claim
Hana is preparing a reading log for NCEA Level 3 Chinese. She finds a social-media post: 「三个月说一口流利中文,我只做了三件事:每天背50个单词、看剧不看字幕、找一个中国语伴。亲测有效!文末有课程链接。」 The post has 2,000 likes, before-and-after audio clips, and no statement of the writer's starting level. The linked course costs ¥899 for 12 weeks. The post claims the method works for 'busy students with no time to study abroad'. The top comment from 小周 reads: 「我也试了,三个月只学会点菜。」 Another comment asks: 「广告吧?」 Hana's teacher requires evaluation of reliability, not summary, and asks for a judgement, two reasons and one condition under which the judgement would change. Hana now wants to stop her class vocabulary homework and follow the post's routine instead. She has 14 weeks until her external assessments, and her vocabulary test average is 62%.
1. Identify three features of the post that weaken its claim, and explain what each feature does.
Read the worked answer
First, 「流利」 is never defined. The central claim therefore cannot be tested: fluent for ordering food, for a job interview and for debating are different standards. An undefined key term lets the writer set the goal after the result.
Second, the evidence is self-reported and selected. 「亲测有效」 is a testimonial, and the before-and-after clips are chosen by the writer, with no standard task, no independent assessor and no stated starting level. A learner who began at HSK 3 and one who began at zero would need very different timelines.
Third, there is a commercial interest: the post ends with a course link costing ¥899. That does not make the advice false, but it gives the writer an incentive to exaggerate and to omit what did not work.
The likes and the comment 小周 cut both ways: 2,000 likes measure popularity, not truth, while 「三个月只学会点菜」 is a counterexample from the same audience. Together these features make the post useful as a source of study ideas but unreliable as evidence about outcomes.
2. What should Hana do? Write a reasoned recommendation using both the post and 小周's comment, and explain why 'not following the post' does not mean 'ignoring it'.
Read the worked answer
She should keep her class vocabulary homework and borrow selected habits from the post.
Her situation is specific: 14 weeks until external assessments and a 62% vocabulary average. That points to a measurable, teacher-monitored plan. The post offers no measurement and no starting level, and 小周's comment shows that the same routine produced a very different outcome for at least one other learner. Individual variation alone means the post cannot be a plan.
But the post contains usable elements: daily word targets, subtitled-free viewing for listening, and a 语伴 for speaking. Hana can adopt these with her own numbers - for example 20 words a day with weekly review, one drama episode without subtitles twice a week, and a 20-minute language exchange - while keeping the class tasks that generate feedback.
'Not following' means rejecting the post as proof and as a schedule. 'Not ignoring' means treating it as a hypothesis to test. She should track her own vocabulary scores over four weeks; if they rise, the habits are working for her, regardless of whether the post's three-month claim is true.
3. What additional evidence would make the post's claim credible? List two specific things and explain how each would reduce bias.
Read the worked answer
First, an independent pre-test and post-test using a defined standard, such as a recorded speaking task scored by two assessors against published criteria, with the starting level stated. This would reduce bias because the goal would be fixed before the result and the judgement would not rest with the person selling the course.
Second, a comparison group or at least a reported sample: for example 40 learners with the same starting level, half following the routine and half continuing their usual classes, with results reported for all of them rather than only the successes. This reduces selection bias and survivorship bias - the tendency to showcase the learners for whom the method worked.
Two further details would help but are secondary: disclosure of the writer's financial interest, and a follow-up test after six months to show retention rather than a short-term boost. The condition under which the original judgement would change is therefore met only if the claim survives an independent test with a defined standard and a stated baseline.