The Clinic's Patient-Satisfaction Score
A regional clinic reports a patient-satisfaction score of 91 percent and cites it in a fundraising letter as proof that "our care is excellent." The score comes from a post-visit survey mailed to patients; 640 of 4,100 patients returned it. The survey asks a single question - "Were you satisfied with your visit?" - on a five-point scale, and the clinic counts 4s and 5s as satisfied. Internal notes show that patients who filed complaints during the year were not mailed surveys, and that the survey was sent only to patients who had a follow-up appointment already scheduled. The letter also states that satisfaction "has risen steadily," based on three annual snapshots: 88, 90, and 91 percent.
1. Identify every factual detail in the setup that limits how the 91 percent figure can be interpreted. Quote or closely paraphrase each.
Read the worked answer
The limiting details, each separately:
- Response rate. 640 of 4,100 returned the survey - about 16 percent. The 91 percent describes responders, not all patients.
- Single-item measure. One question with a five-point scale, with 4s and 5s collapsed into "satisfied." This is a coarse instrument; it cannot distinguish "very good" from "excellent," and it measures satisfaction with a visit, not quality of care.
- Excluded complainants. Patients who filed complaints were not mailed surveys. This removes precisely the respondents most likely to report dissatisfaction.
- Restricted sampling frame. Only patients with an already-scheduled follow-up were surveyed - a group plausibly more engaged or more satisfied than the full patient population.
- Small, non-random trend base. "Risen steadily" rests on three annual point estimates (88, 90, 91) with no sample sizes, confidence intervals, or test of significance reported.
A precise answer separates who was asked (items 1, 3, 4) from what was asked (item 2) from how the trend is characterized (item 5). Each is a different kind of limitation.
2. The letter uses the 91 percent to support the claim "our care is excellent." Explain the gap between the measure and the claim, using the specific details above.
Read the worked answer
The measure and the claim differ on three axes.
Construct. The survey asks whether patients were satisfied with a visit. Satisfaction reflects waiting times, staff friendliness, and scheduling - real but partial aspects of care. "Excellent care" implies clinical quality and outcomes, which a satisfaction item does not measure. A patient can be delighted with the front desk and still receive substandard treatment.
Population. The 91 percent describes 640 responders drawn from a frame that excludes complainants and includes only patients with follow-up appointments. Even if satisfaction were a proxy for quality, the figure would not represent the clinic's patients as a whole.
Inference type. The letter moves from a self-reported feeling to an objective quality judgment. That is an inferential leap, not a restatement. A defensible sentence would be: "Among patients who responded to our survey, 91 percent reported satisfaction with their visit." The original sentence asserts more than the data can carry, and the specific exclusions make the overstatement worse than a generic response-rate caveat would.