Inflated Sampling Frame and Substituted Respondents in a UPI Adoption Survey
An MPhil scholar is studying adoption of UPI among 1,200 street vendors in a municipal market. The traders' association supplied a list of 1,450 names, but 210 entries are duplicate shops or closed stalls. A pilot with 30 vendors yielded 92% cooperation. In the main survey, field investigators obtained 456 completed interviews from the 1,450 listed names (38% of the inflated list). To reach a target of 500, two investigators replaced 44 non-respondents with vendors from a nearby market not in the sampling frame. No refusal reasons were recorded, and 62 listed vendors could not be contacted after three visits. The scholar reports 71% adoption. The municipal corporation's transaction records for the same market show 44% adoption. The guide asks for a defensible sampling report before submission.
1. Identify the sampling-frame and non-response problems in this study and explain how each could bias the 71% estimate.
Read the worked answer
Two separate biases are present. First, the frame is inflated: 210 of 1,450 entries are ineligible, so the eligible frame is at most 1,240 and the true response rate is 456/1,240 ≈ 36.8%, not 38% of a clean frame. Coverage error also arises because the 44 nearby-market vendors were outside the defined population; their adoption behaviour may differ systematically. Second, non-response is not random: 62 vendors were never contacted and 44 were replaced, with no refusal reasons recorded. Vendors who are less digitally active may be more likely to be absent from the market or to refuse, so the 71% figure is plausibly upward-biased. The municipal benchmark of 44% is consistent with this direction, though it measures transactions rather than self-reported adoption. The 44 substituted cases should not be pooled with the probability sample; if retained, they must be analysed separately as a convenience supplement.
2. Recommend a defensible correction and reporting plan, including how to treat the 44 substituted cases.
Read the worked answer
The scholar should first reconstruct the eligible frame by removing duplicates and closed stalls and by documenting the rule used. The response rate should be recomputed against the eligible frame and reported with the number of refusals, non-contacts and ineligibles. A short non-response follow-up should be attempted, at least by phone, to compare early and late respondents on key variables. If reliable vendor counts by section or vendor type are available, post-stratification weights can reduce non-response bias; otherwise a sensitivity analysis should show how the estimate changes under plausible assumptions about non-respondents. The 44 substituted vendors should be excluded from the main estimate, or reported only as a separate convenience sample. The final report should present the corrected estimate with a confidence interval and explicitly compare it with the municipal transaction benchmark rather than presenting 71% as a population estimate.
3. What ethical issue arises from the field investigators' replacement of non-respondents, and how should the scholar address it?
Read the worked answer
The ethical problem is transparency and informed consent, not merely statistical error. Respondents from the nearby market consented to a survey, but they did not consent to being presented as part of the original market sample. Silently replacing non-respondents also creates a misleading impression of coverage and can amount to misrepresentation of the sampling method. The scholar should disclose the replacement in the methods section, explain why it occurred, and remove those cases from the population estimate. If the data are used at all, they should be labelled as a supplemental convenience sample. The scholar should also check whether institutional ethics approval covered the changed procedure and should retain consent records. The guide should require a limitations paragraph that states the likely direction of bias, rather than allowing the 71% figure to stand unqualified.