ePRO study materials
ePRO study resources

The Site With 45% Compliance

ePRO ยท Put your knowledge to work in context.

All case studies

The Site With 45% Compliance

A migraine prevention trial uses a daily two-item ePRO diary: migraine occurrence yes/no and worst pain 0โ€“10. The diary opens at 06:00 and must be completed by 10:00 for the previous 24 hours. There are 180 participants; overall compliance is 68%. Site 12 has 24 participants and 45% compliance. The coordinator says participants delete the app because notifications are 'too many' and some share phones with family members. One participant at site 12 completed 14 daily entries in a single sitting during a clinic visit. The vendor's report shows entries clustered at 09:58, with median completion time 3 seconds. The site asks whether to exclude the participant or 'fix' the dates. The sponsor's statistical team plans a complete-case primary analysis. The data cutoff is in six weeks.

1. What do the compliance pattern and the 14 clustered entries suggest, and what data-integrity concerns should be investigated?

Read the worked answer

The 14 entries in one sitting, with a median completion time of 3 seconds and clustering at 09:58, are a strong signal of retrospective completion rather than daily contemporaneous reporting. That matters because the diary is a 24-hour recall measure; entries made later do not measure the same thing. The first step is to pull the audit trail: creation time, submission time, device identifier, time zone, and whether the app was opened on the days in question. Ask the participant and coordinator whether the entries were made from memory, from notes, or with staff assistance. Do not 'fix' the dates; altering timestamps would destroy the audit trail and create a false record. Treat the affected days as potentially invalid and document the query and outcome. The shared-phone and notification complaints are separate operational issues that may explain broader missingness, but they do not excuse backfilled entries. The site should not decide exclusion alone; the sponsor and medical monitor need a rule applied consistently across sites.

2. What action plan would you set for site 12, and would you exclude the site from the trial?

Read the worked answer

Do not exclude the site reflexively. First, separate capability from conduct. Retrain the coordinator on the diary window, the prohibition on completing entries for participants, and the need to document device problems. Review notification settings with each participant, reduce non-essential alerts, and offer a private-device or loaner option where shared phones are a barrier. Confirm that participants can complete within the 06:00โ€“10:00 window and that the site is not instructing them to catch up at visits. Set a written remediation plan with weekly compliance review, a defined threshold for escalation, and a re-audit of the next 14 days. If the site cannot meet the threshold after remediation, restrict new enrollment and escalate to the sponsor. Excluding the site entirely would lose the participants already enrolled and may introduce selection bias. The participant with 14 clustered entries needs an individual query and a documented validity decision, not a site-level punishment.

3. How should the planned complete-case primary analysis be handled in light of this pattern?

Read the worked answer

Complete-case analysis is not automatically wrong, but it assumes that the participants with complete data are representative. Here, site 12 has both low compliance and evidence of retrospective entry, so complete cases may over-represent better-performing sites and more engaged participants. Before the cutoff, the statistical team should tabulate missingness by site, week, and participant characteristics, and should document whether the pattern is plausibly related to the outcome. Pre-specify a sensitivity analysis, such as multiple imputation under a plausible missing-not-at-random assumption, or a worst-case/best-case bound for the primary endpoint. Do not pool the 14 backfilled days as if they were daily entries; either exclude those days from the primary dataset with a documented rule or include them in a sensitivity analysis. The goal is not to make the data look complete but to show how the conclusion changes under defensible assumptions. The steering committee should review the missingness report before database lock.