Supervisee Whose Data Do Not Match the Videos
A BCBA supervises three RBTs. One RBT, six months into the role, submits session data showing 90-95% independent responding for a client on a discrete-trial program. During a monthly video review, the BCBA observes the client responding independently on roughly 60% of trials, with the RBT prompting after about two seconds and sometimes re-presenting trials until the client responds correctly. The RBT's written notes describe "excellent progress." The BCBA must address the discrepancy, protect the client's program, and meet supervision and documentation requirements.
1. What is the nature of the problem, and what are the immediate supervisory steps?
Read the worked answer
The problem is twofold: a data-integrity problem (recorded data do not match observed performance) and a procedural fidelity problem (prompt delay too short, repeated trials inflating "independent" responses). Both threaten the client's program and the validity of every decision made from those data.
Immediate steps:
- Do not accuse; gather facts. Review additional videos and conduct a live observation to see whether the discrepancy is consistent or situational.
- Check the data collection system: is "independent" defined precisely? Is a trial with a re-presentation counted twice? Ambiguity in definitions can produce inflated numbers without intent to deceive.
- Review prompt-delay procedures and the definition of a trial with the RBT.
- Suspend use of the affected data for program decisions until verified; flag the data in the client record.
- Notify the clinical supervisor and follow organizational policies on data integrity.
- Increase direct observation and feedback frequency temporarily.
The BCBA should distinguish an honest misunderstanding from falsification, but must act to protect the client either way. Documentation should include dates, observations, feedback given, and corrective actions.
2. Design a supervision and remediation plan with measurable criteria, and explain how the BCBA should document it.
Read the worked answer
The remediation plan should be specific, time-bound, and measured.
Training components:
- Retrain on trial presentation, prompt delay (for example, a 5-second constant delay as written in the plan), and the rule against re-presenting trials.
- Retrain on operational definitions and data recording, with practice scoring recorded videos until agreement with the BCBA reaches at least 90% on two consecutive sets.
- Role-play feedback conversations and self-monitoring.
Supervision components:
- Weekly live or video observation for four weeks, then biweekly if criteria are met.
- Fidelity checklist scored each observation; target at least 90% on two consecutive observations.
- Data-recording agreement checked against observation each week; target within 10 percentage points.
- Brief written feedback after each observation, with one strength and one target.
Decision rules:
- If criteria met for four weeks, return to standard supervision with periodic checks.
- If not met, extend remediation and consider reduced caseload or reassignment to protect clients.
Documentation: a supervision log with dates, activities, observation scores, feedback content, RBT response, and the BCBA's signature. Records should be contemporaneous, factual, and stored per policy. The BCBA should also document any correction to the client's data record so future decisions are not based on invalid data. Throughout, the tone should be supportive and developmental while holding clear performance standards, consistent with the obligation to ensure supervisees are competent before independent practice.