Sensitive HR transcripts in a shared prompt-tuning document
Helios Health's HR assistant answers payroll, leave, and benefits questions for 8,500 employees. In Draft, a developer exported 200 conversation transcripts to troubleshoot a benefits action and pasted them into a shared prompt-tuning document. The transcripts include full names, SSNs, salary figures, and free-text medical-leave reasons. The assistant uses a watsonx.ai model through a private endpoint, and the Draft and Live environments share one knowledge-base collection. Analytics access is granted to 40 people in an HR-All group. A contractor with Draft access can edit actions and view logs. Legal has asked for a data-protection review before the assistant is enabled for all employees. The team wants to keep the transcripts because they show real user language and plans to use them in future prompt tests.
1. Assess the risks and immediate containment actions. Distinguish what must stop today from what can be fixed before go-live.
Read the worked answer
Risks: the shared document contains SSNs, salaries, and medical-leave reasons, which are high-sensitivity data and not necessary for prompt tuning. The 40-person HR-All analytics group and the contractor's Draft access widen the audience. A shared Draft and Live knowledge base means unreviewed content can leak. Using real transcripts in future prompt tests creates secondary-use and re-identification risk. Immediate containment: remove the shared document, revoke its link and copies, preserve a restricted audit copy, notify privacy and security, restrict analytics access to a named need-to-know group, suspend the contractor's Draft access pending review, and rotate any credentials exposed in transcripts. Stop all prompt-tuning work with real transcripts today. Before go-live: separate Draft and Live knowledge bases, redact or mask PII at ingestion, set retention, implement least-privilege roles, require approval for exports, and use synthetic or fully redacted transcripts for development. The distinction: stop the active exposure today; role redesign and environment separation can follow a documented plan before enablement.
2. Recommend controls for data minimization, access, retention, and environment separation, with rationale.
Read the worked answer
Data minimization: collect only fields the action needs; mask SSN and salary in logs; redact free-text medical reasons at ingestion; tokenize employee IDs. Use synthetic transcripts for prompt work. Access: separate roles for action editors, log viewers, analytics, and administrators; contractor access time-bound with MFA and an approved case; no broad HR-All analytics group. Retention: 30-90 days for conversation logs, purge exports after the task, and no PII in prompt documents. Environment separation: one-way promotion from Draft to Live, locked Live editing, and separate knowledge-base collections. Add DLP scanning for SSN patterns and outbound documents. Verify the watsonx.ai data-processing terms and private-endpoint configuration, but do not rely on contract alone; technical controls must stand. Rationale: reduce blast radius, make access auditable, and prevent sensitive data from being repurposed for model tuning. The control set should be testable: attempt to export a transcript, attempt to view analytics without a role, and verify redaction with a scripted sample.
3. How would you handle the shared document and any notification obligations? Include a decision framework, not legal advice.
Read the worked answer
Treat the shared document as a potential incident, not a housekeeping task. First preserve evidence in a restricted location; do not delete before knowing who accessed it. Determine exposure: document history, sharing links, download logs, recipients, duration, and whether the contractor or broader group opened it. Apply the organization's incident framework: data type and sensitivity, volume, likelihood of harm, contractual and regulatory obligations, and whether notification is required. Consult privacy and legal; this is not an engineering decision. Notify the privacy office and security incident response, document decisions, and set a remediation deadline. For future prompt tests, require a data-protection review and use synthetic data. If notification is required, coordinate messaging with legal and HR; do not contact affected employees from the assistant team. The exam point is to escalate and contain, not to self-judge that it was only internal.