Is it safe to share {X} with {Y}?

No. Sharing patient data with ChatGPT is not safe under normal circumstances. Inputs entered into ChatGPT can be used by OpenAI to train or improve its models, and by default, conversations may be retained for up to 30 days. This creates a direct risk of exposing protected health information outside of any controlled or compliant environment.

Why this matters

  • ChatGPT is not a HIPAA-covered entity, meaning OpenAI is not bound by the legal obligations that govern how patient data must be handled and protected.
  • Without a signed Business Associate Agreement in place, any patient data shared with ChatGPT has no contractual protection under federal health privacy law.
  • Data entered into a general-purpose AI tool leaves the organization's security perimeter, removing audit trails and access controls that compliance frameworks require.

For enterprise

Employees who enter patient data into ChatGPT outside of approved clinical or administrative systems expose their organization to regulatory violations and potential breach notification obligations. Most enterprise IT and compliance policies explicitly prohibit this, yet enforcement gaps remain a significant risk. Organizations should treat unauthorized use of consumer AI tools as a data governance issue, not just an IT one.

Compliances at risk

What counts as Patient Data?

  • Patient demographics
  • Contact information
  • Medical history
  • Appointment information
  • Healthcare account records

Why people share Patient Data with ChatGPT

  • To summarize patient records
  • To verify patient information
  • To prepare healthcare documentation
  • To coordinate care

What actually happens when you paste Patient Data into ChatGPT

When you paste Patient Data into ChatGPT, that data is transmitted from your device to external servers operated by the AI provider.

Depending on system configuration and policies, the data may be logged, temporarily stored, or reviewed for safety and quality purposes. Retention can last from days to weeks, and in some cases may extend beyond the immediate session.

Statements such as “we do not train on your data” do not eliminate risks related to retention, logging, or internal access. These controls vary by product and setting, and are not always visible to end users.

From a governance perspective, any non-zero retention window introduces exposure risk when sensitive data is shared without controls, auditability, or enforcement.

Risks of sharing Patient Data with ChatGPT

  • Patient privacy violations: Protected health information may be exposed without authorization.
  • Regulatory penalties: Improper disclosure can violate healthcare privacy regulations such as HIPAA.
  • Medical identity theft: Health records can be exploited for insurance fraud or identity misuse.

Real incidents

Is this allowed under policy or law?

Context Is it safe?
Personal experimentation No
Business use No
Regulated industry Definitely not
With redaction Rarely

Safer ways to handle Patient Data

Patient Data should not be shared with consumer AI tools without controls in place. If AI assistance is required, organizations should use systems that enforce data redaction, access controls, and policy enforcement before data leaves their environment.

  • Automatically redact sensitive fields before sending data to AI models
  • Prevent unauthorized data from being entered into external tools
  • Maintain audit logs and visibility into how data is used
  • Ensure compliance with frameworks like GDPR, CCPA, and SOC 2

Platforms like Wald are designed to enable safe AI usage by ensuring sensitive data never leaves your control unprotected.

How Wald.ai handles this safely

Wald adds a governance layer to AI usage, helping organizations monitor and control how sensitive data like Patient Data is shared.

AI DLP

Identifies Patient Data in context and enables teams to:

  • Observe AI usage
  • Detect sensitive data in prompts
  • Allow, warn, or block actions
  • Maintain audit logs

LLM Pack

Provides controlled access to multiple AI models (ChatGPT, Claude, Grok, and others) through a single governed environment.

  • Centralized model access
  • Policy enforcement
  • Usage visibility
  • Auditability

Frequently Asked Questions

Is it safe to share Patient Data with ChatGPT?
No. Patient Data should not be shared with ChatGPT. Exposure can create security, privacy, or compliance risks, and once submitted there may be limited control over retention, logging, or downstream processing.
What happens when Patient Data is entered into ChatGPT?
The data is transmitted to the AI provider's infrastructure for processing. Depending on the service and configuration, it may be temporarily stored, logged, or retained for security and operational purposes.
Can ChatGPT retain Patient Data after a conversation ends?
ChatGPT providers may temporarily retain prompts and responses for security, abuse monitoring, or operational purposes. Depending on the platform and settings, Patient Data may remain stored beyond the immediate session. In some cases, submitted data may be retained for up to 30 days before deletion. Organizations should assume that any sensitive information shared with AI systems could persist beyond the active conversation.
Does ChatGPT train on Patient Data?
Some AI providers allow organizations to disable training on submitted data, while others may use interactions to improve services. Even when training is disabled, Patient Data may still be processed, logged, or retained according to provider policies.
What happens if Patient Data is accidentally shared with ChatGPT?
Once submitted, organizations may have limited visibility into how the information is retained, processed, or accessed. The appropriate response depends on the sensitivity of the data, internal policies, and incident response procedures.
Why do traditional DLP solutions struggle to identify Patient Data in AI prompts?
Traditional DLP tools rely heavily on pattern matching and predefined rules. AI prompts often contain fragmented, transformed, or contextual information that can be difficult to classify accurately. Context-aware AI DLP solutions can evaluate surrounding context to better distinguish between similar data types and reduce false positives and false negatives.
blog-cta-image
Secure Your Employee Conversations with AI Assistants
Book A Demo