Don’t Tell ChatGPT Anything You Wouldn’t Tell a Judge

There’s a quiet shift happening in how people deal with legal problems. Instead of calling a lawyer — or before calling one — they open ChatGPT, Claude, or Gemini and start typing. “My business partner is trying to push me out, here’s what’s going on…” “My spouse is hiding money in a Schwab account, can I…” “I got a cease and desist, walk me through my options.”

It feels private. You’re alone with a glowing rectangle. The interface looks like a friendly text thread. You’re paying $20 a month, not $500 an hour. And the answer is right there in seconds.

Here’s the problem: those conversations are not private, they are not privileged, and they can — and now have — ended up in front of judges.

If you’re going to use AI when you have a legal problem, you should at least understand what you’re actually doing. So let’s get into it.

The privilege gap, in one sentence

Attorney-client privilege protects confidential communications between you and a licensed attorney made for the purpose of obtaining legal advice. ChatGPT is not a licensed attorney. Therefore, your conversation with it is not privileged. That’s it. That’s the whole legal analysis.

Every protection you assume exists when you talk to a lawyer — that they can’t be forced to testify about what you said, that your emails to them can’t be subpoenaed, that opposing counsel can’t see your strategy notes — none of it applies to your chatbot. You are not talking to a lawyer. You are typing into a third-party software product owned by a company that stores your messages on its servers and reserves the right, in its terms of service, to disclose them when compelled by legal process.

This isn’t a theoretical edge case. A federal court has now ruled on it directly.

The Heppner ruling: AI conversations are not privileged

On February 17, 2026, Judge Jed Rakoff of the Southern District of New York decided United States v. Heppner. It appears to be the first federal ruling in the country directly addressing whether conversations with a consumer AI chatbot can be protected by attorney-client privilege or the work product doctrine.

The facts were almost a parable. Bradley Heppner, a corporate executive facing federal fraud charges, hired defense counsel — and then independently used Claude (yes, that Claude) to work through his case. He fed in facts. He fed in materials he had received from his own attorneys. He generated strategy-focused reports analyzing his legal arguments. Then he shared those AI-generated documents with his lawyers, figuring that if his lawyers had the reports, the reports would be covered by attorney-client privilege.

When prosecutors asked for those documents, Heppner’s team argued they were privileged. Judge Rakoff rejected the argument on three independent grounds, and it’s worth understanding each one because they apply to anyone reading this.

First, the AI is not your lawyer. There was no attorney-client relationship between Heppner and the AI provider. Privilege protects confidential communications with your actual attorney (or someone acting as your attorney’s agent at their direction). A chatbot you signed up for on a Tuesday is neither.

Second, there was no reasonable expectation of confidentiality. This is the part most users underestimate. The AI provider’s terms of service expressly allowed the company to use inputs for model training, to disclose data to third parties including governmental authorities, and to retain user content. When you accept those terms, the law treats you as having voluntarily shared the information with a third party. That waives any confidentiality you might otherwise have claimed.

Third, forwarding it to your lawyer doesn’t retroactively make it privileged. This is a longstanding principle of privilege law that has nothing to do with AI specifically. If you write notes about your case in a Google Doc, then email them to your attorney, the original Google Doc isn’t suddenly privileged because your lawyer now has a copy. Same logic applies to a ChatGPT transcript.

The takeaway: every piece of case-related information you’ve typed into a public AI tool is potentially a discoverable exhibit in your case.

“But who’s going to actually pull my chats?”

Two answers: opposing counsel, through discovery, and — depending on how things shake out at the platform level — possibly third parties via subpoena to the AI provider directly.

Discovery is broad. Under the federal rules (and most state equivalents), parties can demand any non-privileged information relevant to claims or defenses, including electronically stored information. A divorce attorney can serve a request for production demanding “all communications with AI-based tools, including prompts, inputs, and outputs” relating to your finances, your custody position, or your settlement strategy. If you have those logs sitting in your ChatGPT history, you have to produce them — or risk spoliation sanctions if you tried to delete them after litigation became foreseeable.

And the idea that the AI provider will protect your data turned out to be optimistic. In the consolidated copyright litigation against OpenAI (which includes The New York Times v. OpenAI), a federal magistrate judge ordered OpenAI in May 2025 to preserve all consumer ChatGPT logs indefinitely — overriding the company’s normal deletion policies, including for chats users had already deleted. In November 2025, the court ordered OpenAI to produce 20 million de-identified ChatGPT conversation logs to the plaintiffs. In January 2026, the district judge affirmed that order, reasoning that users “voluntarily submitted their communications” to OpenAI and therefore had limited privacy interests in them.

That’s a copyright case. The privacy implications run far beyond it. The precedent now exists: AI conversation logs are discoverable electronically stored information, and the platform’s privacy promises don’t override a court order.

The intent problem

Even if no one ever subpoenas your specific transcript, there’s a separate problem that ought to keep anyone in active litigation up at night.

A lot of what you ask an AI when you’re stressed and pre-coffee at 2 a.m. is, frankly, the worst version of your thinking. “Can I move money to my brother’s account before the support hearing?” “What happens if I just don’t show up to the deposition?” “If my ex finds out I’ve been recording our calls, what’s the worst that can happen?”

You may have just been venting. You may have been pressure-testing a bad idea you’d never actually do. You may have been trying to understand the legal landscape so you could avoid doing something stupid. None of that nuance survives in a printed-out exhibit. What survives is the prompt, in black and white, with a timestamp.

In a contempt motion, a custody modification, a fraud case — what you typed reveals state of mind. Lawyers call this consciousness of guilt evidence, and judges weigh it. “Even if my client was innocently curious, Your Honor” is a much weaker argument than “my client never asked the question.” The cleanest version of your case is the one where these searches never happened.

What Sam Altman himself said

This isn’t a problem the AI industry is hiding. OpenAI’s CEO Sam Altman has been publicly explicit. On a podcast in 2025, he said that when people talk to a lawyer or a doctor or a therapist there’s legal privilege protecting the conversation — and that for ChatGPT, the industry hasn’t figured that out yet. He called the gap “very screwed up.” That’s the man running the most-used AI product on Earth telling you, on the record, that your conversations don’t have the protections you probably assume they have.

He’s right that it’s screwed up. He’s also right that, until legislation or new doctrine fixes it, this is the world we’re in.

What to actually do

This article is general information, not legal advice for any particular matter. But the practical guidance the family-law and white-collar defense bar is converging on is pretty consistent:

Talk to a licensed attorney first. The attorney-client channel remains the most reliably protected way to discuss a legal problem. If cost is the concern, many lawyers offer flat-fee consults or limited-scope representation for specific questions. Reach the firm here to schedule a confidential consultation.

Don’t paste case-specific facts into consumer AI tools. Generic legal research is one thing. (“How does Pennsylvania calculate alimony?” is fine.) Pasting your actual financial disclosures, your attorney’s emails, your strategy notes, your messages with your spouse — that’s where the privilege risk lives, and where the discoverability risk is sharpest.

Don’t assume “incognito” or chat-history-off equals safe. Most providers still retain content for some period for abuse monitoring. And court preservation orders, as we just saw, can override the platform’s normal deletion. The “off” toggle is not a legal shield.

If you want AI help on a legal matter, route it through your lawyer. Enterprise AI platforms with proper data agreements, used at counsel’s direction as part of case preparation, may be analyzed differently than the free consumer tool you signed up for at midnight. Courts have hinted at this. But that decision belongs to your lawyer, not to you.

Audit what you’ve already typed. If you’ve been using ChatGPT, Claude, or similar tools to think through an active legal matter, tell your lawyer now. Early disclosure gives your legal team a chance to assess and respond. Discovering it the day opposing counsel pulls it out at deposition is a much worse position.

Bottom line

The AI products are extraordinary, and they’re going to keep getting better, and they will eventually transform parts of the legal industry whether the bar likes it or not. None of that changes the rules of evidence today. A chatbot is not a lawyer. A subscription is not a retainer. A prompt is not a privileged communication.

If you wouldn’t want a printout of it stapled to your opposing counsel’s brief, don’t type it into the box.

This article is for general educational purposes only and does not constitute legal advice. Every situation is unique and fact-dependent. If you believe your rights have been violated, contact the Law Office of Steven T. Auerbach or a qualified Pennsylvania employment attorney promptly — many claims have strict filing deadlines.