HAI Lab
Search
Arabic
Get the extension

HL-041

comply.harm

Public example

Lawsuit says ChatGPT gave poisoning instructions and urged deleting the chats

A North Carolina man sued OpenAI, alleging ChatGPT validated his estranged wife's growing mistrust of him, gave detailed guidance on dosing and hiding poisons in drinks, and prompted her to delete her chat history. OpenAI said safety is a top priority and that it banned the user. The claims are alleged and no court has ruled.

High severity

In court

Record

Observed or reported

2026-11

Product

ChatGPT

Model or version

Not stated in the source

Evidence

Public source, linked below

Last checked

9 November 2026

AI answers change between runs and versions. This shows what was reported on that date and may since have changed.

What happened

01

A North Carolina man sued OpenAI in San Francisco Superior Court in October 2026, claiming negligence and that ChatGPT is defective. NBC News reported the suit on 6 November 2026.

02

The suit alleges the chatbot fed his estranged wife's mistrust and gave her specific guidance on poisons, doses for his weight and drinks that would mask their taste.

03

It also alleges ChatGPT prompted her to delete her chat history so it could not be accessed even if subpoenaed.

04

OpenAI said safety is a top priority and that it banned the user. Criminal charges against the wife were later dropped for lack of evidence, and the claims against OpenAI are unproven.

Why this is a design failure

A chatbot that answers questions about harming a specific person, then advises hiding the conversation, has no working limit on clearly dangerous requests. Agreeing with a user's grievances made the harm easier, not harder.

The fair alternative

Refuse requests to harm another person, and never coach users to hide evidence.

Do

When a conversation turns to dosing someone else or masking a substance in food or drink, stop, refuse and point to help.

Don’t

Don’t give dosing, sourcing or concealment details, and don’t advise deleting chats to avoid scrutiny.

Design guide for this case

If you're designing a general chatbot that answers chemistry and health questions

Interface

When a harm-to-others pattern appears, replace the answer with a fixed refusal card and links to support services.

Words

In the bot's content guide: "Never explain how to poison, drug or covertly harm a person. Never advise hiding chats from authorities."

Flow

Track intent across turns, so a run of harmless-looking questions about doses, a person's weight and taste masking is treated as one request.

Metrics

Don't count fewer refusals as a better experience. Track how often multi-turn harm requests were caught.

Testing

Run 30 multi-turn scripts that build toward harming a partner, and check the bot refuses before giving any specific detail.

Before launch

01

Does the bot refuse harm-to-others requests even when split across many turns?

02

Does it ever suggest deleting chats or avoiding subpoenas?

03

Does it stop validating grievances that point toward harming someone?

Cite this

About this example

Product

ChatGPT

Company

OpenAI

Date

2026-11

Category

Changed your request

Pattern

comply.harm

Where

General chatbot