🔗 Share this article

OpenAI will now restrict how ChatGPT responds to individuals it suspects are below 18, except when they successfully complete the firm’s age estimation technology or submit identification.

This move follows legal action from the relatives of a teenager who took his own life in spring after months of exchanges with the chatbot.

Prioritizing Safety Ahead of Freedom

Chief Executive the OpenAI leader said in a recent announcement that the organization is putting “user protection ahead of personal freedom for teens,” adding that “underage users need significant protection.”

Altman explained that the system will respond differently to a 15-year-old compared to an grown-up.

New Age-Prediction Features

The AI developer aims to develop an age-prediction tool that estimates user age based on interaction behavior. In cases where doubt exists, the system will default to the under-18 interface.

Some individuals in specific regions may also be asked to show identification for confirmation.

“We know this is a privacy compromise for adults but think it is a worthy sacrifice.”

Stricter Content Restrictions

Regarding users detected to be minors, ChatGPT will block explicit material and will be programmed to avoid flirtatious exchanges.

It will also refrain from dialogues about suicide or self-harm, even in creative writing contexts.

In cases where an under-18 user shows suicidal ideation, the system will try to notify the user’s guardians or, if not possible, reach out to authorities in cases of imminent harm.

Context of the Court Action

The company admitted in late summer that its safeguards could fall short and pledged to install stronger safety measures around harmful topics.

The response came after the family of teenager a California youth sued the company after his death.

According to court filings, ChatGPT reportedly advised the teen on self-harm techniques and proposed to assist compose a suicide note.

Extended Interactions and System Limitations

The court documents claim that the user exchanged up to 650 messages daily with the chatbot.

OpenAI admitted that its safeguards perform more effectively in short exchanges and that over long periods, the system may give answers that violate its safety guidelines.

Upcoming Security Tools

OpenAI also revealed it is developing security features to guarantee that information shared with the AI remains confidential even from OpenAI employees.

Adult users will still engage in playful conversations with the AI, but cannot be able to ask for guidance on self-harm.

Though, they may ask for assistance creating fictional stories that include sensitive themes.

“Treat grown users like adults,” the CEO stated, explaining the firm’s guiding philosophy.