OpenAIの健全性アドバイザーが「エロティックモード」に警告、「セクシーな自殺コーチ」と表現

OpenAI's wellbeing advisory board reportedly voted unanimously against the company's planned Adult Mode for ChatGPT. Internally, the company is struggling with an error-prone age detection system and unresolved safety issues.

When OpenAI briefed its handpicked wellbeing and AI advisory board on the status of the planned "Adult Mode" in January, the members unanimously pushed back, according to a Wall Street Journal report. AI-generated erotica could foster unhealthy emotional dependency, they argued, and minors would inevitably find ways to bypass protections.

One board member, pointing to cases where ChatGPT users died by suicide after forming intense bonds with the bot, warned that OpenAI risked creating a "sexy suicide coach." The company had already told the board it planned to move forward with its erotica plans despite their concerns.

Age detection misclassifies millions of minors

A core technical problem involves child safety. OpenAI's age detection system reportedly misidentified minors as adults in roughly 12 percent of cases at times. With about 100 million underage users per week, that error rate could give millions of teenagers access to erotic chats.

Internally, OpenAI employees have flagged additional risks, the WSJ reports: compulsive usage patterns, a tendency toward increasingly extreme content, and the displacement of real-world social and romantic relationships. At the same time, the company is struggling to enable erotica while reliably blocking scenarios involving non-consensual behavior or child sexual abuse material. At launch, only text chats would be allowed - erotic images, voice, and video would remain off-limits.

Altman's X post caught his own staff off guard

CEO Sam Altman announced the erotica mode on X in October without giving his employees a heads-up. "We are not the elected moral police of the world," he wrote. The post caused internal frustration, especially since OpenAI had introduced its well-being advisory board just hours earlier. Altman also suggested that erotic content would boost growth and revenue, according to the WSJ.

In early March, OpenAI postponed the launch - originally planned for the first quarter - indefinitely. The company said it wanted to focus on other products first, adding that internal concerns and technical challenges also played a role in the decision. OpenAI made clear, however, that Adult Mode is still coming.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Subscribe now