The AI giant OpenAI has formed an Expert Council on Well-being and AI to bolster its safety measures after facing mounting scrutiny over how it protects users, particularly minors. The council will comprise eight members who will advise the company on designing safer responses in emotionally sensitive situations.

Background and Context

OpenAI has been expanding its safety controls in recent months as it has faced intense regulatory and public pressure following lawsuits and an ongoing FTC inquiry into how AI chatbots affect children and teens. The company is building an age prediction system that will automatically apply teen-appropriate settings for users under 18, and it launched a series of parental controls late last month.

The council's formation comes amid increasing scrutiny over the safety and societal effects of generative AI. OpenAI has been expanding its safety controls in recent months as it has faced mounting scrutiny over how it protects users, particularly minors. The company is building an age prediction system that will automatically apply teen-appropriate settings for users under 18, and it launched a series of parental controls late last month.

Why It Matters to the Industry

The formation of this council is significant for adult-industry platforms and operators as they grapple with similar challenges. The industry has long struggled with issues related to age verification, moderation, and content restrictions. OpenAI's efforts to develop safer responses in emotionally sensitive situations could have implications for how adult-content platforms approach user interactions.

The company's focus on designing AI systems that promote healthier interactions and better emotional support is also relevant to the industry. Adult-industry platforms often rely on AI-powered moderation tools to detect and remove harmful or non-consensual content. OpenAI's work in this area could lead to more effective and nuanced approaches to content moderation.

What Comes Next

The Expert Council on Well-being and AI will meet regularly with internal teams to examine how AI should function in complex or sensitive situations, advise on guardrails, and explore what constitutes well-being in human-AI interaction. The council's influence is already evident in OpenAI's parental controls and user-teen distress notifications.

OpenAI emphasizes that it remains accountable for its decisions but commits to ongoing learning through this council, the Global Physician Network, policymakers, and experts. The company notes that different age groups use AI tools differently, hence the need for tailored insights.

Key Facts

  • OpenAI has formed an Expert Council on Well-being and AI to bolster its safety measures after facing mounting scrutiny over how it protects users, particularly minors.
  • The council will comprise eight members who will advise the company on designing safer responses in emotionally sensitive situations.
  • OpenAI is building an age prediction system that will automatically apply teen-appropriate settings for users under 18.
  • The company launched a series of parental controls late last month, including notifications if a child shows signs of acute distress.
  • The Expert Council on Well-being and AI will meet regularly with internal teams to examine how AI should function in complex or sensitive situations.