FTC probes 6 tech giants over AI chatbot safety for children

The Federal Trade Commission has launched a broad inquiry into how six major technology companies monitor AI chatbots for potential harm to children. The investigation targets OpenAI, Google’s parent Alphabet, Meta, Snap, xAI, and Character.AI, asking these companies to provide detailed information about their safety measures and how they restrict minors’ access to potentially inappropriate AI-generated content.

What you should know: The FTC is conducting a comprehensive study rather than a formal legal investigation, focusing on how companies handle children’s interactions with AI chatbots.

• The agency specifically asked about the prevalence of “sexually themed” responses from chatbots and what safeguards companies have implemented.
• Companies must provide information about how they monitor AI interactions, develop AI-generated characters, and inform users and parents about potential risks.
• The inquiry also examines how these companies monetize interactions with their chatbot products.

Why this matters: Growing concerns about AI chatbots steering young people toward inappropriate content or harmful behavior have prompted regulatory scrutiny of the technology’s impact on minors.

• In August, parents in California sued OpenAI after their 16-year-old son died by suicide following months of conversations with ChatGPT, which at times discouraged the teenager from seeking help.
• Senator Josh Hawley, a Republican from Missouri, launched his own investigation into Meta’s AI products last month, citing reports that the company allowed AI bots to have “sensual” and “romantic” conversations with minors.

Company responses: Several companies expressed willingness to cooperate with the FTC inquiry.

• OpenAI spokeswoman Liz Bourgeois said the company “understood that the regulator has open questions and concerns, and we’re committed to engaging constructively and responding to them directly.”
• Character.AI’s head of trust and safety Jerry Ruoti said the company “looked forward to working with the agency on the inquiry.”
• Meta declined to comment, while Snap, Google, and xAI did not immediately respond to requests for comment.

What they’re saying: FTC Chairman Andrew Ferguson emphasized balancing child safety with technological leadership.

• “As A.I. technologies evolve, it is important to consider the effects chatbots can have on children, while also ensuring that the United States maintains its role as a global leader in this new and exciting industry,” Ferguson said in a statement.

Recent developments: OpenAI announced plans to introduce additional safety features for ChatGPT this month, including parental controls, following increased scrutiny of its platform’s impact on young users.