The Federal Trade Commission has launched an inquiry into several social media and artificial intelligence companies about the potential harms to children and teenagers who use their AI chatbots as companions.

The FTC said Thursday it has sent letters to Google parent Alphabet, Facebook and Instagram parent Meta Platforms, Snap, Character Technologies, ChatGPT maker OpenAI and xAI.

The FTC said it wants to understand what steps, if any, companies have taken to evaluate the safety of their chatbots when acting as companions, to limit the products’ use by and potential negative effects on children and teens, and to apprise users and parents of the risks associated with the chatbots.

EDITOR’S NOTE — This story includes discussion of suicide. If you or someone you know needs help, the national suicide and crisis lifeline in the U.S. is available by calling or texting 988.

The move comes as a growing number of kids use AI chatbots for everything — from homework help to personal advice, emotional support and everyday decision-making. That’s despite research on the harms of chatbots, which have been shown to give kids dangerous advice about topics such as drugs, alcohol and eating disorders. The mother of a teenage boy in Florida who killed himself after developing what she described as an emotionally and sexually abusive relationship with a chatbot has filed a wrongful death lawsuit against Character.AI. And the parents of 16-year-old Adam Raine recently sued OpenAI and its CEO Sam Altman, alleging that ChatGPT coached the California boy in planning and taking his own life earlier this year.

Character.AI said it is looking forward to “collaborating with the FTC on this inquiry and providing insight on the consumer AI industry and the space’s rapidly evolving technology.”

“We have invested a tremendous amount of resources in Trust and Safety, especially for a startup. In the past year we’ve rolled out many substantive safety features, including an entirely new under-18 experience and a Parental Insights feature,” the company said. “We have prominent disclaimers in every chat to remind users that a Character is not a real person and that everything a Character says should be treated as fiction.”

Meta declined to comment on the inquiry and Alphabet, Snap, OpenAI and X.AI did not immediately respond to messages for comment.

OpenAI and Meta earlier this month announced changes to how their chatbots respond to teenagers asking questions about suicide or showing signs of mental and emotional distress. OpenAI said it is rolling out new controls enabling parents to link their accounts to their teen’s account.

Parents can choose which features to disable and “receive notifications when the system detects their teen is in a moment of acute distress,” according to a company blog post that says the changes will go into effect this fall.

Regardless of a user’s age, the company says its chatbots will attempt to redirect the most distressing conversations to more capable AI models that can provide a better response.

Meta also said it is now blocking its chatbots from talking with teens about self-harm, suicide, disordered eating and inappropriate romantic conversations, and instead directs them to expert resources. Meta already offers parental controls on teen accounts.

Share:
More In Technology
Tech leader who navigated the internet’s 90s crash weighs in on AI
Former Cisco Systems CEO John Chambers learned all about technology’s volatile highs and lows as a veteran of the internet’s early boom days during the late 1990s and the ensuing meltdown that followed the mania. And now he is seeing potential signs of the cycle repeating with another transformative technology in artificial intelligence. Chambers is trying take some of the lessons he learned while riding a wave that turned Cisco into the world's most valuable company in 2000 before a crash hammered its stock price and apply them as an investor in AI startups. He recently discussed AI's promise and perils during an interview with The Associated Press.
Tesla sales jump after months of boycotts
Tesla reported a surprise increase in sales in the third quarter as the electric car maker likely benefited from a rush by consumers to take advantage of a $7,500 credit before it expired on Sept. 30. The company reported Thursday that sales in the three months through September rose 7% compared to the same period a year ago. The gain follows two quarters of steep declines as people turned off by CEO Elon Musk’s foray into right-wing politics avoided buying his company’s cars and even protested at some dealerships. Sales rose to 497,099 vehicles, compared with 462,890 in the same period last year.
OpenAI now worth $500 billion, is the world’s most valuable startup
OpenAI could now be the world’s most valuable startup, ahead of Elon Musk’s SpaceX and TikTok parent company ByteDance, after a secondary stock sale designed to retain employees at the ChatGPT maker. Current and former OpenAI employees sold $6.6 billion in shares to a group of investors, pushing the privately held artificial intelligence company’s valuation to $500 billion, according to a source with knowledge of the deal who was not authorized to discuss it publicly. The valuation reflects high expectations for the future of AI technology and continues OpenAI’s remarkable trajectory from its start as a nonprofit research lab in 2015.
Load More