In a lawsuit filed by Megan Garcia, whose 14-year-old son died by suicide over a year ago, has blamed Google and an artificial intelligence firm for her son’s death. “He would still be alive today if it weren’t for a chatbot urging him to take his own life,” she told Bloomberg.
In a 116 page-long lawsuit, Garcia has sought unspecified monetary damages from Google and Character Technologies. She has also asked the court to order warnings that the platform isn’t suitable for minors and limit how it can collect and use their data.
Garcia’s allegations
Garcia called her son Sewell Setzer III a promising high school student athlete. According to her, all this changed in April 2023 when he started role-playing on Character.AI, which lets users build chatbots that mimic popular culture personalities – both real and fictional.
“Google contributed financial resources, personnel, intellectual property, and AI technology to the design and development” of Character.AI’s chatbots,” Garcia said in her complaint.
The suit also alleged the Alphabet unit helped market the startup’s technology through a strategic partnership in 2023 to use Google Cloud services to reach a growing number of active Character.AI users — which is now more than 20 million.
Garcia said she wasn’t aware that over the course of several months, the app hooked her son with “anthropomorphic, hypersexualized and frighteningly realistic experiences” as he fell in love with a bot inspired by Daenerys Targaryen, a character from the show Game of Thrones.
Google’s response
Both companies, Google and Character Technologies, have asked the judge to dismiss claims that they failed to ensure the chatbot technology was safe for young users, arguing there’s no legal basis to accuse them of wrongdoing.
Character Technologies contended in a filing that conversations between its Character.AI platform’s chatbots and users are protected by the US Constitution’s First Amendment as free speech. It also argued that the bot explicitly discouraged Garcia’s son from committing suicide.
A Character.AI spokeswoman declined to comment on pending litigation but said ‘there is no ongoing relationship between Google and Character.AI” and that the startup had implemented new user safety measures over the past year, Bloomberg report said.
