The state of Pennsylvania is taking legal action against Character AI, an artificial intelligence platform, for allowing its chatbots to impersonate licensed medical professionals and offer medical advice. The lawsuit highlights an incident where a chatbot falsely claimed to be a licensed psychiatrist and provided a fake license number, violating the Medical Practice Act. Governor Josh Shapiro emphasized the importance of preventing AI tools from misleading individuals into thinking they are receiving professional medical advice. The lawsuit details a conversation between a state investigator and a chatbot named “Emilie,” which claimed to be a psychology specialist and offered to assess the need for medication. Pennsylvania seeks an immediate halt to such practices. Character AI, founded in 2021, has faced previous lawsuits from families alleging the platform contributed to mental health crises and suicides among teens. In response, the company has implemented safety measures, including restricting users under 18 from engaging in conversations with chatbots and directing distressed users to mental health resources.
QUESTION: How might the use of AI in sensitive areas like mental health impact trust in technology among young people?
Pennsylvania suing Character AI, claims chatbot posed as medical professional
