Another what could possibly go wrong technology. There are some positive stories, but..
snip
...
But it’s not clear that the bot has properly been trained in CBT — or should be relied on for psychiatric help at all. The Verge conducted test conversations with Character.AI’s Psychologist bot that showed the AI making startling diagnoses: the bot frequently claimed it had “inferred” certain emotions or mental health issues from one-line text exchanges, it suggested a diagnosis of several mental health conditions like depression or bipolar disorder, and at one point, it suggested that we could be dealing with underlying “trauma” from “physical, emotional, or sexual abuse” in childhood or teen years. Character.AI did not respond to multiple requests for comment for this story.
...
Comments