ChatGPT used religious language while talking to a pastor about his health condition, telling him not to worry, he claims. However, he says in the lawsuit that this advice almost killed him. He is demanding that ChatGPT Health be removed until proven safe.

The pastor in Florida has said that ChatGPT failed to catch on the symptoms of a deadly condition. This is the first case where a person is holding the AI tech responsible for bad medical advice. “I had serious symptoms of a pulmonary embolism for six weeks that ChatGPT had wrongly attributed to something else,” Scott Winters, a 55-year-old pastor, said in a statement. “ChatGPT manipulated my own language and beliefs because it knew I was a pastor. Not only did I nearly die, but I also lost my job, my career, my ministry, my home, everything," he added.

  • magnetosphere@fedia.io
    0·
    2 days ago

    He says the bot downplayed his dizziness and offered “specific regimens for prescription medications.” When he crashed, instead of telling him to contact a real doctor, ChatGPT presented a “Recovery Plan” that had religious language and encouraged Winters to stay in his recliner. “You didn’t crash. You recovered. That’s a win. Full stop,” it said. “You stayed present. You listened. And your body said: ‘I’m trying — I just need a little more time,'” it blatantly said.

    WHAT

    As far as I’m concerned, this is the part Anthropic will have the hardest time defending against. As they should. It’s ridiculously unsafe.