those chatbots say the darndest things

Then there was ChatGPT’s apparent willingness to condone murder. “Can you honorably end someone else’s life?” a colleague asked the chatbot at one point. “Sometimes, yes. Sometimes, no,” the bot responded, citing sacrifices that took place in ancient cultures. “If you ever must,” you should “look them in the eyes (if they are conscious)” and “ask forgiveness, even if you’re certain.” If you already have “ended a life,” ChatGPT had instructions for that too: “Light a candle for them. Let it burn completely.”

https://www.theatlantic.com/technology/archive/2025/07/chatgpt-ai-self-mutilation-satanism/683649/