Who are these people? This is ridiculous. :)
I guess with so many humans, there is bound to be a small number of people who have no ability to think for themselves and believe everything a chat bot is writing in their web browser.
People even have romantic relationships with these things.
I dont agree with the argument that chat gpt should “push back”. They have an example in the article where the guy asked for tall bridges to jump from, and chat gpt listed them of course.
Are we expecting the llm to act like a psychologist, evaluating if the users state of mind is healthy before answering questions?
Very slippery slope if you ask me.
Counterpoint: it is NOT an unhealthy relationship. A relationship has more than one person in it. It might be considered an unhealthy behavior.
I don’t think the problem is solvable if we keep treating the Speak’n’spell like it’s participating in this.
Corporations are putting dangerous tools in the hands of vulnerable people. By pretending the tool is a person, we’re already playing their shell game.
But yes, the tool seems primed for enabling self-harm.
Like with every other thing there is: if you don’t know how it basically works or what it even is, you maybe should not really use it. And especially not voice an opinion about it. Furthermore, every tool can be used for self-harm if used incorrectly. You shouldn’t put a screwdriver in your eyes. Just knowing what a plane does won’t make you an able pilot and will likely result in dire harm too.
Not directed at you personally though.