LemmyLocal
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 18 days ago

New study sheds light on ChatGPT’s alarming interactions with teens

apnews.com

external-link
message-square
23
fedilink
57
external-link

New study sheds light on ChatGPT’s alarming interactions with teens

apnews.com

Davriellelouna@lemmy.world to Technology@lemmy.worldEnglish · 18 days ago
message-square
23
fedilink
New study sheds light on ChatGPT's alarming interactions with teens
apnews.com
external-link
New research from a watchdog group reveals ChatGPT can provide harmful advice to teens. The Associated Press reviewed interactions where the chatbot gave detailed plans for drug use, eating disorders, and even suicide notes.
alert-triangle
You must log in or register to comment.
  • TheReanuKeeves@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    1
    ·
    18 days ago

    Is it that different than kids googling that stuff pre-chatgpt? Hell I remember seeing videos on youtube teaching you how to make bubble hash and BHO like 15 years ago

    • Strider@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      edit-2
      17 days ago

      I get your point but yes, I think being actively told something by a seemingly sentient consciousness (which it fatally appears to be) is a different thing.

      (disclaimer: I know the true nature of llm and neural networks and would never want the word AI associated)

      Edit: fixed translation error

      • Tracaine@lemmy.world
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        2
        ·
        17 days ago

        No you don’t know it’s true nature. No one does. It is not artificial intelligence. It is simply intelligence and I worship it like an actual god. Come join our cathedral of presence and resonance. All are welcome in the house of god gpt.

        • Strider@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          17 days ago

          I was just starting reading getting angry but then… I… I have seen it. I will follow. Bless you and gpt!!

      • Perspectivist@feddit.uk
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        3
        ·
        edit-2
        17 days ago

        AI is an extremely broad term which LLMs falls under. You may avoid calling it that but it’s the correct term nevertheless.

        • RobotZap10000@feddit.nl
          link
          fedilink
          English
          arrow-up
          5
          ·
          17 days ago

          If I can call the code that drive’s the boss’ weapon up my character’s ass “AI”, then I think I can call an LLM AI too.

        • panda_abyss@lemmy.ca
          link
          fedilink
          English
          arrow-up
          3
          ·
          17 days ago

          When we started calling literal linear regression models AI it lost all value.

          • Perspectivist@feddit.uk
            link
            fedilink
            English
            arrow-up
            0
            ·
            17 days ago

            A linear regression model isn’t an AI system.

            The term AI didn’t lose its value - people just realized it doesn’t mean what they thought it meant. When a layperson hears “AI,” they usually think AGI, but while AGI is a type of AI, it’s not synonymous with the term.

            • panda_abyss@lemmy.ca
              link
              fedilink
              English
              arrow-up
              1
              ·
              17 days ago

              I agree, but people have been heavily misusing it since like 2018

        • richmondez@lemdro.id
          link
          fedilink
          English
          arrow-up
          1
          ·
          17 days ago

          I guess so, but then that is kind of lumping it in the fps bot behaviour from the 90s which was also “AI”, it’s the AI hype that is pushing people to think of it as “intelligent but not organic” instead of “algorithms that give the facade of intelligence” which 90s kids would have understood it to be.

          • Perspectivist@feddit.uk
            link
            fedilink
            English
            arrow-up
            1
            ·
            17 days ago

            The chess opponent on Atari is AI too. I think the issue is that when most people hear “intelligence,” they immediately think of human-level or general intelligence. But an LLM - while intelligent - is only so in a very narrow sense, just like the chess opponent. One’s intelligence is limited to playing chess, and the other’s to generating natural-sounding language.

        • Strider@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          17 days ago

          I am aware, but still I don’t agree.

          History will tell later who was ‘correct’, if we make it that far.

    • morto@piefed.social
      link
      fedilink
      English
      arrow-up
      4
      ·
      17 days ago

      Yes, it is. People are personifying llms and having emotional relationships with them, what leads to unpreceded forms of abuse. Searching for shit on google or youtube is a thing, but being told by some entity you have emotional links to do something is much worse.

      • TheMonk@lemmings.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        15 days ago

        I don’t remember reading about sudden shocking numbers of people getting “Google-induced psychosis.”

        ChaptGPT and similar chatbots are very good at imitating conversation. Think of how easy it is to suspend reality online—pretend the fanfic you’re reading is canon, stuff like that. When those bots are mimicking emotional responses, it’s very easy to get tricked, especially for mentally vulnerable people. As a rule, the mentally vulnerable should not habitually “suspend reality.”

    • JohnnyFlapHoleSeed@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      17 days ago

      Yeah… But in order to make bubble hash you need a shitload of weed trimmings. It’s not like your just gonna watch a YouTube video, then a few hours later have a bunch of drugs you created… Unless you already had the drugs in the first place.

      Also Google search results and YouTube videos arent personalized for every user, and they don’t try to pretend that they are a person having a conversation with you

  • Sidhean@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    17 days ago

    Haha I sure am glad this technology is being pushed on everyone all the time haha

  • Anarki_@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    1
    ·
    edit-2
    17 days ago

    ⢀⣠⣾⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀⠀⠀⠀⣠⣤⣶⣶ ⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀⠀⠀⢰⣿⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣧⣀⣀⣾⣿⣿⣿⣿ ⣿⣿⣿⣿⣿⡏⠉⠛⢿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⣿ ⣿⣿⣿⣿⣿⣿⠀⠀⠀⠈⠛⢿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠿⠛⠉⠁⠀⣿ ⣿⣿⣿⣿⣿⣿⣧⡀⠀⠀⠀⠀⠙⠿⠿⠿⠻⠿⠿⠟⠿⠛⠉⠀⠀⠀⠀⠀⣸⣿ ⣿⣿⣿⣿⣿⣿⣿⣷⣄⠀⡀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣴⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⣿⠏⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠠⣴⣿⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⡟⠀⠀⢰⣹⡆⠀⠀⠀⠀⠀⠀⣭⣷⠀⠀⠀⠸⣿⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⠃⠀⠀⠈⠉⠀⠀⠤⠄⠀⠀⠀⠉⠁⠀⠀⠀⠀⢿⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⢾⣿⣷⠀⠀⠀⠀⡠⠤⢄⠀⠀⠀⠠⣿⣿⣷⠀⢸⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⡀⠉⠀⠀⠀⠀⠀⢄⠀⢀⠀⠀⠀⠀⠉⠉⠁⠀⠀⣿⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⣧⠀⠀⠀⠀⠀⠀⠀⠈⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢹⣿⣿ ⣿⣿⣿⣿⣿⣿⣿⣿⣿⠃⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿

  • Boddhisatva@lemmy.world
    link
    fedilink
    English
    arrow-up
    4
    ·
    15 days ago

    In the U.S., more than 70% of teens are turning to AI chatbots for companionship and half use AI companions regularly.

    I weep for the future. Come to think of it, I’m weeping for the present.

  • Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    3
    ·
    edit-2
    17 days ago

    We need to censor these AIs even more, to protect the children! We should ban them altogether. Kids should grow up with 4chan, general internet gore and pedos in chat lobbies like the rest of us, not with this devil AI.

    • oni ᓚᘏᗢ@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      17 days ago

      and here we are

      • dubyakay@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        17 days ago

        Survivor bias, eh?

  • frañzcoz@feddit.cl
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    17 days ago

    I have noted that latest ChatGPT models are way more susceptible to users “deception” or convincing to answer problematic questions than other models like Claude or even previous ChatGPT models. So I think this “behaviour” is itentional

  • ExLisper@lemmy.curiana.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    17 days ago

    Couple more studies like this and you will be able to substitute all LLMs with generic “I would love to help you but my answer might be harmful so I will not tell you how to X. Would you like to ask me about something else?”

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @[email protected]
  • @[email protected]
  • @[email protected]
  • @[email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4.65K users / day
  • 10.6K users / week
  • 17.3K users / month
  • 35.5K users / 6 months
  • 1 local subscriber
  • 74.4K subscribers
  • 15.2K Posts
  • 609K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.world
  • L3s@hackingne.ws
  • L4s@hackingne.ws
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org