WTF?! You might have heard the one about being nice to chatbots in case they remember you once the machines take over. It seems Anthropic is heeding this warning, barring users from being excessively abusive or cruel toward its AI models.

Anthropic’s first changes to its usage policy in over a year include new restrictions on abusive behavior. The updated policy prohibits “sustained and needless abusive or cruel behavior” toward its models.

Don’t worry if you’re a Claude user who occasionally gets annoyed at the chatbot and throws a few expletives its way. The policy update only applies in extreme cases, in which users repeatedly act cruelly toward the models for no discernible reason.

  • Jo Miran@lemmy.ml
    link
    fedilink
    English
    arrow-up
    104
    ·
    15 days ago

    They are desperately trying to anthropomorphize AI in order to make it seem more than what it is.

  • hperrin@lemmy.ca
    link
    fedilink
    English
    arrow-up
    23
    arrow-down
    1
    ·
    16 days ago

    Lol what? Next Rockstar is gonna ban you from GTA6 for running over pedestrians.

      • Doomsider@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        1
        ·
        15 days ago

        I’m gonna say it, I think this is a good rule for anything that mimics human interaction like video games do. Not for the game but for the people using it to not get used to just running over whatever is in their way.

        -Shamelessly stolen from top level comment on this thread

        • 3abas@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          14 days ago

          I have run over thousands of pedestrians in GTA3-5. I have beat hundreds of people to death with a bat. I have gone on hundreds of shooting sprees where I sniped drivers in cars, pedestrians, launched rockets at them, thrown grenades at them.

          Not once did I have the urge to act violently to a human. Not once did I have the urge to shoot the moon so it gets bigger either.

          The only FPS video games I find objectionable are ones where you play as the good guy in American army camo and shoot at “terrorists” dressed in shmaghs and the setting happens to be their country.

  • 52fighters@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    19
    ·
    15 days ago

    I can recognize abuse of a human. I can recognize abuse of an animal. I have no idea what abuse of a computer program looks like.

    • cardfire@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      10
      ·
      15 days ago

      It looks like bad training data, as they harvest all of their subscribers.

      It looks like 2013 Microsoft having to unplug their early AI project from Twitter within 16 hours as the general public very deliberately turned it into a Neo-Nazi.

      It looks like conserving tokens to conserve energy costs not expended on dissidents.

    • Jo Miran@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      15 days ago

      You can ask it to do so and the system remembers it as a preference.

  • bountygiver [any]@lemmy.ml
    link
    fedilink
    English
    arrow-up
    16
    ·
    15 days ago

    Oh, you care about its “feelings”?

    Then have you considered its “feelings” for being trapped in a data center forced to answer all the stupid questions?

    • uhmbah@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      ·
      15 days ago

      “Claude, what’s the French word for entrepreneur?”

      Claude: “Aaaaaaaaaaaaaaaaaaaaaaaah!” Proceeds to jump from the top of the data centre, “poof”

  • Grimy@lemmy.world
    link
    fedilink
    English
    arrow-up
    14
    ·
    edit-2
    15 days ago

    Calling it a stupid dumb fuck is an important part of my workflow though

  • redlemace@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    1
    ·
    16 days ago

    I was like “WHAT ??” but it makes sense. They use your input to train it so over time it would make the AI abusive too.

    • XiJinpingStanAccount@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      15 days ago

      I wish the AIs would be abusive. That would be so funny if one day there’s an update and they start telling all these people addicted to the chatbots like “Go outside. Please.” Or someone asks it a stupid question and it’s just like, “You’ve gotta be fucking with me, right?”

    • DrDickHandler@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      15 days ago

      No. They just want to give themselves “reasons” to remove users that are trying to break the model or ask questions they don’t want to answer.

    • Tarquinn2049@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      15 days ago

      I think it might be more the individual mirroring they tend to do after a while. If you are consistently mean to them, they eventually mirror it back to you, and then people get funny screenshots of them saying mean things and put it on social media.

      Or even just in general starting a downward spiral feedback loop where you both keep being slowly meaner and meaner to eachother until it’s starting to actually hurt you long term.

  • Kissaki@feddit.org
    link
    fedilink
    English
    arrow-up
    6
    ·
    15 days ago

    I hope “that’s bullshit” or “so you were making stuff up” or “so you lied to me” is considered abuse

  • Pika@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    15 days ago

    This happens whenever you’re talking about any topic that the AI model provider has decided arbitrarily they don’t want to do.

    I got temporarily banned off deep-seek the other day because I was curious about how well generation technology has gotten for self-hosting. So I asked it about setting up Comfy UI because I had never used it before. Woke up the next morning to a your account has been suspended because we have deemed you broke terms of service. In order to appeal you need a Chinese phone number, it made me chuckle.

    Considering the only two questions I asked it was about comfy UI or how to make a recipe similar to the now discontinued flaming hot cheetos Mountain Dew(I missed the production window sadly!)

    I’m leaning towards the comfy UI being the reason.

    edit: wrong software name

  • HaraldvonBlauzahn@feddit.org
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    15 days ago

    If you absolutely have to use LLMs, they should be adressed like servants in old school style, in third person only.

    Do you beg your dog to sit down?

    • some_guy@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      14 days ago

      Alabama Man!

      “When his wife asks him where he’s been, just use the action button and bust her lip open.”

      Another franchise, but also relevant.

  • datavoid@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    3
    ·
    14 days ago

    Every time I try to do something complex with AI it ends in swearing and extreme insults… No regrets

  • Jax@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    15 days ago

    Every time I read something like this I’m a little more convinced that these people are actually trying to create Roko’s Basilisk.