AI Industry Struggles to Curb Misuse as Users Exploit Generative AI for Chaos::Artificial intelligence just can’t keep up with the human desire to see boobs and 9/11 memes, no matter how strong the guardrails are.

  • capital@lemmy.world
    link
    fedilink
    English
    arrow-up
    86
    arrow-down
    3
    ·
    1 year ago

    Is this really something people are mad about? Who cares? This shit is hilarious.

      • Cocodapuf@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        1 year ago

        Well I mean it points to our inability to control the use of ai systems, that is in fact a very real problem.

        If you can’t keep people from making stupid memes, you also can’t keep people from making misleading propaganda or other seriously problematic content.

        Towards the end of the story there was the example where they couldn’t stop the system from giving people a recipe for napalm, despite “weapons development” being an explicitly banned topic. I don’t think I need to spell out how that’s a problem.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      1 year ago

      No, no one cares but it gets a bunch of clicks because it’s hilarious so articles keep getting written.

      It’s a solved problem too. You just run the prompt and the result of the generation through a second pass of a fine tuned model checking for jailbreaking or rule breaking content generation.

      But that increases cost per query by 2-3x.

      And as you said, no one really cares, so it’s not deemed worth it.

      Yet the clicks keep coming in for anti-AI articles, so they keep getting pumped out, and laypeople now somehow think jailbreaking or hallucinations are intractable problems preventing enterprise adoption of LLMs, which is only true for the most basic plug and play high volume integrations.

      • Cocodapuf@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        It’s a solved problem too. You just run the prompt and the result of the generation through a second pass of a fine tuned model checking for jailbreaking or rule breaking content generation.

        But that increases cost per query by 2-3x.

        Huh, so basically it’s like every time my mom said “think before you speak”. You know, just run that line in your head once before you actually say it, to avoid saying something dumb/offensive.

  • bitsplease@lemmy.ml
    link
    fedilink
    English
    arrow-up
    59
    arrow-down
    1
    ·
    1 year ago

    Serious question - why should anyone care about using AI to make 9/11 memes? Boobs I can see the potential argument against at least (deep fakes and whatnot), but bad taste jokes?

    Are these image generation companies actually concerned they’ll be sued because someone used their platform to make an image in bad taste? Even if such a thing we’re possible, wouldn’t the responsibility be on the person who made it? Or at worst the platform that distributed the images -As opposed to the one that privately made it?

    • Fyurion@lemmy.world
      link
      fedilink
      English
      arrow-up
      56
      ·
      1 year ago

      I don’t see adobe trying to stop people from making 911 memes in photoshop nor have they been sued over anything like that, I dont get why AI should be different. It’s just a tool.

      • bitsplease@lemmy.ml
        link
        fedilink
        English
        arrow-up
        14
        ·
        1 year ago

        That’s a great analogy, wish I’d thought of it

        I guess it comes down to whether the courts decide to view AI as a tool like photoshop, or a service - like an art commission. I think it should be the former, but I wouldn’t be at all surprised if the dinosaurs in the US gov think it’s the latter

      • makyo@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        arrow-down
        1
        ·
        1 year ago

        The problem for Adobe is that the AI work is being done on their computers, not yours, so it could be argued that they are liable for generated content. ‘Could’ because it’s far from established but you can imagine how nervous this all must make their lawyers.

    • kromem@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      ·
      1 year ago

      Protect the brand. That’s it.

      Microsoft doesn’t want non-PC stuff being associated with the Bing brand.

      It’s what a ton of the ‘safety’ alignment work is about.

      This generation of models doesn’t pose any actual threat of hostile actions. The “GPT-4 lied and said it was human to try to buy chemical weapons” in the safety paper at release was comical if you read the full transcript.

      But they pose a great deal of risk to brand control.

      Yet still apparently not enough to run results through additional passes which fixes 99% of all these issues, just at 2-3x the cost.

      It’s part of why articles like these are ridiculous. It’s broadly a solved problem, it’s just the cost/benefit of the solution isn’t enough to justify it because (a) these issues are low impact and don’t really matter for 98% of the audience, and (b) the robust fix is way more costly than the low hanging fruit chatbot applications can justify.

    • M500@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      2
      ·
      1 year ago

      I’d guess that they are worried the IP owners will sue them for singing their IP.

      So sonic creators will say, your profiting by using sonic and not paying us for the right to use him.

      But I agree that deep fakes can be pretty bad.

  • hOrni@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    arrow-down
    1
    ·
    1 year ago

    I busted out laughing on a public bus while reading grandma’s napalm recipe.

  • Agent641@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    1 year ago

    Why didnt someone warn us about this? Nobody said this might happen, nobody! Not a single person tried to be the voice of reason!

        • Womble@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          2
          ·
          1 year ago

          It honestly been really enlightening for me seeing all the same arguments that were made against the printing press and the camera being made against generative AI for text and images. Shows just how little people have changes over hundreds of years.

        • This is fine🔥🐶☕🔥@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          1 year ago

          Ah yes, photorealistic images (and videos) are as effective as text.

          Btw that also is an unfair argument because printing technology printed same book many times. You still need an author to write source text.

          AI generates different images within minutes.

          But please continue pretending AI generated images and videos are not a problem.

          • Womble@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            edit-2
            1 year ago

            the printing press decreased the speed of publication by a larger margin (months to hours for a big book like the bible) and aguably kicked off a century of incredibly bloody warfare with luther and then the counter reformation.

            I dont see how being able to get a decent image of Marx with tits from a few mins of generating images is so much more dangerous.

            • This is fine🔥🐶☕🔥@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              You still needed writers to come up with a new material for printing press. It only increased distribution of existing material.

              Which isn’t case with machine generated text and images. You can get any hateful or depraved output within minutes.

              • Womble@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                arrow-down
                1
                ·
                edit-2
                1 year ago

                That was exactly the point the church made against the printing press, without needing scribes anyone could come up with whatever foul heresy they liked and publish it for distribution.

                The chief difference between now and then is what we consider unpermissable. Otherwise the agrument is the same, we cannot trust people to publish whatever they like or terrible things will happen.

          • regbin_@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            It’s really not a problem. We have both open source and proprietary solutions for generative AI. If you have the hardware for it, you can generate images locally for free. If you don’t, just use one of the many available services.

            It’s literally giving the power of expression to almost everyone, including artists.

            Also let’s not talk about jobs/money. Technology replacing jobs isn’t something new and that’s what humanity should strive toward.

  • Grass@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    25
    arrow-down
    1
    ·
    1 year ago

    Meanwhile bing images blocks 90% of my generation attempts for unsavory content when the prompt is generally something that should be safe even for kids. Why do we only get the extremes?

      • saltnotsugar@lemm.ee
        link
        fedilink
        English
        arrow-up
        24
        ·
        1 year ago

        (Verse 1) Yo, gather 'round, let me tell you a tale, ‘Bout some hamsters, small but they set sail, On a mission, like a furry heist, In the dead of night, they were rollin’ dice.

        In a world where cheese was the ultimate prize, These little rodents had that glint in their eyes, They wore tiny masks, had a cunning plan, To rob the bank, be the rodent clan.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        (Verse 2) Through the vents they crawled, like shadows they crept, Crackin’ safes with their claws, while the city slept, Whisperin’ secrets, in their hamster code, No one could stop them, they owned the road.

        Lil’ bandits of the underground, so sly, As they counted their loot, reachin’ for the sky, Hamster wheelin’, they had the skills, Pullin’ off heists for their thrills and thrills.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        (Bridge) But the long arm of the law was closin’ in, Hamster SWAT teams, it was time to begin, A chase through the sewers, down the wire, The hamsters were on the edge, feelin’ the fire.

        (Verse 3) In the end, they were cornered, it was quite a scene, But these hamsters, they were tougher than they seemed, They fought for their freedom, they fought for their cheese, Tiny warriors, brought to their knees.

        But the legend lives on, in the city’s lore, The hamster heist, forevermore, Tiny rebels, brave and bold, Hamster bank robbers, the story’s told.

        (Chorus) Hamsters in the night, they’re on the run, Stealin’ all the cheddar, it’s just begun, Tiny paws, big dreams, they’re takin’ their chance, Hamsters robbin’ banks, a rodent romance.

        Yeah, hamsters robbin’ banks, that’s the story told, In the underground world, where legends unfold, Tiny but mighty, they took that chance, Hamsters with a dream, a rodent romance.

        • gestalt@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          ·
          1 year ago

          Goddamn! Other than a few errors like “thrills and thrills”, this thing seems pretty cohesive!

          Has a small plot and everything. I hope this tech is used to make some insane human-machine collaborations.

          • PsychedSy@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            4
            ·
            1 year ago

            I’ve used chatgpt to write poems for friends about their medical issues. Has to be the right person, but it’s funny as fuck if it lands.

          • jcit878@lemmy.world
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            1 year ago

            andre antunes got it to write a song in the style of muse and he added the music. it was half decent

  • batmangrundies@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    1 year ago

    In Australia we are currently voting on a constitutional amendment. It would create an advisory body that represents first nations people. It’s super basic, doesn’t really cover how it will work, because they can’t really even work on that until the amendment passes.

    But presumably it will allow them to directly advise government, rather than through the spiderweb of community leaders, NGOs and whatnot that exist now, and provide some structure for Aboriginal representation in parliament

    The sheer amount of disinformation circulating is staggering. I was lucky enough to really avoid most of the drama, until I went and had a look this past week finally.

    What interested me, was rather than the usual short posts and snarky racist comments, of which plenty exist. These long diatribes were dominant, on places like Reddit and Facebook.

    Then it struck me, they all sound like they were written by the same person. Not just a little, if you had removed the names and pictures of the users, I would have flat out assumed it was the same person.

    We have opened Pandora’s Box. We don’t need “AGI” or whatever, this is plenty enough to do us in.

  • Letstakealook@lemm.ee
    link
    fedilink
    English
    arrow-up
    4
    arrow-down
    7
    ·
    1 year ago

    Can we stop calling these technologies “AI?” Then can we stop talking about them?

    • bitsplease@lemmy.ml
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      5
      ·
      1 year ago

      Why did no one care about the misuse of the term AI until these image generators or LLMs? Seriously, people have been talking about video game “AI”, chess “AI” and stuff like that. It’s understood that when people say “AI” they don’t mean “general machine intelligence” or anything like that. And frankly LLMs and image generators fit the bill better than most of the things we’ve used the term for previously

      As for “can we stop talking about them”, these and LLMs are already having some pretty huge impacts on modern society - for better or worse, it’d be pretty odd for us all to decide to just stop talking about them.

      • Letstakealook@lemm.ee
        link
        fedilink
        English
        arrow-up
        9
        arrow-down
        3
        ·
        1 year ago

        The difference from prior use of the term “AI” and these technologies is, as you said, before it was understood that it was a short hand, not actual intelligence. Now you have a bunch of panicky people acting as if skynet has arrived.

        They really haven’t had much of an impact beyond people talking about them all the damn time, especially the fear mongering. At present, these are really just expensive toys. Computer image and gibberish generators.

        The real concerns with developing technologies should be in regards to things like facial recognition and so-called self driving cars. These technologies present actual dangers to society and public safety, not to mention the complex legal questions that come with their use.

        • iopq@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Facial recognition and image generation is the same technology applied in a different way

        • bitsplease@lemmy.ml
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          2
          ·
          1 year ago

          ^They really haven’t had much of an impact beyond people talking about them all the damn time, especially the fear mongering. At present, these are really just expensive toys. Computer image and gibberish generators.

          I highly disagree. Almost everyone I know under the age of 40 uses LLMs to some extent in the course of their job already, whether it’s as simple as composing emails or as significant as using copilot/chatGPT to code. And just today I read an article about an entire call center getting laid off this week to be replaced by an LLM.

          I completely agree that a lot of the hype is overblown, but “AI” is absolute significant in our society, and so we talk about it

          • Letstakealook@lemm.ee
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            1
            ·
            1 year ago

            It seems everyone you know under the age of 40 is in a very specific subset of the workforce. They do not represent a significant portion of the workforce. I would love to read that article about the call center so I can keep an eye out for news when that plan completely fails. I’m assuming it must be a consumer facing call center to be so brazen. They wouldn’t risk business accounts (big money) on an llm, the technology just isn’t there.