AI-created child sexual abuse images ‘threaten to overwhelm internet’::Internet Watch Foundation finds 3,000 AI-made abuse images breaking UK law

  • Treczoks@lemm.ee
    link
    fedilink
    English
    arrow-up
    46
    arrow-down
    1
    ·
    1 year ago

    “Flooding the internet” - my ass. With 3000 pictures. Which is absolutely nothing in todays world. Maybe flooding some pedophile niches in the darkest corners of the internet, maybe replacing pictures of real abuse there. Makes you wonder where this “Internet Watch Foundation” actually hangs out. And what they smoke when they write their press releases.

    • banneryear1868@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      “Overwhelm the internet” makes it sound like it’s going to be flooding every website, but I don’t see why they wouldn’t deal with it the way they already do. A lot of these orgs try to be overly alarmist on purpose to attract political attention to their causes, but it creates distrust with people who aren’t necessarily “in” on the org’s operations and strategy.

    • MTK@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      3
      ·
      1 year ago

      By dark web pedophilia sites standards, I suspect 3000 unique images is actually a lot.

      • tsz@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        Based on the “Ai art” I’ve seen, they aren’t that unique…

  • BetaDoggo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 year ago

    “Threaten to overwhelm”, they found 3,000 images. By internet standards that’s next to nothing. This is already illegal and it’s fairly easy to filter out(or it would be if companies could train on the material legally).

    • MTK@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      3
      ·
      1 year ago

      By dark web pedophilia sites standards, I suspect 3000 unique images is actually a lot.

      • Rouxibeau@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Not really. Image sets tend to have hundreds of photos in different poses. A lot of the sets that would show up on 4chan forever ago included a thumbnail image showing just how many were in the archive.

  • EatYouWell@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    arrow-down
    2
    ·
    1 year ago

    Honestly, even though I find the idea abhorrent, if it prevents actual children from being abused…

    I mean, the content is going to be generated one way or another.

    • HeavyDogFeet@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      5
      ·
      edit-2
      1 year ago

      Does it? Or is it just bonus content for pedophiles? Just because they’re now getting thing B doesn’t mean they’re not also still getting thing A. In fact, there’s nothing to suggest that this wouldn’t just make things worse. What’s to stop them from simply using it like a sandbox to test out shit they’ve been too timid to do themselves in real life? Little allowances like this are actually a pretty common way for people to build up to committing bolder crimes. It’s a textbook pattern for serial killers, what’s to say it wouldn’t serve the same purpose here?

      But hey, if it does result in less child abuse material being created, that’s great. But there’s no evidence that this is actually how it will play out. It’s just wishful thinking because people want to give generative AI the benefit of the doubt that it is a net positive for society.

      Anyway, rant over. You might be able to tell that I have strong feelings about benefit and dangers of these tools.

      • Igloojoe@lemm.ee
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        5
        ·
        1 year ago

        Your argument sounds very similar to when people argue that video games promote violence and criminal activity.

        • HeavyDogFeet@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          edit-2
          1 year ago

          That quite a stretch. For a start, playing video games isn’t illegal. Generating child porn is. Graduating from something innocent to something criminal is very different to starting off at one of the more heinous crimes in modern society and then continuing to do different variations of that same crime.

        • hahattpro@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          2
          ·
          1 year ago

          Yeah, you play Teris at kid, then you become series killer with a brick in adult.

          Yikep

      • burliman@lemm.ee
        link
        fedilink
        English
        arrow-up
        3
        ·
        1 year ago

        I’m guessing they could easily support this with a simple premise: Examine a legal fetish, which AI can generate images of, and ask people who generate those images if their consumption of real images have fallen as a result. Also check if actual real life participation in it has been reduced due to the ability to generate the scenarios privately.

        It will be skewed if the fetish is legal, since participating won’t land you in jail. But there may be some out there that present other risks besides legal ones to help with that.

        • Heavybell@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Where does the fact some people will happily jerk it exclusively to anime titty come into this, I wonder?

    • MTK@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      9
      ·
      1 year ago

      Also the models were trained on real images, every image these tools create are directly related to the rape of thousands or even tens of thousands of children.

      Real or not these images came from real children that were raped in the worst ways imaginable

          • Bye@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            You don’t need the exact content you want in order to train a model (Lora) for SD. If you train on naked adults, and clothed kids, it can make some gross shit. And there are a lot more of those safe pictures out there to use for training. I’d bet my left leg that these models were trained that way.

            • MTK@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              Why? If these people have access to these images why would you bet that they don’t use them?

              There are dark web sites that have huge sets of CSAM, why would these people not use that? What are you betting on? Their morals?

  • hahattpro@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    arrow-down
    4
    ·
    1 year ago

    So, this is where lolicon and shotaco live. Look optimistic, it is better for AI to endure the abuse rather than real human victim.

    • HeavyDogFeet@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      4
      ·
      1 year ago

      Sure, except there’s nothing to suggest that this stuff would reduce the number of real humans being abused.

  • HeavyDogFeet@lemmy.world
    link
    fedilink
    English
    arrow-up
    7
    arrow-down
    8
    ·
    1 year ago

    Full steam ahead on AI bullshit though, no brakes on the freight train of potentially society-shattering fuckery because there could be profits involved.

  • MTK@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    18
    ·
    1 year ago

    Just to remind anyone who thinks AI generated child porn is okay or not as bad as “real” child porn or the same as animated child porn.

    These models were trained on real images, every image these tools create are directly related to the rape of thousands or even tens of thousands of children.

    Real or not these images came from real children that were raped in the worst ways imaginable

        • ThyTTY@lemmy.world
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          2
          ·
          1 year ago

          To simplify:

          • AI parses images of adults having sex
          • AI parses images of minors
          • AI can generate an image of minors doing adult stuff

          If you want to generate an image of a Lion in a tuxedo it didn’t necessary need to parse images of lions in a tuxedo.

          • MTK@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            6
            ·
            1 year ago

            You are talking about technicalities. For a model to be as good as possible you train on the most accurate data.

            It is true that you can take SD, modify it to ignore moral values and then ask for CSAM but if you for example have a bunch of real CSAM and you train it on that data it would be much much better at generating believable CSAM. Which is what these criminals do…

        • Rouxibeau@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          1 year ago

          Bold statement from someone who is literally just saying things and posted nothing to validate their claims.

          • MTK@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            4
            ·
            edit-2
            1 year ago

            I work with LLMs, SD and Threat Intelligence so I have some professional knowledge on the subject.

            • Rouxibeau@lemmy.world
              link
              fedilink
              English
              arrow-up
              3
              arrow-down
              1
              ·
              1 year ago

              That fails to rise to the level of verification. The expert witness must convince the jury that they are in fact an expert.

              • MTK@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                1 year ago

                Dude this isn’t a court room, I said what I said and you can decide to ignore it if you want to.