• LWD@lemm.ee
    link
    fedilink
    arrow-up
    56
    arrow-down
    1
    ·
    10 months ago

    Based on that one Senate hearing, it looks like big companies like Facebook, Discord and Twitter are aiming for the maximum percent of false positives and false negatives when it comes to CSAM.

    The only thing I know about that screenshot is that it used to say “show results anyway” which is probably worse in most cases

  • Squizzy@lemmy.world
    link
    fedilink
    arrow-up
    38
    arrow-down
    1
    ·
    10 months ago

    I reported loads of content on Instagram, genuinely creepy accounts of “athletic teens” and they all got rejected.

    I got caught in a horrible recommendations loop because I’d like family photos of running and gymnastics for my nieces and cousins.

  • forgotmylastusername@lemmy.ml
    link
    fedilink
    arrow-up
    35
    arrow-down
    3
    ·
    10 months ago

    One the biggest problems with the internet today is bad actors know how to manipulate or dodge the content moderation to avoid punitive consequences. The big social platforms are moderated by the most naive people in the world. It’s either that or willful negligence. Has to be. There’s just no way these tech bros who spent their lives deep in internet culture are so clueless about how to content moderate.

    • blazeknave@lemmy.world
      link
      fedilink
      arrow-up
      19
      arrow-down
      4
      ·
      10 months ago

      I know them. I worked in this industry. They’re not naive. What basis do you have for these comments?

      I think you’re conflating with business executives running said social and gaming companies. Stop calling them techbros. Meta is not a tech startup. They’re a transnational corporation. They have capitalist execs running the companies.

    • Jknaraa@lemmy.ml
      link
      fedilink
      arrow-up
      6
      ·
      10 months ago

      The thing is that words can have a very broad range of meaning depending on who uses them and how (among many other factors), but you can’t accurately code all of that into a form that computers can understand. Even ignoring bad actors it makes certain things very difficult, like if you ever want to search for something that just happens to share words with something completely different which is very popular.

    • d-RLY?@lemmy.ml
      link
      fedilink
      arrow-up
      3
      ·
      10 months ago

      Auto-moderation is both lazy and is only going to get worse. Not saying there isn’t some value on things being hard-banned (like very specific spam like shit that just keeps responding to everything with the same thing non-stop). But these mega outlets/sites want to just use full automation to ban shit without any human interactions. At least unless you or another corp has connections on the inside to get a person or people to fix it. Just like how they make it so fucking hard to ever reach a person when calling (or trying to even find) a support line.

      This automated shit just blacklists more and more shit and can completely fuck over people that use those sites for income (and they even can’t reach a person when their income is cut off for false reasons and don’t get back-pay for the period of a strike/ban). The bad guys will always just keep moving to a new word or phrase as the old ones get banned. So we as users are actually losing words and phrases and the actual shit is just on to the next one without issues.

  • IzzyScissor@lemmy.world
    link
    fedilink
    arrow-up
    22
    ·
    10 months ago

    Remember, searching for “halo” is banned because it could potentially be linked to pedophilia, but editing a video of the president to look like a pedophile is fine because “it wasnt done with AI.”

    • SPRUNT@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      10 months ago

      Oh? I assumed the word “halo” was banned due to its association with the church and their link to pedophilia.

  • baatliwala@lemmy.world
    link
    fedilink
    arrow-up
    23
    arrow-down
    2
    ·
    10 months ago

    Barely 2 years ago I noticed that people were posting porn on Insta, and it was publicly visible just because they tagged #cum as #cüm. I don’t think this is possible now, but basically corporations are dumb and people posting disallowed content can be creative as hell.

  • rawrthundercats@lemmy.ml
    link
    fedilink
    arrow-up
    19
    arrow-down
    1
    ·
    10 months ago

    How do we know they didn’t type something more explicit to get the result and just change what’s in the search bar? Has anyone verified this?

    • 7heo@lemmy.mlOP
      link
      fedilink
      arrow-up
      23
      ·
      10 months ago

      I actually don’t know, I’m not sure it is possible (I never used Instagram, the search might be auto-submitting for all I know) but intentionally flagging yourself as potential child abuser, for clout, is a bit extreme…

      • Astro@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        6
        ·
        10 months ago

        It’s the “Kids Online Safety Act”. Basically it’s using the old “think of the children!” move, but in reality conservatives are trying to push anything queer back into the dark.

        • LucidBoi@lemmy.world
          link
          fedilink
          arrow-up
          3
          ·
          10 months ago

          Think of the children! Let us scan all of your images, files and messages! For the sake of children of course! Nothing suspicious here…

      • makeasnek@lemmy.ml
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        3
        ·
        10 months ago

        Do you have to pay comcast extra to stream netflix? No? Net neutrality still exists.

        • brygphilomena@lemmy.world
          link
          fedilink
          arrow-up
          5
          arrow-down
          2
          ·
          10 months ago

          This is a bad take. The public wasn’t the one that would need to pay Comcast, they would have charged Netflix.

          • makeasnek@lemmy.ml
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            1
            ·
            10 months ago

            A total breakdown in net neutrality could have very well had that result.