• 👁️👄👁️@lemm.ee
    link
    fedilink
    English
    arrow-up
    40
    arrow-down
    24
    ·
    1 year ago

    As much as I love Mozilla, I know they’re going to censor it (sorry, the word is “alignment” now) the hell out of it to fit their perceived values. Luckily if it’s open source then people will be able to train uncensored models

    • DigitalJacobin@lemmy.ml
      link
      fedilink
      English
      arrow-up
      51
      arrow-down
      10
      ·
      1 year ago

      What in the world would an “uncensored” model even imply? And give me a break, private platforms choosing to not platform something/someone isn’t “censorship”, you don’t have a right to another’s platform. Mozilla has always been a principled organization and they have never pretended to be apathetic fence-sitters.

      • Doug7070@lemmy.world
        link
        fedilink
        English
        arrow-up
        27
        arrow-down
        2
        ·
        1 year ago

        This is something I think a lot of people don’t get about all the current ML hype. Even if you disregard all the other huge ethics issues surrounding sourcing training data, what does anybody think is going to happen if you take the modern web, a huge sea of extremist social media posts, SEO optimized scams and malware, and just general data toxic waste, and then train a model on it without rigorously pushing it away from being deranged? There’s a reason all the current AI chatbots have had countless hours of human moderation adjustment to make them remotely acceptable to deploy publicly, and even then there are plenty of infamous examples of them running off the rails and saying deranged things.

        Talking about an “uncensored” LLM basically just comes down to saying you’d like the unfiltered experience of a robot that will casually regurgitate all the worst parts of the internet at you, so unless you’re actively trying to produce a model to do illegal or unethical things I don’t quite see the point of contention or what “censorship” could actually mean in this context.

        • underisk@lemmy.ml
          link
          fedilink
          arrow-up
          10
          arrow-down
          2
          ·
          1 year ago

          It means they can’t make porn images of celebs or anime waifus, usually.

        • 👁️👄👁️@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 year ago

          That’s not at all how a uncensored LLM is. That sounds like an untrained model. Have you actually tried an uncensored model? It’s the same thing as regular, but it doesn’t attempt to block itself for saying stupid stuff, like “I cannot generate a scenario where Obama and Jesus battle because that would be deemed offensive to cultures”. It’s literally just removing the safeguard.

        • Spzi@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          I’m from your camp but noticed I used ChatGPT and the like less and less over the past months. I feel they became less and less useful and more generic. In Februar or March, they were my go to tools for many tasks. I reverted back to old-fashioned search engines and other methods, because it just became too tedious to dance around the ethics landmines, to ignore the verbose disclaimers, to convince the model my request is a legit use case. Also the error ratio went up by a lot. It may be a tame lapdog, but it also lacks bite now.

          • Doug7070@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            I’ve found a very simple expedient to avoid any such issues is just to not use things like ChatGPT in the first place. While they’re an interesting gadget, I have been extremely critical of the massive over-hyped pitches of how useful LLMs actually are in practice, and have regarded them with the same scrutiny and distrust as people trying to sell me expensive monkey pictures during the crypto boom. Just as I came out better of because I didn’t add NFTs to my financial assets during the crypto boom, I suspect that not integrating ChatGPT or its competitors into my workflow now will end up being a solid bet, given that the current landscape of LLM based tools is pretty much exclusively a corporate dominated minefield surrounded by countless dubious ethics points and doubts on what these tools are even ultimately good for.

      • 👁️👄👁️@lemm.ee
        link
        fedilink
        English
        arrow-up
        8
        arrow-down
        18
        ·
        1 year ago

        Anything that prevents it from my answering my query. If I ask it how to make me a bomb, I don’t want it to be censored. It’s gathering this from public data they don’t own after all. I agree with Mozilla’s principles, but also LLMs are tools and should be treated as such.

          • 👁️👄👁️@lemm.ee
            link
            fedilink
            English
            arrow-up
            3
            arrow-down
            11
            ·
            edit-2
            1 year ago

            Do gun manufacturers get in trouble when someone shoots somebody?

            Do car manufacturers get in trouble when someone runs somebody over?

            Do search engines get in trouble if they accidentally link to harmful sites?

            What about social media sites getting in trouble for users uploading illegal content?

            Mozilla doesn’t need to host an uncensored model, but their open source AI should be able to be trained to uncensored. So I’m not asking them to host this themselves, which is an important distinction I should have made.

            Which uncensored LLMs exist already, so any argument about the damage they can cause is already possible.

            • Spzi@lemm.ee
              link
              fedilink
              English
              arrow-up
              1
              ·
              1 year ago

              Do car manufacturers get in trouble when someone runs somebody over?

              Yes, if it can be shown the accident was partially caused by the manufacturer’s neglect. If a safety measure was not in place or did not work properly. Or if it happens suspiciously more often with models from this brand. Apart from solid legal trouble, they can get into PR trouble if many people start to think that way, no matter if it’s true.

                • Spzi@lemm.ee
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 year ago

                  Then let me spell it out: If ChatGPT convinces a child to wash their hands with self-made bleach, be sure to expect lawsuits and a shit storm coming for OpenAI.

                  If that occurs, but no liability can be found on the side of ChatGPT, be sure to expect petitions and a shit storm coming for legislators.

                  We generally expect individuals and companies to behave in society with peace and safety in mind, including strangers and minors.

                  Liabilities and regulations exist for these reasons.

                  • 👁️👄👁️@lemm.ee
                    link
                    fedilink
                    English
                    arrow-up
                    1
                    ·
                    1 year ago

                    Again… this is still missing the point.

                    Let me spell it out: I’m not asking for companies to host these services. They are not held liable.

                    For this example to be related, ChatGPT would need to be open source and let you plug in your own model. We should have the freedom to plug in our own trained models, even uncensored ones. This is the case with LLAma and other AI systems right now, and I’m encouraging Mozilla’s AI to allow us to do the same thing.

        • Doug7070@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          1 year ago

          My brother in Christ, building a bomb and doing terrorism is not a form of protected speech, and an overwrought search engine with a poorly attached ability to hold a conversation refusing to give you bomb making information is not censorship.

    • VonCesaw@lemmy.world
      link
      fedilink
      arrow-up
      8
      arrow-down
      4
      ·
      1 year ago

      If ‘censored’ means that underpaid workers in developing countries don’t need to sift through millions of images of gore, violence, etc, then I’m for it