• Ek-Hou-Van-Braai@piefed.socialOP
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    3
    ·
    3 days ago

    Siri has privacy issues, and only works when connected to the internet.

    What are the downsides of me running my own local LLM? I’ve named many benefits privacy being one of them.

    • RushLana@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      3 days ago

      Voice recognition is not limited to siri, I just used the most know exemple. Local assitant have existed long before LLMs and didn’t require this much ressources. You are once again moving the goal post. Find one real world use that offset the downside.

        • RushLana@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          3 days ago

          Once again it’s not enough to justify the cost.

          LLM translation are hazardous at best and we already a lot of translation tools already. Templating systems are older than me and even so no one in their right mind should trust a non deterministic tool to draft documents.

          • Ek-Hou-Van-Braai@piefed.socialOP
            link
            fedilink
            English
            arrow-up
            2
            ·
            3 days ago

            That’s simply not true, What translation tool is better at translating English to Afrikaans?

            I’m just just picking a difficult language, I am Afrikaans look at my post history.

            • RushLana@lemmy.blahaj.zone
              link
              fedilink
              English
              arrow-up
              1
              arrow-down
              1
              ·
              3 days ago

              Are you going to neat-pick a point each time rather than addressing my argument as a whole ?

              I’m french and I can tell you in a software developement context AI is worse than existing tool like deepL, maybe it work better in afrikaans and if that’s the case good we finally have an use case ! sadly being ok at translating thing is not what thoose model are selled on and even if it were : it’s still not worth the cost

              I’ll stop responding, no one is reading that far of a comment and you are not responding to my arguments in way that’s productive.

              • Ek-Hou-Van-Braai@piefed.socialOP
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                3 days ago

                DeepL has the same issues that a LLM has when it comes to translating.

                You’re still sending all your data to some server, it might be a bit more efficient than a LLM, not sure by how much. but it’s essentially the same thing.

                DeepL is essentially just a LLM specifically tuned for translations