Is there any privacy-oriented AI tool for programming?

  • just_another_person@lemmy.world
    link
    fedilink
    arrow-up
    5
    arrow-down
    1
    ·
    6 months ago

    Depends on what you’re trying to get it to do. There are plenty of offline models that can run through code, but their effectiveness is only as good as their training.

    The entire functional nature of code-aware AI models requires large amounts of data to be trained on, so it’s own existence is not privacy friendly, technically.

    Maybe have a run through LM Studio and try a bunch of different things out

    • chanteoma@lemmy.mlOP
      link
      fedilink
      arrow-up
      2
      ·
      6 months ago

      I have to do some Lua scripts, and I don’t know the syntax very well, so I was looking for a tool that could help me with some code suggestions until I get more used to Lua.

      Then, you have a great point regarding the need of large amounts of data to work. In that sense, likely non of them respect privacy during their development.

      My question was more about privacy regarding user data and the prompts you use. I believe that running something locally like ollama (as others suggested) is the best option for what I’m trying to achieve, which is simple feedback about the code.

  • TheDarkQuark@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    6 months ago

    I rarely use AI, but when I do, I use local instances. I personally use Ollama (https://ollama.com). It exposes a REST API which extensions/plugins can talk to. I used Privy in VSCod(e/ium) and CodeCompanion in Neovim.

  • Love it. U have to do some fucking around to get ms plugin repo to work. And there are no plugins that work to develop inside of docker containers. U can use reborn ai plugin and point it to openai, openrouters, or a self hosted an instance for ai chat. Idk about ai completions like how copilot does tho.