• AliasAKA@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 month ago

    Is there any interest in getting local models to run using this? I’d rather not use Gemini, and then all the data can reside locally (and not require a login).

    I’d be happy to work on this, though I’m a python developer not a typescript one.

    • Cr4yfish@lemmy.worldOP
      link
      fedilink
      arrow-up
      4
      ·
      1 month ago

      Yeah, good idea. It’s possible to do that with WebLLM & Langchain. Once Langchain is integrated, it’s kinda similar to the Python Version so should be do-able I think.

      • AliasAKA@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 month ago

        Ah interesting — again happy to help out if there’s anything I can contribute to. I can make a feature request on github if there’s interest.