• j4k3@lemmy.world
    link
    fedilink
    English
    arrow-up
    15
    ·
    edit-2
    1 year ago

    Without the spam ad insanity:

    https://web.archive.org/web/20230605010854/https://linuxopsys.com/topics/linux-commands-cheat-sheet

    On a whole different level… (on enthusiast lvl hardware) a Llama2 70B running with 4 bit GGML on a 16GBV 3080Ti 12th gen Intel with 64GB can do bash and Python completely offline at a cheat sheet/stack overflow level without major errors. I just spent a day modifying someone else’s python script and never went online for anything, have never been good at Python, and haven’t messed with it for years. I actually got more done than I ever have before in a single day mostly because I didn’t need to search documentation. FOSS/almost FOSS/offline AI rocks.