I saw Generative AI for Beginners from Microsoft on GitHub. I’ve looked at https://fmhy.pages.dev/ai but I’m not sure what I’m really looking for.
I write fiction, and I want a chatbot that will function like chat gpt3.5, but not shut down if things get bloody or sexy, as they so often do.
You know ready, aim, fire? I’m in the AIM stage.
I’ve been using GPT4All on my laptop and using mostly 7B models due to my RAM limitations and I am amazed how good some of them are.
It’s been really easy to use. There are models you can download from within the UI or you can get adventurous and download them from elsewhere, they just need to be in the .gguf format. I get most from TheBloke on hugging face.
So far my favourite has been solar-10.7B-instruct-v1.0-uncensored, it has been astonishingly good.
Check out the ai horde. https://aihorde.net or direct llm frontend at https://lite.koboldai.net. Free Foss crowdsourced with uncensored models that won’t ever be rugpulled
I ought to have known you’d have a good answer! Thank you!
Spread the word!
LM Studio is one of the most user friendly ways to play around with LLMs imo. You can run some of the smaller models without too much memory (it will be slow without a decent GPU though).
I’ve been playing a bit with llama2 in Ollama it does not have any restrictions perhaps using Ollama to run models locally is something that would solve some problems for you?
Yeah there are a bunch on uncensored models on ollama. It’s stupid easy to use!
I installed gpt4all https://gpt4all.io/index.html it’s a bit slow but runs on CPU. Then if you have a powerful GPU and like to play with technology I hard good stuff about that project https://github.com/oobabooga/text-generation-webui which wants to be the automatic111 of language model. But I haven’t used it yet
Oh, I thought you were asking how to just … write using your laptop.
That’s a discussion for future generations, but one that will be had I’m sure.
Why not use your own organic talents to write something like millions of other fanfiction writers…?
I’ve been doing that for 40+ years. I just want to try using AI as a partner to bounce ideas back and forth. As I explained in another post, I have trouble generating alternatives once I’ve created an Idea. It’s nice to have a means to get outside myself.
I intend to do the writing, it’s the planning and plotting I’m using AI for.
It’s not impossible
Whew, that guy has too much energy. He reminds me of the Minecraft videos my kids watch.
Slower.
Calmer.
Better.
He’s energized. You could watch at half speed 😅
ollama helps you to easily run llms locally: https://ollama.com/
I’m running llama2-uncensored on my laptop with 8GB of memory.
