The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
The coder model has only that one. The ones bigger than that are like 20GB+, and my GPU has 16GB. I’ve only tried two models, but it looked like the size balloons after that, so that may be the biggest models that I can run.
I got it working with my 6800XT. I’m running deep seek r1 14b (somewhere around there) and the deep seek coder V2. I have a link to a blog with those instructions
https://gotosocial.michaeldileo.org/@mdileo/statuses/01JQA4M4Q33PMCADH9M2AWQSS8
For me federation is working to mastodon, but I don’t think comments are really out yet, but I use cactus comments for it, but that doesn’t federate to mastodon, it federates to matrix. It also requires a matrix server, which was a total pita to set up.
My company just laid off the entire testing department. I don’t think they were joking though.
oh, I thought that was a mastodon thing or something. Thank you for the clarification :)
I have dynamic dns through cloudflare that provides a proxy ip address for me in addition to some protections.
After that I use a reverse proxy to route specific domain names to services. My router is set up to forward only ports 80 and 443 to that reverse proxy, so there’s a good layer of safety there. There could be a weakness on the router, but at this point traffic is pretty limited.
After that, at least for your service, if you can have some control or throttling of signings and be more selective about who you let in, then that could help.
I say do it. Sure there’s risk someone could put something on there you don’t want, but I wouldn’t say it’s big enough to not do it.
Did you ever find a solution? I’m having the same problem. I ensured that my user has wildcard permissions for the host, so it’s granted ALL on 'friendica'@'%'
.
To add on, you can comment in a “binary search” method. Comment out one half of them, if it’s still there, half again, etc and keep going down until you find it.
I’m on mobile and can’t make out any of it, but good luck!
I try to do something to make my presence known because the number of times I’ve frightened a woman by, from her perspective, appearing out of nowhere, is quite high. I’m a pretty quiet walker too.
I also make extra space on the sidewalk or I’ll cross the street at night when I’m overtaking less than 3-4 in a group.
Writefreely is super light weight and minimalist in its design. It also federates with mastodon.
To add on, your budget here really matters. Ideally, you can have an external NAS or drive enclosure that is managed by the laptop. If you want easy backups, a cloud storage provider can help. I do nightly backups to idrive.
What was your input? I’m really curious now
Thank you! This took so long to figure out
Because it doesn’t feel real 😉
Edit: i thought you referred to TrueNas. I’m tired
That’s a common trait in that mindset
This is a very common thing, especially those with Nice Guy ™ syndrome. The gist of it there is that you don’t feel like you have the worth or don’t deserve good things, or something along those lines, so someone helping you violates that narrative, more or less.
I don’t know if this applies or if I’m way off in left field, but Dr. Robert Glover is a phsychologist who’s been working on these traits for a long time. Here’s his website and book.
I haven’t tried those, so not really, but with open web UI, you can download and run anything, just make sure it fits in your vram so it doesn’t run on the CPU. The deep seek one is decent. I find that i like chatgpt 4-o better, but it’s still good.