You must log in or # to comment.
Why use commercial graphics accelerators to run a highly limited “AI”-unique work set? There are specific cards made to accelerate machine learning things that are highly potent with far less power draw than 3090’s.
Because those specific cards are fuckloads more expensive.
It’s for inference, not training.
Even better, because those are cheap as hell compared to 3090s.
But can they run Crysis ?
What are you recommending, I’d be interested in something that’s similar in price to 3090.
Huh?
Stuff like llama.cpp really wants a GPU, a 3090 is a great place to start.