Where can I buy this?
Edit: I realized after I commented this was the product page… My bad. It was more of a take my money now scenario
i wonder if the driver to run is compatible with linux.
Why wouldn’t it? (Like I’m thinking why would they support Microsoft, and the only other viable option is FreeBSD)
the world still uses windows heavily so adoption for the end consumer relies on it.
For inference only. NVIDIA GPU’s are so big because they can train models. Not just run them. All other GPU’s seem to lack that capacity.
Does anyone know if it can run CUDA code? Because that’s the silver bullet ensuring Nvidia dominance in the planet-wrecking servers
llama and pytorch support it right now. CUDA isn’t available on its own as far as I can tell. I’d like to try one out but the bandwidth seems to be ass. About 25% as fast as a 3090. It’s a really good start for them though.
I kinda want an individual consumer-friendly, low-end/mid-end alternative that can run my games and video editing software for very small projects… so far I’m only eyeing the Lisuan G100, which seems to fit that bill…
This seems cool though, other than AI, it could be used for distributed cloud computing or something of that sort
These only work with ARM cpus I think
PCI-E 3.0, DDR4 memory, no drivers, no fans You would be better off any DDR4 CPU with a bunch of ram
When you definitely know the difference between what a CPU and a GPU does.
For 2000$ it “claims” to do 140 TOPS of INT8
When a Intel Core Ultra 7 265K does 33 TOPS of INT8 for 284$Don’t get me wrong, I would LOVE to buy a chinese GPU at a reasonnable price but this isn’t even price competitive with CPUs let alone GPUs.
Again, completely different purposes here.
Alright, lets compare it to another GPU.
According to this source , the RTX 4070 costs about 500$ and does 466 TOPS of INT8
I dont know if TOPS is a good measurement tho (I dont have any experience with AI benchmarking)
Now go look at the amount of VRAM it has.