Just curious, do any of you think AI would be more popular if someone was offering as a physical product?
As in instead of data center and paying a company to use their model, you pay for an in home server with some sort of base agentic LLM preinstslled that you could then train to your specific needs.
The hardware to run it locally would be fairly expensive and would require using a very simple model compared to alternatives. Also much more wasteful if you were only using that hardware for AI use, as you’d be distributing the hardware out rather than centralizing so it’d be often idle and when replaced create more waste than a centralized server rack.
Also, additional per user post-training seems to me both wasteful and not necessary. In context learning is often much more powerful but frequently overlooked.
You can run some pretty neat local AI agents on consumer grade hardware without much issue. There are also new models that will run on phone hardware. They won’t write complicated programs, but they work well for assistant things.
Just curious, do any of you think AI would be more popular if someone was offering as a physical product? As in instead of data center and paying a company to use their model, you pay for an in home server with some sort of base agentic LLM preinstslled that you could then train to your specific needs.
I think we just (rightfully) lost faith in tech products overall by now.
I would use this, but how can one trust that there is any privacy on a product from any of the big tech companies?
Probably less so.
The hardware to run it locally would be fairly expensive and would require using a very simple model compared to alternatives. Also much more wasteful if you were only using that hardware for AI use, as you’d be distributing the hardware out rather than centralizing so it’d be often idle and when replaced create more waste than a centralized server rack.
Also, additional per user post-training seems to me both wasteful and not necessary. In context learning is often much more powerful but frequently overlooked.
Yeah, that would be swell
You can run some pretty neat local AI agents on consumer grade hardware without much issue. There are also new models that will run on phone hardware. They won’t write complicated programs, but they work well for assistant things.