It's not that hard to make a turnkey "just add power" appliance that does nothing but spit out tokens. Some sort of "ollama appliance", which just sits on your network and provides LLM functionality for your home lab?
But beyond that, what would your mythical dream product do?
i'm talking about something you plug in and get on your network then you can chat with it with a typical chat interface and it should expose an openai compatible api
"Okay"
Can you describe for me what the product does?
It's not that hard to make a turnkey "just add power" appliance that does nothing but spit out tokens. Some sort of "ollama appliance", which just sits on your network and provides LLM functionality for your home lab?
But beyond that, what would your mythical dream product do?
i'm talking about something you plug in and get on your network then you can chat with it with a typical chat interface and it should expose an openai compatible api
automatic updates etc etc
the AI home appliance
great for privacy
https://tinygrad.org/#tinybox