Comment by 0xbadcafebee
7 hours ago
For people who don't get this: it's a Home Assistant type thing. You don't do inference on it, you send it a message on Telegram and it does things with physical things through GPIO. You could use a $140 Raspberry Pi with 8GB RAM and host a local model on it plugged into 30W AC power... or you could use a $10 ESP32 which can run for weeks on a tiny battery, and your existing Wifi connection with a cheap cloud model (cloud models are as cheap as $0.02/1MTokens). This makes it easier to ramp up on new ESP32 projects. You can just tell it to do things / give you info, rather than having to write code.
I wouldn't trust LLMs with anything, even low stakes things like handling my notes. I fail to see how people willingly give keys to the kingdom, why, asides from just FOMO/trend chasing.
The model can be taken care of in cloud but hardware also depends upon what we want to do right? If we want to run some lightweight python scripts etc, we cant use ESP32 right?
dope so i can hook it up to my appliances, hvac, etc? maybe it'll do rad things with my smart doorlocks, remote car starter. can it send my self-driving waymobile to pick up my family at the airport too? such wow