Comment by Dylan16807
17 hours ago
A reminder that what I said was "not completely impossible, depending on what your expectations are"
And I was focused more on the ESP32 part than the exact number of bytes. As far as I'm concerned you can port the model from the minecraft video and you still win the challenge.
Also, that last link isn't supposed to represent the best you can do in 800KB. 260k parameters is way way under the limit.
That bar has no lower bound though so of course we're talking past one another
Also we're talking about an esp32. They aren't magic
Being able to talk back and forth with coherent sentences has a lower bound, and it's close to the limit of this hardware.
Something that can actually be an "assistant" has its own lower bound, probably a little harder but mostly a matter of training it differently.