Comment by BoorishBears
6 hours ago
Do integrations supporting streaming input?
One big gap I've run into for UX is most realtime voice harnesses wait for a full response from tools, and at most support the model filling the dead air until then
It'd be a game-changer to be able to have the model start replying with partial information streamed from the tool call, then seamlessly continue with additional information.
honestly its not that big of a deal, being able to call tools is the high order bit
It rubs me the wrong way that someone would respond to something I need with 0 context just to tell me it's not a big deal.
Some people have standards in what they build.