Comment by arcanemachiner
7 hours ago
The thread you're in broke away from the main discussion topic.
Again: Nobody is using LLMs to (for example) sort fruit. But there are some industrial processes that prioritize latency over reliability.
7 hours ago
The thread you're in broke away from the main discussion topic.
Again: Nobody is using LLMs to (for example) sort fruit. But there are some industrial processes that prioritize latency over reliability.
No, we are literally trying to find a use case where using a lower accuracy LLM makes sense for a vision task.
But fine - what are these industrial processes where that prioritize latency over reliability and using a LLM - as mentioned by the OP - makes sense?