Comment by lowsong
21 hours ago
Perhaps this is a difference in terminology, but in no way do you need a LLM for fuzzy search. Semantic search, fuzzy keyword search, and text to speech have existed for years and predate the technology for an LLM. In your use-case, do you really need a chatbot to "ask the video" about this, wouldn't a "search in video" function that does the same thing be better?
Yeah, I was using the term "fuzzy" a bit loosely/incorrectly. I want to be able to say "where's the joke about British people?" even if the transcript only uses related but distinct terms like "Scotsman". I know you can get close to that with Transformers sans LLM, but LLMs are kinda like regex where they're often a non optimal but adequate way to solve a problem quickly.