Comment by dr_kretyn
1 month ago
Why is this a problem? You don't need an LLM; you need a "model for detecting whether and where the given context appears". We're so used to LLMs now that we forget these NLPs problems have been worked on for a long time and they don't require a huge computational beast and it takes a few ms to run (on only the response, while it's being streamed).
That's a no-go for advertisers. They need to control their own brand and their image, there're not going to leave it up to chance like "ok so uh just mention us or something and then we'll pay you." They pay for very specific placements, and they need to provide the content.