Comment by adam_arthur
9 days ago
You can already do this with smaller LLMs, like 10B range. The computer vision/image interpretation has been sufficient at this magnitude for a few months now.
Can run on most decently powered consumer devices.
Latency not great vs ad block though, of course.
Perhaps a fine tuned model explicit to this purpose could be even more compact.
That's an interesting idea to try as a browser extension. I think Facebook is particularly egregious here, so I doubt you'd need to run something like this on other sites. But if it worked fast enough on just Facebook, it would be useful.