Comment by mkroman
2 days ago
I don't understand how they expect offline LLM models to work in a meaningful capacity for users.. Isn't there a single multilingual person working at Mozilla?
All of the small LLM models break down as soon as you try to do something that isn't written in English, because - surprise - they're just too small.
There would need to be a hardware breakthrough, or they would have to somehow solve the heavy cost of switching the models between pages.
Instead of useful AI stuff that is a clear improvement to accessibility, they're insistent on ham-fisting LLM solutions that no one have even asked for.
Off the top of my head, they could instead:
1. Integrate something like whisper to add automatic captions to videos or transcribe audio
2. Integrate one of the many really great text to speech models to read articles or text out loud
Mozilla did integrate TTS into Firefox - in fact, one of the better FOSS TTS AI models out their was their initiative. https://github.com/mozilla/TTS
Ah yeah, there's this: https://github.com/mozilla/TTS
I can't seem to find anything that mentions a Firefox integration though?
Click Reader mode on a web page, then the read aloud option in the sidebar.
Note that how well it works on Linux will depend on your distro and default settings, as is common for Linux world. They do try to provide setup instructions if your linux distro has issues.
... now whether that model is integrated by default, no idea. I imagine that depends on size.
Oh, and mozilla's off-line translate for private translation of web pages... that's another neat AI thing they added that I've found super helpful. Chrome still requires sending the content to their servers.
3 replies →