Comment by gpm

6 days ago

I've been using small local LLMs for translation recently (<=7GB total vram usage) and they, even the small ones, definitely beat Google Translate in my experience. And they don't require sharing whatever I'm reading with Google, which is nice.

3 comments

gpm

Reply
yubblegum  6 days ago

What are you using? whisper?

  • gpm  6 days ago

    Edit: Huh, didn't know whisper could translate.

    Just whatever small LLM I have installed as the default for the `llm` command line tool at the time. Currently that's gemma3:4b-it-q8_0 though it's generally been some version of llama in the past. And then this fish shell function (basically a bash alias)

        function trans
        llm "Translate \"$argv\" from French to English please"
    end

    • codethief  6 days ago

      > Uh, translation, not transcription

      Whisper can translate to English (and maybe other languages these days?), too.