Comment by lsdmtme

You should check out https://pieces.app/ ive been using it for months and I am surprised I have never seen anyone ever talk about it.

It does exactly what you are asking for, and it can do it completely locally or with a mixture of frontier models.