Comment by Weves

Adding local/open source model support is at the top of our TODO list! When we started building, open source models were quite a bit more behind of GPT-4 then they are now. At that time the performance gap was at a point where locally hosted models would provide a significantly hampered experience, but we think that gap has (and will continue) to close rapidly.