Comment by frigidwalnut

14 hours ago

Sounds interesting. Can you give more details on your workflow and what tasks you use it for?

Code, creative writing, email summaries, automated email replies, and I prefill my invoice notes and daily updates for work.

Actually built a full invoicing product for that, using it too.

I use Mistral 7b and LlamaIndexTS on Node, I run it on a MacBook M3 and on a Linux server with only 8GB VRAM (old gaming PC).

Basically flawless, runs very fast and I don’t even know what paying for “tokens” is :)