Comment by yunohn
5 days ago
Super cool, congrats on the launch - will be trying this soon! I noticed it’s using Tauri - what are your main takeaways from building a local inference desktop app with it?
5 days ago
Super cool, congrats on the launch - will be trying this soon! I noticed it’s using Tauri - what are your main takeaways from building a local inference desktop app with it?
Thanks. I learned that running a server on the Rust side and calling it from a TypeScript frontend is a good approach. For example, we run an OpenAI-compatible server using a Tauri plugin (https://github.com/fastrepl/hyprnote/tree/main/plugins/local...) and call it using the Vercel AI SDK.
I wanted to build this for myself. Could never figure out how to get audio output from Mac. Tried almost all audio loopback driver (Blackhole, Soundflower ...). There was problem everywhere wrt security.
Even tried making a teams meeting bot. But Teams doesn't give live audio to developer unless you are a special partner.
Glad you made this. Will play around
Great! We use AudioTap api
great to see that you like it :)
I’ve been thinking about ways to reuse Vercel’s AI SDK, so this is a great one - thanks for sharing!
Also you might find this interesting:
https://github.com/fastrepl/hyprnote/blob/main/packages/util....
2 replies →