← Back to context

Comment by jvanderbot

11 hours ago

Shoutout to project nomad.

https://www.projectnomad.us/

its got a ton of useful options, preconfigured, integrates pretty easily, and can use any local LLM or data.

2 comments

jvanderbot

Reply
KiwiJohnno  10 hours ago

Interesting. I have a mac mini I run headless dedicated for LLM inference. Do you know if I could run project nomad on a linux box but use qwen on the mac for the AI stuff? I can't find any info on if this configuration is possible.