Comment by dotancohen

Thank you. I've been using ollama for a much more modest local inference system. I'll research some of the things you've mentioned.