Comment by anonymous344
2 days ago
i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?
2 days ago
i don't care about microcontroller, what is the decent option to have local llm in my raspi4 that does not take 30 seconds to answer?
Run a smaller LLM. It won't be as smart but the one shown here isn't either.