Comment by mentalgear
8 months ago
Congrats on the effort - the local-first / private space needs more performant AI, and AI in general needs more comparable and trustworthy benchmarks.
Notes: - Olama integration would be nice - Is there an anonymous federated score sharing? That way, users you approximate a model's performance before downloading it.
Can you tell me more about the "anonymous federated score sharing"? Maybe something we can think about more
I totally agree with Ollama integration and if there is interest we will try to upstream into llama.cpp