Comment by FloatArtifact
13 days ago
I've been waiting for something like this. Have you considered the following based on the benchmark data that's submitted beyond the GPU?
1. User selects a model, size and token output speed and latency. The website generates a hardware list of components that should match the performance requirements.
2. User selects hardware components and the website generates a list of models that performant on that hardware.
3. Monetize through affiliate links the components to fund the project. Think like PC part picker.
I know there's going to be some variability in the benchmarks due to the software stack, but it should give a AI enthusiasts, an educated perspective on what hardware can be relevant for their use case.
Right now the main priority is just getting the data out, but in the future may have some interest in this. Or perhaps we can open an API for others to build this as well