Comment by mirekrusin

It would be great if numbers weren't off, would include optimised versions (ie. speculative decoding), context size, include allowed parallel inference (single agents use parallel inference a lot) etc.

I don't think in general people care about long list of models, they just care about the best one.

Also dual gpu is common setup, there should be ie. 2x 4090.