Comment by embedding-shape
5 hours ago
Which one is the fastest and how fast is it? Even the "fast" ones doesn't seem to even reach close to consumer NVIDIA GPUs released years ago when it comes to prompt processing.
5 hours ago
Which one is the fastest and how fast is it? Even the "fast" ones doesn't seem to even reach close to consumer NVIDIA GPUs released years ago when it comes to prompt processing.
large model and slow, or speed and a teeny model, make your choice
Or you get N of RTX Pro 6000 and get large and fast models :) Make your choice, and do it before the prices go up even more.
indeed. make up your mind, and also "slow/fast" mean very little given plethora of models to choose from. fast for what, slow for what. fast with which harness, etc...