Comment by rl3

100% if you didn't experience the delta between software rendered and 3dfx hardware accelerated live as it unfolded 3dfx does not tell you anything.

Well, I think it was taking a swipe at a particular brand of insincere feel-good corporate bullshit marketing that was fairly prevalent at the time. Faceless conglomerates trying to manage their image such that they appeared to be benevolent world citizens—not ruthless plunderers.

That is opposed to say, today's brand of insincere feel-good corporate bullshit marketing.

We are in the 4 Petaflops on a single card age currently, my friend: https://resources.nvidia.com/en-us-tensor-core/nvidia-tensor...

It is quite insane. Now, getting to use all of them is difficult, but certainly possible with some clever planning. Hopefully as the tech matures we'll see higher and higher utilization rates (I think we're moving as fast as we were in the 90's in some ways, but some parts of how big the industry is hides the absolutely insane rate of progress. Also, scale, I suppose).

I remember George Hotz nearly falling out of his chair for example at a project that was running some deep learning computations at 50% peak GPU efficiency (i.e. used flops vs possible flops) (locally, one GPU, with some other interesting constraints). I hadn't personally realized how hard that is apparently to hit, for some things, though I guess it makes sense as there are few efficient applications that _also_ use every single available computing unit on a GPU.

And FP8 should be very usable too in the right circumstances. I myself am very much looking forward to using it at some point in the future once proper support gets released for it. :)))) :3 :3 :3 :))))