Comment by threepts

First of all 1) 8 H100S are NOT ENOUGH for today's premier models (500B+ tokens) and if you do run a obsolete model forget about memory.

2) After buying the 300k GPUs, your electricity cost will put you in competition with hosting on cloud costs, you will probably lose dollars this way.

3) NVIDIA will charge you a kidney to provide driver/hardware support if anything goes wrong.

This inherently a bad idea and this person is probably trying to promote his startup.