← Back to context

Comment by jains99

6 hours ago

But hardware to run them is conveniently something IBM would be happy to sell you.

If IBM would ship a piece of affordable hardware that can run large LLMs efficiently I'd be lining up.

  • "Affordable" and "IBM" don't belong in the same sentence together, but they're happy to sell you their inference-capable hardware if you've got the wallet for it.

    • I don't agree with that. They made the PC revolution possible by making hardware that was at least affordable enough to be bought by a large number of businesses and individuals. It also set the stage for the clone market. I'm pretty sure that if IBM really set their mind to it that they could do this.

      That doesn't detract from your overall point that they tend to make overpriced stuff, but I don't think they have to do that. Besides, what's overpriced? NVidia's GB300 workstation sells for 95K euros, a single RTX 6000 is now 20K. Surely even IBM can compete at that level.

      19 replies →

I didn't think that IBM had gear that mortals would want to run. If you're not running a mainframe, what do they have to sell you? They still sell Power servers and it looks like they have an AI card that can be used on both. But, if we're talking about the IBM CEO talking about on-premises, what are they really talking about hardware-wise? It's not something they would sell, is it?

This is more of a statement for their consulting customers, right?

Yes but unironically? IBM should be what NVIDIA would be competing with their NVL72 and DGX products. It doesn't make sense that IBM is just watching NVIDIA take its lunch.

  • I think they will need a far more aggressive management before such a thing could happen. But I can dream about it.

  • > It doesn't make sense that IBM is just watching NVIDIA take its lunch.

    If you have ever worked at IBM, it makes total sense. Completely dysfunctional middle management and on up.