Comment by petra

AMD can let the SRAM be on a different chip. Maybe even something similar to their 3D cache. that could increase density to 20B[1]. They could also move from 6nm to 2nm. that would probably increase density by another 3x to 60B.

Add a bunch of chips together, and you get to a server that can run a 800B model, very fast and probably significantly cheaper than others.

[1]https://www.eetimes.com/taalas-specializes-to-extremes-for-e...