Comment by geerlingguy

Shorter PCB traces because of insane timing requirements for DDR5, GDDR7, and beyond; GPUs put the memory chips as close as possible surrounding the CPU die to reduce the latency and prevent timing/signaling issues.

But even there, the fastest AI accelerator GPUs are putting memory on die, and using chiplet designs, to get the memory closer and closer to the cores.