Comment by dist-epoch

> Context requires quadratic VRAM

Even if this is not solved, there is so much economic benefit, tens of TBs of VRAM will become feasible.