← Back to context Comment by throwawaymaths 6 months ago what's the memory bandwidth? IIRC that is the limiting factor in LLM hardware today 1 comment throwawaymaths Reply walterbell 6 months ago Slide 21, https://files.futurememorystorage.com/proceedings/2024/20240... TPUv3 TPUv4 HBM2 BW 900 GB/s 1200 GB/s
walterbell 6 months ago Slide 21, https://files.futurememorystorage.com/proceedings/2024/20240... TPUv3 TPUv4 HBM2 BW 900 GB/s 1200 GB/s
Slide 21, https://files.futurememorystorage.com/proceedings/2024/20240...