← Back to context Comment by Readerium 8 hours ago LLMs are memory bandwidth bound not compute bound. 3 comments Readerium Reply ondra 7 hours ago This is incorrect, prompt processing is compute bound. AntiUSAbah 5 hours ago LLMs are bound by both and depends on the hardware which factor is higher. icelancer 6 hours ago This is only true for some parts of the time cost function.
This is incorrect, prompt processing is compute bound.
LLMs are bound by both and depends on the hardware which factor is higher.
This is only true for some parts of the time cost function.