Comment by andersa 2 days ago TensorRT-LLM being open source is a lie, all the important kernels are loaded from cubins. 1 comment andersa Reply nabakin 3 hours ago Yeah you're right (although, they started to open source some of that recently iirc). I meant SOTA for inference engines we can actually download and use ourselves.
nabakin 3 hours ago Yeah you're right (although, they started to open source some of that recently iirc). I meant SOTA for inference engines we can actually download and use ourselves.
Yeah you're right (although, they started to open source some of that recently iirc). I meant SOTA for inference engines we can actually download and use ourselves.