Comment by vkaku

I recently decided to build and run my own training free inference engine... and it worked.

It's called TinyToT: https://github.com/guilt/TinyToT

You basically get a LLM without any training/RL here.

See: https://x.com/i/status/2076344798525460581