Comment by zahlman
3 months ago
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
3 months ago
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
You're absolutely right!