Comment by zahlman
1 month ago
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
1 month ago
My assumption has been that emitting those tokens is part of the inference, analogous to humans "thinking out loud".
You're absolutely right!