Comment by biophysboy
6 hours ago
What do you mean by scientist-heavy orgs solving everything in token space? I feel like they use them to make or run tools almost exclusively.
6 hours ago
What do you mean by scientist-heavy orgs solving everything in token space? I feel like they use them to make or run tools almost exclusively.
I'm saying AI researchers have a bias towards thinking what needs to happen is prompt -> [crunching tokens] -> response rather than prompt -> [orchestrates 5 tools] -> response
In other words 'just add a calculator tool' is not as sexy research-wise as making the model accurately eyeball arithmetic in its chain of thought. Maybe I'm wrong but that seems to be the case