Comment by joelthelion

I think the problem is up to date knowledge isn't really the difficult or useful bit. We're sort of moving to a world where the real value in training comes from tool calling and performance over long context - your models shouldn't really be relying on their internal knowledge, but instead calling various tools. But the performance gap between now and six months for that is pretty huge.