Comment by raahelb
15 hours ago
Because these decision models do not have tool calling, the knowledge cutoff might become a problem. We'll either have to keep training continuously if we run locally or switch to the newer version every month or so when using a closed one like Jev
even with knowledge cutoff set a second from now, you still want to provide as much info as you can if you’re using such tools for delegating decisions
I noticed it has a pretty small context window of only 32k. For most tasks I guess it would be enough with ample context.