Comment by vorticalbox
13 hours ago
that is not an model issue but a harness one, if you don't want it to have io to files or run command then simple don't give it access to the tools.
13 hours ago
that is not an model issue but a harness one, if you don't want it to have io to files or run command then simple don't give it access to the tools.
Yes, I don't. I have my own harness where the agent is only able to do a set of predefined things and none of them involves the internet. However, I imagine the model could be a lot smaller if it does not have the baggage of coding and programming in general.
I mostly just need it to mostly be a very advanced NLP model that is able to figure the set of tools that it needs to call with what argument. Then it will just follow a predefined decision tree.
Check out cactus needle, might be what you're looking for.