writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
Probably but the cost of running a short lived python interpreter to run "print (100 + 200)" is likely negligable compared to the cost of running the language model itself
Usually yes
writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
Probably but the cost of running a short lived python interpreter to run "print (100 + 200)" is likely negligable compared to the cost of running the language model itself