Comment by mavhc
8 hours ago
writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
8 hours ago
writing and calling an entire python setup seems massive overkill, surely just have an internal way of calling a simple calculator function would be millions of times faster
Probably but the cost of running a short lived python interpreter to run "print (100 + 200)" is likely negligable compared to the cost of running the language model itself