Comment by wanderingbit

I set this up on my machine and tested it with the following question:

How can I build a bow drill so I can start a fire?

It got it partially right: spindle, bow with string tied the correct way, and fire board. But then it flubbed by saying you put the spindle between both hands and move your hands back and forth to rotate the spindle and create the necessary friction… this totally ignores using the bow to rotate the spindle! It also mentioned “fanning the sparks” but there is absolutely no way your bow drill is going to create sparks.

I asked a frontier model to check the survival LLM’s conversation trace and it pointed out the errors.

I didn’t see obvious errors in the other 3 prompts I used, but this one seemed pretty egregious for a survival LLM.

I thank the creator for making this, but take it with a grain of salt.