Caveman Mode Save Token?

2 months ago (twitter.com)

Only two or three weeks from incepting the idea of a token efficient LLM English dialect to seeing it in practice. I just never imagined it to take.... this particular form.....

https://news.ycombinator.com/item?id=47434846

I used a system prompt similar to this, where I just dumped the entirety of https://grugbrain.dev/ into it and prefaced it with the assistant having to emulate grug.

Didn't find it particularly useful, but is is funny!

Can this actually work?

  • It does. I've been tinkering with Copilot Studio Agents and you can hit a 8k character limit quickly. By taking your instructions and asking Copilot to compress the information down, while ensuring they are still human readable, you can cut it back to about 5k characters. The information is more dense and functionally the same and the agent is just as consistent as before.