Comment by charcircuit
7 months ago
That's the point of solving problems with LLMs. We pay a large resource cost, but in return we get general intelligence to understand things.
7 months ago
That's the point of solving problems with LLMs. We pay a large resource cost, but in return we get general intelligence to understand things.
We should try to avoid hitting that resource cost on every use where possible though. A CLI tool should have good `--help` docs for example, rather than expecting every inference run to scrub the CLI tool's source code to figure out how to use it.