Comment by dvt
14 hours ago
Or just.. download the books, and slap a search engine on top of them. It'll be like 10x smaller than the model. "Survival LLM" is absolutely a non-relevant use case.
14 hours ago
Or just.. download the books, and slap a search engine on top of them. It'll be like 10x smaller than the model. "Survival LLM" is absolutely a non-relevant use case.
When you’re living in an igloo trying to stay warm in the hollowed out belly of a cow having a few books around the place is probably more useful than some files on a laptop that ran out of battery just before it got morbidly damp. Plus you can burn them if you really need to.
On the other hand, the laptop struggling to power a good-enough LLM will probably be a great heat source for you in that igloo... for about 45 minutes.
As I said elsewhere, you can always burn the books! And eating a laptop is considerably crunchier and more fraught than chewing through some good old fashioned leather facings, horse glue and nice heavy 120gsm wove.
On the other hand, if you know enough to build an igloo, you're probably going to be ok regardless.
"cow in an igloo" sounds like something an LLM would hallucinate.
Yes I slightly mangled that one. But I’m sure there is a survival technique that involves crawling into the body cavity of a hollowed out cow. You probably wouldn’t want to do that in an igloo though. I’m not even sure you could get a cow into an igloo. If standard issue humans are this flawed it’s hardly surprising that top flight LLMs get things so wrong sometimes.
And/or install Kiwix and grab an offline copy of Wikipedia.
If you have AI model there it can make any search engine for you as per your needs.