Comment by SwellJoe

Yeah, without the ability to search the web, a very small model is going to be too dumb to be useful, and maybe even dangerous due to hallucinations. But, there is a point where the knowledge of self-hostable models will surprise you. That point is probably not runnable on the average laptop, though. It's maybe in the ~30B range, but more realistically in the 128B MoE range. I guess in their tests Qwen 3.8 27B got as many right as the much larger Nemotron Super, but I'd bet Qwen 3.8 Flash would be better than either, but it needs 128GB of unified RAM or a big GPU and lots of system RAM to run the 4-bit version.

I think if I had to build an emergency LLM today, that had to run on modest hardware, I'd bet on Gemma 4 12B. It's got excellent reasoning and good vision/audio and speaks 140 languages.

But, I don't know about the "classic" knowledge base theory, though. Is there a high quality curated pile of survival information that could be bundled into a web UI and made searchable in a knowledge base? The LLMs aren't focused on that topic, so there's a lot of wasted space, but they know a little about a lot of things, including survival topics. Combined with Wikipedia, and maybe a few other sources, you're probably better off with one than without.

I guess one could use some huge models plus web search to compile/distill a focused survival knowledge base or LLM.

Edit: Project NOMAD seems to mostly be exactly that. It has authoritative sources in a searchable knowledge base and the tiny LLMs are an afterthought, which is probably what they should be. https://www.projectnomad.us/