Comment by cmrdporcupine

There's also prior art. Or probably, anyways.

https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_liter...

Not only is it replicable as you say, things like it already exist(ed).

The important bit of course is in the actual implementation: a) models fine tuned to produce good results for these types of questions and b) runtimes optimized to do this quickly and at scale