Comment by appplication
2 months ago
There’s also probably a lot less noise from casual internet conversations. I imagine a nontrivial amount of what LLMs know about certain technologies comes directly from forums like reddit where quality of response isn’t guaranteed.
I mean, just the way Tao phrases these inqueries seems to imply a weighting towards an extremely abstract and high level rigorous corpus. In a way, prompt engineering really is the big unlock here.
Maybe! But I suspect you can write a little LLM assisted helper to at least make your prompts sound more like Tao's. (Your ideas won't necessarily be better, but you can probably 'imply a weighting towards an extremely abstract and high level rigorous corpus'.)
Not likely. You run the risk of bleeding into the crank mathematics language pool which is well represented in the training. I mean the prompts may sound good to you and me, but they will have low probability words in respect to the Tao level maths.