Comment by londons_explore
5 hours ago
It will become winner take all when AI companies manage to really get value from user logs.
Right now they don't even get good feedback from local sessions - I can see it make the same mistake two days running, and then months later when a new model comes out, presumably trained on my data, it still makes the same mistake.
law of diminishing returns? i.e. any reasonable frontier lab will have enough user logs...
My theory is there is actual knowledge in the user logs.
When a user says "I'm struggling to undo a bolt on my 1952 Mustang" and the AI responds "try hitting it with a hammer" and the user replies with "that worked thanks" - that is a tiny piece of knowledge which exists nowhere else.
Future AI's can say with more confidence that hitting it with a hammer will probably work.
Across billions of conversations, that can add up to more knowledge than all books.