Comment by simonw
5 hours ago
Yes, my opinions are driven by anecdotal evidence. I think that's fine: I have a pretty good track record, and I'm careful to share my reasoning.
If you want indisputable, data-driven information about the state of the LLM world I guess you can wait for a peer-reviewed academic paper?
Those have been around for a long long time, you may be focusing on anecdotes but the adoption numbers and performance trends speak for themselves and we’ve had performance trends for years. People can argue about whether or not enterprise level adoption has a clear ROI today but the fact that we’re at the point where entire large scale companies are already completely refactored, directly after opus 4.5, if that’s not a convincing enough signal I don’t know what is.
I think we're in agreement then; the point I was responded to was saying your blog was evidence-driven, and we can both agree it's not -- at least to the standard that would pass peer-review.
I don't know if there's much in my blog that could be backed by robust evidence. It's not like "product-market fit" is a testable condition.
I did try to provide credible links to back up my assertions about things like enterprise pricing changes.