← Back to context

Comment by SpicyLemonZest

6 days ago

We should be, but I just don't know how you'd measure that in the short term. It's very hard to put a number to "how much software did Google release this month". You'd expect to see a substantial increase in revenue, but most kinds of software generate revenue only months down the line after adoption picks up, and few companies have even released Q1 results yet.

We've had LLMs for far longer than a quarter now; even if you think that only the recent ones have led to any improvement, you'd still expect to see something.

  • I’m skeptical that LLMs were capable of producing good software at all until Opus 4.5 in November, and they weren’t good enough to be in my personal workflow until 4.6 in February. I really do think the effects would have started only this quarter.