Comment by thewebguyd

3 hours ago

Unpredictable AWS bills are a supply-side problem. He's talking about consumer behavior, and consumers of software do not expect a metered service.

But most consumer's aren't paying per token for access to models, so unless that changes and the labs start charging API pricing to everyone, it's kind of a moot point.