← Back to context

Comment by smalltorch

6 hours ago

Is there any understanding of how it's even 50b? Makes no sense to me.

My team at my company alone burned through $100k worth of tokens in September.

When it hit $20k it triggered a talk with management, but ultimately they decided it was worth because of the value the LLM was providing.

  • Do you have any insight into how your management tracks the value it is providing?

    This is something we've been trying to do for a while now and have not found a convincing metric.

My employer is paying thousands per month for my tokens. Multiply that by a million people and there’s your $50B per year.

You might ask: how could this possibly pencil out for my employer? Answer: I’m the only person left on what used to be a team.

Nvidia’s revenue is more than that per quarter, the demand for AI workloads is through the roof.