Comment by ori_b
2 months ago
This is based on assuming 5 questions a day. YouTube would be very power efficient as well if people only watched 5 seconds of video a day.
How many tokens do you use a day?
2 months ago
This is based on assuming 5 questions a day. YouTube would be very power efficient as well if people only watched 5 seconds of video a day.
How many tokens do you use a day?
It would be less power efficient as some of the associated costs/resources happen per request and also benefit from scale.