Comment by HarHarVeryFunny
2 months ago
10M items @ 10 tokens each ("20 bottles of ferric chloride" etc) plus 10M tokens out (category) is 100M tokens in 10M tokens out.
Claude Haiku is $0.25 per 1M tokens in, $1.05 per 1M out, so cost would be ~$35.
GPT-4o mini is even cheaper at $0.15 per 1M in.
Of course if your volume justifies the hardware cost you could always run Llama locally, for the cost of the electricity used.
No comments yet
Contribute on Hacker News ↗