Comment by deadbabe
13 hours ago
I think it will be a good thing for other reasons: there will be a massive push to get hardware good enough to run local LLMs burning infinite tokens.
13 hours ago
I think it will be a good thing for other reasons: there will be a massive push to get hardware good enough to run local LLMs burning infinite tokens.
Yeah but energy is still a cost, and local inference without batch and multiplexing for many users (like an office would be) is even less optimal. I'm not sure I think it's just pushing the problem forward
Then there will also be a push for cheaper, freer energy as well.
Yeah, with all the AI needs we’ll just have to transition to fusion energy.
1 reply →
Hahahahaha sorry, that's hilarious.