Comment by lostlogin
6 months ago
But also: if Apple's way works, it’s incredibly wasteful.
Server side means shared resources, shared upgrades and shared costs. The privacy aspect matters, but at what cost?
6 months ago
But also: if Apple's way works, it’s incredibly wasteful.
Server side means shared resources, shared upgrades and shared costs. The privacy aspect matters, but at what cost?
Server side means an excuse to not improve model handling everywhere you can, and increasing global power usage by noticable percentage point, at a time when we're approaching "point of no return" with burning out the only planet we can live on.
The cost, so far, is greater.
> Server side means an excuse to not improve model handling everywhere you can...
How so if efficiency is key for datacenters to be competitive? If anything it's the other way around.
Or, instead of improving efficiency, they go ahead and just deploy more generators [0]. Stop gap measures are cheaper.
[0] https://interestingengineering.com/innovation/elon-musk-xai-...
1 reply →
The previous commenter is right in that server-side companies have little incentive to do less, especially when they're backed by investors money. Client-side AI will be bound by device capabilities and customer investment in new devices.
How does running AI workloads on end user devices magically make them use less energy?
More like squinting to see if it's still visible in the rear view mirror.
With the wave of enshitiffication that's surrounding everything tech or tech-adjacent, the privacy cost is pretty~ high.