Comment by sureglymop
2 days ago
That's one thing. Another would be introducing homomorphic encryption in order for companies and people using their models to stay compliant and private. I can't believe it's such an under-researched area in AI.
2 days ago
That's one thing. Another would be introducing homomorphic encryption in order for companies and people using their models to stay compliant and private. I can't believe it's such an under-researched area in AI.
That is the only implementation I can think of that might make me trust a third party with confidential data. Of course these massive transformers are already insanely computer intensive and adding FHE would make that orders of magnitude worse.
I agree but that's why it needs to be researched more. Some changes in architecture may be able to address some performance problems. It could lead to algorithmic optimizations or even specialized hardware for this.
100% on board. This would be a paradigm shift for cloud services.
(And take away a, for many significant, source of income - data they can sell, train on, etc - So I’m afraid the incentive to research an implement it will be lacking)