Comment by yid
9 years ago
> you'll still possibly reap massive perf gains over Hadoop in certain contexts.
Certainly, and unfortunately, the exact point at which Hadoop becomes the better option over big iron is generally an ongoing debate and shifting target. But there's no doubt that such a point actually exists.
...I'm not sure if it does. Bain's Law still stands.
But if it does, then it's a pretty big chunk of data, and a very fast network.
Couldn't find anything for Bain's Law, do you have a reference I could follow?
I believe it's a reference to this old (but insightful) comment: https://news.ycombinator.com/item?id=8902739
As such, it is actually "Bane's Rule" which states, "you don't understand a distributed computing problem until you can get it to fit on a single machine first."
(Thanks to nekopa, who also referenced it further down in this thread.)