Comment by micro_softy
9 years ago
What happens if a consultant approaches a company that uses Hadoop and offers them "custom data transformation" solutions for their most frequent processing jobs at lower cost and that beat Hadoop's processing times 100-fold?
The company saves money by choosing the lower cost and time by not having to wait for slow Hadoop processing.
It seems like there is competitive advantage to be gained and money to be made by taking advantage of Hadoop's inefficiencies.
But then things are not always what they seem.
This assumes that company will be making rational choice, which is rarely the case. The choice is usually made based on "no one got fired by using X".
Or/and "my resume will look good because big data and Hadoop and Spark and ..."