Comment by pm90
3 days ago
Theoretically, yes, if AWS were really focused on they could probably deliver something like databricks; all the components are off the shelf, and a significant number of databricks clusters are on aws anyway. The question though is why; they’re already driving a lot of traffic to AWS and managing all the end customer stuff. The benefit of killing databricks is less than letting it live and grow and buy more from AWS.
Good point. I had the assumption that AWS EMR and Redshift had incentives to compete with Databricks. Another assumption was that someone in the AWS will eventually be ambitious enough to add offerings similar to Databrick's, like how AWS added MKS and OpenSearch. Both assumptions can well be wrong, though.