Comment by whattheheckheck

Why is everyone so scared of pyspark? Make it run in a local docker image and call it off to a sagemaker processing job