Comment by dogman123
3 days ago
sqlmesh execution engine + cloud resource provisioning
provision spark on emr or duckdb on beefy ec2 -> run sqlmesh -> wipe resources.
i'm still in MVP phase of revamping my company's current data platform, so maybe there are better alternatives -- which i'd love to hear about.
Cool, would be happy to talk a bit more about it. Want to shoot me an email (in bio) or if you sign up for our waitlist on https://tower.dev I can reach out in the AM (we’re in Germany)!