Comment by esafak
2 days ago
For bigger workflows, this declarative pattern is already implemented by orchestrators like Dagster, Flyte, and recently Airflow; e.g., https://dagster.io/blog/declarative-scheduling [fixed]
2 days ago
For bigger workflows, this declarative pattern is already implemented by orchestrators like Dagster, Flyte, and recently Airflow; e.g., https://dagster.io/blog/declarative-scheduling [fixed]
Are you talking about Airflow Datasets and data-aware scheduling?
https://airflow.apache.org/docs/apache-airflow/2.4.0/release...
Isn't that about as recently as Dagster?
Yes, asset-aware scheduling.
this 404's for me