Hello 🙂
I would like to know if, when generating the Airflow DAG for a Kedro project using the kedro-airflow tool, is it possible to create a separate DAG for each pipeline in the project rather than a single DAG per project? If so, how can I configure each DAG to specify start times and other parameters for each DAG corresponding to each pipeline in the project?
I think I've found the answer to my question 😄 For generating DAGs for specific Kedro pipelines, I can use kedro airflow create -p <pipeline_name>. For configuration options, here’s what’s available:
-e, --env: Set the Kedro configuration environment, default is local.-j, --jinja-file: Template file for the DAGs.--params: Pass extra parameters to the context initializer.--conf-source: Path to the configuration folder or archived file for the DAG.