Hey,
I'm using databricks.yml in conf in order to generate the yaml to deploy on databricks workflow, with the command run kedro databricks bundle , I wanted Let's say I have something like :
<my_job>:
schedule:
# Run at 12:50
quartz_cron_expression: '00 30 10 * * ?'
timezone_id: Europe/ParisThis works fine and the file is well generated<my_job>:
schedule:
# Run at 12:50
quartz_cron_expression: '00 30 10 * * ?'
timezone_id: Europe/Paris
tasks:
- task_key: default
run_if: AT_LEAST_ONE_SUCCESSEvery tasks from my_job has the run_if conditions. However, I just wanted that a specific task inherits this run_in condition :<my_job>:
schedule:
# Run at 12:50
quartz_cron_expression: '00 30 10 * * ?'
timezone_id: Europe/Paris
tasks:
- task_key: <my_task>
run_if: AT_LEAST_ONE_SUCCESBut this is not correctly converted to my ressource file from this jobHey Kedro users,
A quick question about how parameters are handled in Kedro.
I know I can use parameters defined in parameters/xxx.yml to then pass those parameters as input of node.
My question is : is there a "Kedro way" to also access those parameters in the pipeline.py file to create the node ? My purpose is to build nodes based on a parameter defined in this yml file
Cheers !