Join the Kedro community

Home
Members
Luc Soret
L
Luc Soret
Offline, last seen 3 days ago
Joined January 15, 2025

Hey,
I'm using databricks.yml in conf in order to generate the yaml to deploy on databricks workflow, with the command run kedro databricks bundle , I wanted Let's say I have something like :

<my_job>:
  schedule:
    # Run at 12:50
    quartz_cron_expression: '00 30 10 * * ?'
    timezone_id: Europe/Paris
This works fine and the file is well generated
Same, if i'm doing something like :
<my_job>:
  schedule:
    # Run at 12:50
    quartz_cron_expression: '00 30 10 * * ?'
    timezone_id: Europe/Paris
  tasks:
    - task_key: default
      run_if: AT_LEAST_ONE_SUCCESS
Every tasks from my_job has the run_if conditions. However, I just wanted that a specific task inherits this run_in condition :
<my_job>:
  schedule:
    # Run at 12:50
    quartz_cron_expression: '00 30 10 * * ?'
    timezone_id: Europe/Paris
  tasks:
    - task_key: <my_task>
      run_if: AT_LEAST_ONE_SUCCES
But this is not correctly converted to my ressource file from this job

Do you have any idea on how I can solve this ? Cheers !

3 comments
J
L

Hey Kedro users,
A quick question about how parameters are handled in Kedro.
I know I can use parameters defined in parameters/xxx.yml to then pass those parameters as input of node.
My question is : is there a "Kedro way" to also access those parameters in the pipeline.py file to create the node ? My purpose is to build nodes based on a parameter defined in this yml file

Cheers !

2 comments
L
P