Join the Kedro community

Updated last month

The Value Error: Pipeline Input(s) Not Found in the DataCatalog

At a glance

Hello,

I have this error : ValueError: Pipeline input(s) {'mlflow_run_id'} not found in the DataCatalog
What I am trying to do is to pass "mlflow_run_id" value from one pipeline (named training) to another pipeline (named deployement)
As attached, my kedro viz
And this gist contains my two pipelines + nodes (training) (deployment) code source : https://gist.github.com/Noobzik/cdf7a4754067e587010d4819fae671f4
Can you help me point where I did wrong ?

2 comments

RRakib Sheikh

Sorry, I am just dumb, I forgot the

mlflow_run_id:
  type: MemoryDataset

Inside the catalog

Which it lead me to an another question, how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

JJuan Luis Cano Rodríguez

glad you solved it @Rakib Sheikh!

how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

maybe kedro run --to-outputs=stage_model? (and --from-inputs= if you want to specify a starting point)

would this work for you?

Add a reply