The Value Error: Pipeline Input(s) Not Found in the DataCatalog

Question

Hello,

I have this error : ValueError: Pipeline input(s) {'mlflow_run_id'} not found in the DataCatalog
What I am trying to do is to pass "mlflow_run_id" value from one pipeline (named training) to another pipeline (named deployement)
As attached, my kedro viz
And this gist contains my two pipelines + nodes (training) (deployment) code source : https://gist.github.com/Noobzik/cdf7a4754067e587010d4819fae671f4
Can you help me point where I did wrong ?

Rakib Sheikh · Answer

Sorry, I am just dumb, I forgot the mlflow_run_id:
  type: MemoryDataset Inside the catalog Which it lead me to an another question, how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

Juan Luis Cano Rodríguez · Answer

glad you solved it  @Rakib Sheikh ! how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ? maybe  kedro run --to-outputs=stage_model ? (and  --from-inputs=  if you want to specify a starting point) would this work for you?

Join the Kedro community

The Value Error: Pipeline Input(s) Not Found in the DataCatalog