Join the Kedro community

Updated 2 weeks ago

The Value Error: Pipeline Input(s) Not Found in the DataCatalog

Hello,

I have this error : ValueError: Pipeline input(s) {'mlflow_run_id'} not found in the DataCatalog
What I am trying to do is to pass "mlflow_run_id" value from one pipeline (named training) to another pipeline (named deployement)
As attached, my kedro viz
And this gist contains my two pipelines + nodes (training) (deployment) code source : https://gist.github.com/Noobzik/cdf7a4754067e587010d4819fae671f4
Can you help me point where I did wrong ?

R
J
2 comments

Sorry, I am just dumb, I forgot the

mlflow_run_id:
  type: MemoryDataset
Inside the catalog

Which it lead me to an another question, how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

glad you solved it @Rakib Sheikh!

how can I run all pipeline from the training pipeline till the end so I can keep the mlflow_run_id in memory ?

maybe kedro run --to-outputs=stage_model? (and --from-inputs= if you want to specify a starting point)

would this work for you?

Add a reply
Sign up and join the conversation on Slack