Join the Kedro community

Updated last month

Using Kedro Catalog Resolve With Multiple Configuration Folders

At a glance

Hello,

I have a question regarding the kedro cli tool `kedro catalog resolve`.
In our way of working with kedro, we generate specific conf for pipeline (independtly from general conf).

It means, that we have the base, and local folder in conf folder, but we also generate conf folder for specific pipelines. When we run pipeline, we do it like kedro run --conf-source={pipeline_conf}

However, With this way of doing, I am not able to use kedro catalog resolve since it is not possible to specify --conf-source in the cli tool.

Would you have any idea on how I could do that?

d
T
6 comments

Hmm that's an interesting idea

to get this in the short term I think you'd need to extend our CLI to do this, but this is a good feature request

https://github.com/kedro-org/kedro/blob/9cbd2f74edb551bb6f2d5d50353c3ae0ea806737/kedro/framework/cli/catalog.py#L217

Ok, can I try to propose a PR?

So I was suggesting you extend your current project to unblock you today
https://docs.kedro.org/en/stable/extend_kedro/common_use_cases.html#use-case-3-how-to-add-or-modify-cli-commands

But once you get it working, we'd absolutely love a PR extending kedro catalog resolve to accept --conf-source

Ok great, I will do that. Thank you 🙂

This similar PR should actually give you everything you need
https://github.com/kedro-org/kedro/pull/3199

Add a reply
Sign up and join the conversation on Slack