Join the Kedro community

Updated last week

Alternatives to Micro-packaging in Kedro

At a glance

The community member is starting to learn about Kedro and noticed that micro-packaging is being deprecated. They asked for suggestions on alternatives to this feature. Another community member responded that Kedro projects are reusable Python libraries, so you can pip install them and import the pipelines into production code. They mentioned that you may need to ship the configuration with it, and that the kedro package feature still works. The original poster acknowledged this as a viable option.

Useful resources

Hello guys, I am just starting to learn about Kedro and noticed that micro-packaging will is being deprecated. Could someone please suggest any alternatives to that feature?

got it. every Kedro project is a reusable Python library, so in principle you can pip-install it and import those pipelines into the production code.

you might need to ship the configuration with it, so that it can work properly. micropackaging was a (clunky) way of achieving this. kedro package still works.

you can read more here: https://docs.kedro.org/en/stable/tutorial/package_a_project.html#package-a-kedro-project

do you think this would be enough for your needs?

View full solution
J
q
5 comments

hi @qwerty! could you tell us more about your use case? what problem are you trying to solve?

@juanlu Right now I am in the middle of the process of choosing a framework for our project (we are building various things with LLM APIs) to create pipelines and run experiments. The idea was to have a way to share the working solution with our backend so they can easily integrate it into production code.

got it. every Kedro project is a reusable Python library, so in principle you can pip-install it and import those pipelines into the production code.

you might need to ship the configuration with it, so that it can work properly. micropackaging was a (clunky) way of achieving this. kedro package still works.

you can read more here: https://docs.kedro.org/en/stable/tutorial/package_a_project.html#package-a-kedro-project

do you think this would be enough for your needs?

@juanlu Well, I think this is also an option. Thank you!

any time! keep us posted on your progress 💪

Add a reply
Sign up and join the conversation on Slack