Join the Kedro community

q
qwerty
Offline, last seen 4 days ago
Joined February 14, 2025

Hello, guys, I noticed that there is no support for log_table method in kedro-mlflow. So I wonder what will be the right way to log additional data from a node, something that is not yet supported by the plugin?

Right now I just do something like this at the end of the node function

mlflow.log_table(data_for_table, output_filename)
But I am concerned as I am not sure if it will always work and will always log the data to the correct run because I was not able to get retrieve the active run id from inside the node with mlflow.active_run() (it returns None all the time).

I need this because I want to use the Evaluation tab in the UI to manually compare some outputs of different runs.

15 comments
q
Y
P

Guys, could someone help with using KedroContext properly?

I want to add a --only-missing CLI parameter to kedro run so that it runs pipelines using the run_only_missing method. From what I understand, adding this parameter to the default CLI was rejected because it can be implemented via KedroContext customization.

However, I’m not sure how to do this correctly. Or maybe I am missing something 😔
Could someone share an example or a code snippet because I don't see the usage of this class in the docs (e.g. here or here)?

3 comments
E
q

Also am I right that there is no way to run pipelines only if they include all of the tags listed in the run configuration via default cli ?

3 comments
E
q

Guys, is this the right place to ask about kedro-mlflow plugin?

3 comments
Y
q

Hello guys, I am just starting to learn about Kedro and noticed that micro-packaging will is being deprecated. Could someone please suggest any alternatives to that feature?

5 comments
J
q