Join the Kedro community

A
M
M
M
D

Kedro with databricks and managed table dataset

Ho , I copy your question here. My team and I are using kedro with databricks without problem. Our sources are databricks native tables which can be dealt with the specific ManagedTableDataset, see here. You can unit-test your nodes with a local spark cluster without issue too.

G
F
2 comments

thanks ! and what about Delta Live Table Pipelines? Is there any integration with that? (see: https://docs.databricks.com/en/delta-live-tables/tutorial-pipelines.html)

My apologies, I never used this functionality.

Add a reply
Sign up and join the conversation on Slack
Join