Join the Kedro community

Updated 4 weeks ago

Create Empty Bigquery Tables In Kedro

Hey team, thank you so for answering my previous questions. Another question on setting up a dataset correctly in the beginning.:

I have table schemas defined in my kedro catalog for bigquery tables. I would like to make sure that I create empty versions of these tables at the beginning of my kedro pipeline based on these schemas.

How can I do this cleanly in kedro?

P
D
J
4 comments

These are tables that might exist and might have data but if not you want the table to be created?

And creating the tables with the first regular write to them is not an option?

Perhaps a before_pipeline_run hook? Realistically, Kedro doesn't provide any such "create empty tables from schemas" functionality out of the box.

Add a reply
Sign up and join the conversation on Slack