Join the Kedro community

Home
Members
Camilo Piñón
C
Camilo Piñón
Offline, last seen last week
Joined November 13, 2024

Hello, team!
Does anyone know the best (or maybe most kedroic) way to work with a PartitionedDataset by processing the partitions individually (merging them would consume all memory). I want to aply the same operations to all partitions. Would it be a better idea to use/add namespaces for this (all my files have the format f"sessions_{YYYY-MM-DD}.parquet")? Thank you!

2 comments
A
C