Kedro Partition Dataset Lacks Caching Support

The community member is asking if there is a reason why PartitionDataset does not have caching support. They explain that when running an expensive computation, if an error occurs, it would be helpful to have a way to resume the computation from where it left off, instead of starting from the beginning. They mention this is particularly relevant when using dict of Callable for Kedro to invoke. The community member wonders if there is a specific reason why this feature is not yet available.

In the comments, other community members express interest in this feature and suggest creating a feature request, as it would require some design considerations. One community member thinks it might be a simple addition, like adding a cache: True parameter to check if the file exists before calling the user function, but acknowledges they may be missing other cases. They mention they will open a request ticket for this.

There is no explicitly marked answer in the provided information.