Join the Kedro community

Updated 10 hours ago

Was Trying Out Kedro-Databricks On A Simple Project

was trying out Kedro-Databricks on a simple project and the job got stuck for 15 minutes before I killed it, has it happened to anyone?

N
J
3 comments

^is the job request stuck or is the job created successfully but stuck during execution? Can you see the job on Databricks portal?

hmmm actually after 24 minutes (!) it failed with an error that happened quite early in the process

MissingConfigException: Given configuration path either does not exist or is not a valid directory: /dbfs/FileStore/spaceflights/conf/base

so there's

  • an issue with how the config got sent to FileStore
  • an issue with tasks lingering for a very long time before logs are shown 🤔

Add a reply
Sign up and join the conversation on Slack