Join the Kedro community

Updated last month

Was Trying Out Kedro-Databricks On A Simple Project

At a glance

was trying out Kedro-Databricks on a simple project and the job got stuck for 15 minutes before I killed it, has it happened to anyone?

N
J
3 comments

^is the job request stuck or is the job created successfully but stuck during execution? Can you see the job on Databricks portal?

hmmm actually after 24 minutes (!) it failed with an error that happened quite early in the process

MissingConfigException: Given configuration path either does not exist or is not a valid directory: /dbfs/FileStore/spaceflights/conf/base

so there's

  • an issue with how the config got sent to FileStore
  • an issue with tasks lingering for a very long time before logs are shown 🤔

Add a reply
Sign up and join the conversation on Slack