Credentials inserted into dataset configuration causing...

PPaul Weiss

Hi all! I have an issue with credentials not being inserted into the dataset configuration:

credentials.yml
my_connection_string: "<connection>" catalog.yml table1: type: pandas.CSVDataSet filepath: <a target="_blank" rel="noopener noreferrer">abfs://my_container/table1.csv</a> credentials: connection_string: my_connection_string I get "unable to connect to account for Connection string is either blank or malformed.." errors. I guess "my_connection_string" is used as the connection string not "<connection>".

3 comments

NNok Lam Chan

can you change it to credentials: my_conneciton_string instead?

NNok Lam Chan

if i understand correctly, this is what you need:

# credentials:

my_connection_string:
  connection_string: <actual_connection_string> # Assuming connection string is the actual name of the argument

# catalog.yml

<some_data>:
  ...
  credentials: my_connection_string

PPaul Weiss

Thanks so much. I did not realize that the replacement only works for top level keys.

Add a reply

Join the Kedro community

Credentials inserted into dataset configuration causing connection string errors