Join the Kedro community

Home
Members
Richard Purvis
R
Richard Purvis
Offline, last seen 2 weeks ago
Joined October 1, 2024

Hi all, I'm having trouble getting kedro viz to run, even for an example repo. Here's the steps I've taken:

  1. run uvx kedro new (uses kedro 0.19.11 )
  2. Generate a project with options 1-5,7 (everything but pyspark)
  3. Run uv venv and uv sync
  4. Run kedro viz, I get the following output: Error: No such command 'viz'.

This is on a Mac with python 3.11. Am I missing something very obvious?

6 comments
R
J

Question, if we have a dataset in the catalog that updates incrementally with an upsert/append, and then is an input to another node, is there a risk that the full dataset will get loaded from the catalog and input to the downstream node rather than the increment of data?

12 comments
J
R
N

Hi team, are there any best practices for optimizing spark code within Kedro pipelines? I have a large pipeline that executes at the last node due to lazy eval. I would like to look at execution plans, etc.

Any suggestions? I suppose this would apply to Polars/Ibis/other similar frameworks.

3 comments
m
N