https://kedro.org/ logo
Join the conversationJoin Discord
Channels
advanced-need-help
announcements
beginners-need-help
introductions
job-posting
plugins-integrations
random
resources
welcome
Powered by Linen
beginners-need-help
  • n

    noklam

    10/04/2022, 1:53 PM
    Is it possible to share the JSON file that you have? or mask any sensitive information. Also which kedro, and kedro-viz version are you using?
  • t

    TESSA_BEIJLOOS

    10/04/2022, 1:57 PM
    yeah of course, and im using kedro viz verson 5.1.1 and kedro version 0.18.2
  • t

    TESSA_BEIJLOOS

    10/04/2022, 1:57 PM
    message has been deleted
  • n

    noklam

    10/04/2022, 2:10 PM
    I cannot reproduce the error, everything works fine on my side.
  • n

    noklam

    10/04/2022, 2:11 PM
    Can you copy the full error trace here? I need to check if the error is coming from kedro or kedro-viz, since the screenshot you post suggest that something went wrong when it is iterating the path.
  • t

    TESSA_BEIJLOOS

    10/04/2022, 2:16 PM
    message has been deleted
    n
    • 2
    • 17
  • n

    noklam

    10/04/2022, 2:18 PM
    from pathlib import Path
    Path('certifai\\data\\09_tracking\\test_attributes_best_model.json').iterdir()
  • n

    noklam

    10/04/2022, 2:18 PM
    Does this give you the same error?
  • r

    rohan_ahire

    10/05/2022, 4:16 PM
    Before we create a Kedro session, we need to change directory to the location where the the pyproject.toml file and the conf files are located right? Is there anything else it needs to create the Kedro session?
  • d

    datajoely

    10/05/2022, 4:18 PM
    You can tweak the pyproject.toml to choose a diff directory iirc
  • r

    rohan_ahire

    10/05/2022, 4:21 PM
    I am using dbx to deploy my code to databricks and with each deployment the code is deployed to a uniquely regenerated uuid folder. So it is hard for me to tell Kedro where the pyproject.toml file is located as with each deployment the project root changes.
  • n

    noklam

    10/05/2022, 4:24 PM
    I am not sure how dbx works, but how would you execute code from there for non-kedro project? I imagine you must start from the same directory, why do you need to specify the absolute path?
    r
    • 2
    • 17
  • r

    rafael.gildin

    10/08/2022, 6:50 PM
    Hello guys, How can i get the dataset name, specidfied in the catalog, from a dataset class for example GBQQueryDataSet?
    d
    • 2
    • 4
  • t

    ToniMaroni

    10/10/2022, 7:52 AM
    Hi Kedro team, do you have some guidelines as per when is it better to split one node into multiple nodes, and conversely when is it better to merge multiple nodes into one? For example, i am working on a feature engineering pipeline that operates on pandas dataframes, and it's not exactly clear for me when i should stack a whole bunch of transformations/augmentations in one single node, or instead split that code into multiple nodes. Would you have some feedback on this? Thanks!
  • r

    rafael.gildin

    10/10/2022, 1:14 PM
    Custom DataSet
  • d

    datajoely

    10/11/2022, 1:10 PM
    We typically use the heuristic "what's easy to test". That leads us to often break nodes down into small single purpose parts rather than big monoliths.
  • d

    datajoely

    10/11/2022, 1:10 PM
    I should say we explicitly mean unit and integration test here
  • t

    ToniMaroni

    10/12/2022, 12:51 PM
    ah ok thanks, so I guess you have unit test for every nodes in your pipelines? I don't have too many unit tests at the moment, and when I have I test more at the output of a pipeline level
  • d

    datajoely

    10/12/2022, 1:53 PM
    Yeah you can confidently test the function of a unit of logic with simple data
  • m

    MichaelB

    10/12/2022, 2:59 PM
    Hey, is it possible to use Kedro's way of handling configuration (paths, envs, etc.) for training a docker image with Sagemaker (from within a pipeline)?
  • a

    Allen Ma

    10/18/2022, 2:02 AM
    hi I tried to develop kedro plug-in locally. When I obtained the pipeline, I found that the node tags were not obtained. But I did when I defined it
  • t

    Thiago Poletto

    10/18/2022, 11:40 AM
    Hey guys, how do I prevent a specific node from running until an event happens?
  • d

    datajoely

    10/18/2022, 11:49 AM
    We do typically encourage this because it introduces combinatorial complexity. But env vars are the easiest way imo
  • t

    Thiago Poletto

    10/18/2022, 11:56 AM
    thanks, sorry for the lazy question, too much on my head, and too early in the morning...
  • n

    noestl

    10/18/2022, 4:53 PM
    Hey team, what best approach do you have to generate a data catalog from catalog.yml?
    n
    • 2
    • 2
  • n

    noklam

    10/18/2022, 5:08 PM
    Generate catalog from catalog.yml
  • e

    eliaspd

    10/18/2022, 7:40 PM
    These are dedicated outputs to a pipelines, so they are not namespaced in their origin pipeline (or the catalogue). But now these origin pipelines are part of a modular pipeline . Now that I wrapped these pipelines inside a Modular pipeline they've become namespaced and roam around my kedro viz, if I don't unfold the pipelines. What is the best way to handle this?
  • o

    ongeiver

    10/18/2022, 8:01 PM
    Hello, In the spaceflight tutorial, the following code is used to create a pipeline:
    python
    from kedro.pipeline import Pipeline, node, pipeline
    def create_pipeline(**kwargs) -> Pipeline:
        return pipeline(
            [
                node(),
                node(),
            ]
        )
    I have a "Module is not callable" lint error due to the use of
    pipeline()
    (without a capital letter). The message disappears when I replace
    pipeline()
    by
    Pipeline()
    . What is the difference between these 2? and why are we importing both?
  • n

    noklam

    10/18/2022, 8:25 PM
    Does it gives you an error when you run it? pipeline is a function that helps you to create the Pipeline object.
  • n

    noklam

    10/18/2022, 8:26 PM
    The cap is a class, the non cap version is a function to create the class
Powered by Linen
Title
n

noklam

10/18/2022, 8:26 PM
The cap is a class, the non cap version is a function to create the class
View count: 1