https://kedro.org/ logo
Join the conversationJoin Discord
Channels
advanced-need-help
announcements
beginners-need-help
introductions
job-posting
plugins-integrations
random
resources
welcome
Powered by Linen
beginners-need-help
  • d

    desrame

    03/05/2022, 6:29 PM
    ohhhh
  • d

    desrame

    03/05/2022, 6:29 PM
    i was waiting for connection to work before working on pipelines haha
  • d

    datajoely

    03/05/2022, 6:30 PM
    so you can do that if you haven't registered the pipeline in
    pipeline_registry.py
    I think
  • d

    datajoely

    03/05/2022, 6:30 PM
    but if it's already registered it needs to resolve
  • d

    datajoely

    03/05/2022, 6:31 PM
    if this is your first time - it may be worth running through the spaceflights tutorial https://kedro.readthedocs.io/en/stable/03_tutorial/01_spaceflights_tutorial.html
  • d

    datajoely

    03/05/2022, 6:32 PM
    or potentially follow along this training session I did a couple of weeks ago

    https://www.youtube.com/watch?v=NU7LmDZGb6E&t=2191s▾

  • d

    desrame

    03/05/2022, 6:32 PM
    i ran through the spaceflights
  • d

    datajoely

    03/05/2022, 6:32 PM
    ah okay
  • d

    desrame

    03/05/2022, 6:32 PM
    and tried the same thing in another repo with that
  • d

    desrame

    03/05/2022, 6:32 PM
    and had the same issue 😦
  • d

    desrame

    03/05/2022, 6:32 PM
    thinking...
  • d

    datajoely

    03/05/2022, 6:32 PM
    if you're able to share the code I can get it working?
  • d

    desrame

    03/05/2022, 6:32 PM
    oh god thats so overly helpful haha
  • d

    datajoely

    03/05/2022, 6:33 PM
    yeah I might not get a chance tonight
  • d

    desrame

    03/05/2022, 6:33 PM
    let me play around with some of the tools you've given
  • d

    datajoely

    03/05/2022, 6:33 PM
    but I can do it some point in the next 24 hours
  • d

    desrame

    03/05/2022, 6:33 PM
    and see if i cant resolve, i'll look into the no nodes pipeline bit and see if it changes it
  • d

    desrame

    03/05/2022, 6:33 PM
    i can load csv's just fine
  • d

    desrame

    03/05/2022, 6:33 PM
    if that helps at all
  • d

    desrame

    03/05/2022, 6:34 PM
    and i'll cross my T's and dot my I's on the spaceflight as well 🙂
  • d

    desrame

    03/05/2022, 6:34 PM
    id hate to waste your time
  • d

    datajoely

    03/05/2022, 6:34 PM
    okay in
    pipeline_registry.py
    you can just remove the keys from the dictionary
  • d

    datajoely

    03/05/2022, 6:34 PM
    its not a problem!
  • d

    datajoely

    03/05/2022, 6:34 PM
    I'm going to create a thread so capture this topic though
    d
    • 2
    • 41
  • d

    desrame

    03/05/2022, 6:35 PM
    awesome
  • d

    desrame

    03/05/2022, 6:35 PM
    and if i figure it out i'll report back 🙂
  • d

    desrame

    03/06/2022, 11:42 PM
    plugging right along 🙂 is there a preferred method for saving 3d numpy arrays to be called later in the pipeline?
  • d

    datajoely

    03/06/2022, 11:48 PM
    PickleDataSet
    is probably the best shout - potentially with the
    joblib
    backend
  • d

    datajoely

    03/06/2022, 11:49 PM
    also note you don't have to save if you're using things later in the pipeline as it will automatically be handled as a
    MemoryDataSet
  • d

    desrame

    03/07/2022, 12:01 AM
    gotcha, cool!
Powered by Linen
Title
d

desrame

03/07/2022, 12:01 AM
gotcha, cool!
View count: 1