https://kedro.org/ logo
Join the conversationJoin Discord
Channels
advanced-need-help
announcements
beginners-need-help
introductions
job-posting
plugins-integrations
random
resources
welcome
Powered by Linen
beginners-need-help
  • d

    datajoely

    07/21/2021, 2:34 PM
    🤔 It's a good thought
  • w

    waylonwalker

    07/21/2021, 2:34 PM
    i've quickly turned my help question into marketing my plugin 👅
  • a

    Arnaldo

    07/21/2021, 4:21 PM
    amazing work, @User 👏 👏 👏
  • w

    waylonwalker

    07/21/2021, 4:26 PM
    Thanks @User , we are getting close to a first release! right now the output is messy, we still have warnings and logs mixed in, but you are welcome to give it a spin by installing right off of github
  • w

    waylonwalker

    07/21/2021, 4:27 PM
    It will add a directory called
    .kedro-diff
    , but other than that it will actually copy your project into a tmp directory while it does the checkouts, so there is no risk in it mucking with your actual project.
  • j

    jcasanuevam

    07/22/2021, 11:26 AM
    Hi! I'm trying to run 'kedro install' in my root directory in order to install the packages listed in my src/environment.yml (I have conda dependencies) but I get the following error: conda env update --file 'C:\Users\jcasanueva\ALTEN Group\OPS - Digital Department - Analytics and ML\PSE-Analytics\PSE-Qualiview_Prediction\a400m_tp_kedro\a400m-tps-analytics\src\environment.yml' --prune Traceback (most recent call last): . . . File "C:\Users\jcasanueva\.conda\envs\a400m_tp_kedro\lib\subprocess.py", line 1311, in _execute_child hp, ht, pid, tid = _winapi.CreateProcess(executable, args, FileNotFoundError: [WinError 2] the system could not find the file specified
  • d

    datajoely

    07/22/2021, 12:04 PM
    @jcasanuevam are you able to
    pip install kedro
    instead at the start of the process? We’re getting reports of conda not working nicely atm
  • j

    jcasanuevam

    07/22/2021, 12:07 PM
    yep, kero is already installed. Maybe it's because I have already installled that packages in the kedro conda environment?
  • d

    datajoely

    07/22/2021, 12:07 PM
    Yes that’s what I mean
  • d

    datajoely

    07/22/2021, 12:07 PM
    You can use conda for env creation
  • d

    datajoely

    07/22/2021, 12:07 PM
    But conda install has been a bit of an issue lately
  • j

    jcasanuevam

    07/22/2021, 12:10 PM
    ok! thanks. One more issue: How can I add a new configuration file to my conf/base/ directory? Inside conf/base directory I have created a new config.yml file and use it as input for some nodes, so when I run 'kedro run' I get the following ValueError: Pipeline input(s) {'config'} not found in the DataCatalog
  • d

    datajoely

    07/22/2021, 12:14 PM
    No problem!
  • d

    datajoely

    07/22/2021, 12:14 PM
    So Kedro is set up by default to find YAML files in the following patterns
  • d

    datajoely

    07/22/2021, 12:15 PM
    If you're not familiar with glob syntax it will find any YAML file prefixed with
    catalog_
    or any file under a folder called
    catalog
    https://en.wikipedia.org/wiki/Glob_(programming)
  • d

    datajoely

    07/22/2021, 12:16 PM
    so by default it won't find
    config
    unless you tweak the patterns Kedro is set up to look for
  • d

    datajoely

    07/22/2021, 12:16 PM
    the pipeline inputs should also be a KEY within the
    yml
    file not the file name
  • d

    datajoely

    07/22/2021, 12:16 PM
    does the make sense?
  • j

    jcasanuevam

    07/22/2021, 12:21 PM
    and where I can tweak the patterns Kedro is set up to look for?
  • d

    datajoely

    07/22/2021, 12:21 PM
    In the current version of Kedro you have to inherit and implement your own config loader class
  • d

    datajoely

    07/22/2021, 12:22 PM
    it may be easier to just work within the pre-defined parameter and catalog namespaces
  • j

    jcasanuevam

    07/22/2021, 12:22 PM
    hahaha yeah I think so, thanks!
  • d

    datajoely

    07/22/2021, 12:23 PM
    In an upcoming version either 0.17.5 or 0.18.0 this exact thing will be just a config change
  • d

    datajoely

    07/22/2021, 12:23 PM
    Good luck and shout if you have any problems
  • d

    datajoely

    07/23/2021, 5:43 PM
    @DhruvK git is not a requirement but you will get a warning if you don’t have it installed as we’re trying to encourage good version control practices
  • d

    DhruvK

    07/23/2021, 5:44 PM
    I installed kedro == 0.17.3 on my computer, when I am running kedro info it seems to give an error, I don't have git on my system, is it prequisitive for this system? But it should give the error right
  • d

    DhruvK

    07/23/2021, 5:45 PM
    I see but not everyone uses git repo, I use Azure devops repo
  • d

    datajoely

    07/23/2021, 5:45 PM
    So git the protocol is used by both GitHub and Azure DevOps
  • d

    datajoely

    07/23/2021, 5:45 PM
    https://stackoverflow.com/questions/13321556/difference-between-git-and-github
  • d

    DhruvK

    07/23/2021, 5:47 PM
    Yeah ! Thanks for sharing
Powered by Linen
Title
d

DhruvK

07/23/2021, 5:47 PM
Yeah ! Thanks for sharing
View count: 1