Hello, I'm Michael, I'm applying for a position at Quantum Black and hoping to learn more about kedro and causalnex!

Hi Michael, it's great to have you here! Good look with your application! 💪

Hello everyone! My name's Rohail and i'm a data scientist at UCB, a pharmaceutical company (ucb.com). I've been using kedro, or carbonai as it used to be called at some point :), since 2018? I'm very happy to have seen the project become open source and how it's grown in popularity within our data science community. The thing I like most about kedro is that it created a setup for collaboration between data scientists and engineers and helped ground teams in best practices that help promote reusable codebases.. My thanks to the kedro team for a well designed product - api, documentation and a great momentum in improving the product!

Welcome to the discord @User! You must be one of the longest users of kedro on the Discord! What is your best tip/super power that kedro gives you after all these years of using kedro?

Welcome @User ! Good luck on your application. What have you done to start learning kedro so far? Are there any resources that you feel like you are missing?

Thank you! Hmmmm, not sure what's missing so far. The documentation is pretty thorough, but I'm just branching out to start my own MNIST project now, after finishing most of the spaceflights tutorial

Spaceflights is a solid start

@User thanks for that question! I would give five tips (or at least things that worked quite well for me): 1. Prefer code over yaml API wherever possible - it really allows you to leverage all the features of pycharm and access certain features that the yaml API doesn't provide. YAML API has readability advantages but being able to dynamically generate pipelines based on configuration files is quite powerful. Also, easier to find errors when using the code api. 2. Use templatedconfiguration files whereever possible! Using jinja syntax in the config files is really helpful! Also, good to have conventions about parameter and catalog files --> better to have many small understandable configs rather than huge config files. Creating an understandable directory structure helps! 3. Master debugging kedro pipelines and reproducing errors --> A colleague may see an error on their side that you're not able to reproduce due to the: - Current state of their code (git working state); maybe a fix was pushed that they haven't retrieved - Find out the current state of their pipeline; maybe they retrieved the fix but didn't rerun the affected nodes --> partial pipeline runs are your friend 4. Use kedro starters for recurring projects! Developing these templates has been a tricky learning path since you're constantly enriching the starter as well as generating a project from that template to see that everything works. I've been using some hacky solutions that work for me but there are probably smarter workflows that I'm not aware of 5. When using notebooks in a kedro project, the first few cells should contain the git commit SHA and any versioning configurations for the catalog entries. It becomes difficult to reproduce notebook results since catalog entries keep changing as the project evolves

This is great @User are you creating your own starters internally or just using the ones off the shelf?

Creating our own starters!

oh that's great to hear!

we're also digging deep into hooks and customized great expectations to work for our use cases

Hello all 👋

Hello @User , cool handle. Are you a seasoned kedro user, or checking it out?

Hey guys

I installed kedro == 0.17.3 on my computer, when I am running kedro info it seems to give an error, I don't have git on my system, is it prequisitive for this system

@DhruvK do you mind asking this on #846330075535769601

Hi! I’m a Mechanical Eng, worked in oil and gas around 13 years, mostly root cause analysis for drilling/workover Ops and equipment, data analysis, and lean/CI, recently moved to banking to do data eng and I’m interested in knowing more about Kedro. Big fan of anything that has to do with automation!

Hey @User Kedro feels like a good fit for that sort of problem! Good luck and shout if you need any help

Hey @User I am also a mechanical engineer that made the jump to data science/engineering back in 2017.

Hello Everyone! I am Pranjal Gupta from India, a CSE undergrad, ML/DS practitioner and researcher. Looking forward to contribute to Kedro and interact with you all

Hi @User ! Welcome to the community! Do shout if you need any help or pointers 🙂

Welcome to the communiity @User!! Are you currently using any pipeline framework similar to kedro?

I am extremely new to this! Relied more on the theoretical workflow of DS and ML. I have used airflow tho for a project of mine!

On and off, I have been contributing to the core library, if you see my github handle by the same name

Oh nice, thanks for contributing to the community

Hi everyone! I'm Avaneesh. I've been at QuantumBlack Singapore as a Data Engineer for the past year and had a chance to use it on multiple projects. Looking forward to contribute directly to kedro from now.

Hello everyone! 👋