Kedro

These are the coolest emotes !!! <:yetu:844961817507790869> <:kedro:783422505645113354>

Doing some kedro for the next ~1hr live.

https://www.twitch.tv/waylonwalker

We’re currently agonisingly close to 4K stars… can anyone help with that? 😊 <:kedroid:855153796736614411>

https://github.com/quantumblacklabs/kedro

What's this an indication of? More Kedro in production? I imagine much of this could be CI builds.

for sure, much of this is ci builds. Just a cool milestone, it does give indication that its growing and that many people are using it, but no this doesnt represent how many.

I'm thinking I'll be working on kedro-diff

Converting our pypi-list project to a kedro starter in 30 minutes.

https://twitch.tv/waylonwalker

Made some progress on pypi-list this morning, should be able to turn it into a starter next time. 
 https://github.com/WaylonWalker/pypi-list

Working on kedro-diff now, lets talk about building data pipelines with python.

https://www.twitch.tv/waylonwalker

Welcome for any feedback, getting close to a first release.


If anyone has a public kedro project with a git history I would love to try using kedro-diff on it.  Please share a link below

https://github.com/WaylonWalker/kedro-diff

Kedro-Accelerator is a plugin that speeds up pipelines by parallelizing I/O in the background. 

To get started, `pip install kedro-accelerator`.

Comments? Questions? Thoughts? Suggestions Check out: https://github.com/deepyaman/kedro-accelerator

Let's play with mixing partitioned, incremental, and versioned datasets.

https://www.twitch.tv/waylonwalker

Lets work on a new kedro starter

https://twitch.tv/waylonwalker

submitted the simple starter to the starters repos on stream this morning. https://github.com/quantumblacklabs/kedro-starters/pull/40

working on kedro diff live, join in now.

https://twitch.tv/waylonwalker

Woohoo! 🥳 
https://www.youtube.com/watch?v=DXp4ey3rh-E

So much better than this silly reply feature

This is our starting point today with kedro-diff.  the goal will be to get rid of all logging unless  --verbose is called

and aready we found two culprits, and have a clean output.

<@!538915541210103818> I'm speaking at EuroPython tomorrow about Kedro. Still finishing up the slides. Do you mind if I use some of Kedro diff screenshots above? They look amazing. Also I know I still owe you a python package. It's just between getting covid and everything else I haven't found the time. Will definitely get on it though.

<@456226577798135808> I had no idea you got covid.  Are you and the ones you're close to ok?

Of freaking course you can use these screenshots!!

Let me edit that pipeline and give you some screenshots with some changed nodes, these only have adds/deletes.

is the galaxy background ok, or do you want something cleaner while I am at it.

I think it's perfect the way it is. Just want to show some cool extensions on the final slide.