Agenda for the showcase today at 18:30 UK 18:30 - Welcome, intro to Kedro, the team and recap of the latest release 0.17.4 18:40 - @User - Saying good bye to the

KedroContext

   18:43 - @User  walkthrough of the latest features in Viz   ⮑ New Params ⚙️, Split panel 🧭, Tree nav 🌴, Plotly  18:53 -  @User  on Experiment tracking 🧪 18:55 -  @User on Modular Pipeline packaging update 📦 19:00 -  Handover to @User + @User ) from the Dolt team to talk about data versioning 19:10 - @User  - The state of config in Kedro  19:13 - @User  bring us home with community announcements 19:15 - Q&A - Ask us anything 19:30 - Close Zoom link here: https://mckinsey.zoom.us/j/98404972424?pwd=ZnFFenJ1aTNNZUI5ckxoc3V4dE5uQT09

@here Our Open Kedro Retro is available on YouTube. It's currently unlisted until we put in captions for accessibility. Link:

@here 🎀 Kedro-Viz Release Kedro-Viz 3.13.0 is available on PyPI. We’ve introduced significant design upgrades for the sidebar. You will find a tree navigation panel that arranges nodes and datasets within modular pipelines and a separate filter panel for tags and elements. We’ve also made it possible to access your entire parameter object via a JSON viewer on the metadata side panel, as well as the source code for decorated functions via the code panel. Find the full release notes. ⬇️ Install and Upgrade Kedro-Viz Upgrade Kedro-Viz 3.13.0 with the following:

pip install kedro-viz==3.13.0

Love that parameter view + nested sidebar amazing work team!

Also like to nudge people that Kedro Viz is designed to be as backwards as compatible so you should be able to upgrade your projects freely

Sneak peak of auto-reload coming to Viz (one of many advantages the new fastapi backend affords us) https://github.com/quantumblacklabs/kedro-viz/pull/498

Hi Kedroids ! It’s been about a month and half since we launched (opt in) telemetry into Kedro and wanted share back some very early insights. We’ve been able to plot our most common journeys (log scaled, see the sunburst diagram attached). This data is really invaluable for us learning about how you use the framework and will hopefully reduce the number of interviews we need to do to understand how people use certain features. Have a great week everyone!

@here Is anyone interested in presenting a use case about using Kedro and AWS products at your company for re:Invent 2021? I'd need to know by 17:00 (UTC +01:00); with form submissions to be ready for Thursday, the 29th of July.

@here 🎀    Kedro-Viz Release Kedro-Viz

3.14.0

 is available on PyPI. We’ve now introduced Focus Mode 🧐 which takes our new tree view to the next level allowing you to drill into specific branches. We’ve also added a new

--auto-reload option

that does what it says on the tin!  Find the full release notes here. https://github.com/quantumblacklabs/kedro-viz/releases ⬇️    Install and Upgrade Kedro-Viz Upgrade Kedro-Viz 3.14.0 with the following:

pip install kedro-viz==3.14.0

π𝜋𝛑𝝅𝞹ℼ

@here A while back we started the research to understand how people use configuration in Kedro. We are pleased to share the findings publicly with you all in this GitHub Issue https://github.com/quantumblacklabs/kedro/issues/891. Please feel free to add your thoughts and comments to this as we continue to work on this in the near future to improve your Kedro experience. Finally a big THANK YOU to all our research participants. We could not have done this without you. 🙏🏾 ❤️

Thanks for putting this together Hamza Oza! So what is Kedro's final recommendation after having gone through this analysis for the best method of Data Catalog Generation? It looks like YAML Anchors?

We haven't made a decision yet- we're just trying to be open with our thinking

@here KEDRO RELEASE Kedro 0.17.5 is available on PyPI and Conda. This version of Kedro has bugfixes and introduces several new features and improvements, including: 🧪 Two datasets to enable basic experiment tracking (https://kedro.readthedocs.io/en/stable/08_logging/02_experiment_tracking.html): 

tracking.MetricsDataSet

and

tracking.JSONDataSet

📦 Support for bulk packaging/pulling modular pipelines 💻 A new CLI group registry with the associated commands kedro registry list and kedro registry describe, to replace kedro pipeline list and kedro pipeline describe 🥒 Support for dill backend to PickleDataSet 🐛 Pinned dynaconf to fix issues with a broken method signature See the release notes for more info: https://github.com/quantumblacklabs/kedro/blob/master/RELEASE.md ⬇️     Installation Kedro 0.17.5 is a non-breaking release in the 0.17.x series, upgrade now with:

pip install kedro==0.17.5
conda install -c conda-forge kedro==0.17.5

@here Please check out the message posted in #778998619067908106 by @User but we'd like to present the new

kedro-neptune

plugin, which creates a seamless experience using Kedro and Neptune. Neptune is used for: - Experiment tracking: Log, display, organize, and compare ML experiments in a single place. - Model registry: Version, store, manage, and query trained models, and model building metadata. - Monitoring ML runs live: Record and monitor model training, evaluation, or production runs live Find out more about the plugin by: - Watching a video about how it works: https://www.loom.com/share/0a690ce0aa39405da955e853d2fd73d6?t=2 - Reading the documentation: https://docs.neptune.ai/integrations-and-supported-tools/automation-pipelines/kedro

Hey Kedroids! I’ve just posted 4 prototypes to our config research piece, it would be great to get some feedback on how we can improve the configuration overhead in Kedro 💪 https://github.com/quantumblacklabs/kedro/issues/891#issuecomment-930217650

Mark your calendars, kedro is going to be featured on @TalkPythonthis Friday. Join the live chat on YouTube to be a part of the show. https://t.co/dysJyYXVB6

@here We're participating in Hacktoberfest again! We'll need to know if there is enough interest for us to create a #hacktoberfest channel, please indicate if you would join it with a 👍 What we'd like to encourage? - We would prefer newcomers to the open-source community to pick up

goodfirstissues

, and we'd love to help you learn how to contribute to the open-source community - Look out for issues tagged with

hacktoberfest

for easier contributions - Get hacking!

Hacktoberfest tasks

All of our hacktoberfest tickets have been taken up by you lovely people only 6 days into the mont! Don't worry - I've got a long backlog of ideas, so stay tuned for more issues on GitHub 🙂

This channel has been set up to receive official Discord announcements for admins and moderators of Community servers. We'll let you know about important updates, such as new moderation features or changes to your server's eligibility for Server Discovery, here. You can change which channel these messages are sent to at any time inside Server Settings. We recommend choosing your staff channel, as some information may be sensitive to your server. Thanks for choosing Discord as the place to build your community!

@here Kedro-Viz 4.0.0 is here Hi everyone, we're very excited to announce the release of Kedro-Viz 4.0.0. This release marks a new era in Kedro-Viz, in which we commit to deliver the best interactive development experience for Kedro as we possibly can. The highlight of this release is the ability to expand and collapse modular pipelines on your Kedro pipeline. We hope that this feature could improve the usage of modular pipelines with Kedro, which we believe is the best way to build modular data science code. And as you might already have heard, we have more to come very soon 🚀 Demo: Spaceflights pipeline: https://quantumblacklabs.github.io/kedro-viz/?data=spaceflights Stress demo: https://quantumblacklabs.github.io/kedro-viz/ As usual, you can install it with:

pip install kedro-viz==4.0.0

If you have any feedback, let us know.

@here We're going to be launching an online Kedro training series soon. In the sessions, you'll interact with one of the Kedro maintainers, get an introduction to Kedro and learn how to use it as a beginner. We make the sessions hands-on. Is anyone interested in signing up? This may also include that you express interest for friends and/or colleagues to join too. Indicate your interest with a 👍 and we'll get enrolment going soon.

Just in case this may be of interest for someone, I've started a kedro-serving (https://github.com/Galileo-Galilei/kedro-serving) to serve kedro pipelines with fastapi. The plugin is in a very early stage, but feedbacks would help a lot to improve it!

This looks very interesting, thanks for sharing! Will have a proper look later, but I'm very intrigued by your commit message emojis 😀 Do you have some sort of standardised categorisation/way of doing these or do you just insert them manually as you feel like it?

there is an emoji-code for that: https://gitmoji.dev

Yes, that's what I use!

Kedro-Viz 4.1.1 is out @here This is the release you’ve all been waiting for - Kedro-Viz now supports native experiment tracking 🧪 The Kedro-Viz team is very excited to introduce you all to the first MVP of native Experiment Tracking on Kedro-viz, where you will be able to see and compare the various tracked datasets from your Kedro runs. ( More information here :  https://github.com/quantumblacklabs/kedro-viz#experiment-tracking-usage). This is enabled via the introduction of a SQLite database on the Kedro-viz server, as well as the setup of GraphQL technology that enables us to deliver the experiment data in a fast and reliable way. The team is hard at work adding more and more features in this space - check out our roadmap for more info (we’re currently at Milestone 2): https://github.com/quantumblacklabs/kedro/issues/1070 . To get started - simply use one of the two special datasets 

tracking.MetricsDataSet

 and 

tracking.JSONDataSet

 , check out the docs for more info! Checkout our new demo here : https://kedro-viz-live-demo.hfa4c8ufrmn4u.eu-west-2.cs.amazonlightsail.com/runsList ⬅️⬅️⬅️ Have a great Friday everyone!

Thank you to the Kedroids who have helped out with #864784648575254558 @User @User @User @User !