https://kedro.org/ logo
Join the conversationJoin Discord
Channels
advanced-need-help
announcements
beginners-need-help
introductions
job-posting
plugins-integrations
random
resources
welcome
Powered by Linen
announcements
  • d

    datajoely

    06/17/2021, 1:50 PM
    Agenda for the showcase today at 18:30 UK 18:30 - Welcome, intro to Kedro, the team and recap of the latest release 0.17.4 18:40 - @User - Saying good bye to the
    KedroContext
       18:43 - @User  walkthrough of the latest features in Viz   ⮑ New Params ⚙️, Split panel 🧭, Tree nav 🌴, Plotly  18:53 -  @User  on Experiment tracking 🧪 18:55 -  @User on Modular Pipeline packaging update 📦 19:00 -  Handover to @User + @User ) from the Dolt team to talk about data versioning 19:10 - @User  - The state of config in Kedro  19:13 - @User  bring us home with community announcements 19:15 - Q&A - Ask us anything 19:30 - Close Zoom link here: https://mckinsey.zoom.us/j/98404972424?pwd=ZnFFenJ1aTNNZUI5ckxoc3V4dE5uQT09
  • y

    Yetunde

    06/18/2021, 5:01 PM
    @here Our Open Kedro Retro is available on YouTube. It's currently unlisted until we put in captions for accessibility. Link:

    https://www.youtube.com/watch?v=nSYCoRKqvlE&ab_channel=QuantumBlack▾

  • s

    studioswong

    07/13/2021, 4:08 PM
    @here 🎀 Kedro-Viz Release Kedro-Viz 3.13.0 is available on PyPI. We’ve introduced significant design upgrades for the sidebar. You will find a tree navigation panel that arranges nodes and datasets within modular pipelines and a separate filter panel for tags and elements. We’ve also made it possible to access your entire parameter object via a JSON viewer on the metadata side panel, as well as the source code for decorated functions via the code panel. Find the full release notes. ⬇️ Install and Upgrade Kedro-Viz Upgrade Kedro-Viz 3.13.0 with the following:
    pip install kedro-viz==3.13.0
  • d

    datajoely

    07/13/2021, 4:09 PM
    Love that parameter view + nested sidebar amazing work team!
  • d

    datajoely

    07/13/2021, 4:25 PM
    Also like to nudge people that Kedro Viz is designed to be as backwards as compatible so you should be able to upgrade your projects freely
  • d

    datajoely

    07/15/2021, 3:55 PM
    Sneak peak of auto-reload coming to Viz (one of many advantages the new fastapi backend affords us) https://github.com/quantumblacklabs/kedro-viz/pull/498
  • d

    datajoely

    07/26/2021, 9:04 AM
    Hi Kedroids ! It’s been about a month and half since we launched (opt in) telemetry into Kedro and wanted share back some very early insights. We’ve been able to plot our most common journeys (log scaled, see the sunburst diagram attached). This data is really invaluable for us learning about how you use the framework and will hopefully reduce the number of interviews we need to do to understand how people use certain features. Have a great week everyone!
  • y

    Yetunde

    07/27/2021, 11:01 AM
    @here Is anyone interested in presenting a use case about using Kedro and AWS products at your company for re:Invent 2021? I'd need to know by 17:00 (UTC +01:00); with form submissions to be ready for Thursday, the 29th of July.
  • d

    datajoely

    07/28/2021, 5:19 PM
    @here 🎀    Kedro-Viz Release Kedro-Viz
    3.14.0
     is available on PyPI. We’ve now introduced Focus Mode 🧐 which takes our new tree view to the next level allowing you to drill into specific branches. We’ve also added a new
    --auto-reload option
    that does what it says on the tin!  Find the full release notes here. https://github.com/quantumblacklabs/kedro-viz/releases ⬇️    Install and Upgrade Kedro-Viz Upgrade Kedro-Viz 3.14.0 with the following:
    pip install kedro-viz==3.14.0
    π𝜋𝛑𝝅𝞹ℼ
  • h

    Hamza Oza

    09/13/2021, 3:10 PM
    @here A while back we started the research to understand how people use configuration in Kedro. We are pleased to share the findings publicly with you all in this GitHub Issue https://github.com/quantumblacklabs/kedro/issues/891. Please feel free to add your thoughts and comments to this as we continue to work on this in the near future to improve your Kedro experience. Finally a big THANK YOU to all our research participants. We could not have done this without you. 🙏🏾 ❤️
  • w

    WolVez

    09/13/2021, 3:23 PM
    Thanks for putting this together Hamza Oza! So what is Kedro's final recommendation after having gone through this analysis for the best method of Data Catalog Generation? It looks like YAML Anchors?
  • d

    datajoely

    09/14/2021, 7:24 AM
    We haven't made a decision yet- we're just trying to be open with our thinking
  • m

    Merel

    09/15/2021, 10:57 AM
    @here KEDRO RELEASE Kedro 0.17.5 is available on PyPI and Conda. This version of Kedro has bugfixes and introduces several new features and improvements, including: 🧪 Two datasets to enable basic experiment tracking (https://kedro.readthedocs.io/en/stable/08_logging/02_experiment_tracking.html): 
    tracking.MetricsDataSet
    and
    tracking.JSONDataSet
    📦 Support for bulk packaging/pulling modular pipelines 💻 A new CLI group registry with the associated commands kedro registry list and kedro registry describe, to replace kedro pipeline list and kedro pipeline describe 🥒 Support for dill backend to PickleDataSet 🐛 Pinned dynaconf to fix issues with a broken method signature See the release notes for more info: https://github.com/quantumblacklabs/kedro/blob/master/RELEASE.md ⬇️     Installation Kedro 0.17.5 is a non-breaking release in the 0.17.x series, upgrade now with:
    pip install kedro==0.17.5
    conda install -c conda-forge kedro==0.17.5
  • y

    Yetunde

    09/17/2021, 1:17 PM
    @here Please check out the message posted in #778998619067908106 by @User but we'd like to present the new
    kedro-neptune
    plugin, which creates a seamless experience using Kedro and Neptune. Neptune is used for: - Experiment tracking: Log, display, organize, and compare ML experiments in a single place. - Model registry: Version, store, manage, and query trained models, and model building metadata. - Monitoring ML runs live: Record and monitor model training, evaluation, or production runs live Find out more about the plugin by: - Watching a video about how it works: https://www.loom.com/share/0a690ce0aa39405da955e853d2fd73d6?t=2 - Reading the documentation: https://docs.neptune.ai/integrations-and-supported-tools/automation-pipelines/kedro
  • d

    datajoely

    09/29/2021, 2:31 PM
    Hey Kedroids! I’ve just posted 4 prototypes to our config research piece, it would be great to get some feedback on how we can improve the configuration overhead in Kedro 💪 https://github.com/quantumblacklabs/kedro/issues/891#issuecomment-930217650
  • w

    waylonwalker

    09/30/2021, 1:19 AM
    Mark your calendars, kedro is going to be featured on @TalkPythonthis Friday. Join the live chat on YouTube to be a part of the show. https://t.co/dysJyYXVB6
  • y

    Yetunde

    10/01/2021, 10:50 AM
    @here We're participating in Hacktoberfest again! We'll need to know if there is enough interest for us to create a #hacktoberfest channel, please indicate if you would join it with a 👍 What we'd like to encourage? - We would prefer newcomers to the open-source community to pick up
    goodfirstissues
    , and we'd love to help you learn how to contribute to the open-source community - Look out for issues tagged with
    hacktoberfest
    for easier contributions - Get hacking!
  • d

    datajoely

    10/01/2021, 12:29 PM
    Hacktoberfest tasks
  • d

    datajoely

    10/06/2021, 9:29 AM
    All of our hacktoberfest tickets have been taken up by you lovely people only 6 days into the mont! Don't worry - I've got a long backlog of ideas, so stay tuned for more issues on GitHub 🙂
  • d

    datajoely

    10/13/2021, 3:37 PM
    https://twitter.com/quantumblack/status/1448309673329844232
  • u

    user

    10/13/2021, 6:16 PM
    This channel has been set up to receive official Discord announcements for admins and moderators of Community servers. We'll let you know about important updates, such as new moderation features or changes to your server's eligibility for Server Discovery, here. You can change which channel these messages are sent to at any time inside Server Settings. We recommend choosing your staff channel, as some information may be sensitive to your server. Thanks for choosing Discord as the place to build your community!
  • d

    datajoely

    10/27/2021, 9:06 AM
    @here Kedro-Viz 4.0.0 is here Hi everyone, we're very excited to announce the release of Kedro-Viz 4.0.0. This release marks a new era in Kedro-Viz, in which we commit to deliver the best interactive development experience for Kedro as we possibly can. The highlight of this release is the ability to expand and collapse modular pipelines on your Kedro pipeline. We hope that this feature could improve the usage of modular pipelines with Kedro, which we believe is the best way to build modular data science code. And as you might already have heard, we have more to come very soon 🚀 Demo: Spaceflights pipeline: https://quantumblacklabs.github.io/kedro-viz/?data=spaceflights Stress demo: https://quantumblacklabs.github.io/kedro-viz/ As usual, you can install it with:
    pip install kedro-viz==4.0.0
    If you have any feedback, let us know.
  • y

    Yetunde

    11/12/2021, 5:35 PM
    @here We're going to be launching an online Kedro training series soon. In the sessions, you'll interact with one of the Kedro maintainers, get an introduction to Kedro and learn how to use it as a beginner. We make the sessions hands-on. Is anyone interested in signing up? This may also include that you express interest for friends and/or colleagues to join too. Indicate your interest with a 👍 and we'll get enrolment going soon.
  • g

    Galileo-Galilei

    11/18/2021, 6:57 PM
    Just in case this may be of interest for someone, I've started a kedro-serving (https://github.com/Galileo-Galilei/kedro-serving) to serve kedro pipelines with fastapi. The plugin is in a very early stage, but feedbacks would help a lot to improve it!
  • a

    antony.milne

    11/19/2021, 9:36 AM
    This looks very interesting, thanks for sharing! Will have a proper look later, but I'm very intrigued by your commit message emojis 😀 Do you have some sort of standardised categorisation/way of doing these or do you just insert them manually as you feel like it?
  • a

    Arnaldo

    11/19/2021, 12:22 PM
    there is an emoji-code for that: https://gitmoji.dev
  • g

    Galileo-Galilei

    11/19/2021, 9:33 PM
    Yes, that's what I use!
  • s

    studioswong

    11/26/2021, 4:33 PM
    Kedro-Viz 4.1.1 is out @here This is the release you’ve all been waiting for - Kedro-Viz now supports native experiment tracking 🧪 The Kedro-Viz team is very excited to introduce you all to the first MVP of native Experiment Tracking on Kedro-viz, where you will be able to see and compare the various tracked datasets from your Kedro runs. ( More information here :  https://github.com/quantumblacklabs/kedro-viz#experiment-tracking-usage). This is enabled via the introduction of a SQLite database on the Kedro-viz server, as well as the setup of GraphQL technology that enables us to deliver the experiment data in a fast and reliable way. The team is hard at work adding more and more features in this space - check out our roadmap for more info (we’re currently at Milestone 2): https://github.com/quantumblacklabs/kedro/issues/1070 . To get started - simply use one of the two special datasets 
    tracking.MetricsDataSet
     and 
    tracking.JSONDataSet
     , check out the docs for more info! Checkout our new demo here : https://kedro-viz-live-demo.hfa4c8ufrmn4u.eu-west-2.cs.amazonlightsail.com/runsList ⬅️⬅️⬅️ Have a great Friday everyone!
  • d

    datajoely

    11/26/2021, 4:35 PM
    Thank you to the Kedroids who have helped out with #864784648575254558 @User @User @User @User !
  • d

    datajoely

    12/01/2021, 4:03 PM
    Hello Kedroids - we are in the process of launching a Kedro website as we move into the Linux Foundation. We're looking for a couple of testimonials to use as pull quotes. Would you or your company be interesting in providing us with a snippet ?
    a
    • 2
    • 8
Powered by Linen
Title
d

datajoely

12/01/2021, 4:03 PM
Hello Kedroids - we are in the process of launching a Kedro website as we move into the Linux Foundation. We're looking for a couple of testimonials to use as pull quotes. Would you or your company be interesting in providing us with a snippet ?
a

Arnaldo

12/01/2021, 4:56 PM
yes, @User
where do I send it? here?
d

datajoely

12/01/2021, 4:56 PM
Or DM me if you're more comfortable
a

Arnaldo

12/02/2021, 12:14 PM
Hi, @User here is my quote: > With Kedro it's easy to standardize the development of ML pipelines and share them across the teams. We also love the flexbility of Kedro to add plugins and create custom datasets. Please, let me know if it meets your expectations
d

datajoely

12/02/2021, 12:15 PM
Awesome and can we attribute that to you or your oganisation?
a

Arnaldo

12/02/2021, 12:16 PM
It's better to attribute that to me
d

datajoely

12/02/2021, 12:16 PM
Sure thing!
thank you
View count: 2