Add New Dependencies to Your Kedro Project

As you work on your kedro projects you are bound to need to add more

dependencies to the project eventually. Kedro uses

https://waylonwalker.com/til/kedro-new-dependencies

Lambda Function as a Kedro Node

I keep my nodes short and sweet. They do one thing and do it well. I

turn almost every DataFrame transformation into it

https://waylonwalker.com/til/kedro-lambda-node

Ahoy @here s there will be two free 'intro to Kedro training' events scheduled for 23rd of Feb at different time-zones. They will be led by myself and fellow maintainer @User . Please feel free to join, share with your colleagues and friends 🙂 You can sign up on the event pages here in discord or via the links below: https://quantumblack.co/KedroAPAC <- EMEA/APAC https://quantumblack.co/KedroAmericas <- EMEA/AMER/LATAM

Im not keen to use linked in how to sign up via discord?

Oh ignore me@i found the discord event link

@User you will need a LinkedIn account I think, the discord link just points there

Ok

Please use this link to view the current broadcast: https://www.linkedin.com/video/live/urn:li:ugcPost:6902175426215493633/

Hello - was the session on LinkedIn today recorded? I’d love to share with other members on my team

+1 on this. It would be great if you could share the session

Yes you should be able to watch it back here: https://www.linkedin.com/video/live/urn:li:ugcPost:6902175426215493633/

YouTube version of this week's training course:

Building Data Pipelines with Kedro: https://benhay.es/posts/building-pipelines-kedro/

Make Kedro Runs Beautiful

Kedro rich is a very new and unstable (it Kedro rich is a very new and unstable (it There is no pypi package yet, but it There is no pypi package yet, but it Yo

https://waylonwalker.com/til/kedro-rich

The folks at XP inc. have genuinely one of the coolest kedro implementations I've seen - if any of you are in Latam you may like this talk they're doing at TDC Brazil 🇧🇷 https://www.linkedin.com/posts/joel-schwarzmann_tdc-kedro-mlops-activity-6910729203814400000-_1pm?utm_source=linkedin_share&utm_medium=android_app

A bit off-topic, but our community member's article made it front page on HN: https://news.ycombinator.com/item?id=31308099. Please check out his great writeup on how to use

fzf

for

tmux

sessions. Well done @waylonwalker 🚀

Use fzf for tmux session switching

Hello, people. I just made a sample project using the PartitionedDataset with the assumption that the machine does not have memory to hold more than one partition. https://github.com/macksin/kedro_partitioneddataset_example Thanks

Our friends at GetInData (@marrrcin in #908346260224872480) have been making and maintaining all kinds of useful Kedro plugins. They recently shared this article that talks about different deployment plugins they've made for Kedro. Check out

kedro-kubeflow

,

kedro-airflow-k8s

,

kedro-vertexai

and `kedro-azureml`: https://getindata.com/blog/running-kedro-everywhere-machine-learning-pipelines-kubeflow-vertex-ai-azure-airflow/

kedro replit

I am trying to see what an embeded replit

https://waylonwalker.com/kedro172-replit

The neptune.ai team published a case study on how Kedro is used with Neptune (an experiment tracking tool) at a company called ReSpo.Vision: https://neptune.ai/customers/respo-vision

ReSpo.Vision uses computer vision and machine learning in sports data analysis to extract 3D data from single-view camera sports broadcast videos, providing players, scouts, managers, clubs and federations with an unmatched depth of knowledge. They concentrate on football (soccer) and target sports clubs, leagues, bookmakers and media.

Kedro pipelines are crucial to their tech stack because they manage the workflow through those pipelines. The team defines the number of pipelines for specific models, and algorithms of data processing methods as pipelines, enabling them to easily set parameters for multiple jobs, creating a manageable and reproducible workflow.

That

@hereWe're making the changes official. We have moved to Slack (#1) and you'll find 500 members in that channel supporting each other! Check #778996598880862208 for the rationale and remember to sign up for swag (#2). We're also running a survey to gauge interest in a "Software Engineering for Data Scientists and Data Engineers" course that we want to write and run next year so please fill out this survey if this is something you want (#3). We'll see you on Slack ❤️ Links #1 Join Slack: https://slack.kedro.org/ #2 Get swag when we ship our new branding: https://www.surveys.online/jfe/form/SV_8jfTn7SQDcUiN5c #3 Software Engineering for Data Scientists and Data Engineers survey: https://www.surveys.online/jfe/form/SV_37WxRUy5xkC0xkW