Kedro is an open-sourced Python framework for creating maintainable and modular data science code.

Kedro

Would be a cool Kedro dataset!
https://github.com/jina-ai/docarray

Just yesterday I was coaching a new Data Scientist on the team, we hit the docs for SqlQueryDataSet, it felt so good to see that the docs now align with the recommended catalog method of using yaml rather than the python api!

<@!538915541210103818> it's not entirely exhaustive - the following still need to be updated

```
api.APIDataSet
biosequence.BioSequenceDataSet
dask.ParquetDataSet
email.EmailMessageDataSet
geopandas.GeoJSONDataSet
holoviews.HoloviewsWriter
json.JSONDataSet
matplotlib.MatplotlibWriter
networkx.NetworkXDataSet
pandas.FeatherDataSet
pillow.ImageDataSet
plotly.JSONDataSet
plotly.PlotlyDataSet
tensorflow.TensorFlowModelDataset
text.TextDataSet
tracking.JSONDataSet
tracking.MetricsDataSet
yaml.YAMLDataSet
```

Good to know, is there an issue or anything tracking it?

You have the major ones that I REALLY care about covered.

yeah I think plotly, json, yaml, text and tracking need to get in

those were the ones I have in my I might want those category, but not my daily use category.

<@!538915541210103818> 
https://github.com/kedro-org/kedro/issues/1155

Hey :). I know it's hard to give estimates, but do you have an idea of when 0.18 is going to launch? I'm starting a new project within the next month or so, and just want to know if I should wait 😉

The aim is end of the month, early next month.

There will be an upgrade guide so unless you go really off-piste it should be easy enough to upgrade a project 🙂

That's great. I'll just wait for it then. Thanks! 🙂

You can see the draft release notes here
https://github.com/kedro-org/kedro/blob/develop/RELEASE.md#upcoming-release-0180

Looks good 🙂 . Do you have a plan for Python 3.10 at some point?

I'm pretty sure we'll support it yes - 3.9 for sure, 3.10 is the plan

GitHub now supports mermaid, of course the first thing I have to try is kedro viz in mermaid form.


I actually thought it turned out darn well!  I expected it only to work well for a much smaller pipeline.

I would definitely be using this on slices/subsets of pipelines in prs or docs on github.

Really cool! How did you do it exactly? Save the viz pipeline to a json and then  do something magical on that? 😄

https://github.blog/2022-02-14-include-diagrams-markdown-files-mermaid/

play around here 
https://mermaid.live/edit

Check out Vite.so this super cool video note-taking app made by maintainer <@!281372736520060928>  <:kedroid:855153796736614411>  💪 !
https://vite.so/

Is this <@!281372736520060928> 's ruby project?  Do they use kedro?

hey no it doesn't use kedro but if I have users I will use kedro to build analytics pipeline 😄 thanks <@!842787984902062080> for the shoutout. it's definitely a random project