Onéira
10/11/2022, 1:41 PMfarisology
10/12/2022, 7:10 AMkedro run
in a local machine and it starts executing it says running kedro session start
does this mean it runs a local server?
2- If we are running Kedro DAG will that mean the kedro will start a local server in our airflow? what ports will it use?
3- The kedro-airflow has been archived, what does this mean for the support of the project?
4- Since there is limited documentation on running kedro in stand-alone airflow, does this mean kedro airflow will only be a sustainable approach with astronomer going forward?
5- why there is kedro operator instead of python or base operator?Merel
10/12/2022, 9:36 AMkedro-airflow
plugin for this?
3. You can definitely run Kedro on stand-alone airflow as well. The Kedro maintainer team tries to keep documentation and deployment guides up to date, but we don't always manage to write about all possible ways of deploying Kedro projects. Let us know where we can help here!
4. I don't really understand your question, is this related to airflow/`kedro-airflow` again?lancechua
10/12/2022, 11:42 AMGenericDataSet
class factory make sense?
I'm looking to write a class factory with the following signature:
python
def create_generic_dataset(
name: str,
load: Callable[[Path, ...], pandas.DataFrame],
save: Callable[[pandas.DataFrame, Path, ...], None]
):
...
or is subclassing the AbstractaDataSet
still the preferred method?datajoely
10/12/2022, 11:43 AMlancechua
10/12/2022, 11:47 AMdatajoely
10/12/2022, 11:48 AMdatajoely
10/12/2022, 11:49 AMdatajoely
10/12/2022, 11:49 AMdatajoely
10/12/2022, 11:50 AMlancechua
10/12/2022, 11:59 AMdatajoely
10/12/2022, 11:59 AMdatajoely
10/12/2022, 12:01 PMlancechua
10/12/2022, 12:28 PMnoklam
10/12/2022, 12:31 PMnoestl
10/12/2022, 1:25 PMDIVINE
10/12/2022, 4:12 PMdatajoely
10/12/2022, 4:12 PMDIVINE
10/12/2022, 4:18 PMfarisology
10/13/2022, 3:26 AMuser
10/13/2022, 8:15 AMgonecaving
10/13/2022, 9:17 AMuser
10/13/2022, 2:43 PMPetitLepton
10/13/2022, 7:54 PMuser
10/14/2022, 8:58 AMnoklam
10/14/2022, 9:10 AMPetitLepton
10/14/2022, 9:12 AMnoklam
10/14/2022, 9:24 AMPetitLepton
10/14/2022, 6:43 PMPetitLepton
10/15/2022, 9:18 AMPetitLepton
10/15/2022, 9:18 AM