#beginners-need-help
Title
# beginners-need-help
d
datajoely
03/05/2022, 6:34 PMI'm going to create a thread so capture this topic though
d
desrame
03/05/2022, 6:35 PMthank you!
d
datajoely
03/05/2022, 6:35 PMPleasure
d
desrame
03/05/2022, 7:03 PMso i rebuilt the spaceflgiht tutorial again, and the excel files passed fine
the moment I added our test sql
Copy code
Python 3.8.10 (tags/v3.8.10:3d8993a, May 3 2021, 11:48:03) [MSC v.1928 64 bit (AMD64)]
Type 'copyright', 'credits' or 'license' for more information
IPython 7.32.0 -- An enhanced Interactive Python. Type '?' for help.
PyDev console: using IPython 7.32.0
Python 3.8.10 (tags/v3.8.10:3d8993a, May 3 2021, 11:48:03) [MSC v.1928 64 bit (AMD64)] on win32
shuttles = catalog.load("shuttles")
Traceback (most recent call last):
File "C:\Users\alexr\kedro-repos\masterenv\master-kedro\lib\site-packages\IPython\core\interactiveshell.py", line 3524, in run_code
exec(code_obj, self.user_global_ns, self.user_ns)
File "<ipython-input-2-7b32a5522d82>", line 1, in <cell line: 1>
shuttles = catalog.load("shuttles")
NameError: name 'catalog' is not definedi comment out the sql from catalog and credentials, and get the same name error
d
datajoely
03/05/2022, 7:14 PMIf you try and kedro run what error do you get?
d
desrame
03/05/2022, 7:17 PM Copy code
In [3]: kedro run
File "<ipython-input-3-283f190c240f>", line 1
kedro run
^
SyntaxError: invalid syntax
In [4]:did a reload and back to no pipelines, with ipython not loading catalog or context whiel our SQL is in there
d
datajoely
03/05/2022, 7:25 PMSorry you need to do that outside of ipython
I meant in the terminal
d
desrame
03/05/2022, 7:25 PMgotcha
sorry it is installing reqs, it'll be a moment
d
datajoely
03/05/2022, 7:26 PM👍
d
desrame
03/05/2022, 7:27 PMthe behavior seems to be, if sql in yml, then "no nodes"
if sql not in yml, and reload, then it loads context/catalog etc
d
datajoely
03/05/2022, 7:27 PMI think it may be a requirements thing
But we need to check
Pyodbc needs a bunch of things available in the environment and we just need to make sure it's not that
d
desrame
03/05/2022, 7:29 PM..... 48 hrs later
i can see it
ive watched so much waylon walker and dataengineerone
d
datajoely
03/05/2022, 7:30 PMAs in it now works?!
d
desrame
03/05/2022, 7:30 PMyes
!
d
datajoely
03/05/2022, 7:30 PMWell that's amazing
d
desrame
03/05/2022, 7:30 PMgoing to try to document the steps as i remember them
in case it helps someone else
d
datajoely
03/05/2022, 7:30 PMBut I'm now going to make a note to look into the no nodes issue
Because we can do a better job there
d
desrame
03/05/2022, 7:31 PMi think you guys do a great job, what this framework unlocks is so tantalizing
my company is moving to databricks in the next month or two and i loved the idea of this integrated with DBs
d
datajoely
03/05/2022, 7:31 PMThere was a slight change to the SQL datasets in 0.17.7 where we only make a single connection to database whereas we used to create a new one for each operation
d
desrame
03/05/2022, 7:31 PMoh interesting
d
datajoely
03/05/2022, 7:31 PMSo maybe we are swallowing the requirements error
I'll look into it
d
desrame
03/05/2022, 7:32 PMok cool, sincerely
d
datajoely
03/05/2022, 7:32 PMGood luck! Shout if you have any questions
d
desrame
03/05/2022, 7:32 PMyou were so supportive
thank you
3 Views