Title
#beginners-need-help
datajoely

datajoely

03/05/2022, 6:34 PM
I'm going to create a thread so capture this topic though
desrame

desrame

03/05/2022, 6:35 PM
thank you!
datajoely

datajoely

03/05/2022, 6:35 PM
Pleasure
desrame

desrame

03/05/2022, 7:03 PM
so i rebuilt the spaceflgiht tutorial again, and the excel files passed fine
7:03 PM
the moment I added our test sql
7:04 PM
Python 3.8.10 (tags/v3.8.10:3d8993a, May  3 2021, 11:48:03) [MSC v.1928 64 bit (AMD64)]
Type 'copyright', 'credits' or 'license' for more information
IPython 7.32.0 -- An enhanced Interactive Python. Type '?' for help.
PyDev console: using IPython 7.32.0
Python 3.8.10 (tags/v3.8.10:3d8993a, May  3 2021, 11:48:03) [MSC v.1928 64 bit (AMD64)] on win32
shuttles = catalog.load("shuttles")
Traceback (most recent call last):
  File "C:\Users\alexr\kedro-repos\masterenv\master-kedro\lib\site-packages\IPython\core\interactiveshell.py", line 3524, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-2-7b32a5522d82>", line 1, in <cell line: 1>
    shuttles = catalog.load("shuttles")
NameError: name 'catalog' is not defined
7:05 PM
i comment out the sql from catalog and credentials, and get the same name error
datajoely

datajoely

03/05/2022, 7:14 PM
If you try and kedro run what error do you get?
desrame

desrame

03/05/2022, 7:17 PM
In [3]: kedro run
  File "<ipython-input-3-283f190c240f>", line 1
    kedro run
          ^
SyntaxError: invalid syntax


In [4]:
7:20 PM
did a reload and back to no pipelines, with ipython not loading catalog or context whiel our SQL is in there
datajoely

datajoely

03/05/2022, 7:25 PM
Sorry you need to do that outside of ipython
7:25 PM
I meant in the terminal
desrame

desrame

03/05/2022, 7:25 PM
gotcha
7:26 PM
sorry it is installing reqs, it'll be a moment
datajoely

datajoely

03/05/2022, 7:26 PM
👍
desrame

desrame

03/05/2022, 7:27 PM
the behavior seems to be, if sql in yml, then "no nodes"
7:27 PM
if sql not in yml, and reload, then it loads context/catalog etc
datajoely

datajoely

03/05/2022, 7:27 PM
I think it may be a requirements thing
7:27 PM
But we need to check
7:28 PM
Pyodbc needs a bunch of things available in the environment and we just need to make sure it's not that
desrame

desrame

03/05/2022, 7:29 PM
..... 48 hrs later
7:29 PM
i can see it
7:29 PM
ive watched so much waylon walker and dataengineerone
datajoely

datajoely

03/05/2022, 7:30 PM
As in it now works?!
desrame

desrame

03/05/2022, 7:30 PM
yes
7:30 PM
!
datajoely

datajoely

03/05/2022, 7:30 PM
Well that's amazing
desrame

desrame

03/05/2022, 7:30 PM
going to try to document the steps as i remember them
7:30 PM
in case it helps someone else
datajoely

datajoely

03/05/2022, 7:30 PM
But I'm now going to make a note to look into the no nodes issue
7:30 PM
Because we can do a better job there
desrame

desrame

03/05/2022, 7:31 PM
i think you guys do a great job, what this framework unlocks is so tantalizing
7:31 PM
my company is moving to databricks in the next month or two and i loved the idea of this integrated with DBs
datajoely

datajoely

03/05/2022, 7:31 PM
There was a slight change to the SQL datasets in 0.17.7 where we only make a single connection to database whereas we used to create a new one for each operation
desrame

desrame

03/05/2022, 7:31 PM
oh interesting
datajoely

datajoely

03/05/2022, 7:31 PM
So maybe we are swallowing the requirements error
7:32 PM
I'll look into it
desrame

desrame

03/05/2022, 7:32 PM
ok cool, sincerely
datajoely

datajoely

03/05/2022, 7:32 PM
Good luck! Shout if you have any questions
desrame

desrame

03/05/2022, 7:32 PM
you were so supportive
7:32 PM
thank you
datajoely

datajoely

03/05/2022, 7:32 PM