Data Engineering - Auxiliary Question for AWS

Course Q&A Data Engineering Data Modeling, Transformation, and Serving
1

Greetings,

My question is: Is there a guide to best practice available on how to connect a jupyter notebook to your AWS environment

Here is some context for the question:

I completed the first lab for week 1 of data modeling, transformation and serving.

The exercise is delivered through a jupyter notebook.

In the exercise, the workflow uses connectors to the SQL database, extracts data and then loads it to Pandas for manipulation and then seamlessly update the SQL database.

I love the way the notebook flows.

I saw the jupyter configuration script and it is not trivial at all. It appears that the scripting approach is advanced, well beyond my skills.

I would be very grateful for any insight on how to connect Jupyter or VSCode to AWS to have seamless integration with jupyter notebook.

I tried following online tutorials in the past, but they never work and have since gave up.

Cheers

2

Hi @dan_herman, if let’s say you have created a database in AWS, your question is to know how you can connect to it from your local jupyter notebook. Is that correct?

3

Hello Hawraa,

Thanks for jumping in.

I was looking to setup a jupyter notebook to interact with different aws services. It appears I can do this with AWS Sagemaker, where they offer a service to host jupyter notebooks.

It appears this is an abstracted configuration - compared to what’s offered in the course.

Cheers

1 Like