Speeding Up filling database with encodings

Hi guys, I have been making all of my projects in Jupiter notebooks up until now. I am making a security app that works with security cameras to identify people. Right now I am loading a csv with encodings of identities scraped off a public website. At the current rate it will take 10 days to get all the encodings loaded, assuming everything goes smoothly. I want to rent a virtual server so I can run many instances of the scraper at once and get the job done much more quickly. I am thinking maybe an AWS ec2, but I have no Idea how to connect my GitHub repo with the csv and code to the ec2, or what settings I need to choose while configuring it. Any help would be much appreciated!

1 Like