Step 2.4: C4_W4_Assignment_2.ipynb

[David_Cox1]

I got this error when trying to run the glue_api_users_extract_job:
MissingSchema: Invalid URL ‘ec2-52-73-34-185.compute-1.amazonaws.com?start_date=2020-01-01&end_date=2020-01-31’: No schema supplied. Perhaps you meant http://ec2-52-73-34-185.compute-1.amazonaws.com?start_date=2020-01-01&end_date=2020-01-31?

So figured I needed to copy in the entire url from to get the http:// in there. Then I got this error:
HTTPError: 404 Client Error: Not Found for url: http://ec2-52-73-34-185.compute-1.amazonaws.com/?start_date=2020-01-01&end_date=2020-01-31

Here is the info from CloudFormation when I copy-paste the row corresponding to the API information:
APIEndpoint ec2-52-73-34-185.compute-1.amazonaws.com This is the Endpoint of the API service

I’m sure I’m probably missing something simple again?

[David_Cox1]

Also, this from the command line:
coder@e872d9b657de:~/project/terraform$ curl http://ec2-52-73-34-185.compute-1.amazonaws.com/
{“detail”:“Not Found”}

[David_Cox1]

Still getting this error and unable to even begin. Any chance someone can help here?

Programming Assignment: Assignment 5: Capstone Project Part 2 - Data Quality and Orchestration and Visualization

[Georgios]

Hello @David_Cox1,

Sorry for the inconvenience and the late response. I could reproduce your error and it seems you were using the wrong api_url (first you didnt include the http:// as you correctly found out but then you were missing the /users at the end:

   "--api_start_date"      = "2020-01-01"
    "--api_end_date"        = "2020-01-31"
    "--api_url"             = "http://ec2-***.compute-1.amazonaws.com/users" <---ADD /users
    "--target_path"         = "s3://${var.data_lake_bucket}/landing_zone/api/users"
    "--ingest_date"         = "2020-02-01"

1. Without http://

2. Without /users

If you have other issues running the lab you could fill the lab refresh form. Again sorry you were missing something simple and sorry for your trouble. Hope it helps