C2_w1_lab-3-s3

Course Q&A Data Engineering Source Systems, Data Ingestion, and Pipelines
,
1

I am getting the following error when running the s3 lab.
An error occurred (MethodNotAllowed) when calling the SelectObjectContent operation: The specified method is not allowed against this resource.
This is related to the step where I am doing
response = s3_select_object_content(bucket_name=BUCKET_NAME, object_key=file_s3_key, **kwargs)

I can see the bucket and the uploaded csv file in the console.

Please advise
Thanks

2 Likes
2

The same problem happening with me

3

Hello @zensim
Sorry for the inconvenience. Our team are aware of this issue and are working on it. You will be informed when the issue is resolved.
For the time being, you can skip the two cells after s3_select_object_content and continue with the lab.

4

Just to confirm, are these cases due to the fact that aws is dropping support for SelectObjectContent?

So in the future when doing queries from s3 we have to GetObject from s3 and query from it, or use services like athena/lambda?

5

Hi @Amir_Zare I am having the same error: ā€œAn error occurred (MethodNotAllowed) when calling the SelectObjectContent operation: The specified method is not allowed against this resourceā€.

I assume you are still looking into it?

Cheers
Ram

1 Like
6

Hi,

I am getting the same error:ClientError: An error occurred (MethodNotAllowed) when calling the SelectObjectContent operation: The specified method is not allowed against this resource.
Please check and resolve.

Thanks
Rati

1 Like
7

Hello @Rati27 and @Ram_Sastry
We are still working on the issue. Please, skip the two cells after s3_select_object_content for now.

2 Likes
8

Same problem here

9

@Amir_Zare not sure why Iā€™m not allowed to create topics so I will ask from here.

Iā€™m receiving an error when running the glue job:
An error occurred while calling o88.getDynamicFrame. Unknown database ā€˜de-c1w2-rdsā€™

10

Hello @mateusamorim96
Unfortunately, I was not able to reproduce the problem. Had you run the source scripts/setup.sh as described in step 7 in Vocareum? What about step 2.2 of the lab? Were you able to connect to the database?

11

Usually this is because you havenā€™t reached the required forum ā€œtrust levelā€ yet.

1 Like
12

I missed the ā€œsource scripts/setup.shā€ so I right-clicked and selected ā€œrun scriptā€, not sure if it will produce the same thing. I was able to connect to the database and get the hostname from it using the terminal.

Update: While I was writing here I decided to try one more time. First, using ā€œsource scripts/setup.shā€ took more time to finish so it has some differences in it. Second, I noticed a second VPC ID with the same name (de-c1w2) so thereā€™s a chance I was getting the security group id from one instead of the other and that was messing with the Glue Job.

Now I was able to finish the lab. Thanks