# Building End-to-End Batch and Streaming Data Pipelines Based on Stakeholder Requirements

**URL:** <https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772>\
**Category:** Introduction to Data Engineering\
**Tags:** week-module-4, coursera-platform\
**Created:** [November 16, 2024, 1:52pm UTC](https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772 "2024-11-16T13:52:53Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![goncalosantos](https://avatars.discourse-cdn.com/v4/letter/g/e68b1a/32.png) [@goncalosantos](https://community.deeplearning.ai/u/goncalosantos)\
**Post date:** [November 16, 2024, 1:52pm UTC](https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772/1 "2024-11-16T13:52:53Z")

</div>

Can anyone help me?  
I’m following the last Lab Walkthrough, and when I executing step 1.10, it appears the following error:

 ![image](https://global.discourse-cdn.com/dlai/original/3X/0/9/09f758cbf872f0824b9ea0aeec9535c50c688721.png)

Please give me advice!

---

<div class="post-metadata">

**Author:** ![pastorsoto](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/pastorsoto/32/127023_2.png) [@pastorsoto](https://community.deeplearning.ai/u/pastorsoto)\
**Post date:** [November 16, 2024, 2:26pm UTC](https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772/2 "2024-11-16T14:26:01Z")

</div>

Hi. Yes, it looks you already created the s3 bucket. I think you can move to the next step in the lab instead of trying to do the terraform stepas it seems you already completed

---

<div class="post-metadata">

**Author:** ![goncalosantos](https://avatars.discourse-cdn.com/v4/letter/g/e68b1a/32.png) [@goncalosantos](https://community.deeplearning.ai/u/goncalosantos)\
**Post date:** [November 16, 2024, 2:35pm UTC](https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772/3 "2024-11-16T14:35:15Z")

</div>

Hi. How is that possible? I’ve followed all the steps, so it shouldn’t be already completed before the moment I executed the terraform steps, right? Moreover, I tried to follow your advice to move forward, but the resources are not available…

---

<div class="post-metadata">

**Author:** ![Amir\_Zare](https://sea1.discourse-cdn.com/dlai/user_avatar/community.deeplearning.ai/amir_zare/32/95275_2.png) [@Amir\_Zare](https://community.deeplearning.ai/u/Amir_Zare)\
**Post date:** [November 16, 2024, 7:52pm UTC](https://community.deeplearning.ai/t/building-end-to-end-batch-and-streaming-data-pipelines-based-on-stakeholder-requirements/723772/4 "2024-11-16T19:52:55Z")

</div>

Hello @goncalosantos  
There is a problem with the bucket variable in `terraform/backend.tf` file. The bucket variable should be like `de-c1w4-<ACCOUNT_ID>-us-east-1-terraform-state`, and in your case the `<ACCOUNT_ID>` part is missing. Apparently, there has been a problem and `./scripts/setup.sh` didn’t work properly when you ran `source ./scripts/setup.sh` in step 1.6. Please, try again, and if the issue persists, you can manually change line 3 in the `backend.tf` file. You can copy your account ID from the top of the AWS console.  
Account ID:

 ![image](https://global.discourse-cdn.com/dlai/original/3X/4/d/4d64290266ecc98e49be40b9c50498323ec87239.png)  
What the file should be like:  
 ![image](https://global.discourse-cdn.com/dlai/original/3X/e/e/ee42190400985c62d7f402f07ab796a1e6d697e3.png)