Not enough memory while running fla-t5-base model

Course Q&A Generative AI with Large Language Models
1

Week 1 : Lab 1 - Generative AI Use Case: Summarize Dialogue I am facing issue while running command model_name=‘google/flan-t5-base’ model = AutoModelForSeq2SeqLM.from_pretrained(model_name) with not enough memory error.

2

I keep getting the following timeout error at the same point, i.e., loading the flan-t5-base model. The lab assignment due time is tonight. Can someone please help?

TimeoutError Traceback (most recent call last) File /opt/conda/lib/python3.11/site-packages/urllib3/connectionpool.py:404, in HTTPConnectionPool._make_request(self, conn, method, url, timeout, chunked, **httplib_request_kw) 403 try: → 404 self._validate_conn(conn) 405 except (SocketTimeout, BaseSSLError) as e: 406 # Py2 raises this as a BaseSSLError, Py3 raises it as socket timeout.

3

Hi, and welcome to the Forum! Kindly watch this topic for updates regarding this bug. Thanks!

4

Hey Chris,

I am getting the below error now as I was running into issue with lab1 and I trying to complete it even though the due date has passed but it is not allowing me with the below error.

image
image1106×426 22.9 KB

5

Hi,

Try in incognito browser mode. In the next time please use a separate thread for your issue.

1 Like
6

Thank you for your response. I was not able to reply in a separate thread as there were no ‘Reply’ option, the thread shared by Chris was closed probably that’s why it was not allowing any reply. Please share a proper working thread.

Thanks!

7

Hi Hasnain! Please tell us how you landed on that error. What are the exact steps you took so we can try to reproduce the issue. If possible, please take screenshots at each major step. Thanks.

8

Thank you Chris for reaching out.

These are the steps I am following.

  1. Launching app by going to Lab 1.

image.png
image.png1825×893 89.6 KB

  1. Click Start lab.

    image.png
    image.png1860×1000 83.8 KB

  2. Once the lab starts and AWS yellow dot turns Green, I click on AWS.

image.png
image.png1902×983 85 KB

  1. Looks like it is working in incognito mode because earlier I was not able to get to this page and it shows invalid credentials and contact administrator.

image.png
image.png1887×873 95.5 KB

Thank you Chris and Igor, appreciate it.

Thanks!
Hasnain

2 Likes
9

Great! Glad it works now! Will note the bug you encountered and see if it happens to others too. Will escalate if needed. Thanks.