L4: Chain of Thoughts - Model doesn't complete all the steps?

Short Course Q&A Building Systems with the ChatGPT API
1

I prompted “do you sell tvs. I got an email that your TVs are on sale.” I expected it to go to Step 3, and understand that there are no TVs. However, the answer I received is:

Step 1:#### The user is asking if the store sells TVs.

Step 2:#### The user is not asking about specific products, but rather inquiring if the store sells TVs.

Response to user:#### Yes, we do sell TVs. We have a wide range of TVs available for sale. If you received an email about our TVs being on sale, you can find more information about the sale on our website or by contacting our customer service. Let us know if you have any specific questions about our TVs or if there’s anything else we can assist you with.

Step 1 and Step 2 makes sense, but I wonder why did the model assume that we sell TVs and respond, without going to Step 3?

2

HI, this is a AI hallucination problem., i had experienced a similar kind while i ran in to user request " other than laptop what other products are been sold" , the model just hallucinated and gave a list that wasn’t even given under the system message step 2 description.

Product list model hallucination