Logical Error in fuction "tokenize_function"

There is an error in “tokenize_function” error. The prompt is completely missed when tokens are created in the function… Why is that?

Hi @abdmateen

Welcome to the community.

Are you try to run locally?

if you look at the said function you will see that prompt part is missing out. The instructor does include this part earlier when she is giving a dummy example but when she comes in the “tokenize_function” , she misses out the prompt. that means hat the tokens are created without the prompt. I am saying its a logical problem, nothing wrong with syntax.

1 Like