what should i do in this case ?
Seems like you are tokenizing sentences instead of labels. Please confirm.
Do move this post to the correct topic.
I have the same error. All tokenization is about “labels”. What is wrong?
Are you using the local variable label_tokenizer for tokenizing labels instead of the global variable tokenizer?
No, here was the mistake. Thank you very much!
I don’t follow you. Please explain.
I did not use the local variable label_tokenizer for tokenizing labels instead of the global as you said.
I am also facing the same error even though i used the global Tokinizer. what is the way out please
You should not use the global tokenizer variable when fitting / transforming labels. There’s a Tokenizer instance that’s local to the method. Please use that instead.
honestly, i don’t understand what you trying to say here. I simply did Tokiniser() for the instantiation. what should i rather use? is there a separate class for instantiating labels?
Problem solved. I was using the instance of the sentence Tokinizer() instead.
Thank you for your time.