you are using standardize_func at the wrong place, this need to be recalled where we instantiate the tokenizer class.
See the below thread for more detail
Regards
DP
you are using standardize_func at the wrong place, this need to be recalled where we instantiate the tokenizer class.
See the below thread for more detail
Regards
DP