How to determine the source model for transfer learning?

Hi @Harshit1097,

welcome to the community!

Maybe Huggingface’s transformers docs and models are relevant for you. In my opinion they are definitely worth a closer look:

Of course you can also use there the search and filter function to get a good overview on state of the art pretrained transformers which you can use for transfer learning afterwards…

Afterwards there are several ways how to proceed but I guess this would be a good starting point, see also this similar thread.

Best regards
Christian