Hi @Harshit1097,
welcome to the community!
Maybe Huggingface’s transformers docs and models are relevant for you. In my opinion they are definitely worth a closer look:
Of course you can also use there the search and filter function to get a good overview on state of the art pretrained transformers which you can use for transfer learning afterwards…
Afterwards there are several ways how to proceed but I guess this would be a good starting point, see also this similar thread.
Best regards
Christian