How to create a code generator for a new language that is not yet trained by GPT. Like a json. Can we use fewshort lrwerning or finetune the gpt2

How to create a code generator for a new language that is not yet trained by GPT. Like a json. Can we use fewshort learning or finetune the gpt2?

Probably not, unless the new language is almost same as the ones been trained with.

You see it has to learn to write in that language and programming is very sensitive, so probably you need a full train from scratch.