Hey @EduardoChicago,
I believe that applying semantic segmentation on existing datasets is out of the picture, but if that is something you want to consider, you can check this thread out.
Now, coming to your exact question, this and this thread discusses how to prepare the ground truth vectors for images in your own dataset.
Let us know if this helps.
Cheers,
Elemento