How to Fine Tune BERT On unlabeled data?

Rhayem_Bannouri · August 31, 2022, 4:58pm

Hello and Greetings ,
I have a dataset that contains job description , and I have different one that contains job skills , actually I’d like to fine tune BERT so it could better understand the the two columns.(Note the 2 columns job description and job skills are from different source)
So finally I could use cosine similarity to classify them .
any suggestions please ?

reinoudbosch · September 23, 2022, 11:08am

Hi Rhayem_Bannouri,

Maybe this post answers your question?

Topic		Replies	Views
Fine Tuning Bert Lecture Video is Confusing NLP with Attention Models week-3	1	317	December 21, 2023
How to Deal; with Unlabled dataset? AI Discussions ai-discussions	10	218	August 21, 2024
Why does BERT trained on TyDi QA dataset is able to do a better job at answering the question on comics books? NLP with Attention Models week-3	4	500	February 7, 2023
Clarification about Course 4 Week 3 HW NLP with Attention Models week-3	2	595	May 6, 2022
Fine-tuning an LLM on non-Q&A and unlabeled dataset Finetuning Large Language Models	0	353	September 30, 2023

How to Fine Tune BERT On unlabeled data?

Related topics