There might be one error regarding the loss function in the slice on page 21

Heepo_Leo · July 24, 2023, 4:20am

The loss function of the reward model seems to lack of a negative sign. I’ve checked the new version of the paper, and it also fixed this. Check the v3 version of the paper https://arxiv.org/pdf/2009.01325.pdf

luhengok · August 8, 2023, 4:09am

Agree with you

Topic		Replies	Views
Is it a typo in the loss function of Reward model in Week3? Generative AI with Large Language Models week-module-3	3	425	September 15, 2023
Question on the loss function of reward model Generative AI with Large Language Models week-module-3	1	65	July 15, 2024
W3 - RLHF Reward Model - loss of reward model Generative AI with Large Language Models week-module-3	1	378	October 1, 2023
Week 3: Video RLHF Reward Model Generative AI with Large Language Models week-module-3	0	326	November 18, 2023
Why Log Sigmoid log(σ(r_j - r_k)) as loss function to train reward model? Generative AI with Large Language Models conceptual-question	12	1019	September 26, 2024

There might be one error regarding the loss function in the slice on page 21

Related topics