In the Comprehensive Testing Framework, Reviewing evaluations section: Was the order of “Decision” and “Explanation” sections in the evaluation prompt arbitrary or are there any reasons to put the Decision before the Explanation?
I have seen some places recommend putting the explanation first, letting the model “reason” before using that explanation to give a decision (in a similar vein to Chain of Thoughts), as opposed to forcing it to give a decision first then potentially hallucinate a reason for that.