Understanding human level performance

I have a question regarding this video on DLS Coursw 3 week 1. On time 3:13, how can we get the error of a team of experienced doctors? Through an exam?

What I’m basically asking is, how can you know that a team of experts in a subject is wrong?

The answer may not be the same in all cases, but in the medical case I believe they use long term tracking of the patient histories, not just the images. In other words, you find out later from the patient’s health history whether the image actually showed a tumor or not. That might include physical examinations, surgical biopsies and so forth.


I see. Alright! Thank you!