I have submitted several iterations of results where my model has achieved > 0.81 accuracy/sparse categorical accuracy, but the saliency score has not exceeded 0.89.
Despite consulting the various threads re: Similarity Score on the discussion forum, I am unable to achieve the 0.95 threshold.
My model architecture is the same as the CamCatsDogs lab:
The final output layer has two output neurons and a softmax activation.
Train batch size is 80%.
Sparse categorical crossentropy as loss func, accuracy as the metric.
I saw the code, if you say it trains well and have good accuracy and as far as I see there are no issues with the do_salience function. However at " Generate saliency maps at 18 epochs" section you are not supposed to load weights at 18 epochs, you are not given those. In the previous cell the model is trained from 15 epochs + 3 epochs so it reaches 18 epochs. So beneath you just do salience for the 5 images.
That fixed it - I removed the line where I loaded the weights from the 18th epoch and it passed. Thank you very much, this was becoming very frustrating.