Model cannot learn!

Course Q&A TensorFlow: Advanced Techniques Specialization Advanced Computer Vision with TensorFlow
1

I believe my compile is not correct.

image
image972×240 22.2 KB

I think to this specific problem only, the accuracy should be very high (i.e >99%) because the region of the segmentation is small.
image
image1167×440 23.4 KB

but this val_accuracy of mine is not increasing which, I think, means not learning.
image
image859×104 4.26 KB

I think the reason is because of the config for the model. Can anyone give me a hint on what the config should be. (I have already try combinations of SGD, adam and mse, categorical_crossentropy and some other config).

image
image843×553 26 KB

This is the decoder, I tried sigmoid and softmax, both did not work!

image
image784×191 6.8 KB

This is my conv_block, I got 5 of them which have filters = 32,64,128,256,256, respectively.

2

I tried RMSprop and It was a success! I got IOU over 85% and that is amazing. I wonder how to get the correct config??? is there any approriate way instead of error and trial ??

2 Likes
3

Hi there,

Assuming all the rest is fine (as long as you follow the instructions properly on the assignment) when it comes to compiling the model intentionally is left for you to decide which optimizer and loss to use. You need to tweek the parameters but there should be guidances on the videos and labs as well. Think of the outputs the model will classify and experiment with the optimizer.

4

Why is sigmoid recommended in this assignment and not softmax? There are 11 classes, right? Am I not understanding something…
Thank you very much!

1 Like
5

Hi @juancopi81,

Suppose you have a chest X-ray that has multiple diseases. You would want to predict all the diseases that are present. So, even though you have multiple classes, you would use sigmoid so that you can tell the prediction of each class.

Hope this answers your question.

6

Hi @thearkamitra,

Thank you very much for your answer, Yes, it makes sense and answers my question… still I was having bad results with sigmoid, so changed it to softmax - categorical_crossentropy and everything was much better (with Adam as optimizer)

1 Like
7

Hi @juancopi81,

Yes it makes sense. Cross_entropy works best for softmax while sigmoid works best for binary cross entropy.

8

Consider using smaller kernel_size and activation = ‘relu’ in Conv2D. FYI on my side it works better without cropping