Why isn't callback function working?

[Rishikesh_F]

[snippet removed by mentor]

This is my code. The output am getting is as follows :

Epoch 1/10 60000/60000 [==============================] - 9s 155us/sample - loss: 0.2242 - acc: 0.9354 Epoch 2/10 60000/60000 [==============================] - 9s 157us/sample - loss: 0.0936 - acc: 0.9713 Epoch 3/10 60000/60000 [==============================] - 9s 157us/sample - loss: 0.0609 - acc: 0.9812s - Epoch 4/10 60000/60000 [==============================] - 9s 145us/sample - loss: 0.0440 - acc: 0.9855 Epoch 5/10 60000/60000 [==============================] - 9s 145us/sample - loss: 0.0334 - acc: 0.9890 Epoch 6/10 60000/60000 [==============================] - 9s 148us/sample - loss: 0.0253 - acc: 0.9917 Epoch 7/10 60000/60000 [==============================] - 9s 148us/sample - loss: 0.0187 - acc: 0.9943 Epoch 8/10 60000/60000 [==============================] - 8s 142us/sample - loss: 0.0166 - acc: 0.9942 Epoch 9/10 60000/60000 [==============================] - 9s 145us/sample - loss: 0.0123 - acc: 0.9960 Epoch 10/10 60000/60000 [==============================] - 8s 140us/sample - loss: 0.0105 - acc: 0.9964

Out[12]:

([0, 1, 2, 3, 4, 5, 6, 7, 8, 9], 0.9964)

I am not getting, why callback function is not working.

[german.mesa]

@Rishikesh_F

if(logs.get('accuracy') != None and logs.get('acc') >= 0.99):

Changing ‘accuracy’ for ‘acc’ should make the trick.

[Rishikesh_F]

thanks a lot it worked. But ‘acc’ and ‘accuracy’ are almost the same right ? what’s the difference ? why is it that one works and other doesn’t ?

[german.mesa]

It’s exactly the same. Name ‘accuracy’ was introduced later in new versions. What’s important here is the concept behind and that does not change.

[meiyou]

the course’s previous code examples use ‘accuracy’ in the callback function, so it’s natural students continue using the full name in assignment, but this would result failure when submitting the assignment. I spent 40 min debugging my code, and only realize the cause is different versions of code.
shouldn’t the assignment notify this in the beginning notes? (and we appreciate the other notes including the epoch and accuracy)

[balaji.ambresh]

Could you folks vote on this?

Why is tensorflow version 1.x in use?

For all course 1 exercises, the coursera notebooks use tensorflow 1.x Please fix this for the following reasons: People take this course for preparing for tensorflow 2.x certification. This method doesn’t exist in tensorflow 1 (tf.random.set_seed) Thanks.

[dennisobrien]

I ran into this same issue. I found it helpful to list the keys passed in the logs dictionary.

        def on_epoch_end(self, epoch, logs={}):
            keys = list(logs.keys())
            print("End epoch {} of training; got log keys: {}".format(epoch, keys))

[ai_curious]

In this context, logs is a Python dictionary using key-value pairs. In dictionary lookup, close doesn’t count…the key is either in the dictionary or it’s not. Which means that the key used in the callback lookup must match the one used in the model compile() statement when the metric was defined. You can use the string ‘acc’ or ‘accuracy’ as the key, but pick one and use it consistently because in this context they are most definitely not exactly the same.

In this case the code fragment provided above is:

    model.compile(optimizer='adam',
                  loss='sparse_categorical_crossentropy',
                  metrics=['acc'])

so you have to use ‘acc’ as the index in the callback or this expression

if(logs.get('accuracy') != None

will return False

[DeltaG2]

My callback is not working
All 10 epochs run and all with ‘acc’ = 0.0987 - see image
I have used ‘acc’ throughout and NOT ‘accuracy’
What is the problem?
thx

[snippet removed by mentor]

[DeltaG2]

Another post spells out how to fix when call back functioin is not working

Cannot get accuracy to 99% for handwritten digits problem

Cannot get accuracy to 99% for handwritten digits problem. What must I change in my code? My code is: mnist = tf.keras.datasets.mnist (x_train, y_train),(x_test, y_test) = mnist.load_data(path=path) x_train, x_test = x_train / 255.0, x_test / 255.0 # GRADED FUNCTION: train_mnist def train_mnist(): # Please write your code only where you are indicated. # please do not remove # model fitting inline comments. # YOUR CODE SHOULD START HERE class myCallback(tf.keras.callbacks.Cal…

[balaji.ambresh]

Please remove code from all your posts. It’s okay to share stacktrace(s) though.

You already pointed out the error i.e. using acc as a metric instead of accuracy.

Click my name and message your notebook and expanded grader feedback if the grader fails your submission.

[Jose_Antonio_Garcia]

I have the same problem, I reach 99% accuracy but my call to the callback function does not exit the train execution but continues executing the 10 epochs

This is my callback function

and my train function

Could someone help me or give me a hit if my callcack or train function is wrong?

[balaji.ambresh]

Posting code in a public topic is discouraged and can get your account suspended. It’s okay to share stacktrace on a public post and send code to a mentor via direct message. Please clean up your recent reply.

Since = code isn’t clear, you should look at the ungraded labs (C1_W2_Lab_2_callbacks.ipynb) to see what boolean value is used to ensure that model does stop training. Here’s another link you’ll find useful.

[balaji.ambresh]

Fix the typo in self.model.stop_trainig to get the code to work.

[Jose_Antonio_Garcia]

Solved, thanks a lot