I commented out the following two assertion statement, after which I also was able to get a 100 on the assignment.
#assert np.allclose(attn_w_b2[0, 0, 1], [0.34485385, 0.33230072, 0.32284543]), “Wrong values in attn_w_b2. Check the call to self.mha2”
#assert np.allclose(out[0, 0], [0.64775777, -1.5134472, 1.1092964, -0.24360693]), “Wrong values in out”
So, yes, either there is something wrong with the assertion statements and it is correct to follow the TensorFlow guide verbatim, or we are bypassing an error that should be flagged and the self.mha2 call is different from the guide.