I got AssertionError: wrong values for ft. I’m wondering do we need to use sigma as equation 1?


I implemented the formula without sigma, because it is not explained in the descriptions.

 ft =  np.dot(Wf, concat) + bf

The forget gate output if 0, forgets the saved state and if close to 1, remembers the saved state. Here’s the equation as given in the markdown cell.

You need the sigmoid function since it clamps matrix multiplication and addition to range [0, 1].

1 Like