Reset gate

The reset gate helps to decide how to add the new information to the memory, that is, how much of the past information it can forget. The reset gate, ,at time step is expressed as follows:

Here, the following applies:

  •  is the input-to-hidden weights of the reset gate
  • is the hidden-to-hidden weights of the reset gate
  •  is the bias of the reset gate

The reset gate is shown in the following diagram:

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset