Forward propagation in LSTM

Putting it all together, the final LSTM cell with all the operations is shown in the following diagram. Cell state and hidden states are shared across time steps, meaning that the LSTM computes the cell state, , and hidden state, , at time step , and sends it to the next time step:

The complete forward propagation steps in the LSTM cell can be given as follows:

  1. Input gate:
  2. Forget gate:
  3. Output gate:
  4. Candidate state:
  5. Cell state:
  6. Hidden state:
  7. Output:

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset