Long-Short Term Memory (LSTM) can remember things from a long time ago by using a forget gate. The advantage of LSTM (over RNN) is that it can remember over long periods of time. There are several gates in LSTM, such as the forget gate, the output gate, and the input gate. Each has its own function:

We have learned several techniques for deep learning in this section. Next, we will learn about TensorFlow.