The most common type of encoder uses bidirectional RNNs, with either LSTM or GRU units. In such cases, the input to the encoder is a distributed representation of words or word embeddings.
The most common type of encoder uses bidirectional RNNs, with either LSTM or GRU units. In such cases, the input to the encoder is a distributed representation of words or word embeddings.