Tanh is another activation function that tolerates some negative values. Tanh accepts a real-valued input and squashes them to [-1, 1]:
tanh(x) = 2σ(2x) − 1
Figure 5: Tanh activation function
Tanh is another activation function that tolerates some negative values. Tanh accepts a real-valued input and squashes them to [-1, 1]: