The following images show different activation functions and their respective plots. Use this as a visual reference when dealing with individual function plots:
The following images show different activation functions and their respective plots. Use this as a visual reference when dealing with individual function plots: