The simplest activation function, one that is commonly used for the output layer activation function in neural network problems, is the linear activation function represented by the following formula:

The output is same as the input and the function is defined in the range (-infinity, +infinity). In the following figure, a linear activation function is shown: