Deep Learning Networks: Advantages of ReLU over Sigmoid Function
This was posted as a question on StackExchange. The state of the art of non-linearity is to use rectified linear units (ReLU) instead of sigmoid… Read More »Deep Learning Networks: Advantages of ReLU over Sigmoid Function