lrelu function

double lrelu(
  1. double x
)

Leaky Linear Unit - Shallow line is seen in the negative x- and y-axes, instead of reducing result to 0 like ReLU.

Implementation

double lrelu(double x) => max(0.01 * x, x);