Activation.leakyReLU constructor

Activation.leakyReLU()

Leaky ReLU activation function

leakyRelu(x) = max(0,x)

Example:

final leakyRelu = Activation.leakyReLU();
final x = Matrix.row([-1, 1]);
final y = leakyRelu.function(x);
final y2 = leakyRelu.function(x, 0.3);
print(y); // output: matrix 1⨯2 [[-0.1, 1.0]]
print(y2); // output: matrix 1⨯2 [[-0.3, 1.0]]

Implementation

Activation.leakyReLU() {
  function = (Matrix m, [dynamic alpha = 0.1]) =>
      m.apply((double x) => x > 0 ? x : x * (alpha as double));
  dfunction = (Matrix m, [dynamic alpha = 0.1]) =>
      [m.apply((double x) => x > 0 ? 1 : (alpha as double))];
  name = 'leaky_relu';
}