transformer/layerNormalization library

Classes

LayerNormalization

A Layer Normalization layer for 2D Matrix data.

LayerNormalizationVector

A Layer Normalization layer for 1D Vector data.

Functions

layerNorm(Tensor<Matrix> m, Tensor<Vector> gamma, Tensor<Vector> beta, {double epsilon = 1e-5}) → Tensor<Matrix>

layerNormVector(Tensor<Vector> v, Tensor<Vector> gamma, Tensor<Vector> beta, {double epsilon = 1e-5}) → Tensor<Vector>