LayerNorm class

Applies Layer Normalization over a single input vector.

This layer normalizes the activations of the previous layer for each token independently. It helps in stabilizing the learning process.

Inheritance

• Object
• Module
• LayerNorm

Constructors

LayerNorm(int dim, {double epsilon = 1e-5})

Properties

beta → Value

final

epsilon → double

final

gamma → Value

final

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

forward(ValueVector x) → ValueVector

Forward pass for Layer Normalization.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

parameters() → List<Value>

override

toString() → String

A string representation of this object.

inherited

zeroGrad() → void

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited