WindowAttention class

Window-based Multi-Head Self-Attention.

This module wraps MultiHeadAttention to clarify its role in processing windows. The actual window partitioning happens before calling this module.

Inheritance

• Object
• Module
• WindowAttention

Constructors

WindowAttention(int embedSize, int numHeads)

Properties

attn → MultiHeadAttention

final

hashCode → int

The hash code for this object.

no setter, inherited

runtimeType → Type

A representation of the runtime type of the object.

no setter, inherited

Methods

forward(List<ValueVector> windowTokens) → List<ValueVector>

Forward pass for Window Attention.

noSuchMethod(Invocation invocation) → dynamic

Invoked when a nonexistent method or property is accessed.

inherited

parameters() → List<Value>

override

toString() → String

A string representation of this object.

inherited

zeroGrad() → void

inherited

Operators

operator ==(Object other) → bool

The equality operator.

inherited