forward method

List<ValueVector> forward(
  1. List<ValueVector> windowTokens
)

Forward pass for Window Attention.

Takes a list of ValueVectors representing the tokens within a single window.

Implementation

List<ValueVector> forward(List<ValueVector> windowTokens) {
  // MultiHeadAttention handles the QKV projection, scaling, softmax, and output projection
  return attn.forward(windowTokens);
}