KVCache constructor

KVCache(
  1. int numLayers
)

Implementation

KVCache(int numLayers)
    : selfAttnCache = List.filled(numLayers, null),
      crossAttnCache = List.filled(numLayers, null);