bytesForContext method

int bytesForContext(
  1. int contextTokens
)

Total bytes to run with a contextTokens-sized window.

Implementation

int bytesForContext(int contextTokens) =>
    weightsBytes + fixedOverheadBytes + kvBytesPerToken * contextTokens;