maxNewTokens property

int maxNewTokens
final

The decoder has 448 positions. The prompt uses 4.

Implementation

final int maxNewTokens;