defaultInputLength property

int defaultInputLength

Each model has a limited context until this model starts to "forget".

The default input length is calculated as follows: 1 token = 4 characters (English) input context = 1 / 3 of the model's context (Assuming 2x output context) Therefore, input_length = 1.33 * model_context

Implementation

final int defaultInputLength;