toolTokenCountOverhead top-level constant

int const toolTokenCountOverhead

Fixed token overhead added by the API when tools are present.

Implementation

const int toolTokenCountOverhead = 500;