getTokenCount abstract method

Future<int> getTokenCount(
  1. ConversationHandle conversation
)

Gets the number of tokens in the conversation KV Cache.

Implementation

Future<int> getTokenCount(ConversationHandle conversation);