CommonExtension extension

Common extension for the FlamaBindings class.

on

• FlamaBindings

Methods

llamaBatchAdd({required llama_batch batch, required int token, required int pos, required List<int> seqIds, required bool logits}) → llama_batch

Available on FlamaBindings, provided by the CommonExtension extension

Add a token to the batch.

llamaTokenize({required Pointer<llama_model> model, required String text, required bool addBos, bool special = false}) → (Pointer<llama_token>, int)

Available on FlamaBindings, provided by the CommonExtension extension

Tokenize the given text.

llamaTokenToPiece(Pointer<llama_context> ctx, int token) → String

Available on FlamaBindings, provided by the CommonExtension extension

Get string representation of the token.