llama_kv_cache_seq_rm method

void llama_kv_cache_seq_rm(
  1. Pointer<llama_context> ctx,
  2. int seq_id,
  3. int p0,
  4. int p1,
)

Removes all tokens that belong to the specified sequence and have positions in [p0, p1) seq_id < 0 : match any sequence p0 < 0 : 0, p1 p1 < 0 : [p0, inf)

Implementation

void llama_kv_cache_seq_rm(
  ffi.Pointer<llama_context> ctx,
  int seq_id,
  int p0,
  int p1,
) {
  return _llama_kv_cache_seq_rm(
    ctx,
    seq_id,
    p0,
    p1,
  );
}