llama_beams_state class final

Passed to beam_search_callback function. Whenever 0 < common_prefix_length, this number of tokens should be copied from any of the beams (e.g. beams0) as they will be removed (shifted) from all beams in all subsequent callbacks. These pointers are valid only during the synchronous callback, so should not be saved.

Inheritance
Implemented types
Available extensions

Constructors

llama_beams_state()

Properties

address → Pointer<T>

Available on T, provided by the StructAddress extension

The memory address of the underlying data.
no setter
beam_views ↔ Pointer<llama_beam_view>
getter/setter pair
common_prefix_length ↔ int
Current max length of prefix tokens shared by all beams.
getter/setter pair
hashCode → int
The hash code for this object.
no setterinherited
last_call ↔ bool
True iff this is the last callback invocation.
getter/setter pair
n_beams ↔ int
Number of elements in beam_views[].
getter/setter pair
runtimeType → Type
A representation of the runtime type of the object.
no setterinherited

Methods

noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
toString() → String
A string representation of this object.
inherited

Operators

operator ==(Object other) → bool
The equality operator.
inherited