LlamaLibrarySharedBindingsByGeneralDeveloper class

LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer

Constructors

LlamaLibrarySharedBindingsByGeneralDeveloper(DynamicLibrary dynamicLibrary)
The symbols are looked up in dynamicLibrary.
LlamaLibrarySharedBindingsByGeneralDeveloper.fromLookup(Pointer<T> lookup<T extends NativeType>(String symbolName))
The symbols are looked up with lookup.

Properties

GGML_TENSOR_SIZE int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
no setter
hashCode int
The hash code for this object.
no setterinherited
runtimeType Type
A representation of the runtime type of the object.
no setterinherited
stderr Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getter/setter pair
stdin Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getter/setter pair
stdout Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getter/setter pair

Methods

asprintf(Pointer<Pointer<Char>> __ptr, Pointer<Char> __fmt) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
clearerr(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
clearerr_unlocked(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ctermid(Pointer<Char> __s) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
dprintf(int __fd, Pointer<Char> __fmt) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fclose(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fdopen(int __fd, Pointer<Char> __modes) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
feof(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
feof_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ferror(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ferror_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fflush(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fflush_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fgetc(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fgetc_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fgetpos(Pointer<FILE> __stream, Pointer<fpos_t> __pos) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fgets(Pointer<Char> __s, int __n, Pointer<FILE> __stream) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fileno(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fileno_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
flockfile(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fmemopen(Pointer<Void> __s, int __len, Pointer<Char> __modes) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fopen(Pointer<Char> __filename, Pointer<Char> __modes) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fopencookie(Pointer<Void> __magic_cookie, Pointer<Char> __modes, cookie_io_functions_t __io_funcs) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fprintf(Pointer<FILE> __stream, Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fputc(int __c, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fputc_unlocked(int __c, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fputs(Pointer<Char> __s, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fread(Pointer<Void> __ptr, int __size, int __n, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fread_unlocked(Pointer<Void> __ptr, int __size, int __n, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
freopen(Pointer<Char> __filename, Pointer<Char> __modes, Pointer<FILE> __stream) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fscanf(Pointer<FILE> __stream, Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fseek(Pointer<FILE> __stream, int __off, int __whence) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fseeko(Pointer<FILE> __stream, int __off, int __whence) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fsetpos(Pointer<FILE> __stream, Pointer<fpos_t> __pos) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ftell(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ftello(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ftrylockfile(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
funlockfile(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fwrite(Pointer<Void> __ptr, int __size, int __n, Pointer<FILE> __s) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
fwrite_unlocked(Pointer<Void> __ptr, int __size, int __n, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getc(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getc_unlocked(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getchar() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getchar_unlocked() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getdelim(Pointer<Pointer<Char>> __lineptr, Pointer<Size> __n, int __delimiter, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getline(Pointer<Pointer<Char>> __lineptr, Pointer<Size> __n, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
getw(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_abort(Pointer<Char> file, int line, Pointer<Char> fmt) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_abs(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_abs_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_acc(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int nb2, int nb3, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_acc_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int nb2, int nb3, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add1(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add1_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add_cast(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int type) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add_rel_pos(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> pw, Pointer<ggml_tensor> ph) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_add_rel_pos_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> pw, Pointer<ggml_tensor> ph) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_arange(Pointer<ggml_context> ctx, double start, double stop, double step) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_are_same_shape(Pointer<ggml_tensor> t0, Pointer<ggml_tensor> t1) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_are_same_stride(Pointer<ggml_tensor> t0, Pointer<ggml_tensor> t1) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_argmax(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_argsort(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int order) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_alloc_buffer(ggml_backend_t backend, int size) ggml_backend_buffer_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_alloc_ctx_tensors(Pointer<ggml_context> ctx, ggml_backend_t backend) Pointer<ggml_backend_buffer>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_alloc_ctx_tensors_from_buft(Pointer<ggml_context> ctx, ggml_backend_buffer_type_t buft) Pointer<ggml_backend_buffer>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_clear(ggml_backend_buffer_t buffer, int value) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_free(ggml_backend_buffer_t buffer) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_alignment(ggml_backend_buffer_t buffer) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_alloc_size(ggml_backend_buffer_t buffer, Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_base(ggml_backend_buffer_t buffer) Pointer<Void>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_max_size(ggml_backend_buffer_t buffer) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_size(ggml_backend_buffer_t buffer) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_type(ggml_backend_buffer_t buffer) ggml_backend_buffer_type_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_get_usage(ggml_backend_buffer_t buffer) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_init_tensor(ggml_backend_buffer_t buffer, Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_is_host(ggml_backend_buffer_t buffer) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_name(ggml_backend_buffer_t buffer) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_reset(ggml_backend_buffer_t buffer) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buffer_set_usage(ggml_backend_buffer_t buffer, int usage) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_alloc_buffer(ggml_backend_buffer_type_t buft, int size) ggml_backend_buffer_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_get_alignment(ggml_backend_buffer_type_t buft) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_get_alloc_size(ggml_backend_buffer_type_t buft, Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_get_device(ggml_backend_buffer_type_t buft) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_get_max_size(ggml_backend_buffer_type_t buft) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_is_host(ggml_backend_buffer_type_t buft) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_buft_name(ggml_backend_buffer_type_t buft) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_compare_graph_backend(ggml_backend_t backend1, ggml_backend_t backend2, Pointer<ggml_cgraph> graph, ggml_backend_eval_callback callback, Pointer<Void> user_data) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_buffer_from_ptr(Pointer<Void> ptr, int size) ggml_backend_buffer_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_buffer_type() ggml_backend_buffer_type_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_init() ggml_backend_t
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_reg() ggml_backend_reg_t
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_set_abort_callback(ggml_backend_t backend_cpu, ggml_abort_callback abort_callback, Pointer<Void> abort_callback_data) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_set_n_threads(ggml_backend_t backend_cpu, int n_threads) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_cpu_set_threadpool(ggml_backend_t backend_cpu, ggml_threadpool_t threadpool) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_dev_backend_reg(ggml_backend_dev_t device) ggml_backend_reg_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_buffer_from_host_ptr(ggml_backend_dev_t device, Pointer<Void> ptr, int size, int max_tensor_size) ggml_backend_buffer_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_buffer_type(ggml_backend_dev_t device) ggml_backend_buffer_type_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_by_name(Pointer<Char> name) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_by_type(int type) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_count() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_description(ggml_backend_dev_t device) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_get(int index) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_get_props(ggml_backend_dev_t device, Pointer<ggml_backend_dev_props> props) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_host_buffer_type(ggml_backend_dev_t device) ggml_backend_buffer_type_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_init(ggml_backend_dev_t device, Pointer<Char> params) ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_memory(ggml_backend_dev_t device, Pointer<Size> free, Pointer<Size> total) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_name(ggml_backend_dev_t device) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_offload_op(ggml_backend_dev_t device, Pointer<ggml_tensor> op) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_supports_buft(ggml_backend_dev_t device, ggml_backend_buffer_type_t buft) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_supports_op(ggml_backend_dev_t device, Pointer<ggml_tensor> op) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_dev_type1(ggml_backend_dev_t device) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_device_register(ggml_backend_dev_t device) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_event_free(ggml_backend_event_t event) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_event_new(ggml_backend_dev_t device) ggml_backend_event_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_event_record(ggml_backend_event_t event, ggml_backend_t backend) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_event_synchronize(ggml_backend_event_t event) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_event_wait(ggml_backend_t backend, ggml_backend_event_t event) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_free(ggml_backend_t backend) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_get_alignment(ggml_backend_t backend) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_get_default_buffer_type(ggml_backend_t backend) ggml_backend_buffer_type_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_get_device(ggml_backend_t backend) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_get_max_size(ggml_backend_t backend) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_compute(ggml_backend_t backend, Pointer<ggml_cgraph> cgraph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_compute_async(ggml_backend_t backend, Pointer<ggml_cgraph> cgraph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_copy1(ggml_backend_t backend, Pointer<ggml_cgraph> graph) ggml_backend_graph_copy
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_copy_free(ggml_backend_graph_copy copy) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_plan_compute(ggml_backend_t backend, ggml_backend_graph_plan_t plan) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_plan_create(ggml_backend_t backend, Pointer<ggml_cgraph> cgraph) ggml_backend_graph_plan_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_graph_plan_free(ggml_backend_t backend, ggml_backend_graph_plan_t plan) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_guid(ggml_backend_t backend) ggml_guid_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_init_best() ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_init_by_name(Pointer<Char> name, Pointer<Char> params) ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_init_by_type(int type, Pointer<Char> params) ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_is_cpu(ggml_backend_t backend) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_backend_load(Pointer<Char> path) ggml_backend_reg_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_load_all() → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_load_all_from_path(Pointer<Char> dir_path) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_name(ggml_backend_t backend) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_offload_op(ggml_backend_t backend, Pointer<ggml_tensor> op) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_by_name(Pointer<Char> name) ggml_backend_reg_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_count() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_dev_count(ggml_backend_reg_t reg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_dev_get(ggml_backend_reg_t reg, int index) ggml_backend_dev_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_get(int index) ggml_backend_reg_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_get_proc_address(ggml_backend_reg_t reg, Pointer<Char> name) Pointer<Void>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_reg_name(ggml_backend_reg_t reg) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_alloc_graph(ggml_backend_sched_t sched, Pointer<ggml_cgraph> graph) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_free(ggml_backend_sched_t sched) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_backend(ggml_backend_sched_t sched, int i) ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_buffer_size(ggml_backend_sched_t sched, ggml_backend_t backend) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_n_backends(ggml_backend_sched_t sched) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_n_copies(ggml_backend_sched_t sched) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_n_splits(ggml_backend_sched_t sched) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_get_tensor_backend(ggml_backend_sched_t sched, Pointer<ggml_tensor> node) ggml_backend_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_graph_compute(ggml_backend_sched_t sched, Pointer<ggml_cgraph> graph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_graph_compute_async(ggml_backend_sched_t sched, Pointer<ggml_cgraph> graph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_new(Pointer<ggml_backend_t> backends, Pointer<ggml_backend_buffer_type_t> bufts, int n_backends, int graph_size, bool parallel) ggml_backend_sched_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_reserve(ggml_backend_sched_t sched, Pointer<ggml_cgraph> measure_graph) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_reset(ggml_backend_sched_t sched) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_set_eval_callback(ggml_backend_sched_t sched, ggml_backend_sched_eval_callback callback, Pointer<Void> user_data) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_set_tensor_backend(ggml_backend_sched_t sched, Pointer<ggml_tensor> node, ggml_backend_t backend) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_sched_synchronize(ggml_backend_sched_t sched) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_supports_buft(ggml_backend_t backend, ggml_backend_buffer_type_t buft) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_supports_op(ggml_backend_t backend, Pointer<ggml_tensor> op) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_synchronize(ggml_backend_t backend) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_alloc(ggml_backend_buffer_t buffer, Pointer<ggml_tensor> tensor, Pointer<Void> addr) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_copy(Pointer<ggml_tensor> src, Pointer<ggml_tensor> dst) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_copy_async(ggml_backend_t backend_src, ggml_backend_t backend_dst, Pointer<ggml_tensor> src, Pointer<ggml_tensor> dst) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_get(Pointer<ggml_tensor> tensor, Pointer<Void> data, int offset, int size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_get_async(ggml_backend_t backend, Pointer<ggml_tensor> tensor, Pointer<Void> data, int offset, int size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_memset(Pointer<ggml_tensor> tensor, int value, int offset, int size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_set(Pointer<ggml_tensor> tensor, Pointer<Void> data, int offset, int size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_tensor_set_async(ggml_backend_t backend, Pointer<ggml_tensor> tensor, Pointer<Void> data, int offset, int size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_unload(ggml_backend_reg_t reg) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_backend_view_init(Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_bf16_to_fp32(ggml_bf16_t arg0) double
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_bf16_to_fp32_row(Pointer<ggml_bf16_t> arg0, Pointer<Float> arg1, int arg2) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_blck_size(int type) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_build_backward_expand(Pointer<ggml_context> ctx_static, Pointer<ggml_context> ctx_compute, Pointer<ggml_cgraph> cgraph, bool accumulate) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_build_forward_expand(Pointer<ggml_cgraph> cgraph, Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_can_repeat(Pointer<ggml_tensor> t0, Pointer<ggml_tensor> t1) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cast(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int type) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_clamp(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double min, double max) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_concat(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int dim) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cont(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cont_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cont_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cont_3d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cont_4d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2, int ne3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int p0, int d0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_1d_dw(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int p0, int d0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_1d_dw_ph(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int d0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_1d_ph(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s, int d) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int s1, int p0, int p1, int d0, int d1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_2d_dw(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int s1, int p0, int p1, int d0, int d1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_2d_s1_ph(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_2d_sk_p0(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_transpose_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int p0, int d0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_conv_transpose_2d_p0(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int stride) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cos(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cos_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_count_equal(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cpu_get_sve_cnt() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_amx_int8() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_arm_fma() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx2() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx512() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx512_bf16() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx512_vbmi() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx512_vnni() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_avx_vnni() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_dotprod() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_f16c() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_fma() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_fp16_va() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_llamafile() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_matmul_int8() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_neon() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_riscv_v() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_sse3() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_ssse3() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_sve() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_vsx() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_has_wasm_simd() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpu_init() → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_cpy(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cross_entropy_loss(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cross_entropy_loss_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cycles() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_cycles_per_ms() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_diag(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_diag_mask_inf(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_past) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_diag_mask_inf_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_past) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_diag_mask_zero(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_past) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_diag_mask_zero_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_past) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_div(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_div_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_dup(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_dup_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_dup_tensor(Pointer<ggml_context> ctx, Pointer<ggml_tensor> src) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_element_size(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_elu(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_elu_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_exp(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_exp_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_flash_attn_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> q, Pointer<ggml_tensor> k, Pointer<ggml_tensor> v, Pointer<ggml_tensor> d, bool masked) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_flash_attn_ext(Pointer<ggml_context> ctx, Pointer<ggml_tensor> q, Pointer<ggml_tensor> k, Pointer<ggml_tensor> v, Pointer<ggml_tensor> mask, double scale, double max_bias, double logit_softcap) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_flash_attn_ext_get_prec(Pointer<ggml_tensor> a) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_flash_attn_ext_set_prec(Pointer<ggml_tensor> a, int prec) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fopen(Pointer<Char> fname, Pointer<Char> mode) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_format_name(Pointer<ggml_tensor> tensor, Pointer<Char> fmt) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp16_to_fp32(int arg0) double
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp16_to_fp32_row(Pointer<ggml_fp16_t> arg0, Pointer<Float> arg1, int arg2) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp32_to_bf16(double arg0) ggml_bf16_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp32_to_bf16_row(Pointer<Float> arg0, Pointer<ggml_bf16_t> arg1, int arg2) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp32_to_bf16_row_ref(Pointer<Float> arg0, Pointer<ggml_bf16_t> arg1, int arg2) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp32_to_fp16(double arg0) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_fp32_to_fp16_row(Pointer<Float> arg0, Pointer<ggml_fp16_t> arg1, int arg2) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_free(Pointer<ggml_context> ctx) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_ftype_to_ggml_type(int ftype) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_alloc_graph(ggml_gallocr_t galloc, Pointer<ggml_cgraph> graph) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_free(ggml_gallocr_t galloc) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_get_buffer_size(ggml_gallocr_t galloc, int buffer_id) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_new(ggml_backend_buffer_type_t buft) ggml_gallocr_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_new_n(Pointer<ggml_backend_buffer_type_t> bufts, int n_bufs) ggml_gallocr_t
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_reserve(ggml_gallocr_t galloc, Pointer<ggml_cgraph> graph) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gallocr_reserve_n(ggml_gallocr_t galloc, Pointer<ggml_cgraph> graph, Pointer<Int> node_buffer_ids, Pointer<Int> leaf_buffer_ids) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gated_linear_attn(Pointer<ggml_context> ctx, Pointer<ggml_tensor> k, Pointer<ggml_tensor> v, Pointer<ggml_tensor> q, Pointer<ggml_tensor> g, Pointer<ggml_tensor> state, double scale) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gelu(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gelu_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gelu_quick(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_gelu_quick_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_data(Pointer<ggml_tensor> tensor) Pointer<Void>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_data_f32(Pointer<ggml_tensor> tensor) Pointer<Float>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_f32_1d(Pointer<ggml_tensor> tensor, int i) double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_get_f32_nd(Pointer<ggml_tensor> tensor, int i0, int i1, int i2, int i3) double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_get_first_tensor(Pointer<ggml_context> ctx) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_i32_1d(Pointer<ggml_tensor> tensor, int i) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_get_i32_nd(Pointer<ggml_tensor> tensor, int i0, int i1, int i2, int i3) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_get_max_tensor_size(Pointer<ggml_context> ctx) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_mem_buffer(Pointer<ggml_context> ctx) Pointer<Void>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_mem_size(Pointer<ggml_context> ctx) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_name(Pointer<ggml_tensor> tensor) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_next_tensor(Pointer<ggml_context> ctx, Pointer<ggml_tensor> tensor) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_no_alloc(Pointer<ggml_context> ctx) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_rel_pos(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int qh, int kh) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_rows(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_rows_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_tensor(Pointer<ggml_context> ctx, Pointer<Char> name) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_type_traits(int type) Pointer<ggml_type_traits>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_get_type_traits_cpu(int type) Pointer<ggml_type_traits_cpu>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_get_unary_op(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_add_node(Pointer<ggml_cgraph> cgraph, Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_clear(Pointer<ggml_cgraph> cgraph) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_compute(Pointer<ggml_cgraph> cgraph, Pointer<ggml_cplan> cplan) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_graph_compute_with_ctx(Pointer<ggml_context> ctx, Pointer<ggml_cgraph> cgraph, int n_threads) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_graph_cpy(Pointer<ggml_cgraph> src, Pointer<ggml_cgraph> dst) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_dump_dot(Pointer<ggml_cgraph> gb, Pointer<ggml_cgraph> gf, Pointer<Char> filename) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_dup(Pointer<ggml_context> ctx, Pointer<ggml_cgraph> cgraph) Pointer<ggml_cgraph>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_export(Pointer<ggml_cgraph> cgraph, Pointer<Char> fname) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_get_grad(Pointer<ggml_cgraph> cgraph, Pointer<ggml_tensor> node) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_get_grad_acc(Pointer<ggml_cgraph> cgraph, Pointer<ggml_tensor> node) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_get_tensor(Pointer<ggml_cgraph> cgraph, Pointer<Char> name) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_import(Pointer<Char> fname, Pointer<Pointer<ggml_context>> ctx_data, Pointer<Pointer<ggml_context>> ctx_eval) Pointer<ggml_cgraph>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_n_nodes(Pointer<ggml_cgraph> cgraph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_node(Pointer<ggml_cgraph> cgraph, int i) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_nodes(Pointer<ggml_cgraph> cgraph) Pointer<Pointer<ggml_tensor>>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_overhead() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_overhead_custom(int size, bool grads) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_plan(Pointer<ggml_cgraph> cgraph, int n_threads, Pointer<ggml_threadpool> threadpool) ggml_cplan
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_graph_print(Pointer<ggml_cgraph> cgraph) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_reset(Pointer<ggml_cgraph> cgraph) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_graph_size(Pointer<ggml_cgraph> cgraph) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_group_norm(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_groups, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_group_norm_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int n_groups, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_guid_matches(ggml_guid_t guid_a, ggml_guid_t guid_b) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_hardsigmoid(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_hardswish(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_im2col(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int s0, int s1, int p0, int p1, int d0, int d1, bool is_2D, int dst_type) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_im2col_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<Int64> ne, int s0, int s1, int p0, int p1, int d0, int d1, bool is_2D) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_init(ggml_init_params params) Pointer<ggml_context>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_3d(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_contiguous(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_contiguous_0(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_contiguous_1(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_contiguous_2(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_empty(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_matrix(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_numa() bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_is_permuted(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_quantized(int type) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_scalar(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_transposed(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_is_vector(Pointer<ggml_tensor> tensor) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_leaky_relu(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double negative_slope, bool inplace) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_log(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_log_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_log_set(ggml_log_callback log_callback, Pointer<Void> user_data) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_binary_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_binary_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_binary_inplace_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_binary_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom1(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_custom1_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom1_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_custom1_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom1_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_custom1_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom1_inplace_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_custom1_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom2(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_custom2_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom2_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_custom2_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom2_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_custom2_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom2_inplace_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, ggml_custom2_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom3(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, ggml_custom3_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom3_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, ggml_custom3_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom3_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, ggml_custom3_op_t fun, int n_tasks, Pointer<Void> userdata) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_custom3_inplace_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, ggml_custom3_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_unary_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_unary_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_map_unary_inplace_f32(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, ggml_unary_op_f32_t fun) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mean(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mul(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mul_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mul_mat(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mul_mat_id(Pointer<ggml_context> ctx, Pointer<ggml_tensor> as1, Pointer<ggml_tensor> b, Pointer<ggml_tensor> ids) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_mul_mat_set_prec(Pointer<ggml_tensor> a, int prec) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_n_dims(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_nbytes(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_nbytes_pad(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_neg(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_neg_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_nelements(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_buffer(Pointer<ggml_context> ctx, int nbytes) Pointer<Void>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_f32(Pointer<ggml_context> ctx, double value) Pointer<ggml_tensor>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_new_graph(Pointer<ggml_context> ctx) Pointer<ggml_cgraph>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_graph_custom(Pointer<ggml_context> ctx, int size, bool grads) Pointer<ggml_cgraph>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_i32(Pointer<ggml_context> ctx, int value) Pointer<ggml_tensor>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_new_tensor(Pointer<ggml_context> ctx, int type, int n_dims, Pointer<Int64> ne) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_tensor_1d(Pointer<ggml_context> ctx, int type, int ne0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_tensor_2d(Pointer<ggml_context> ctx, int type, int ne0, int ne1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_tensor_3d(Pointer<ggml_context> ctx, int type, int ne0, int ne1, int ne2) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_new_tensor_4d(Pointer<ggml_context> ctx, int type, int ne0, int ne1, int ne2, int ne3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_norm(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_norm_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_nrows(Pointer<ggml_tensor> tensor) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_numa_init(int numa) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_op_desc(Pointer<ggml_tensor> t) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_op_name(int op) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_op_symbol(int op) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_opt_step_adamw(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> grad, Pointer<ggml_tensor> m, Pointer<ggml_tensor> v, Pointer<ggml_tensor> adamw_params) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_out_prod(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_pad(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int p0, int p1, int p2, int p3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_pad_reflect_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int p0, int p1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_permute(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int axis0, int axis1, int axis2, int axis3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_pool_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int op, int k0, int s0, int p0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_pool_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int op, int k0, int k1, int s0, int s1, double p0, double p1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_pool_2d_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> af, int op, int k0, int k1, int s0, int s1, double p0, double p1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_print_object(Pointer<ggml_object> obj) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_print_objects(Pointer<ggml_context> ctx) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_quantize_chunk(int type, Pointer<Float> src, Pointer<Void> dst, int start, int nrows, int n_per_row, Pointer<Float> imatrix) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_quantize_free() → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_quantize_init(int type) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_quantize_requires_imatrix(int type) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_relu(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_relu_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_repeat(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_repeat_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reset(Pointer<ggml_context> ctx) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reshape(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reshape_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reshape_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reshape_3d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_reshape_4d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2, int ne3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rms_norm(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rms_norm_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rms_norm_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double eps) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int n_dims, int mode) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_custom(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int n_dims, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_custom_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int n_dims, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_ext(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, int n_dims, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_ext_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, int n_dims, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_ext_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, int n_dims, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int n_dims, int mode) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_multi(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, int n_dims, Pointer<Int> sections, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_multi_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, Pointer<ggml_tensor> c, int n_dims, Pointer<Int> sections, int mode, int n_ctx_orig, double freq_base, double freq_scale, double ext_factor, double attn_factor, double beta_fast, double beta_slow) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rope_yarn_corr_dims(int n_dims, int n_ctx_orig, double freq_base, double beta_fast, double beta_slow, Pointer<Float> dims) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_row_size(int type, int ne) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_rwkv_wkv6(Pointer<ggml_context> ctx, Pointer<ggml_tensor> k, Pointer<ggml_tensor> v, Pointer<ggml_tensor> r, Pointer<ggml_tensor> tf, Pointer<ggml_tensor> td, Pointer<ggml_tensor> state) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_scale(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double s) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_scale_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, double s) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int nb2, int nb3, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_1d_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_2d_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_f32(Pointer<ggml_tensor> tensor, double value) Pointer<ggml_tensor>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_f32_1d(Pointer<ggml_tensor> tensor, int i, double value) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_f32_nd(Pointer<ggml_tensor> tensor, int i0, int i1, int i2, int i3, double value) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_i32(Pointer<ggml_tensor> tensor, int value) Pointer<ggml_tensor>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_i32_1d(Pointer<ggml_tensor> tensor, int i, int value) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_i32_nd(Pointer<ggml_tensor> tensor, int i0, int i1, int i2, int i3, int value) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_set_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, int nb1, int nb2, int nb3, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_input(Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_loss(Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_name(Pointer<ggml_tensor> tensor, Pointer<Char> name) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_no_alloc(Pointer<ggml_context> ctx, bool no_alloc) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_output(Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_param(Pointer<ggml_context> ctx, Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_set_zero(Pointer<ggml_tensor> tensor) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sgn(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sgn_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sigmoid(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sigmoid_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_silu(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_silu_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_silu_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sin(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sin_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_soft_max(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_soft_max_ext(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> mask, double scale, double max_bias) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_soft_max_ext_back(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, double scale, double max_bias) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_soft_max_ext_back_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b, double scale, double max_bias) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_soft_max_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sqr(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sqr_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sqrt(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sqrt_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_ssm_conv(Pointer<ggml_context> ctx, Pointer<ggml_tensor> sx, Pointer<ggml_tensor> c) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_ssm_scan(Pointer<ggml_context> ctx, Pointer<ggml_tensor> s, Pointer<ggml_tensor> x, Pointer<ggml_tensor> dt, Pointer<ggml_tensor> A, Pointer<ggml_tensor> B, Pointer<ggml_tensor> C) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_status_to_string(int status) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_step(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_step_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sub(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sub_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, Pointer<ggml_tensor> b) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sum(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_sum_rows(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_tallocr_alloc(Pointer<ggml_tallocr> talloc, Pointer<ggml_tensor> tensor) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_tallocr_new(ggml_backend_buffer_t buffer) ggml_tallocr
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_tanh(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_tanh_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_tensor_overhead() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_threadpool_free(Pointer<ggml_threadpool> threadpool) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_threadpool_get_n_threads(Pointer<ggml_threadpool> threadpool) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_threadpool_new(Pointer<ggml_threadpool_params> params) Pointer<ggml_threadpool>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_threadpool_params_default(int n_threads) ggml_threadpool_params
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_threadpool_params_init(Pointer<ggml_threadpool_params> p, int n_threads) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_threadpool_params_match(Pointer<ggml_threadpool_params> p0, Pointer<ggml_threadpool_params> p1) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_threadpool_pause(Pointer<ggml_threadpool> threadpool) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_threadpool_resume(Pointer<ggml_threadpool> threadpool) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
ggml_time_init() → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_time_ms() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_time_us() int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_timestep_embedding(Pointer<ggml_context> ctx, Pointer<ggml_tensor> timesteps, int dim, int max_period) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_top_k(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int k) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_transpose(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_type_name(int type) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_type_size(int type) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_type_sizef(int type) double
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_unary(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int op) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_unary_inplace(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int op) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_unary_op_name(int op) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_unravel_index(Pointer<ggml_tensor> tensor, int i, Pointer<Int64> i0, Pointer<Int64> i1, Pointer<Int64> i2, Pointer<Int64> i3) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_upscale(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int scale_factor) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_upscale_ext(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2, int ne3) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_used_mem(Pointer<ggml_context> ctx) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_validate_row_data(int type, Pointer<Void> data, int nbytes) bool
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_view_1d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_view_2d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int nb1, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_view_3d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2, int nb1, int nb2, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_view_4d(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int ne0, int ne1, int ne2, int ne3, int nb1, int nb2, int nb3, int offset) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_view_tensor(Pointer<ggml_context> ctx, Pointer<ggml_tensor> src) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_win_part(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int w) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
ggml_win_unpart(Pointer<ggml_context> ctx, Pointer<ggml_tensor> a, int w0, int h0, int w) Pointer<ggml_tensor>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
llama_adapter_lora_free(Pointer<llama_adapter_lora> adapter) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_adapter_lora_init(Pointer<llama_model> model, Pointer<Char> path_lora) Pointer<llama_adapter_lora>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_add_bos_token(Pointer<llama_vocab> vocab) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_add_eos_token(Pointer<llama_vocab> vocab) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_apply_adapter_cvec(Pointer<llama_context> ctx, Pointer<Float> data, int len, int n_embd, int il_start, int il_end) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_attach_threadpool(Pointer<llama_context> ctx, ggml_threadpool_t threadpool, ggml_threadpool_t threadpool_batch) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_backend_free() → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_backend_init() → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_batch_free(llama_batch batch) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_batch_get_one(Pointer<llama_token> tokens, int n_tokens) llama_batch
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_batch_init(int n_tokens, int embd, int n_seq_max) llama_batch
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_chat_apply_template(Pointer<Char> tmpl, Pointer<llama_chat_message> chat, int n_msg, bool add_ass, Pointer<Char> buf, int length) int
Apply chat template. Inspired by hf apply_chat_template() on python. Both "model" and "custom_template" are optional, but at least one is required. "custom_template" has higher precedence than "model" NOTE: This function does not use a jinja parser. It only support a pre-defined list of template. See more: https://github.com/ggerganov/llama.cpp/wiki/Templates-supported-by-llama_chat_apply_template @param tmpl A Jinja template to use for this chat. If this is nullptr, the model’s default chat template will be used instead. @param chat Pointer to a list of multiple llama_chat_message @param n_msg Number of llama_chat_message in this chat @param add_ass Whether to end the prompt with the token(s) that indicate the start of an assistant message. @param buf A buffer to hold the output formatted prompt. The recommended alloc size is 2 * (total number of characters of all messages) @param length The size of the allocated buffer @return The total number of bytes of the formatted prompt. If is it larger than the size of buffer, you may need to re-alloc it and then re-apply the template.
llama_chat_builtin_templates(Pointer<Pointer<Char>> output, int len) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_clear_adapter_lora(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_context_default_params() llama_context_params
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_copy_state_data(Pointer<llama_context> ctx, Pointer<Uint8> dst) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_decode(Pointer<llama_context> ctx, llama_batch batch) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_detach_threadpool(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_detokenize(Pointer<llama_vocab> vocab, Pointer<llama_token> tokens, int n_tokens, Pointer<Char> text, int text_len_max, bool remove_special, bool unparse_special) int
@details Convert the provided tokens into text (inverse of llama_tokenize()). @param text The char pointer must be large enough to hold the resulting text. @return Returns the number of chars/bytes on success, no more than text_len_max. @return Returns a negative number on failure - the number of chars/bytes that would have been returned. @param remove_special Allow to remove BOS and EOS tokens if model is configured to do so. @param unparse_special If true, special tokens are rendered in the output.
llama_encode(Pointer<llama_context> ctx, llama_batch batch) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_free(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_free_model(Pointer<llama_model> model) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_embeddings(Pointer<llama_context> ctx) Pointer<Float>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_embeddings_ith(Pointer<llama_context> ctx, int i) Pointer<Float>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_embeddings_seq(Pointer<llama_context> ctx, int seq_id) Pointer<Float>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_kv_cache_token_count(Pointer<llama_context> ctx) int
llama_get_kv_cache_used_cells(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_logits(Pointer<llama_context> ctx) Pointer<Float>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_logits_ith(Pointer<llama_context> ctx, int i) Pointer<Float>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_model(Pointer<llama_context> ctx) Pointer<llama_model>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_get_state_size(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_init_from_model(Pointer<llama_model> model, llama_context_params params) Pointer<llama_context>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_can_shift(Pointer<llama_context> ctx) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_clear(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_defrag(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_add(Pointer<llama_context> ctx, int seq_id, int p0, int p1, int delta) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_cp(Pointer<llama_context> ctx, int seq_id_src, int seq_id_dst, int p0, int p1) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_div(Pointer<llama_context> ctx, int seq_id, int p0, int p1, int d) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_keep(Pointer<llama_context> ctx, int seq_id) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_pos_max(Pointer<llama_context> ctx, int seq_id) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_seq_rm(Pointer<llama_context> ctx, int seq_id, int p0, int p1) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_update(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_view_free(Pointer<llama_kv_cache_view> view) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_view_init(Pointer<llama_context> ctx, int n_seq_max) llama_kv_cache_view
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_kv_cache_view_update(Pointer<llama_context> ctx, Pointer<llama_kv_cache_view> view) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_load_model_from_file(Pointer<Char> path_model, llama_model_params params) Pointer<llama_model>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_load_session_file(Pointer<llama_context> ctx, Pointer<Char> path_session, Pointer<llama_token> tokens_out, int n_token_capacity, Pointer<Size> n_token_count_out) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_log_set(ggml_log_callback log_callback, Pointer<Void> user_data) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_max_devices() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_chat_template(Pointer<llama_model> model, Pointer<Char> name) Pointer<Char>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_decoder_start_token(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_default_params() llama_model_params
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_desc(Pointer<llama_model> model, Pointer<Char> buf, int buf_size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_free(Pointer<llama_model> model) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_get_vocab(Pointer<llama_model> model) Pointer<llama_vocab>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_has_decoder(Pointer<llama_model> model) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_has_encoder(Pointer<llama_model> model) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_is_recurrent(Pointer<llama_model> model) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_load_from_file(Pointer<Char> path_model, llama_model_params params) Pointer<llama_model>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_load_from_splits(Pointer<Pointer<Char>> paths, int n_paths, llama_model_params params) Pointer<llama_model>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_meta_count(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_meta_key_by_index(Pointer<llama_model> model, int i, Pointer<Char> buf, int buf_size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_meta_val_str(Pointer<llama_model> model, Pointer<Char> key, Pointer<Char> buf, int buf_size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_meta_val_str_by_index(Pointer<llama_model> model, int i, Pointer<Char> buf, int buf_size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_n_ctx_train(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_n_embd(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_n_head(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_n_layer(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_n_params(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_quantize(Pointer<Char> fname_inp, Pointer<Char> fname_out, Pointer<llama_model_quantize_params> params) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_quantize_default_params() llama_model_quantize_params
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_rope_freq_scale_train(Pointer<llama_model> model) double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_rope_type(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_model_size(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_batch(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_ctx(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_ctx_train(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_embd(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_head(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_layer(Pointer<llama_model> model) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_seq_max(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_threads(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_threads_batch(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_ubatch(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_n_vocab(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_new_context_with_model(Pointer<llama_model> model, llama_context_params params) Pointer<llama_context>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_numa_init(int numa) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_context(Pointer<llama_context> ctx) llama_perf_context_data
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_context_print(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_context_reset(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_sampler(Pointer<llama_sampler> chain) llama_perf_sampler_data
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_sampler_print(Pointer<llama_sampler> chain) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_perf_sampler_reset(Pointer<llama_sampler> chain) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_pooling_type1(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_print_system_info() Pointer<Char>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_rm_adapter_lora(Pointer<llama_context> ctx, Pointer<llama_adapter_lora> adapter) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_accept(Pointer<llama_sampler> smpl, int token) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_apply(Pointer<llama_sampler> smpl, Pointer<llama_token_data_array> cur_p) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_add(Pointer<llama_sampler> chain, Pointer<llama_sampler> smpl) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_default_params() llama_sampler_chain_params
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_get(Pointer<llama_sampler> chain, int i) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_init(llama_sampler_chain_params params) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_n(Pointer<llama_sampler> chain) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_chain_remove(Pointer<llama_sampler> chain, int i) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_clone(Pointer<llama_sampler> smpl) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_free(Pointer<llama_sampler> smpl) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_get_seed(Pointer<llama_sampler> smpl) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init(Pointer<llama_sampler_i> iface, llama_sampler_context_t ctx) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_dist(int seed) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_dry(Pointer<llama_vocab> vocab, int n_ctx_train, double dry_multiplier, double dry_base, int dry_allowed_length, int dry_penalty_last_n, Pointer<Pointer<Char>> seq_breakers, int num_breakers) Pointer<llama_sampler>
@details DRY sampler, designed by p-e-w, as described in: https://github.com/oobabooga/text-generation-webui/pull/5677, porting Koboldcpp implementation authored by pi6am: https://github.com/LostRuins/koboldcpp/pull/982
llama_sampler_init_grammar(Pointer<llama_vocab> vocab, Pointer<Char> grammar_str, Pointer<Char> grammar_root) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_grammar_lazy(Pointer<llama_vocab> vocab, Pointer<Char> grammar_str, Pointer<Char> grammar_root, Pointer<Pointer<Char>> trigger_words, int num_trigger_words, Pointer<llama_token> trigger_tokens, int num_trigger_tokens) Pointer<llama_sampler>
@details Lazy grammar sampler, introduced in https://github.com/ggerganov/llama.cpp/pull/9639 @param trigger_words A list of words that will trigger the grammar sampler. This may be updated to a loose regex syntax (w/ ^) in a near future. @param trigger_tokens A list of tokens that will trigger the grammar sampler.
llama_sampler_init_greedy() Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_infill(Pointer<llama_vocab> vocab) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_logit_bias(int n_vocab, int n_logit_bias, Pointer<llama_logit_bias> logit_bias) Pointer<llama_sampler>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_init_min_p(double p, int min_keep) Pointer<llama_sampler>
@details Minimum P sampling as described in https://github.com/ggerganov/llama.cpp/pull/3841
llama_sampler_init_mirostat(int n_vocab, int seed, double tau, double eta, int m) Pointer<llama_sampler>
@details Mirostat 1.0 algorithm described in the paper https://arxiv.org/abs/2007.14966. Uses tokens instead of words. @param candidates A vector of llama_token_data containing the candidate tokens, their probabilities (p), and log-odds (logit) for the current position in the generated text. @param tau The target cross-entropy (or surprise) value you want to achieve for the generated text. A higher value corresponds to more surprising or less predictable text, while a lower value corresponds to less surprising or more predictable text. @param eta The learning rate used to update mu based on the error between the target and observed surprisal of the sampled word. A larger learning rate will cause mu to be updated more quickly, while a smaller learning rate will result in slower updates. @param m The number of tokens considered in the estimation of s_hat. This is an arbitrary value that is used to calculate s_hat, which in turn helps to calculate the value of k. In the paper, they use m = 100, but you can experiment with different values to see how it affects the performance of the algorithm. @param mu Maximum cross-entropy. This value is initialized to be twice the target cross-entropy (2 * tau) and is updated in the algorithm based on the error between the target and observed surprisal.
llama_sampler_init_mirostat_v2(int seed, double tau, double eta) Pointer<llama_sampler>
@details Mirostat 2.0 algorithm described in the paper https://arxiv.org/abs/2007.14966. Uses tokens instead of words. @param candidates A vector of llama_token_data containing the candidate tokens, their probabilities (p), and log-odds (logit) for the current position in the generated text. @param tau The target cross-entropy (or surprise) value you want to achieve for the generated text. A higher value corresponds to more surprising or less predictable text, while a lower value corresponds to less surprising or more predictable text. @param eta The learning rate used to update mu based on the error between the target and observed surprisal of the sampled word. A larger learning rate will cause mu to be updated more quickly, while a smaller learning rate will result in slower updates. @param mu Maximum cross-entropy. This value is initialized to be twice the target cross-entropy (2 * tau) and is updated in the algorithm based on the error between the target and observed surprisal.
llama_sampler_init_penalties(int penalty_last_n, double penalty_repeat, double penalty_freq, double penalty_present) Pointer<llama_sampler>
NOTE: Avoid using on the full vocabulary as searching for repeated tokens can become slow. For example, apply top-k or top-p sampling first.
llama_sampler_init_softmax() Pointer<llama_sampler>
@details Sorts candidate tokens by their logits in descending order and calculate probabilities based on logits. NOTE: Avoid using on the full vocabulary as the sorting can become slow. For example, apply top-k or top-p sampling first.
llama_sampler_init_temp(double t) Pointer<llama_sampler>
#details Updates the logits l_i` = l_i/t. When t <= 0.0f, the maximum logit is kept at it's original value, the rest are set to -inf
llama_sampler_init_temp_ext(double t, double delta, double exponent) Pointer<llama_sampler>
@details Dynamic temperature implementation (a.k.a. entropy) described in the paper https://arxiv.org/abs/2309.02772.
llama_sampler_init_top_k(int k) Pointer<llama_sampler>
@details Top-K sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751
llama_sampler_init_top_p(double p, int min_keep) Pointer<llama_sampler>
@details Nucleus sampling described in academic paper "The Curious Case of Neural Text Degeneration" https://arxiv.org/abs/1904.09751
llama_sampler_init_typical(double p, int min_keep) Pointer<llama_sampler>
@details Locally Typical Sampling implementation described in the paper https://arxiv.org/abs/2202.00666.
llama_sampler_init_xtc(double p, double t, int min_keep, int seed) Pointer<llama_sampler>
@details XTC sampler as described in https://github.com/oobabooga/text-generation-webui/pull/6335
llama_sampler_name(Pointer<llama_sampler> smpl) Pointer<Char>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_reset(Pointer<llama_sampler> smpl) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_sampler_sample(Pointer<llama_sampler> smpl, Pointer<llama_context> ctx, int idx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_save_session_file(Pointer<llama_context> ctx, Pointer<Char> path_session, Pointer<llama_token> tokens, int n_token_count) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_abort_callback(Pointer<llama_context> ctx, ggml_abort_callback abort_callback, Pointer<Void> abort_callback_data) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_adapter_lora(Pointer<llama_context> ctx, Pointer<llama_adapter_lora> adapter, double scale) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_causal_attn(Pointer<llama_context> ctx, bool causal_attn) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_embeddings(Pointer<llama_context> ctx, bool embeddings) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_n_threads(Pointer<llama_context> ctx, int n_threads, int n_threads_batch) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_set_state_data(Pointer<llama_context> ctx, Pointer<Uint8> src) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_split_path(Pointer<Char> split_path, int maxlen, Pointer<Char> path_prefix, int split_no, int split_count) int
@details Build a split GGUF final path for this chunk. llama_split_path(split_path, sizeof(split_path), "/models/ggml-model-q4_0", 2, 4) => split_path = "/models/ggml-model-q4_0-00002-of-00004.gguf"
llama_split_prefix(Pointer<Char> split_prefix, int maxlen, Pointer<Char> split_path, int split_no, int split_count) int
@details Extract the path prefix from the split_path if and only if the split_no and split_count match. llama_split_prefix(split_prefix, 64, "/models/ggml-model-q4_0-00002-of-00004.gguf", 2, 4) => split_prefix = "/models/ggml-model-q4_0"
llama_state_get_data(Pointer<llama_context> ctx, Pointer<Uint8> dst, int size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_get_size(Pointer<llama_context> ctx) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_load_file(Pointer<llama_context> ctx, Pointer<Char> path_session, Pointer<llama_token> tokens_out, int n_token_capacity, Pointer<Size> n_token_count_out) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_save_file(Pointer<llama_context> ctx, Pointer<Char> path_session, Pointer<llama_token> tokens, int n_token_count) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_seq_get_data(Pointer<llama_context> ctx, Pointer<Uint8> dst, int size, int seq_id) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_seq_get_size(Pointer<llama_context> ctx, int seq_id) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_seq_load_file(Pointer<llama_context> ctx, Pointer<Char> filepath, int dest_seq_id, Pointer<llama_token> tokens_out, int n_token_capacity, Pointer<Size> n_token_count_out) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_seq_save_file(Pointer<llama_context> ctx, Pointer<Char> filepath, int seq_id, Pointer<llama_token> tokens, int n_token_count) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_seq_set_data(Pointer<llama_context> ctx, Pointer<Uint8> src, int size, int dest_seq_id) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_state_set_data(Pointer<llama_context> ctx, Pointer<Uint8> src, int size) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_supports_gpu_offload() bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_supports_mlock() bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_supports_mmap() bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_supports_rpc() bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_synchronize(Pointer<llama_context> ctx) → void
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_time_us() int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_bos(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_cls(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_eos(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_eot(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_mid(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_pad(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_pre(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_rep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_sep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_fim_suf(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_get_attr(Pointer<llama_vocab> vocab, int token) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_get_score(Pointer<llama_vocab> vocab, int token) double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_get_text(Pointer<llama_vocab> vocab, int token) Pointer<Char>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_is_control(Pointer<llama_vocab> vocab, int token) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_is_eog(Pointer<llama_vocab> vocab, int token) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_nl(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_pad(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_sep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_token_to_piece(Pointer<llama_vocab> vocab, int token, Pointer<Char> buf, int length, int lstrip, bool special) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_tokenize(Pointer<llama_vocab> vocab, Pointer<Char> text, int text_len, Pointer<llama_token> tokens, int n_tokens_max, bool add_special, bool parse_special) int
@details Convert the provided text into tokens. @param tokens The tokens pointer must be large enough to hold the resulting tokens. @return Returns the number of tokens on success, no more than n_tokens_max @return Returns a negative number on failure - the number of tokens that would have been returned @param add_special Allow to add BOS and EOS tokens if model is configured to do so. @param parse_special Allow tokenizing special and/or control tokens which otherwise are not exposed and treated as plaintext. Does not insert a leading space.
llama_vocab_bos(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_cls(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_eos(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_eot(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_mid(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_pad(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_pre(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_rep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_sep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_fim_suf(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_get_add_bos(Pointer<llama_vocab> vocab) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_get_add_eos(Pointer<llama_vocab> vocab) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_get_attr(Pointer<llama_vocab> vocab, int token) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_get_score(Pointer<llama_vocab> vocab, int token) double
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_get_text(Pointer<llama_vocab> vocab, int token) Pointer<Char>
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_is_control(Pointer<llama_vocab> vocab, int token) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_is_eog(Pointer<llama_vocab> vocab, int token) bool
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_n_tokens(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_nl(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_pad(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_sep(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
llama_vocab_type1(Pointer<llama_vocab> vocab) int
General Library Documentation Undocument By General Corporation & Global Corporation & General Developer
noSuchMethod(Invocation invocation) → dynamic
Invoked when a nonexistent method or property is accessed.
inherited
open_memstream(Pointer<Pointer<Char>> __bufloc, Pointer<Size> __sizeloc) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
pclose(Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
perror(Pointer<Char> __s) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
popen(Pointer<Char> __command, Pointer<Char> __modes) Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
printf(Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
putc(int __c, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
putc_unlocked(int __c, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
putchar(int __c) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
putchar_unlocked(int __c) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
puts(Pointer<Char> __s) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
putw(int __w, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
remove(Pointer<Char> __filename) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
rename(Pointer<Char> __old, Pointer<Char> __new) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
renameat(int __oldfd, Pointer<Char> __old, int __newfd, Pointer<Char> __new) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
rewind(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
scanf(Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
setbuf(Pointer<FILE> __stream, Pointer<Char> __buf) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
setbuffer(Pointer<FILE> __stream, Pointer<Char> __buf, int __size) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
setlinebuf(Pointer<FILE> __stream) → void
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
setvbuf(Pointer<FILE> __stream, Pointer<Char> __buf, int __modes, int __n) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
snprintf(Pointer<Char> __s, int __maxlen, Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
sprintf(Pointer<Char> __s, Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
sscanf(Pointer<Char> __s, Pointer<Char> __format) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
tempnam(Pointer<Char> __dir, Pointer<Char> __pfx) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
tmpfile() Pointer<FILE>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
tmpnam(Pointer<Char> arg0) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
tmpnam_r(Pointer<Char> __s) Pointer<Char>
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
toString() String
A string representation of this object.
inherited
ungetc(int __c, Pointer<FILE> __stream) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vasprintf(Pointer<Pointer<Char>> __ptr, Pointer<Char> __f, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vdprintf(int __fd, Pointer<Char> __fmt, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vfprintf(Pointer<FILE> __s, Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vfscanf(Pointer<FILE> __s, Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vprintf(Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vscanf(Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vsnprintf(Pointer<Char> __s, int __maxlen, Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vsprintf(Pointer<Char> __s, Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer
vsscanf(Pointer<Char> __s, Pointer<Char> __format, Pointer<__va_list_tag> __arg) int
LlamaLibrarySharedBindingsByGeneralDeveloper Binding By General Corporation & Global Corporation & General Developer

Operators

operator ==(Object other) bool
The equality operator.
inherited