Skip to main content

local_inference 0.1.0 copy "local_inference: ^0.1.0" to clipboard
local_inference: ^0.1.0 copied to clipboard

On-device LLM inference in pure Dart on llama.cpp: chat templates, tool calling with GBNF grammars, a tool-using assistant and verified model downloads.

160/ 160
pub points
95
downloads

We analyzed this package 27 hours ago, and awarded it 160 pub points (of a possible 160):

Passed report section
Follow Dart file conventions
30 / 30trigger folding of the section

Passed check 10/10 points: Provide a valid pubspec.yaml

Passed check 5/5 points: Provide a valid README.md

Passed check 5/5 points: Provide a valid CHANGELOG.md

Passed check 10/10 points: Use an OSI-approved license

Detected license: MIT.

Passed report section
Provide documentation
20 / 20trigger folding of the section

Passed check 10/10 points: 20% or more of the public API has dartdoc comments

1104 out of 1301 API elements (84.9 %) have documentation comments.

Some symbols that are missing documentation: doctor.CheckResult.CheckResult.new, doctor.CheckResult.status, doctor.CheckResult.toJson, doctor.Doctor.Doctor.new, doctor.Doctor.environment.

Passed check 10/10 points: Package has an example

Passed report section
Platform support
20 / 20trigger folding of the section

Passed check 20/20 points: Supports 5 of 6 possible platforms (iOS, Android, Web, Windows, macOS, Linux)

  • ✓ Android

  • ✓ iOS

  • ✓ Windows

  • ✓ Linux

  • ✓ macOS

These platforms are not supported:

Package not compatible with platform Web

Because:

  • package:local_inference/local_inference.dart that imports:
  • package:local_inference/src/model/prefix/prefix_state_store.dart that imports:
  • package:local_inference/src/model/prefix/prefix_key.dart that imports:
  • package:local_inference/src/model/prefix/model_identity.dart that imports:
  • dart:io
Passed report section
Pass static analysis
50 / 50trigger folding of the section

Passed check 50/50 points: code has no errors, warnings, lints, or formatting issues

Partially passed report section
Support up-to-date dependencies
40 / 40trigger folding of the section

Partially passed check 10/10 points: All of the package dependencies are supported in the latest version

Package Constraint Compatible Latest Notes
crypto ^3.0.7 3.0.7 3.0.7
dinja >=1.0.0 <1.1.0 1.0.0 1.3.0
llamadart 0.8.23 0.8.23 0.15.2
meta ^1.18.0 1.19.0 1.19.0
path ^1.9.1 1.9.1 1.9.1
yaml ^3.1.3 3.1.4 3.1.4
Transitive dependencies
Package Constraint Compatible Latest Notes
archive - 4.5.2 4.5.2
async - 2.13.1 2.13.1
code_assets - 2.1.0 2.1.0
collection - 1.19.1 1.19.1
ffi - 2.2.0 2.2.0
hooks - 2.2.0 2.2.0
http - 1.6.0 1.6.0
http_parser - 4.1.2 4.1.2
logging - 1.3.0 1.3.0
posix - 6.5.2 6.5.2
pub_semver - 2.2.1 2.2.1
record_use - 1.1.1 1.1.1
source_span - 1.10.2 1.10.2
string_scanner - 1.4.1 1.4.1
term_glyph - 1.2.2 1.2.2
typed_data - 1.4.0 1.4.0
web - 1.1.1 1.1.1

To reproduce run dart pub outdated --no-dev-dependencies --up-to-date --no-dependency-overrides.

The constraint `>=1.0.0 <1.1.0` on dinja does not support the stable version `1.1.0`, that was published 24 days ago.

When dinja is 30 days old, this package will no longer be awarded points in this category.

Try running dart pub upgrade --major-versions dinja to update the constraint.

The constraint `0.8.23` on llamadart does not support the stable version `0.8.24`, that was published 28 days ago.

When llamadart is 30 days old, this package will no longer be awarded points in this category.

Try running dart pub upgrade --major-versions llamadart to update the constraint.

Passed check 10/10 points: Package supports latest stable Dart and Flutter SDKs

Passed check 20/20 points: Compatible with dependency constraint lower bounds

pub downgrade does not expose any static analysis error.

Analyzed with Pana 0.23.19, Dart 3.13.5.

Check the analysis log for details.

Weekly downloads

Display as:
By versions:
3
likes
160
points
95
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

On-device LLM inference in pure Dart on llama.cpp: chat templates, tool calling with GBNF grammars, a tool-using assistant and verified model downloads.

Repository (GitHub)
View/report issues

Topics

#llm #llama-cpp #on-device-ai #ai #tool-calling

License

MIT (license)

Dependencies

crypto, dinja, llamadart, meta, path, yaml

More

Packages that depend on local_inference