gpt4all 0.1.1 copy "gpt4all: ^0.1.1" to clipboard
gpt4all: ^0.1.1 copied to clipboard

Dart wrapper API for the GPT4All open-source chatbot ecosystem.

GPT4All Dart Binding #

Dart bindings for the GPT4All C/C++ libraries and models.

https://pub.dev/packages/gpt4all

Target platforms:

  • Windows
  • macOS
  • Linux

Getting started #

  1. Compile llmodel C/C++ libraries
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all/gpt4all-backend/
mkdir build
cd build
cmake ..
cmake --build . --parallel
copied to clipboard

Confirm that libllmodel.* exists in gpt4all-backend/build.

Those build artifacts contain all libraries required later in step 3.

  1. Download model

Visit the GPT4All Website and use the Model Explorer to find and download your model of choice (e.g. ggml-gpt4all-j-v1.3-groovy.bin).

  1. Run the Dart code

Use the downloaded model and compiled libraries in your Dart code. Have a look at the example implementation in main.dart:

  LLModel model = LLModel();
  try {
    // Always load the model before performing any other work.
    await model.load(
      // Path to the downloaded model file (*.bin)
      modelPath: '/some/path/to/ggml-gpt4all-j-v1.3-groovy.bin',
      // Path to the library folder including compiled *.dll (Windows), *.dylib (Mac) or
      // *.so (Linux) files
      librarySearchPath: '/some/path/gpt4all-backend/build',
      // Optionally fine-tune the default configuration
      promptConfig: LLModelPromptConfig()..nPredict = 256,
    );

    // Generate a response to the given prompt
    await model.generate(
      prompt: "### Human:\nWhat is the meaning of life?\n### Assistant:",
    );
  } finally {
    // Always destroy the model after calling the load(..) method
    model.destroy();
  }
copied to clipboard
6
likes
140
points
47
downloads

Publisher

unverified uploader

Weekly Downloads

2024.08.07 - 2025.02.19

Dart wrapper API for the GPT4All open-source chatbot ecosystem.

Documentation

API reference

License

MIT (license)

Dependencies

ffi

More

Packages that depend on gpt4all