gpt4all 0.1.1
gpt4all: ^0.1.1 copied to clipboard
Dart wrapper API for the GPT4All open-source chatbot ecosystem.
GPT4All Dart Binding #
Dart bindings for the GPT4All C/C++ libraries and models.
https://pub.dev/packages/gpt4all
Target platforms:
- Windows
- macOS
- Linux
Getting started #
- Compile
llmodel
C/C++ libraries
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all/gpt4all-backend/
mkdir build
cd build
cmake ..
cmake --build . --parallel
copied to clipboard
Confirm that libllmodel.*
exists in gpt4all-backend/build
.
Those build artifacts contain all libraries required later in step 3.
- Download model
Visit the GPT4All Website and use the Model Explorer to find and download your model of choice (e.g. ggml-gpt4all-j-v1.3-groovy.bin).
- Run the Dart code
Use the downloaded model and compiled libraries in your Dart code. Have a look at the example implementation in main.dart:
LLModel model = LLModel();
try {
// Always load the model before performing any other work.
await model.load(
// Path to the downloaded model file (*.bin)
modelPath: '/some/path/to/ggml-gpt4all-j-v1.3-groovy.bin',
// Path to the library folder including compiled *.dll (Windows), *.dylib (Mac) or
// *.so (Linux) files
librarySearchPath: '/some/path/gpt4all-backend/build',
// Optionally fine-tune the default configuration
promptConfig: LLModelPromptConfig()..nPredict = 256,
);
// Generate a response to the given prompt
await model.generate(
prompt: "### Human:\nWhat is the meaning of life?\n### Assistant:",
);
} finally {
// Always destroy the model after calling the load(..) method
model.destroy();
}
copied to clipboard