flutter_gpt_engine 0.0.8 
flutter_gpt_engine: ^0.0.8 copied to clipboard
Headless Flutter package for running GGUF LLMs locally on Android with streaming, conversation history, web search, device context, thinking support, benchmarking, and CPU/GPU auto-tuning.
0.0.7 #
- Reduced token-stream parsing allocations with an incremental reasoning parser.
- Coalesced ChangeNotifier generation updates for smoother Flutter UIs.
- Reused HTTP connections and parallelized web source fetching.
- Added bounded conversation-history context.
- Added local TTFT / token-throughput benchmarking.
- Added opt-in CPU/GPU auto-tuning for the current device and GGUF model.
0.0.6 #
- device state analysis integrated.
0.0.5 #
- Web search added.
0.0.4 #
- Web search added.
0.0.3 #
- More user friendly.
0.0.2 #
- More user friendly.
0.0.1 #
- Initial package.
Metadata
2
likes
130
points
415
downloads
Documentation
Publisher
unverified uploader
Weekly Downloads
Metadata
Headless Flutter package for running GGUF LLMs locally on Android with streaming, conversation history, web search, device context, thinking support, benchmarking, and CPU/GPU auto-tuning.
Repository (GitHub)
View/report issues
License
MIT (license)
Dependencies
battery_plus, connectivity_plus, device_info_plus, file_picker, flutter, geocoding, geolocator, html, llama_flutter_android, package_info_plus, path_provider, sensors_plus, system_info2