ADKflutter

ADKflutter is the official Flutter package by 20Centra for connecting to the Gemini Live API server. It provides a robust WebSocket client for real-time, multimodal AI interactions, including audio streaming, text messaging, and image context.

Features

Real-time Audio Streaming: Stream PCM audio data to the Gemini Live API.
Multimodal Interaction: Send text and images (context) alongside audio.
WebSocket Support: Persistent connection management with automatic reconnection logic.
Event-Driven: Listen to streams for audio, text, transcription, and connection state.
Background Processing: Image compression and processing handled in background isolates.

Getting Started

Add adk_flutter to your pubspec.yaml:

dependencies:
  adk_flutter: ^1.0.0

Usage

Initialization

import 'package:adk_flutter/adk_flutter.dart';

final client = AdkFlutterClient(
  serverUrl: 'wss://your-api-endpoint.com',
  apiKey: 'YOUR_API_KEY',
);

// Connect to the server
await client.connect();

Sending Audio

// Send raw PCM audio bytes (16kHz, 16-bit, mono)
client.sendAudio(pcmData);

Sending Text

client.sendText('Hello, Gemini!');

Listening to Responses

client.onText.listen((text) {
  print('Received text: $text');
});

client.onAudio.listen((audioData) {
  // Play audio data
});

License

This project is licensed under the MIT License - see the LICENSE file for details.