Flutter Waterbus SDK

Flutter plugin of Waterbus. Build video call or online meeting application with SFU model. Supports iOS, Android. ExampleApp

GitHub issueslibwebrtcCocoapods VersionPRs Welcome

⚡ Current supported features

Feature Subscribe/Publish Screen Sharing Picture in Picture Virtual Background Beauty Filters End to End Encryption
Android 🟢 🟢 🟢 🟢 🟢 🟢
iOS 🟢 🟢 🟢 🟢 🟢 🟢
Web 🟢 🟢 🟢 🟢 🟡 🟢
MacOS 🟢 🟢 🔴 🟢 🟢 🟢
Linux 🟢 🟢 🔴 🟡 🟢 🟢
Windows 🟢 🟢 🔴 🟡 🟢 🟢

🟢 = Available

🟡 = Coming soon (Work in progress)

🔴 = Not currently available (Possibly in the future)

Installation

Install Rust via rustup.

Add dependency

Add the dependency from command-line

$ flutter pub add waterbus_sdk

The command above will add this to the pubspec.yaml file in your project (you can do this manually):

dependencies:
    waterbus_sdk: ^1.3.15

Configuration

Android

Ensure the following permission is present in your Android Manifest file, located in <project root>/android/app/src/main/AndroidManifest.xml:

<uses-feature android:name="android.hardware.camera" />
<uses-feature android:name="android.hardware.camera.autofocus" />
<uses-permission android:name="android.permission.CAMERA" />
<uses-permission android:name="android.permission.RECORD_AUDIO" />
<uses-permission android:name="android.permission.ACCESS_NETWORK_STATE" />
<uses-permission android:name="android.permission.CHANGE_NETWORK_STATE" />
<uses-permission android:name="android.permission.MODIFY_AUDIO_SETTINGS" />

If you need to use a Bluetooth device, please add:

<uses-permission android:name="android.permission.BLUETOOTH" android:maxSdkVersion="30" />
<uses-permission android:name="android.permission.BLUETOOTH_ADMIN" android:maxSdkVersion="30" />

The Flutter project template adds it, so it may already be there.

Also you will need to set your build settings to Java 8, because official WebRTC jar now uses static methods in EglBase interface. Just add this to your app level build.gradle:

android {
    //...
    compileOptions {
        sourceCompatibility JavaVersion.VERSION_1_8
        targetCompatibility JavaVersion.VERSION_1_8
    }
}

iOS

Add the following entry to your Info.plist file, located in <project root>/ios/Runner/Info.plist:

<key>NSCameraUsageDescription</key>
<string>$(PRODUCT_NAME) Camera Usage!</string>
<key>NSMicrophoneUsageDescription</key>
<string>$(PRODUCT_NAME) Microphone Usage!</string>

This entry allows your app to access camera and microphone.

Note for iOS.

The WebRTC.xframework compiled after the m104 release no longer supports iOS arm devices, so need to add the config.build_settings['ONLY_ACTIVE_ARCH'] = 'YES' to your ios/Podfile in your project

ios/Podfile

post_install do |installer|
  installer.pods_project.targets.each do |target|
    flutter_additional_ios_build_settings(target)
     target.build_configurations.each do |config|
      # Workaround for https://github.com/flutter/flutter/issues/64502
      config.build_settings['ONLY_ACTIVE_ARCH'] = 'YES' # <= this line
     end
  end
end

Usage

Initialization

Before using any feature, initialize the SDK with server and encryption config:

import 'package:waterbus_sdk/waterbus_sdk.dart';

void main() async {
  final config = SdkConfig(
    serverConfig: ServerConfig(
      url: "https://services.waterbus.tech",
      suffixUrl: "/busapi/v3/",
    ),
    messageEncryptionKey: 'your-secret-message-key',
    webrtcE2eeKey: 'your-e2ee-key',
  );

  await WaterbusSdk.instance.initialize(config: config);
}

Authentication

Create Token

Create a new session using a token:

final Result<User> result = await WaterbusSdk.instance.createToken(
  AuthPayload(fullName: "Waterbus", externalId: "unique-id"),
);

Refresh Token

await WaterbusSdk.instance.renewToken();

Delete Token

Delete token for disconnect websocket and prepare for create new token

await WaterbusSdk.instance.deleteToken();

User Management

Get user profile

final profile = await WaterbusSdk.instance.getProfile();

Update profile

await WaterbusSdk.instance.updateProfile(user: updatedUser);

Change username

await WaterbusSdk.instance.updateUsername(username: "new_username");

Room Management

Create room

final RoomParams params = RoomParams(
  room: Room(title: 'Daily Meeting'),
  password: '123123',
  userId: 'user-id',
);

final result = await WaterbusSdk.instance.createRoom(params: params);

Join room

final JoinRoomParams params = JoinRoomParams(
  roomId: 'room-id',
  password: 123123',
  userId: 'user-id',
);

final Result<Room> result = await WaterbusSdk.instance.joinRoom(params: params);

Leave room

await WaterbusSdk.instance.leaveRoom();

Media Controls

await WaterbusSdk.instance.prepareMedia();
await WaterbusSdk.instance.toggleVideo();
await WaterbusSdk.instance.toggleAudio();
await WaterbusSdk.instance.switchCamera();

Screen sharing

await WaterbusSdk.instance.startScreenSharing();
// Stop
await WaterbusSdk.instance.stopScreenSharing();

Raise or lower hand

WaterbusSdk.instance.toggleRaiseHand();

Virtual Background

await WaterbusSdk.instance.enableVirtualBackground(
  backgroundImage: yourImageBytes,
  thresholdConfidence: 0.7,
);

// Disable:
await WaterbusSdk.instance.disableVirtualBackground();

Additional Utilities

Get supported codecs

final codecs = await WaterbusSdk.instance.getSupportedVideoCodecs();

Picture-in-Picture

await WaterbusSdk.instance.setPictureInPictureEnabled(
  textureId: 'your_texture_id',
  enabled: true,
);

Contributing

Contributions are welcome! Please feel free to submit a pull request or open an issue if you encounter any problems or have suggestions for improvements.

Contact Information

If you have any questions or suggestions related to this application, please contact me via email: lambiengcode@gmail.com.

Reference

flutter_webrtc

License

Apache License 2.0

Libraries

constants/constants
constants/endpoints
constants/rtc_configurations
constants/status_code
constants/storage_keys
constants/ws_event
core/api/auth/datasources/auth_local_data_source
core/api/auth/datasources/auth_remote_data_source
core/api/auth/repositories/auth_repository
core/api/base/base_local_storage
core/api/base/base_remote_data
core/api/chat/datasources/chat_remote_data_source
core/api/chat/repositories/chat_repository
core/api/messages/datasources/message_remote_data_source
core/api/messages/repositories/message_repository
core/api/rooms/datasources/room_remote_data_source
core/api/rooms/repositories/room_repository
core/api/user/datasources/user_remote_data_source
core/api/user/repositories/user_repository
core/webrtc/webrtc_manager
core/webrtc/webrtc_manager_impl
core/websocket/interfaces/ws_emitter
core/websocket/interfaces/ws_handler
core/websocket/unload_handler/handler_stub
core/websocket/unload_handler/handler_web
core/websocket/unload_handler/index
core/websocket/ws_emitter_impl
core/websocket/ws_handler_impl
e2ee/e2ee_manager
e2ee/key_provider
flutter_waterbus_sdk
injection/injection_container
injection/injection_container.config
native/native_channel
native/picture-in-picture/index
native/picture-in-picture/pip_stub
native/picture-in-picture/pip_web
native/replaykit
native/virtual_background/index
native/virtual_background/virtual_background_app
native/virtual_background/virtual_background_web
stats/webrtc_audio_stats
stats/webrtc_video_stats
types/error/app_exception
types/error/failures
types/externals/enums/audio_level
types/externals/enums/callback_events
types/externals/enums/camera_type
types/externals/enums/index
types/externals/enums/member_status_enum
types/externals/enums/message_status_enum
types/externals/enums/room_role
types/externals/enums/rtc_video_codec
types/externals/enums/sending_status_enum
types/externals/enums/status_message
types/externals/enums/status_seen_message_enum
types/externals/enums/video_quality_enum
types/externals/models/audio_config
types/externals/models/auth_payload
types/externals/models/base_url
types/externals/models/beauty_filters
types/externals/models/call_state
types/externals/models/callback_payload
types/externals/models/conversation_socket_event
types/externals/models/index
types/externals/models/join_room_params
types/externals/models/media_config
types/externals/models/media_source
types/externals/models/member
types/externals/models/message
types/externals/models/message_socket_event
types/externals/models/participant
types/externals/models/participant_media_state
types/externals/models/presigned_url
types/externals/models/room
types/externals/models/room_params
types/externals/models/rtc_participant_stats
types/externals/models/subscribe_payload
types/externals/models/subtitle
types/externals/models/user
types/externals/models/video_config
types/externals/models/video_quality
types/index
types/internals/enums/connection_type
types/internals/enums/description_type
types/internals/enums/index
types/internals/enums/room_status
types/internals/enums/rtc_audio_codec
types/internals/enums/rtc_track_kind
types/internals/enums/track_type
types/internals/enums/video_layout
types/internals/models/audio_stats_params
types/internals/models/index
types/internals/models/int_converter
types/internals/models/participant_e2ee_config
types/internals/models/participant_screen_sharing_config
types/internals/models/publish_ws_emitter_payload
types/internals/models/stats
types/internals/models/subscribe_response
types/internals/models/track_quality
types/internals/models/track_quality_request
types/internals/models/track_subscribed_message
types/internals/models/video_stats_params
types/result
ui/waterbus_media_view
ui/waterbus_render_manager
utils/callkit/callkit_listener
utils/codec_selector
utils/dio/dio_configuration
utils/encrypt/aes_256_gcm
utils/encrypt/encrypt
utils/extensions/duration_extension
utils/extensions/pc_extension
utils/extensions/sdp_extension
utils/logger/logger
utils/msg_pack_parser
utils/path_helper
utils/queues/completer_queue
utils/replaykit/replaykit_helper
waterbus_event_listener
waterbus_sdk_impl
waterbus_sdk_interface