flutter_unity_widget_2

This plugin is a fork of flutter_unity_widget, which is outdated on pub.dev.

The aim of this fork is to publish bug fixes and improve compatibility with newer Flutter and Unity versions.
These changes come from the master branch of the original Github repo, which is far ahead of it's latest pub.dev release.

Don't expect major new features or rewrites for now, as this plugin will try to stick close to the original.
If you are looking for a full rewrite of the Unity integration, try flutter_embed_unity instead.

• Plugin versions 2022.x.y should support Unity 2019.4 up to Unity 2022.3.
  The main focus is on Unity 2022.3 LTS.
• Plugin versions 6000.x.y support Unity 6 and up.

This plugin works with the same unitypackages as the original plugin.

For now, most of the original readme is included below for documentation. I might expand on this later.

Migration from Unity 2022 to Unity 6.

The 6000 version is currently based on a 6000 branch in the original repo. See this issue for more details.

In short:

1. Follow the regular android setup like in the readme.
   But for Android ignore setting ndk.dir= in local.properties.
   Use the ndkVersion = "<ndk version number here>" in build.gradle approach.

2. Your Flutter project will need to use Java 17 and gradle 8.x to match the versions used by Unity.

Try to match or exceed these gradle and AGP versions:

Check the Unity documentation for any updates. You can change the editor version in the top left.

3. Make sure to import a 6000.0.x unitypackage into your Unity project. The export scripts have been updated.

4. Make sure to delete any old exports in ios/UnityLibrary and android/unityLibrary before making a new export.

Migration from flutter_unity_widget

I've tried to keep most internal classes identical, to keep migrating to the fork simple.

You just need to rename the plugin by adding _2 in several files in your project:

1. pubspec.yaml

dependencies:
-  flutter_unity_widget: ^2022.2.1
+  flutter_unity_widget_2: ^2022.2.2 # use ^6000.0.0 for Unity 6.x

2. Dart files in your Flutter project.

- import 'package:flutter_unity_widget/flutter_unity_widget.dart';
+ import 'package:flutter_unity_widget_2/flutter_unity_widget_2.dart';

3. Your android/app/build.gradlefile.

// android/app/build.gradle
-  implementation project(':flutter_unity_widget')
+  implementation project(':flutter_unity_widget_2')

// android/app/build.gradle.kts (Flutter 3.29+)
-  implementation(project(":flutter_unity_widget"))
+  implementation(project(":flutter_unity_widget_2"))

4. Your ios/Runner/AppDelegate.swift.

- import flutter_unity_widget
+ import flutter_unity_widget_2

Original Readme

Flutter unity 3D widget for embedding unity in flutter. Now you can make awesome gamified features of your app in Unity and get it rendered in a Flutter app both in fullscreen and embeddable mode. Works great on Android, iPad OS, iOS, Web.

Notes

• Use Windows or Mac to export and build your project.
  Users on Ubuntu have reported a lot of errors in the Unity export.
• Emulator support is limited and requires special setup. Please use a physical device for Android and iOS.
• Use only OpenGLES3 as Graphics API on Android for AR compatibility.
• Windows isn't supported because of the lack of Flutter PlatformView support.

Notice

This plugin expects you to atleast know how to use Unity Engine. If you have issues with how unity widget is presented, you can please modify your unity project build settings as you seem fit.

Moving forward, versioning of the package will change to match unity releases after proper test. Mind you this does not mean the package is not compatible with other versions, it just mean it's been tested to work with a unity version.

Installation

This plugin requires Flutter >= 3.16.0.

First depend on the library by adding this to your packages pubspec.yaml:

dependencies:
  flutter_unity_widget_2: ^2022.2.2 # use the latest compatible version

Now inside your Dart code you can import it.

import 'package:flutter_unity_widget_2/flutter_unity_widget_2.dart';

You will need to open and export a Unity project, even for running the example. Your build will fail if you only include the widget in Flutter!

Preview

30 fps gifs, showcasing communication between Flutter and Unity:

Setup

In the tutorial below, there are steps specific to each platform, denoted by a ℹ️ icon followed by the platform name (Android or iOS). You can click on its icon to expand it.

Prerequisites

• An existing Flutter project (if there is none, you can create a new one)

• An existing Unity project (if there is none, you can create a new one).

• A fuw-XXXX.unitypackage file, found in the unitypackages folder. Try to use the most recent unitypackage available.

Unity versions for publishing

If you want to publish your app for Android or iOS, you need to satisfy certain Unity version requirements.

iOS
Apple's privacy manifest requirements need a minimal Unity version of:

• 2021.3.35+
• 2022.3.18+
• 6000.0.0+

Android

Starting November 1st, 2025, all new apps and updates to existing apps submitted to Google Play and targeting Android 15+ devices must support 16 KB page sizes.

This requires Unity versions:

• 2021.3.48+ (Enterprise and Industry only)
• 2022.3.56+
• 6000.0.38+

Unity project setup

These instructions assume you are using a new Unity project. If you open the example project from this repository, you can move on to the next section Unity Exporting.

1. Create a folder named unity in your Flutter project folder and move the Unity project into there.
   The Unity export will modify some files in the /android and /ios folders of your flutter project. If your Unity project is in a different location the export might (partially) fail.

The expected path is

2. Make sure you have downloaded a fuw-XXXX.unitypackage file mentioned in prerequisites.

3. Using Unity (hub), open the Unity project. Go to Assets > Import Package > Custom Package and select the downloaded fuw-XXXX.unitypackage file. Click on Import.

4. Go to File > Build Settings > Player Settings and change the following under the Other settings > Configuration section:

• In Scripting Backend, change to IL2CPP

• (Android) Target Architectures, select ARMv7 and ARM64

• (Android) For the best compatibility set Active Input Handling to Input Manager (Old) or Both.
  (The new input system has some issues with touch input on Android)

• (iOS) Select Target SDK depending on where you will run your app (simulator or physical device).
  We recommend starting with a physical device and the Device SDK setting, due to limited simulator support.

• (Web) Set Publishing settings > Compression format to Brotli or Disabled.
  Some users report that Unity gets stuck on the loading screen with the Gzip setting, due to MIME type errors.

5. In File > Build Settings, make sure to have at least 1 scene added to your build.

Some options in the Build settings window get overridden by the plugin's export script. Attempting to change settings like Development Build, Script Debugging and Export project in this window will not make a difference. If you end up having to change a build setting that doesn't seem to respond, take a lookat the export script FlutterUnityIntegration\Editor\Build.cs.

Unity exporting

1. After importing the unitypackage, you should now see a Flutter option at the top of the Unity editor.

2. Click on Flutter and select the appropriate export option:

• For android use Export Android Debug or Export Android Release.
  This will export to android/unityLibrary.
• For iOS use Export iOS Debug or Export iOS Release.
  This will export to ios/UnityLibrary.
• Do not use Flutter > Export Platform plugin as it was specially added to work with flutter_unity_cli for larger projects.

If you use git, you will probably want to add these unityLibrary folders to your gitignore file. These folders can get huge and are not guaranteed to work on another computer.

Proceed to the next section to handle iOS and Android specific setup after the export.

Platform specific setup (after Unity export)

After exporting Unity, you will need to make some small changes in your iOS or Android project.
You will likely need to do this only once. These changes remain on future Unity exports.

    // mac
    ndk.dir=/Applications/Unity/Hub/Editor/2020.3.19f1/PlaybackEngines/AndroidPlayer/NDK
    // windows
    ndk.dir=C:\\Program Files\\Unity\\Hub\\Editor\\2021.3.13f1\\Editor\\Data\\PlaybackEngines\\AndroidPlayer\\NDK

android {

  ndkVersion "21.3.6528147"
}

     dependencies {
         // build.gradle
+        implementation project(':flutter_unity_widget_2')
         // build.gradle.kts (Flutter 3.29+)
+        implementation(project(":flutter_unity_widget_2"))
     }

// MainActivity.kt

+ import com.xraph.plugin.flutter_unity_widget.FlutterUnityActivity;

+ class MainActivity: FlutterUnityActivity() {
- class MainActivity: FlutterActivity() {

// MainActivity.kt

// only do this if your activity does not inherit FlutterActivity

import com.xraph.plugin.flutter_unity_widget.IFlutterUnityActivity;

class MainActivity: CustomActivity(), IFlutterUnityActivity {
    // unity will try to read this mUnityPlayer property
    @JvmField 
    var mUnityPlayer: java.lang.Object? = null;

    // implement this function so the plugin can set mUnityPlayer
    override fun setUnityPlayer(unityPlayer: java.lang.Object?) {
        mUnityPlayer = unityPlayer;
    }
}

// build.gradle
+    include ":unityLibrary"
+    project(":unityLibrary").projectDir = file("./unityLibrary")

// build.gradle.kts (Flutter 3.29+)
+    include(":unityLibrary")
+    project(":unityLibrary").projectDir = file("./unityLibrary")

     dependencies {
          // app/build.gradle
+        implementation project(':unityLibrary')
         // app/build.gradle.kts (Flutter 3.29+)
+        implementation(project(":unityLibrary"))
     }

allprojects {
    repositories {
+       flatDir {
            // build.gradle
+           dirs "${project(':unityLibrary').projectDir}/libs"
            // build.gradle.kts (Flutter 3.29+)
+           dirs(file("${project(":unityLibrary").projectDir}/libs"))
+       }
        google()
        mavenCentral()
    }
}

     buildTypes {
         release {
             signingConfig signingConfigs.debug
         }
+        debug {
+            signingConfig signingConfigs.debug
+        }
+        profile {
+            signingConfig signingConfigs.debug
+        }
+        innerTest {
+            matchingFallbacks = ['debug', 'release']
+        }
+   }

+    -keep class com.xraph.plugin.** {*;}

+    <activity
+        android:name="com.xraph.plugin.flutter_unity_widget.OverrideUnityActivity"
+        android:theme="@style/UnityThemeSelector"
+        android:screenOrientation="fullSensor"
+        android:launchMode="singleTask"
+        android:configChanges="mcc|mnc|locale|touchscreen|keyboard|keyboardHidden|navigation|orientation|screenLayout|uiMode|screenSize|smallestScreenSize|fontScale|layoutDirection|density"
+        android:hardwareAccelerated="false"
+        android:process=":Unity">
+    <meta-data android:name="com.xraph.plugin.flutter_unity_widget.OverrideUnityActivity" android:value="true" />
+    </activity>

ℹ️ iOS

1. Open the ios/Runner.xcworkspace (workspace, not the project) file in Xcode, right-click on the Navigator (not on an item), go to Add Files to "Runner" and add the ios/UnityLibrary/Unity-Iphone.xcodeproj file.

2. (Optional) Select the Unity-iPhone/Data folder and change the Target Membership for Data folder to UnityFramework.

3.1. If you're using Swift, open the ios/Runner/AppDelegate.swift file and change the following:

     import UIKit
     import Flutter
+    import flutter_unity_widget_2

     @UIApplicationMain
     @objc class AppDelegate: FlutterAppDelegate {
         override func application(
             _ application: UIApplication,
             didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?
         ) -> Bool {
+            InitUnityIntegrationWithOptions(argc: CommandLine.argc, argv: CommandLine.unsafeArgv, launchOptions)

             GeneratedPluginRegistrant.register(with: self)
             return super.application(application, didFinishLaunchingWithOptions: launchOptions)
         }
     }

3.2. If you're using Objective-C, open the ios/Runner/main.m file and change the following:

+    #import "flutter_unity_widget_2.swift.h"

     int main(int argc, char * argv[]) {
          @autoreleasepool {
+             InitUnityIntegration(argc, argv);
              return UIApplicationMain(argc, argv, nil, NSStringFromClass([AppDelegate class]));
          }
     }

4. Add the UnityFramework.framework file as a library to the Runner project.

5. Unity plugins that make use of native code (Vuforia, openCV, etc.) might need to be added to Runner like UnityFramework.
   Check the contents of the /ios/UnityLibrary/Frameworks/ directory. Any <name>.framework located in (subdirectories of) this directory is a framework that you can add to Runner.

6. Make sure pods are installed after your Unity export, either using flutter run or by running pod install in the ios folder.

7. If you use Xcode 14 or newer, and Unity older than 2021.3.17f1 or 2022.2.2f1, your app might crash when running from Xcode.
   Disable the Thread Performance Checker feature in Xcode to fix this.
   - In Xcode go to Product > Scheme > Edit Scheme...
   - Now With Run selected on the left, got to the Diagnostics tab and uncheck the checkbox for Thread Performance Checker.

---

Setup AR

The following setup for AR is done after making an export from Unity.

Warning: Flutter 3.22 has introduced a crash when using AR on Android < 13 #957

     <dict>
+        <key>NSCameraUsageDescription</key>
+        <string>$(PRODUCT_NAME) uses Cameras</string>
     </dict>

     <dict>
+        <key>NSCameraUsageDescription</key>
+        <string>$(PRODUCT_NAME) uses Cameras</string>
     </dict>

Emulators

We recommend using a physical iOS or Android device, as emulator support is limited.
Below are the limited options to use an emulator.

Communicating

Flutter-Unity

1. On a UnityWidget widget, get the UnityWidgetController received by the onUnityCreated callback.

2. Use the method postMessage to send a string, using the GameObject name and the name of a behaviour method that should be called.

// Snippet of postMessage usage in the example project.
_unityWidgetController?.postMessage(
  'Cube', // GameObject name
  'SetRotationSpeed', // Function name in attached C# script
  speed, // Function parameter (string)
);

Unity-Flutter

1. Select the GameObject that should execute the communication and go to Inspector > Add Component > Unity Message Manager.

2. Create a new MonoBehaviour subclass and add to the same GameObject as a script.

3. On this new behaviour, call GetComponent<UnityMessageManager>() to get a UnityMessageManager.

4. Use the method SendMessageToFlutter to send a string. Receive this message using the onUnityMessage callback of a UnityWidget.

// Send a basic string to Flutter
SendMessageToFlutter("Hello there!");

// If you want to send multiple parameters or objects, use a JSON string.
// This is a random object serialized to JSON using Json.net.
JObject o = JObject.FromObject(new
{
    id = 1,
    name = "Object 1",
    whatever = 12
});
SendMessageToFlutter(o.ToString());

Examples

Simple Example

import 'package:flutter/material.dart';
import 'package:flutter_unity_widget_2/flutter_unity_widget_2.dart';

void main() {
  runApp(
    const MaterialApp(
      home: UnityDemoScreen(),
    ),
  );
}

class UnityDemoScreen extends StatefulWidget {
  const UnityDemoScreen({Key? key}) : super(key: key);

  @override
  State<UnityDemoScreen> createState() => _UnityDemoScreenState();
}

class _UnityDemoScreenState extends State<UnityDemoScreen> {

  UnityWidgetController? _unityWidgetController;

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      body: Container(
        color: Colors.yellow,
        child: UnityWidget(
          onUnityCreated: onUnityCreated,
        ),
      ),
    );
  }

  // Callback that connects the created controller to the unity controller
  void onUnityCreated(UnityWidgetController controller) {
    _unityWidgetController = controller;
  }
}

Communicating with and from Unity

import 'package:flutter/material.dart';
import 'package:flutter_unity_widget_2/flutter_unity_widget_2.dart';

void main() {
  runApp(
    const MaterialApp(
      home: UnityDemoScreen(),
    ),
  );
}

class UnityDemoScreen extends StatefulWidget {
  const UnityDemoScreen({Key? key}) : super(key: key);

  @override
  State<UnityDemoScreen> createState() => _UnityDemoScreenState();
}

class _UnityDemoScreenState extends State<UnityDemoScreen> {
  UnityWidgetController? _unityWidgetController;
  double _sliderValue = 0.0;

  @override
  Widget build(BuildContext context) {
    return Scaffold(
      appBar: AppBar(
        title: const Text('Unity Flutter Demo'),
      ),
      body: Stack(
        children: <Widget>[
          UnityWidget(
            onUnityCreated: onUnityCreated,
            onUnityMessage: onUnityMessage,
            onUnitySceneLoaded: onUnitySceneLoaded,
          ),

          // Flutter UI Stacked on top of Unity to demo Flutter -> Unity interactions.
          // On web this requires a PointerInterceptor widget.
          Positioned(
            bottom: 0,
            // <You need a PointerInterceptor here on web>
            child: SafeArea(
              child: Card(
                elevation: 10,
                child: Column(
                  children: <Widget>[
                    const Padding(
                      padding: EdgeInsets.only(top: 20),
                      child: Text("Rotation speed:"),
                    ),
                    Slider(
                      onChanged: (value) {
                        setState(() {
                          _sliderValue = value;
                        });
                        // Send value to Unity
                        setRotationSpeed(value.toString());
                      },
                      value: _sliderValue,
                      min: 0.0,
                      max: 1.0,
                    ),
                  ],
                ),
              ),
            ),
          ),
        ],
      ),
    );
  }

  // Communcation from Flutter to Unity
  void setRotationSpeed(String speed) {
    _unityWidgetController?.postMessage(
      'Cube',
      'SetRotationSpeed',
      speed,
    );
  }

  // Callback that connects the created controller to the unity controller
  void onUnityCreated(UnityWidgetController controller) {
    _unityWidgetController = controller;
  }

  // Communication from Unity to Flutter
  void onUnityMessage(dynamic message) {
    print('Received message from unity: ${message.toString()}');
  }

  // Communication from Unity when new scene is loaded to Flutter
  void onUnitySceneLoaded(SceneLoaded? sceneInfo) {
    if (sceneInfo != null) {
      print('Received scene loaded from unity: ${sceneInfo.name}');
      print(
          'Received scene loaded from unity buildIndex: ${sceneInfo.buildIndex}');
    }
  }
}

Props

• fullscreen (Enable or disable fullscreen mode on Android)

API

• pause() (Use this to pause unity player)
• resume() (Use this to resume unity player)
• unload() (Use this to unload unity player) *Requires Unity 2019.4.3 or later
• quit() (Use this to quit unity player)
• postMessage(String gameObject, methodName, message) (Allows you invoke commands in Unity from flutter)
• onUnityMessage(data) (Unity to flutter binding and listener)
• onUnityUnloaded() (Unity to flutter listener when unity is unloaded)
• onUnitySceneLoaded(String name, int buildIndex, bool isLoaded, bool isValid,) (Unity to flutter binding and listener when new scene is loaded)

Troubleshooting

Location: Unity

Error:

Multiple precompiled assemblies with the same name Newtonsoft.Json.dll included on the current platform. Only one assembly with the same name is allowed per platform. (Assets/FlutterUnityIntegration/JsonDotNet/Assemblies/AOT/Newtonsoft.Json.dll)

PrecompiledAssemblyException: Multiple precompiled assemblies with the same name Newtonsoft.Json.dll included on the current platform. Only one assembly with the same name is allowed per platform.

Solution: Locate the listed dll file, in this case: Assets/FlutterUnityIntegration/JsonDotNet/Assemblies/AOT/Newtonsoft.Json.dll

• Option 1: Delete the dll file or rename the file extension (e.g. .dll.txt) to stop it from being imported.
• Option 2: Uninstall the package that conflicts in the Unity package manager (usually Version control, or Collab). The exact package can be found by looking for newtonsoft in package-lock.json

Location: Unity

Error:

The type or namespace name 'Newtonsoft' could not be found (are you missing a using directive or an assembly reference?)
The type or namespace name 'JObject' could not be found (are you missing a using directive or an assembly reference?)
The type or namespace name 'JToken' could not be found (are you missing a using directive or an assembly reference?)
The type or namespace name 'JToken' could not be found (are you missing a using directive or an assembly reference?)

Solution:

Include the Newtonsoft JsonDotNet library. It is likely already included in your project with a wrong file extension: Assets/FlutterUnityIntegration/JsonDotNet/Assemblies/AOT/Newtonsoft.Json.dll.txt Rename the .dll.txt extension to .dll in your file explorer and open Unity again.

Alternatively you can manually add the library from the Unity package manager.

Location: Unity

Error:

InvalidOperationException: The build target does not support build appending.

Solution:

1. Open the unity/project-name/Assets/FlutterUnityIntegration/Editor/Build.cs file.

1.1. On line 48, change the following:

-    var options = BuildOptions.AcceptExternalModificationsToPlayer;
+    var options = BuildOptions.AllowDebugging;
+    EditorUserBuildSettings.exportAsGoogleAndroidProject = true;

1.2. On line 115, change the following:

-    var options = BuildOptions.AcceptExternalModificationsToPlayer;
+    var options = BuildOptions.AllowDebugging;

Location: Android Studio

Error:

minSdkVersion XX cannot be smaller than version 19 declared in library 
    \ [:flutter_unity_widget] .../AndroidManifest.xml as the library might be using 
    \ APIs not available in XX

Solution:

1. Open the android/app/build.gradle file and change the following:

-    minSdkVersion XX
+    minSdkVersion 19

Location: Android Studio

Error:

e: .../FlutterUnityWidgetBuilder.kt: (15, 42): Expecting a parameter declaration
e: .../FlutterUnityWidgetBuilder.kt: (23, 25): Expecting an argument
e: .../FlutterUnityWidgetController.kt: (22, 44): Expecting a parameter declaration
e: .../FlutterUnityWidgetFactory.kt: (13, 58): Expecting a parameter declaration

Solution:

1. Open the android/build.gradle file and change the following:

-    ext.kotlin_version = '1.3.50'
+    ext.kotlin_version = '1.4.31'

Location: Android Studio

Error:

Unable to find a matching variant of project :unityLibrary:

Solution:

1. Open the android/app/build.gradle file and change the following:

     lintOptions {
         disable 'InvalidPackage'
+        checkReleaseBuilds false
     }

Flavors

Recommendation

The easiest way to apply flavors for your app would be: flutter_flavorizr.

If you use flavors in your app you will notice that especially iOS crashes while running or building your app! Here are the necessary steps for flavored apps:

Android

No changes needed. Flavors are applied without any additional setups.

iOS

For your Unity iOS-Build you have to add your flavors to your Unity iOS Configuration.

1. Check your actual Runner (your app) configurations. If you have for example the flavors:

• dev
• prod

Your Runner configurations are looking like this:

So you have the flavors:

• Debug-dev
• Profile-dev
• Release-dev
• Debug-prod
• Profile-prod
• Release-prod

These flavors needs to be added to your Unity-IPhone project.

2. Go into your Unity-IPhone project -> PROJECT Unity-IPhone -> Info:

Here you can see in the Configurations section only:

• Release
• ReleaseForProfiling
• ReleaseForRunning
• Debug

3. Copy Debug configuration twice and rename them to Debug-dev and the second to Debug-prod.

You can do that by selecting + and duplicate the configuration like this:

4. Repeat this with Release to Release-dev and Release-prod.

5. Repeat this with Release to Profile-dev and Profile-prod.

6. Your Unity-IPhone configurations should now look like this:

Web

Flutter on default doesn't support --flavor for building web. But you can set your target main.dart entrypoint (with -t main.dart) while running and building. So if you setup your flavors properly there're also no changes needed for web to apply changes for your Flutter-Unity web App.

Known issues

• Remember to disabled fullscreen in unity player settings to disable unity fullscreen.
• Unity freezes and crashes on Android, please use OpenGL3 as Graphics API.
• Project fails to build due to some native dependencies in your unity project, please integrate the native libraries for those dependencies on Android or iOS
• App crashes on screen exit and re-entry do this

  Build Setting - iOS - Other Settings - Configuration - Enable Custom Background Behaviors or iOS

• Android builds takes forever to complete Unity 2022.1.*, remove these lines from unityLibrary/build.gradle file

  commandLineArgs.add("--enable-debugger") commandLineArgs.add("--profiler-report") commandLineArgs.add("--profiler-output-file=" + workingDir + "/build/il2cpp_"+ abi + "_" + configuration + "/il2cpp_conv.traceevents")

Web GL

Flutter widgets stacked on top of the UnityWidget will not register clicks or taps. This is a Flutter issue and can be solved by using the PointerInterceptor package.

Example usage:

Stack(
  children: [
    UnityWidget(
      onUnityCreated: onUnityCreated,
      onUnityMessage: onUnityMessage,
      onUnitySceneLoaded: onUnitySceneLoaded,
    ),
    Positioned(
      bottom: 20,
      left: 20,
      right: 20,
      child: PointerInterceptor(
        child: ElevatedButton(
          onPressed: () {
            // do something
          },
          child: const Text('Example button'),
        ),
      ),
    ),

We already integrated this into our Examples in the /example folder.

Contributors ✨

Thanks goes to these wonderful people (emoji key):

Rex Raphael 💻 📖 💬 🐛 👀 ✅

Thomas Stockx 💻 📖 💬 ✅

Kris Pypen 💻 📖 💬 ✅

Lorant Csonka 📖 📹

This project follows the all-contributors specification. Contributions of any kind welcome!