flutter_d2go 0.0.1

Flutter Plugin inferring using d2go, the mobile model of detectron2.

flutter_d2go

Flutter Plugin inferring using d2go, the mobile model of detectron2. Currently only Android works. Also, only object detection can be performed.

Installation

Add flutter_d2go to your pubspec.yaml.

dependencies:
  flutter_d2go: ^0.2.0

Put the d2go model and class file in the assets directory.

assets:
  - assets/models/d2go.pt
  - assets/models/classes.txt

Run flutter pub get.

flutter pub get

import the library

import 'package:flutter_d2go/flutter_d2go.dart';

Usage

Load model and classes

await FlutterD2go.loadModel(
    modelPath: 'assets/models/d2go.pt',     // required
    labelPath: 'assets/models/classes.txt', // required
);

get predictions

List<Map<String, dynamic>> predictions = await FlutterD2go.getImagePrediction(
    image: image,           // required File(dart:io) image
    width: 320,             // defaults to 640
    height: 320,            // defaults to 640
    mean: [0.0, 0.0, 0.0],  // defaults to [0.0, 0.0, 0.0]
    std: [1.0, 1.0, 1.0],   // defaults to [1.0, 1.0, 1.0]
    minScore: 0.7,          // defaults to 0.5
);

output format

rect is the scale of the original image

[
      {
        rect: {
          left: 74.65713500976562,
          top: 76.94147491455078,
          right: 350.64324951171875,
          bottom: 323.0279846191406
        },
        confidenceInClass: 0.985002338886261,
        detectedClass: bicycle
      },
      ...
]