nutrition_ai 0.0.8

Passio Nutrition AI SDK for Flutter. Supports Android and iOS.

Passio Nutrition-AI Flutter SDK

Overview

Welcome to Passio Nutrition-AI Flutter SDK!

When integrated into your app the SDK provides you with food recognition and nutrition assistant technology. The SDK is designed to take a stream of images and output foods recognized in those images along with nutrition data related to the recognized foods.

As the developer, you have complete control of when to turn on/off the SDK and to configure the outputs which includes:

• food names (e.g. banana, hamburger, fruit salad, quest chocolate bar)
• lists of alternatives for recognized foods (e.g., soy milk would be an alternative of a visually recognized class milk)
• barcodes detected on food packages
• packaged foods recognized by the text detected on food packages
• nutrition information detected on food packages via Passio's Nutrition Facts reader which returns information written in Nutrition Facts labels
• nutrition information associated with the foods
• food weight and volume for certain foods

By default the SDK does not record/store any photos or videos. Instead, as the end user hovers over a food item with his/her camera phone, the SDK recognizes and identifies food items in real time. This hovering action is only transitory/temporary while the end user is pointing the camera at a particular item and is not recorded or stored within the SDK. As a developer, you can configure the SDK to capture images or videos and store them in your app.

BEFORE YOU CONTINUE:

1. Passio Nutrition-AI SDK added data from Open Food Facts (https://en.openfoodfacts.org/). Each food that contains data from Open Food Facts will be marked by public var isOpenFood: Bool.. In case you choose to set isOpenFood = true you agree to abide by the terms of the Open Food Facts license agreement (https://opendatacommons.org/licenses/odbl/1-0) and their terms of use (https://world.openfoodfacts.org/terms-of-use) and you will have to add to the UI the following license copy:

"This record contains information from Open Food Facts (https://en.openfoodfacts.org), which is made available here under the Open Database License (https://opendatacommons.org/licenses/odbl/1-0)"

2. To use the SDK sign up at https://www.passio.ai/nutrition-ai. The SDK WILL NOT WORK without a valid SDK key.

Minimum Requirements

	Android	iOS
Support	SDK 26+	13.0+

• The SDK requires access to the devices's camera.

Setup for Android

• Add to top build.gradle file (Project: android)

allprojects {
    repositories {
        ...
        flatDir {
            dirs project(':nutrition_ai').file('libs')
        }
    }
}

• The nutrition_ai build.gradle file dependency section should look like (Module: nutrition_ai)

allprojects {
    repositories {
        ...
        flatDir {
            implementation (name: 'passiolib-release', ext: 'aar')
        }
    }
}

Initialize and configure the SDK

1. Import the Passio Nutrition AI Package

import 'package:nutrition_ai/nutrition_ai_sdk.dart';

2. Configure the SDK with the Key you obtained by signing up at https://www.passio.ai/nutrition-ai.

void configureSDK() async {
  String passioKey = "Your_PassioSDK_Key";
  var configuration = PassioConfiguration(passioKey);
  passioStatus = await NutritionAI.instance.configureSDK(configuration);
  switch(passioStatus.mode) {
    // Handle result of the configuration process.
    case PassioMode.notReady: { break; }
    case PassioMode.isBeingConfigured: { break; }
    case PassioMode.failedToConfigure: { break; }
    case PassioMode.isDownloadingModels: { break; }
    case PassioMode.isReadyForDetection: { break; }
  }
}

class PassioStatus {
  PassioMode mode = PassioMode.notReady;
  List<String>? missingFiles;
  String? debugMessage;
  PassioSDKError? error;
  int? activeModels;
}

The mode of the PassioStatus defines what is the current status of the configuration process. There are 5 different modes, and they all should be handled by the implementing side.

enum PassioMode {
  notReady,
  failedToConfigure,
  isBeingConfigured,
  isDownloadingModels,
  isReadyForDetection
}

• notReady -> The configuration process hasn't started yet.
• failedToConfigure -> There was an error during the configuration process.
• isBeingConfigured -> The SDK is still in the configuration process. Normally, you shouldn't receive this mode as a callback to the configure method. If you do please contact our support team.
• isDownloadingModels -> The files required by the SDK to work are not present and are currently being downloaded.
• isReadyForDetection -> The configuration process is over and all the SDKs functionalities are available.

3. Request authorization to use the camera and add the PassioPreview widget:

Future<void> _checkPermission() async {
  if (await Permission.camera.request().isGranted) {
    _startFoodDetection();
  }
}

@override
Widget build(BuildContext context) {
  return Scaffold(
    body: Stack(
      children: [
        const PassioPreview(),
        ...
      ],
    ),
  );
}

4. Add the method startFoodDetection() and register a FoodRecognitionListener

void _startFoodDetection() {
  var detectionConfig = FoodDetectionConfiguration();
  detectionConfig.detectBarcodes = true;
  NutritionAI.instance.startFoodDetection(detectionConfig, this);
}

@override
void recognitionResults(FoodCandidates foodCandidates) {
  // Handle recognition results
}

5. Stop Food Detection on widget dispose:

@override
void dispose() {
  NutritionAI.instance.stopFoodDetection();
  super.dispose();
}

6. Get nutritional information for food using a PassioID as a food identifier:

var attributes = await NutritionAI.instance.lookupPassioAttributesFor(passioID);

^{Copyright 2023 Passio Inc}