createModel abstract method

Future<InferenceModel> createModel({
  1. required ModelType modelType,
  2. int maxTokens = 1024,
  3. PreferredBackend? preferredBackend,
  4. List<int>? loraRanks,
  5. int? maxNumImages,
  6. bool supportImage = false,
})

Creates and returns a new InferenceModel instance.

modelType — model type to create. maxTokens — maximum context length for the model. preferredBackend — backend preference (e.g., CPU, GPU). loraRanks — optional supported LoRA ranks. maxNumImages — maximum number of images (for multimodal models). supportImage — whether the model supports images.

Implementation

Future<InferenceModel> createModel({
  required ModelType modelType,
  int maxTokens = 1024,
  PreferredBackend? preferredBackend,
  List<int>? loraRanks,
  int? maxNumImages, // Добавляем поддержку изображений
  bool supportImage = false, // Добавляем флаг поддержки изображений
});