createSession abstract method
Creates a new InferenceModelSession for generation.
temperature
, randomSeed
, topK
, topP
— parameters for sampling.
loraPath
— optional path to LoRA model.
enableVisionModality
— enable vision modality for multimodal models.
Implementation
Future<InferenceModelSession> createSession({
double temperature = .8,
int randomSeed = 1,
int topK = 1,
double? topP,
String? loraPath,
bool? enableVisionModality, // Добавляем поддержку vision модальности
});