GenerationSettings constructor

const GenerationSettings({ double temperature = 0.7, int topK = 40, double topP = 0.9, int maxTokens = 128, double repeatPenalty = 1.1, })

Creates generation settings. All parameters are optional and fall back to conservative defaults.

Implementation

const GenerationSettings({
  this.temperature = 0.7,
  this.topK = 40,
  this.topP = 0.9,
  this.maxTokens = 128,
  this.repeatPenalty = 1.1,
});