AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration constructor

const AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration({
  1. required Input<int> maxLength,
  2. required Input<List<String>> stopSequences,
  3. required Input<double> temperature,
  4. required Input<int> topK,
  5. required Input<double> topP,
})

Creates a new AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration. maxLength Maximum number of tokens to allow in the generated response. stopSequences List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response. temperature Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options. topK Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence. topP Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.

Implementation

const AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration({
  required this.maxLength,
  required this.stopSequences,
  required this.temperature,
  required this.topK,
  required this.topP,
});