AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration constructor
Creates a new AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration.
maxLength Maximum number of tokens to allow in the generated response.
stopSequences List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.
temperature Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.
topK Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence.
topP Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.
Implementation
const AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration({
required this.maxLength,
required this.stopSequences,
required this.temperature,
required this.topK,
required this.topP,
});