AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration class
Constructors
-
AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration({required Input<int> maxLength, required Input<List<String>> stopSequences, required Input<double> temperature, required Input<int> topK, required Input<double> topP})
-
Creates a new AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration.
maxLength Maximum number of tokens to allow in the generated response.
stopSequences List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.
temperature Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.
topK Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence.
topP Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.
const
-
AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration.fromMap(Map<String, dynamic> map)
-
factory
Properties
-
hashCode
→ int
-
The hash code for this object.
no setterinherited
-
maxLength
→ Input<int>
-
Maximum number of tokens to allow in the generated response.
final
-
runtimeType
→ Type
-
A representation of the runtime type of the object.
no setterinherited
-
stopSequences
→ Input<List<String>>
-
List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.
final
-
temperature
→ Input<double>
-
Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.
final
-
topK
→ Input<int>
-
Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence.
final
-
topP
→ Input<double>
-
Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.
final