timeout property
Length of time the Engine is willing to wait for a response from
generateResponse
before assuming that the inference task has failed
and should be resumed.
Implementation
final Duration timeout;
Length of time the Engine is willing to wait for a response from
generateResponse
before assuming that the inference task has failed
and should be resumed.
final Duration timeout;