serverStreamingPredict method

Stream<StreamingPredictResponse> serverStreamingPredict(
  1. StreamingPredictRequest request
)

Perform a server-side streaming online prediction request for Vertex LLM streaming.

Throws a http.ClientException if there were problems communicating with the API service. Throws a ServiceException if the API method failed for any reason.

Implementation

Stream<StreamingPredictResponse> serverStreamingPredict(
  StreamingPredictRequest request,
) {
  final url = _endPoint.replace(
    path: '/v1beta1/${request.endpoint}:serverStreamingPredict',
  );
  return _client
      .postStreaming(url, body: request, enableSse: true)
      .map(StreamingPredictResponse.fromJson);
}