sampling property

bool sampling

Sampling support — host's LLM is reachable through this client (the server can ask for completions via sampling/createMessage).

Implementation

final bool sampling;