promptCaching property
Ask the API to cache the longest reusable prompt prefix
(top-level cache_control).
Implementation
final bool promptCaching;
Ask the API to cache the longest reusable prompt prefix
(top-level cache_control).
final bool promptCaching;