breakpoints property

List<int> breakpoints

Indices of messages (in the messages array) whose last content block should receive a cache_control ephemeral marker. Typically the system prompt and the most recent few turns benefit most from caching.

Implementation

final List<int> breakpoints;