hasSpeculativeDecodingSupport abstract method

bool hasSpeculativeDecodingSupport(
  1. CapabilitiesHandle capabilities
)

Checks whether loaded capabilities support speculative decoding.

Implementation

bool hasSpeculativeDecodingSupport(CapabilitiesHandle capabilities);