quantize property

bool get quantize

Whether the returned embedding should be quantized to bytes via scalar quantization. Embeddings are implicitly assumed to be unit-norm and therefore any dimension is guaranteed to have a value in -1.0, 1.0. Use the l2_normalize option if this is not the case.

See also:

• l2Normalize

Implementation

bool get quantize;