liter_llm
library
Functions
-
allProviders()
→ Future<List<ProviderConfig>>
-
Return all provider configs from the registry.
-
capabilities({required String providerName})
→ Future<ProviderCapabilities>
-
Return the capability flags for a named provider.
-
checkBound({required String context, required PlatformInt64 currentLen, required PlatformInt64 incoming, required PlatformInt64 limit})
→ Future<void>
-
Assert that
current_len + incoming does not exceed limit.
-
clear()
→ Future<void>
-
Remove all guardrails from the global registry.
-
completionCost({required String model, required PlatformInt64 promptTokens, required PlatformInt64 completionTokens})
→ Future<double?>
-
Calculate the estimated cost of a completion given a model name and token
counts.
-
completionCostWithCache({required String model, required PlatformInt64 promptTokens, required PlatformInt64 cachedTokens, required PlatformInt64 completionTokens})
→ Future<double?>
-
Calculate the estimated cost of a completion, accounting for cached
(cache-hit) prompt tokens billed at the provider's discounted rate.
-
complexProviderNames()
→ Future<List<String>>
-
Return the set of complex provider names.
-
countRequestTokens({required String model, required ChatCompletionRequest req})
→ Future<PlatformInt64>
-
Count tokens for a full
ChatCompletionRequest.
-
countTokens({required String model, required String text})
→ Future<PlatformInt64>
-
Count tokens in a text string using the tokenizer for the given model.
-
createAssistantMessageFromJson({required String json})
→ Future<AssistantMessage>
-
-
createAudioContentFromJson({required String json})
→ Future<AudioContent>
-
-
createAuthConfigFromJson({required String json})
→ Future<AuthConfig>
-
-
createBatchListQueryFromJson({required String json})
→ Future<BatchListQuery>
-
-
createBatchListResponseFromJson({required String json})
→ Future<BatchListResponse>
-
-
createBatchObjectFromJson({required String json})
→ Future<BatchObject>
-
-
createBatchRequestCountsFromJson({required String json})
→ Future<BatchRequestCounts>
-
-
createBudgetConfigFromJson({required String json})
→ Future<BudgetConfig>
-
-
createCacheConfigFromJson({required String json})
→ Future<CacheConfig>
-
-
createChatCompletionChunkFromJson({required String json})
→ Future<ChatCompletionChunk>
-
-
createChatCompletionRequestFromJson({required String json})
→ Future<ChatCompletionRequest>
-
-
createChatCompletionResponseFromJson({required String json})
→ Future<ChatCompletionResponse>
-
-
createChatCompletionToolFromJson({required String json})
→ Future<ChatCompletionTool>
-
-
createChoiceFromJson({required String json})
→ Future<Choice>
-
-
createClient({required String apiKey, String? baseUrl, PlatformInt64? timeoutSecs, PlatformInt64? maxRetries, String? modelHint})
→ Future<DefaultClient>
-
Create a new LLM client with simple scalar configuration.
-
createClientFromJson({required String json})
→ Future<DefaultClient>
-
Create a new LLM client from a JSON string.
-
createCreateBatchRequestFromJson({required String json})
→ Future<CreateBatchRequest>
-
-
createCreateFileRequestFromJson({required String json})
→ Future<CreateFileRequest>
-
-
createCreateImageRequestFromJson({required String json})
→ Future<CreateImageRequest>
-
-
createCreateResponseRequestFromJson({required String json})
→ Future<CreateResponseRequest>
-
-
createCreateSpeechRequestFromJson({required String json})
→ Future<CreateSpeechRequest>
-
-
createCreateTranscriptionRequestFromJson({required String json})
→ Future<CreateTranscriptionRequest>
-
-
createCustomProviderConfigFromJson({required String json})
→ Future<CustomProviderConfig>
-
-
createDecodedDataUrlFromJson({required String json})
→ Future<DecodedDataUrl>
-
-
createDeleteResponseFromJson({required String json})
→ Future<DeleteResponse>
-
-
createDeveloperMessageFromJson({required String json})
→ Future<DeveloperMessage>
-
-
createDocumentContentFromJson({required String json})
→ Future<DocumentContent>
-
-
createEmbeddingObjectFromJson({required String json})
→ Future<EmbeddingObject>
-
-
createEmbeddingRequestFromJson({required String json})
→ Future<EmbeddingRequest>
-
-
createEmbeddingResponseFromJson({required String json})
→ Future<EmbeddingResponse>
-
-
createFileListQueryFromJson({required String json})
→ Future<FileListQuery>
-
-
createFileListResponseFromJson({required String json})
→ Future<FileListResponse>
-
-
createFileObjectFromJson({required String json})
→ Future<FileObject>
-
-
createFunctionCallFromJson({required String json})
→ Future<FunctionCall>
-
-
createFunctionDefinitionFromJson({required String json})
→ Future<FunctionDefinition>
-
-
createFunctionMessageFromJson({required String json})
→ Future<FunctionMessage>
-
-
createImageFromJson({required String json})
→ Future<Image>
-
-
createImagesResponseFromJson({required String json})
→ Future<ImagesResponse>
-
-
createImageUrlFromJson({required String json})
→ Future<ImageUrl>
-
-
createJsonSchemaFormatFromJson({required String json})
→ Future<JsonSchemaFormat>
-
-
createModelObjectFromJson({required String json})
→ Future<ModelObject>
-
-
createModelsListResponseFromJson({required String json})
→ Future<ModelsListResponse>
-
-
createModerationCategoriesFromJson({required String json})
→ Future<ModerationCategories>
-
-
createModerationCategoryScoresFromJson({required String json})
→ Future<ModerationCategoryScores>
-
-
createModerationRequestFromJson({required String json})
→ Future<ModerationRequest>
-
-
createModerationResponseFromJson({required String json})
→ Future<ModerationResponse>
-
-
createModerationResultFromJson({required String json})
→ Future<ModerationResult>
-
-
createOcrImageFromJson({required String json})
→ Future<OcrImage>
-
-
createOcrPageFromJson({required String json})
→ Future<OcrPage>
-
-
createOcrRequestFromJson({required String json})
→ Future<OcrRequest>
-
-
createOcrResponseFromJson({required String json})
→ Future<OcrResponse>
-
-
createPageDimensionsFromJson({required String json})
→ Future<PageDimensions>
-
-
createPromptTokensDetailsFromJson({required String json})
→ Future<PromptTokensDetails>
-
-
createProviderCapabilitiesFromJson({required String json})
→ Future<ProviderCapabilities>
-
-
createProviderConfigFromJson({required String json})
→ Future<ProviderConfig>
-
-
createRateLimitConfigFromJson({required String json})
→ Future<RateLimitConfig>
-
-
createRerankRequestFromJson({required String json})
→ Future<RerankRequest>
-
-
createRerankResponseFromJson({required String json})
→ Future<RerankResponse>
-
-
createRerankResultDocumentFromJson({required String json})
→ Future<RerankResultDocument>
-
-
createRerankResultFromJson({required String json})
→ Future<RerankResult>
-
-
createResponseObjectFromJson({required String json})
→ Future<ResponseObject>
-
-
createResponseOutputItemFromJson({required String json})
→ Future<ResponseOutputItem>
-
-
createResponseToolFromJson({required String json})
→ Future<ResponseTool>
-
-
createResponseUsageFromJson({required String json})
→ Future<ResponseUsage>
-
-
createSearchRequestFromJson({required String json})
→ Future<SearchRequest>
-
-
createSearchResponseFromJson({required String json})
→ Future<SearchResponse>
-
-
createSearchResultFromJson({required String json})
→ Future<SearchResult>
-
-
createSpecificFunctionFromJson({required String json})
→ Future<SpecificFunction>
-
-
createSpecificToolChoiceFromJson({required String json})
→ Future<SpecificToolChoice>
-
-
createStreamChoiceFromJson({required String json})
→ Future<StreamChoice>
-
-
createStreamDeltaFromJson({required String json})
→ Future<StreamDelta>
-
-
createStreamFunctionCallFromJson({required String json})
→ Future<StreamFunctionCall>
-
-
createStreamOptionsFromJson({required String json})
→ Future<StreamOptions>
-
-
createStreamToolCallFromJson({required String json})
→ Future<StreamToolCall>
-
-
createSystemMessageFromJson({required String json})
→ Future<SystemMessage>
-
-
createToolCallFromJson({required String json})
→ Future<ToolCall>
-
-
createToolMessageFromJson({required String json})
→ Future<ToolMessage>
-
-
createTranscriptionResponseFromJson({required String json})
→ Future<TranscriptionResponse>
-
-
createTranscriptionSegmentFromJson({required String json})
→ Future<TranscriptionSegment>
-
-
createUsageFromJson({required String json})
→ Future<Usage>
-
-
createUserMessageFromJson({required String json})
→ Future<UserMessage>
-
-
createWaitForBatchConfigFromJson({required String json})
→ Future<WaitForBatchConfig>
-
-
decodeDataUrl({required String url})
→ Future<DecodedDataUrl?>
-
Decode a base64 data URL into
DecodedDataUrl.
-
encodeDataUrl({required List<int> bytes, String? mime})
→ Future<String>
-
Encode bytes as a base64 data URL:
data:<mime>;base64,<b64>.
-
ensureCryptoProvider()
→ Future<void>
-
Install the
ring crypto provider as the rustls process default, idempotently.
-
registerCustomProvider({required CustomProviderConfig config})
→ Future<void>
-
Register a custom provider in the global runtime registry.
-
unregisterCustomProvider({required String name})
→ Future<bool>
-
Remove a previously registered custom provider by name.
