Module llm 

LLM-related primitive types and traits.

Pure data types and interface definitions for LLM operations. Runtime orchestration (ProviderRegistry, CircuitBreaker) lives in crates/api/src/providers/.

Structs

ExtractedArtifact

An artifact extracted from content.

HeuristicTokenizer

Heuristic tokenizer using character-to-token ratios.

SummarizeConfig

Configuration for summarization requests.

Enums

CircuitState

Circuit breaker state.

ProviderCapability

Capabilities a provider can offer.

RoutingStrategy

Strategy for routing requests to providers.

SummarizeStyle

Style of summarization output.

Statics

GLOBAL_TOKENIZER 🔒

Traits

EmbeddingProvider

Async trait for embedding providers.

SummarizationProvider

Async trait for summarization providers.

Tokenizer

Trait for counting tokens in text.

Functions

estimate_tokens

Estimate token count using the configured tokenizer if present.

estimate_tokens_heuristic

Estimate token count using the default heuristic tokenizer.

register_global_tokenizer

Register a global tokenizer used by estimate_tokens.