LLMManager

Node-level LLM management with client factory and LRU caching.

Declared in src/libs/libllm/llm/LLMManager.hpp
Inherits QObject
Group libllm

Detailed description

Wraps an LLMRegistry and creates LLMClient instances on demand for configured models. Maintains an LRU cache of loaded clients to bound memory usage, automatically evicting the least-recently-used client when the cache limit is exceeded.

See also LLMRegistry, LLMClient.

In this section