LLMManager
Node-level LLM management with client factory and LRU caching.
| Declared in | src/libs/libllm/llm/LLMManager.hpp |
| Inherits | QObject |
| Group | libllm |
Detailed description
Wraps an LLMRegistry and creates LLMClient instances on demand for configured models. Maintains an LRU cache of loaded clients to bound memory usage, automatically evicting the least-recently-used client when the cache limit is exceeded.
See also LLMRegistry, LLMClient.