• OctoMY API
  • OctoMY API Reference
  • C++ Classes
  • OctoMY
  • LLMManager
  • LLMManager Class

    Node-level LLM management with client factory and LRU caching. More...

    Header: #include <LLMManager>
    Since: 1.0
    Inherits: QObject

    Detailed Description

    Wraps an LLMRegistry and creates LLMClient instances on demand for configured models. Maintains an LRU cache of loaded clients to bound memory usage, automatically evicting the least-recently-used client when the cache limit is exceeded.

    See also LLMRegistry and LLMClient.