• OctoMY API
  • OctoMY API Reference
  • C++ Classes
  • OctoMY
  • LLMRequestRouter
  • LLMRequestRouter Class

    Receives LLM request blobs and routes them to the local LLMClient. More...

    Header: #include <LLMRequestRouter>
    Since: 1.0
    Inherits: QObject

    Detailed Description

    Listens for incoming LLM request blobs on a Phase 12 BlobCourier, deserializes them, dispatches the chat to the appropriate local LLMClient via LLMManager, and sends the response blob back to the requesting peer.

    Routing is by mime hint: incoming blobs are processed iff the hint is "application/octomy.llm-request"; replies go out with hint "application/octomy.llm-response" addressed to the source peer.

    See also LLMCourier.