LLMRequestRouter

Receives LLM request blobs and routes them to the local LLMClient.

Inherits QObject
Group libllm

Declared in src/libs/libllm/llm/comms/LLMRequestRouter.hpp.

Detailed description

Listens for incoming LLM request blobs on a Phase 12 BlobCourier, deserializes them, dispatches the chat to the appropriate local LLMClient via LLMManager, and sends the response blob back to the requesting peer.

Routing is by mime hint: incoming blobs are processed iff the hint is application/octomy.llm-request; replies go out with hint application/octomy.llm-response addressed to the source peer.

See also LLMCourier.

In this section