LLMRequestRouter

Receives LLM request blobs and routes them to the local LLMClient.

Declared in src/libs/libllm/llm/comms/LLMRequestRouter.hpp
Inherits QObject
Group libllm

Detailed description

Listens for incoming LLM request blobs on a Phase 12 BlobCourier, deserializes them, dispatches the chat to the appropriate local LLMClient via LLMManager, and sends the response blob back to the requesting peer.

Routing is by mime hint: incoming blobs are processed iff the hint is "application/octomy.llm-request"; replies go out with hint "application/octomy.llm-response" addressed to the source peer.

See also LLMCourier.

In this section