LLMRequestRouter
Receives LLM request blobs and routes them to the local LLMClient.
| Declared in | src/libs/libllm/llm/comms/LLMRequestRouter.hpp |
| Inherits | QObject |
| Group | libllm |
Detailed description
Listens for incoming LLM request blobs on a Phase 12 BlobCourier, deserializes them, dispatches the chat to the appropriate local LLMClient via LLMManager, and sends the response blob back to the requesting peer.
Routing is by mime hint: incoming blobs are processed iff the hint is "application/octomy.llm-request"; replies go out with hint "application/octomy.llm-response" addressed to the source peer.
See also LLMCourier.