LLMRequestRouter
Receives LLM request blobs and routes them to the local LLMClient.
| Inherits | QObject |
| Group | libllm |
Declared in src/libs/libllm/llm/comms/LLMRequestRouter.hpp.
Detailed description
Listens for incoming LLM request blobs on a Phase 12 BlobCourier, deserializes them, dispatches the chat to the appropriate local LLMClient via LLMManager, and sends the response blob back to the requesting peer.
Routing is by mime hint: incoming blobs are processed iff the hint is application/octomy.llm-request; replies go out with hint application/octomy.llm-response addressed to the source peer.
See also LLMCourier.