LLMClient

Abstract asynchronous interface for LLM inference.


Declared in	`src/libs/libllm/llm/LLMClient.hpp`
Inherits	octomy::llm::driver::ILLMDriver
Inherited By	AndroidPlatformLLMClient, ClaudeCodeClient, LocalLlamaClient, and OnlineAPIClient
Group	libllm

Detailed description

Defines the contract for sending chat messages to an LLM and receiving responses either as a single completed reply or as a stream of tokens. Concrete implementations include OnlineAPIClient, LocalLlamaClient, ClaudeCodeClient and AndroidPlatformLLMClient. A model on a peer node is reached through RemoteNodeDriver, which implements the driver interface instead of this one.