LLM Chat
Chat with any LLM using the provider interface
Usage Instructions
Send prompts to any supported LLM provider (OpenAI, Anthropic, Google, Azure, Bedrock, Vertex AI, and more). Supports system prompts, temperature control, and max token configuration.
Tools
llm_chat
Input
| Parameter | Type | Required | Description |
|---|---|---|---|
model | string | Yes | No description |
systemPrompt | string | No | No description |
context | string | Yes | No description |
apiKey | string | No | No description |
temperature | number | No | No description |
maxTokens | number | No | No description |
azureEndpoint | string | No | No description |
azureApiVersion | string | No | No description |
vertexProject | string | No | No description |
vertexLocation | string | No | No description |
vertexCredential | string | No | No description |
bedrockAccessKeyId | string | No | No description |
bedrockSecretKey | string | No | No description |
bedrockRegion | string | No | No description |
Output
| Parameter | Type | Description |
|---|---|---|
content | string | The generated response content |
model | string | The model used for generation |
tokens | object | Token usage information |