LLM

LLM is a wrapper around various LLM providers, making your function implementations LLM-agnostic.

Note: llm-exe utilizes the underlying API's from the various providers. This means that you must have an account (and usually an API key) with them if you want to call those models using llm-exe.

LLM Features:

• Built-in timeout mechanism for better control when a provider takes too long.
• Automatic retry with configurable back-off for errors.
• Use different LLM's with different configurations for different functions.
• Streaming coming soon.

Note: You can use and call methods on LLM's directly, but they are usually passed to an LLM executor and then called internally.

Currently Supported Providers

Currently, llm-exe supports calling LLM's from:

• OpenAi
• Anthropic
• xAI
• Google
• AWS Bedrock
• Ollama
• Deepseek
• Custom Providers

Adding Custom LLM's

You can create custom LLM configurations using useLlmConfiguration. This allows you to:

• Connect to OpenAI-compatible APIs
• Use local models
• Work with corporate proxies
• Add support for new providers

See the Custom Provider Configuration guide for details.