LLM

LLM is a wrapper around various LLM providers, making your function implementations LLM-agnostic.

Note: llm-exe utilizes the underlying API's from the various providers. This means that you must have an account (and usually an API key) with them if you want to call those models using llm-exe.

LLM Features:

• Built-in timeout mechanism for better control when a provider takes too long.
• Automatic retry with configurable back-off for errors.
• Use different LLM's with different configurations for different functions.
• Streaming coming soon.

Note: You can use and call methods on LLM's directly, but they are usually passed to an LLM executor and then called internally.

Adding Custom LLM's

If you need to register additional LLM's to be used, you can, once I add documentation.