LLM

LLM is a wrapper around various LLM providers, making your function implementations LLM-agnostic.

LLM Features:

• Built-in timeout mechanism for better control when a provider takes too long.
• Automatic retry with configurable back-off for errors.
• Use different LLM's with different configurations for different functions.
• Streaming coming soon.

Note: You can use and call methods on LLM's directly, but they are usually passed to an LLM executor and then called internally.

|

Adding Custom LLM's

If you need to register additional LLM's to be used, you can...

// TODO: add docs 😕