llm-exe

A package that provides simplified base components to make building and maintaining LLM-powered applications easier.

Documentation

See Examples

Github

Modular

Write functions powered by LLM's with easy to use building blocks.

TypeScript First

Pure Javascript and TypeScript. Allows you to pass and infer types.

Use {{variables}}

Supercharge your prompts by using handlebars expressions and functions.

Control

Not very opinionated. You have control on how you use it.

Chat or Text Prompts

Support for text-based and chat-based prompts.

Function Calling

Allow LLM's to call functions - or other LLM executors.

Prompt Templates

Build reusable prompt template parts.

Test Coverage

100% test coverage.

Quick Example

const PROMPT = `You are a senior TypeScript developer. 

Write a concise implementation for the task: "{{spec}}". 

Respond with only the code (no questions or explanation), inside a single ts code block`;

export async function writeCodeFromSpec(spec: string) {
  const llm = useLlm("openai.gpt-4o-mini"); // change this if you want
  const prompt = createChatPrompt<{ spec: string }>(PROMPT);
  const parser = createParser("markdownCodeBlock");

  const executor = createLlmExecutor({ llm, prompt, parser });

  return executor.execute({ spec });
}

const code = await writeCodeFromSpec("add two numbers together");
console.log(code.code); // => function add(a: number, b: number) { ... }