Google Gemini

When using Google Gemini models, llm-exe will make POST requests to https://generativelanguage.googleapis.com/v1beta/models/{model}:generateContent. All models are supported if you pass google.chat.v1 as the first argument, and then specify a model in the options.

Basic Usage

Gemini Chat

const llm = useLlm("google.chat.v1", {
  model: "gemini-2.5-flash", // specify a model
});

Gemini Chat By Model

const llm = useLlm("google.gemini-2.5-flash", {
  // other options,
  // no model needed, using gemini-2.5-flash
});

INFO

You can use the following models using this shorthand:

• google.gemini-2.0-flash
• google.gemini-2.0-flash-lite
• google.gemini-2.5-flash
• google.gemini-2.5-flash-lite
• google.gemini-1.5-pro
• google.gemini-2.5-pro

Authentication

To authenticate, you need to provide a Google Gemini API Key. You can provide the API key various ways, depending on your use case.

1. Pass in as execute options using geminiApiKey
2. Pass in as setup options using geminiApiKey
3. Use a default key by setting an environment variable of GEMINI_API_KEY

Generally you pass the LLM instance off to an LLM Executor and call that. However, it is possible to interact with the LLM object directly, if you wanted.

// call the LLM directly with a prompt
await llm.call(prompt);

Gemini-Specific Options

In addition to the generic options, the following options are Gemini-specific and can be passed in when creating a llm function.

Option	Type	Default	Description
model	string	—	The model to use. Must be specified when using google.chat.v1. See Google Gemini Docs
geminiApiKey	string	undefined	API key for Google. See authentication
effort	string	undefined	Maps to thinkingConfig.thinkingBudget. Valid values: "minimal", "low", "medium", "high". Only supported with reasoning models (e.g. gemini-2.5-pro, gemini-2.5-flash, gemini-2.5-light).

NOTE

The Gemini provider currently maps model, geminiApiKey, and effort. Generic options like temperature, maxTokens, and topP are not mapped to the Gemini API at this time.

See Google Gemini API Reference for details.