Skip to content

Ollama (local)

Ollama lets you run AI models locally on your own machine. No API key is required and no data leaves your computer. Griptape Nodes dynamically discovers which models you have installed.

Prerequisites

  1. Download and install Ollama from ollama.com

  2. Pull at least one model. For example:

    ollama pull llama3.2

  3. Verify Ollama is running and the model is available:

    ollama list

    Ollama must be running whenever you want to use it in Griptape Nodes.

Add the Provider

  1. Open Settings → Agent Settings
  2. Click + Add Provider
  3. Select Ollama (local)

Fill in the configuration:

  • Name — leave as Ollama or enter a custom label
  • Base URL — defaults to http://localhost:11434/v1; click the refresh button to test the connection
  • When Ollama is running you'll see Connected — N models available in green
  • Model (optional) — choose a default model, or leave blank to select at chat time

Click Create Provider.

Test

After creation the wizard shows a confirmation screen. Select a model, type a test message, and verify you get a response before clicking Done.

Choosing Models

Models you've pulled with ollama pull appear automatically in:

  • The Model dropdown in the Agent, grouped under the Ollama provider name
  • The prompt model parameter on the Agent node when provider is set to Ollama

To add more models, run ollama pull <model-name> in a terminal and they'll appear immediately.