ollama-ai-provider-v2 weekly downloads statistics

Ollama Provider V2 for Vercel AI SDK

Use Ollama with the Vercel AI SDK, implementing the official Ollama API. This provider has minimal dependencies and is web-compatible out of the box.

Support this project — Maintained in spare time and free to use under Apache-2.0. If you value this plugin and appreciate it, a donation is appreciated and helps keep it updated with new AI SDK releases.

Why Choose Ollama Provider V2?

• ✅ Minimal Dependencies - Lean codebase with just 2 core dependencies • ✅ Universal Compatibility - Works seamlessly in Node.js, browsers, and edge environments • ✅ Direct Ollama Integration - Uses official Ollama API endpoints for maximum compatibility • ✅ Advanced Features - Tool calling, streaming, thinking mode, embeddings, and completion models • ✅ Type Safety - Full TypeScript support with comprehensive type definitions • ✅ Zero Configuration - Works out-of-the-box with sensible defaults • ✅ Actively Maintained - Regular updates and AI SDK v7 compatibility

Quick Start

Core Features

Streaming Text Generation

Tool Calling Support

AI SDK 7 defaults to a single generation step. When the model calls a tool, that step ends with empty text and populated toolCalls. Set stopWhen to allow the model to execute tools and then answer.

Reasoning Mode (Thinking)

Unique feature for models that support chain-of-thought reasoning:

You can also use the Ollama-specific provider option:

Advanced Ollama Options

Access Ollama's native parameters while maintaining AI SDK compatibility:

Embeddings

Completion Models

For use cases requiring completion-style generation:

Custom Ollama Instance

Connect to remote Ollama servers or custom configurations:

Supported Models

Works with any model in your Ollama installation, including:

• Chat Models: llama3.2, mistral, phi4-mini, qwen2.5, codellama, gemma3 • Vision Models: llava, llama3.2-vision, minicpm-v • Reasoning Models: deepseek-r1:7b, deepseek-r1:1.5b, deepseek-r1:8b • Code Models: codellama:code, codellama:python, deepseek-coder-v2 • Embedding Models: nomic-embed-text, all-minilm, mxbai-embed-large

Prerequisites

1. Ollama installed and running 2. AI SDK v7 (ai@^7) 3. Node.js 22+ (required by AI SDK 7)

Upgrading from 3.x

Version 4.0.0 adds AI SDK 7 support via the Provider V4 specification.

• Requires ai@^7 and Node.js 22+ • Drops AI SDK 5/6 support • No changes to the public createOllama() / ollama() API surface

Contributing

Contributions are welcome! Here's how to get started:

1. Fork the repository 2. Install dependencies: pnpm install 3. Build the project: pnpm build 4. Run tests: pnpm test 5. Make your changes 6. Test locally: Copy dist/* to your project's node_modules/ollama-ai-provider-v2/dist 7. Submit a pull request

License

Apache-2.0 © nordwestt

See LICENSE.md for details.

Description from the npm listing.