Open Source

Ollama

Run open-weight language models on your own computer

Is Ollama open source?

Yes. Ollama is open source software released under the MIT license and developed by Ollama. The source code is public in its official repository.

Advertisement

Overview

Ollama is a free and open source tool for running large language models on your own hardware. It handles the parts that make local AI awkward: downloading model files, picking settings that fit your hardware, using your GPU when one is available, and keeping models loaded in memory. You pull a model from Ollama’s library, which includes open-weight families such as Llama, Gemma, Qwen, Mistral, and DeepSeek, and run it with one command.

Ollama runs as a background service with a REST API on localhost:11434. That API is why it has become a common building block: chat front ends like Open WebUI, LibreChat, and AnythingLLM, coding agents such as OpenCode and Aider, and your own scripts can all use the same local models through it. Official Python and JavaScript libraries make that integration straightforward.

The project is released under the MIT license and developed in the open on GitHub. It runs on Linux, Windows, and macOS, and an official ollama/ollama Docker image makes it easy to run on a home server.

Key Features

  • One-command models — Download and run a model with ollama run, with sensible defaults for your hardware
  • Local REST API — A documented API on port 11434 for chat, text generation, embeddings, and model management
  • Model library — Ready-to-run builds of popular open-weight models in several sizes
  • Customization with Modelfiles — Package a model with your own system prompt and parameters under a new name
  • GPU acceleration — Uses supported NVIDIA, AMD, and Apple Silicon GPUs, and falls back to the CPU
  • Python and JavaScript libraries — Official client libraries for building on top of local models

Use Cases

  • Private chat and drafting — Keep prompts and documents on your own machine instead of a cloud service
  • Back end for other apps — Serve local models to chat interfaces, note apps, and coding agents
  • Development and testing — Prototype AI features against a free, local API before choosing a hosted provider
  • Home servers — Run models on a machine with a GPU and use them from other devices on your network

Who It’s For

Ollama is for anyone who wants to run AI models locally without managing model files by hand, from Linux users trying a first local LLM to developers who need a stable local API. It’s free with no account required. Model quality and speed depend on your hardware: small models run on an ordinary laptop, while larger ones need a capable GPU or a lot of memory.

Advertisement

This is a free alternative to: Claude

Frequently Asked Questions

How do I run Ollama on Linux?

Install it with the script or manual instructions on ollama.com, then run a model with a command such as ollama run followed by the model name. Ollama starts a local API on port 11434 that other apps can use. An official Docker image is also available.

Does Ollama work offline?

Yes. You need an internet connection to download a model the first time; after that, models run entirely on your own machine.

Does Ollama have a chat interface?

Ollama itself is mainly a command-line tool and API. For a full chat interface, pair it with a front end such as Open WebUI, LibreChat, or AnythingLLM.

Similar software: AI Assistants

AnythingLLM

Private AI app for chatting with documents, with agents and local models

AnythingLLM is a free, MIT-licensed AI app for chatting with your documents using local or cloud models, as a desktop app or a self-hosted server.

Open Source MIT

Jan

Desktop AI chat app that runs models locally or connects to cloud APIs

Jan is a free, Apache-2.0 desktop app for chatting with AI models that run on your own computer, with optional connections to cloud providers.

Open Source Apache-2.0

LibreChat

Self-hosted AI chat app for teams, with many model providers

LibreChat is a free, MIT-licensed, self-hosted AI chat app with multi-user accounts, agents, and support for Claude, OpenAI, Google, and local models.

Open Source MIT

llama.cpp

Lightweight C/C++ engine for running LLMs on local hardware

llama.cpp is an MIT-licensed C/C++ engine for running LLMs locally on CPUs and GPUs, with a command-line chat tool and an OpenAI-compatible server.

Open Source MIT

Claude

Anthropic's AI assistant for writing, analysis, and coding

Claude is Anthropic's proprietary AI assistant for writing, analysis, research, and coding, offered on the web, desktop, and mobile with free and paid plans.

Proprietary

Open WebUI

Self-hosted web interface for local and cloud AI models

Open WebUI is a self-hosted web interface for AI models that works with Ollama and OpenAI-compatible APIs, under a source-available license.

Source Available Source-available