Advertisement

Claude is Anthropic's proprietary AI assistant for writing, analysis, research, and coding, offered on the web, desktop, and mobile with free and paid plans. Full details →

Switching from Claude to an open source assistant is mainly about where your data goes and who controls the software. Every Claude conversation is processed on Anthropic’s servers under Anthropic’s terms, while the tools below can run open-weight language models entirely on your own computer or server: prompts and documents never leave your hardware, there’s no subscription or usage cap, and they keep working offline. They also let you choose and switch between models freely instead of being tied to one vendor’s lineup.

The honest trade-off is capability and hardware. Open-weight models that run on a typical laptop are noticeably less capable than Claude’s largest models on complex reasoning and long, multi-step work, and larger local models need a strong GPU or a lot of memory to run at a comfortable speed. Many people end up mixing the two: a local model for private or routine work, and a cloud model, Claude included, when a task needs more. Several of these apps make that easy by supporting both in one interface.

Advertisement

6 Open Source Alternatives to Claude

  1. Jan

    A Claude-style desktop chat app that runs models on your computer

    Jan is a free, Apache-2.0 desktop app for chatting with AI models that run on your own computer, with optional connections to cloud providers.

    What you gain over Claude
    Private, offline chats with open-weight models, no account, and the option to add cloud models (including Claude, with your own API key) in the same app.
    Trade-offs
    Local models are generally less capable than Claude’s largest models, and speed depends on your hardware.
    Switching
    Install Jan, download a model sized for your RAM or GPU from its hub, and start chatting; add an Anthropic API key if you still want Claude for some tasks.

    Jan: features, platforms, and license →

  2. Ollama

    Running local models for the command line and other apps

    Ollama is a free, MIT-licensed tool for downloading and running open-weight LLMs locally, with a command line and an API other apps connect to.

    What you gain over Claude
    A free local API that chat apps, coding agents, and your own scripts can share, with one-command model downloads.
    Trade-offs
    Mainly a command-line tool; for a full chat interface you add a front end such as Open WebUI, LibreChat, or AnythingLLM.

    Ollama: features, platforms, and license →

  3. LibreChat

    A self-hosted, multi-user AI chat service for teams

    LibreChat is a free, MIT-licensed, self-hosted AI chat app with multi-user accounts, agents, and support for Claude, OpenAI, Google, and local models.

    What you gain over Claude
    One interface for a whole team, with accounts, agents, and both local and cloud models, including Claude through Anthropic’s API.
    Trade-offs
    You run and maintain a Docker deployment, and cloud model usage is billed by each provider.

    LibreChat: features, platforms, and license →

  4. AnythingLLM

    Chatting with your own documents, privately

    AnythingLLM is a free, MIT-licensed AI app for chatting with your documents using local or cloud models, as a desktop app or a self-hosted server.

    What you gain over Claude
    Workspaces that answer from your files with citations, running locally by default.
    Trade-offs
    Built around documents and agents rather than open-ended chat; multi-user features need the Docker version.

    AnythingLLM: features, platforms, and license →

  5. llama.cpp

    Maximum control and performance on your own hardware

    llama.cpp is an MIT-licensed C/C++ engine for running LLMs locally on CPUs and GPUs, with a command-line chat tool and an OpenAI-compatible server.

    What you gain over Claude
    The engine many local AI apps are built on, with fine-grained control over models, quantization, and GPU use.
    Trade-offs
    Command-line and API only, aimed at technical users.

    llama.cpp: features, platforms, and license →

  6. Open WebUI

    A polished self-hosted web UI for Ollama (source-available)

    Open WebUI is a self-hosted web interface for AI models that works with Ollama and OpenAI-compatible APIs, under a source-available license.

    What you gain over Claude
    A full-featured browser interface for local and cloud models, popular on home servers.
    Trade-offs
    Source-available rather than open source: larger deployments can’t remove its branding without permission.

    Open WebUI: features, platforms, and license →

Feature Comparison

Alternative Interface Runs models locally Multi-user License
Jan Desktop app Yes No Apache-2.0
Ollama Command line and local API Yes Shared API on a server MIT
LibreChat Self-hosted web app Through Ollama or llama.cpp Yes MIT
AnythingLLM Desktop app or self-hosted server Yes (built-in engine) Yes (Docker version) MIT
llama.cpp Command line and API server Yes Shared API on a server MIT
Open WebUI Self-hosted web app and desktop app Through Ollama Yes Source-available

Frequently Asked Questions

Is Claude open source?

No. Claude’s models and apps are proprietary to Anthropic, and its model weights aren’t published. See the Claude page for details.

Is there an open source alternative to Claude?

There’s no open source equivalent of Claude’s own models, but open source apps such as Jan and Ollama run open-weight models, such as Llama, Qwen, Gemma, and Mistral, on your own computer for free.

Can I run an AI assistant offline?

Yes. Jan, Ollama, AnythingLLM, and llama.cpp all run models locally; you only need the internet to download a model. Small models run on an ordinary laptop, while larger ones need a capable GPU or plenty of memory.

Can I keep using Claude models in an open source app?

Yes. LibreChat and Jan both support Anthropic as a provider with your own API key, so you can use Claude and local models side by side. Those Claude chats are still processed by Anthropic.

What about coding?

For an alternative to Claude’s coding tool specifically, see open source alternatives to Claude Code.