Jan screenshot

What is Jan?

Jan is an open-source AI chat application designed to run entirely on your own computer, without sending data to external servers. It functions as a privacy-focused alternative to ChatGPT, letting you download and run large language models locally on desktop or mobile devices. You can use models like Llama3, Gemma3, and Mistral, or connect to cloud-based services through API keys if you prefer. The tool includes built-in features for handling complex tasks over multiple steps, understanding different types of content like text and images, and automating workflows. Because everything runs on your device, your conversations and data stay under your control. Jan is particularly useful for people who need AI capabilities but want to keep sensitive information private, or who work in environments where data cannot leave the organisation.

Key Features

Local model support

Download and run open-source models like Llama3, Gemma3, and Mistral directly on your device

Offline operation

Full functionality without internet connection; no data sent to external servers

OpenAI-compatible API

Run Jan as a local API server compatible with tools built for OpenAI's interface

Extension system

Add custom functionality using a VSCode-like extension architecture

Multimodal capabilities

Process text, images, and other content types with Jan's built-in models

Cloud provider integration

Optionally connect to cloud-based AI services via API keys when needed

Pros & Cons

Advantages

  • Complete data privacy; all processing happens on your device with no external data transmission
  • No subscription required; open-source and free to use indefinitely
  • Works offline; you can use AI tools without internet access
  • Flexible model choices; switch between local models or cloud providers based on your needs
  • Developer-friendly; includes local API server and extension support for integration into other tools

Limitations

  • Requires sufficient local hardware; running larger models demands significant RAM and processing power
  • Slower performance compared to cloud-based AI services, depending on your device capabilities
  • Steeper learning curve for non-technical users; more setup required than using ChatGPT directly

Use Cases

Processing confidential documents or sensitive business information without external transmission

Running AI workflows in environments with strict data governance requirements

Building custom AI applications using the local API server

Working offline in locations without reliable internet connectivity

Reducing costs by avoiding API fees from cloud-based AI providers