Blog

The latest updates from Jan. See Changelog for more product updates.

May 10, 2025

Best Settings to Run Qwen3-30B-A3B Locally

If you're running Qwen3-30B-A3B locally, don't guess your way through the settings. This guide tells you what actually works based on Qwen's own documentation and what we've seen hold up in practice.

guides Read article →

February 8, 2025

Offline ChatGPT: You can't run ChatGPT offline, do this instead

Learn how to use AI offline with Jan - a free, open-source alternative to ChatGPT that works 100% offline on your computer.

guides Read article →

January 31, 2025

Run DeepSeek R1 locally on your device (Beginner-Friendly Guide)

A straightforward guide to running DeepSeek R1 locally regardless of your background.

guides Read article →

January 31, 2025

How to run AI models locally as a beginner?

A straightforward guide to running AI models locally on your computer, regardless of your background.

guides Read article →

April 29, 2024

Benchmarking NVIDIA TensorRT-LLM

This post compares the performance of TensorRT-LLM and llama.cpp on consumer NVIDIA GPUs, highlighting the trade-offs among speed, resource usage, and convenience.

research Read article →

March 25, 2024

The Invisible Moat around Open-Source LLM

Uncover the pivotal role of data ownership in training the next iteration of LLM.

research Read article →

March 25, 2024

RAG is not enough: Lessons from Beating GPT-3.5 on Specialized Tasks with Mistral 7B

We present a straightforward approach to customizing small, open-source models using fine-tuning and RAG that outperforms GPT-3.5 for specialized use cases.

research Read article →

January 10, 2024

Bitdefender False Positive Flag

10th January 2024, Jan's 0.4.4 Release on Windows triggered Bitdefender to incorrectly flag it as infected with Gen:Variant.Tedy.258323, leading to automatic quarantine warnings on users' computers.

building-jan Read article →