LM Studio: Run Local LLMs with a Desktop GUI
LM Studio is the most user-friendly way to run powerful AI models entirely offline. Browse and download models from HuggingFace, chat in a polished interface, and spin up a local OpenAI-compatible API server — all without touching a terminal.
Related Products
on GumroadDeveloper Productivity Bundle
Stop rebuilding the same setup every project. 51 VSCode snippets, 40 Git aliases, 5 Docker Compose stacks, 5 GitHub Actions workflows, 5 README templates, and a dotfiles kit. Set up a professional dev environment in under an hour.
Buy on Gumroad →AI Prompt Engineering Toolkit
58 structured prompt templates for Claude, ChatGPT, and Gemini — organized by use case. Code Review, Debugging, Documentation, Architecture, and 10 model-specific tips. Stop writing prompts from scratch.
Buy on Gumroad →Developer Cheat Sheet Bundle
10 print-ready cheat sheets for the tools developers use every day: Git, Docker, Linux CLI, SQL, Regex, HTTP Status codes, VS Code shortcuts, Bash scripting, jq/JSON, and Markdown.
Buy on Gumroad →You Might Also Need
JSON Formatter & Validator
Format, beautify, and validate JSON online. Paste your JSON to instantly pretty-print it with 2-space, 4-space, or tab indentation. Minify JSON too. Free, runs in your browser.
Open free tool →
Regex Tester
Free regex tester. Test regular expressions against multiple strings with expected match/no-match assertions — see instant pass/fail results. Built-in presets for email, URL, IPv4, and phone. Pro: unl
Open free tool →
Base64 Encoder & Decoder
Free Base64 Encoder & Decoder. Convert text, images, and any file to Base64 and back. Supports URL-safe Base64, image data URIs, and file download from Base64. Runs 100% in your browser — no data sent
Open free tool →
More Free Tools
Related Articles
curl 深度使用手冊：API 測試從入門到進階
curl 是每位開發者必備的 CLI 工具。本文涵蓋 GET/POST/PUT/DELETE 請求、認證、header 設定、檔案上傳、除錯技巧，以及 REST API 測試的完整實戰範例。
Best AI Code Review Tools 2026: CodeRabbit, Sourcery, DeepCode & Bito Compared
Compare top AI code review tools for 2026: CodeRabbit, Sourcery, DeepCode, and Bito. Features, pricing, GitHub/GitLab integration, and choosing the right tool for your team.
AI Code Review Tools 2026: GitHub Copilot, CodeRabbit, Qodo Merge Ranked
Compare AI code review tools for 2026: GitHub Copilot code review, CodeRabbit, Qodo Merge, Sourcery, and PR-Agent. Pricing, accuracy, and GitHub integration.
AI Coding Tools Comparison 2026: GitHub Copilot vs Cursor vs Windsurf vs Cline
Comprehensive comparison of the best AI coding tools in 2026: GitHub Copilot, Cursor, Windsurf, and Cline. Pricing, features, model support, and real-world benchmarks.
AI Pair Programming in 2026: GitHub Copilot vs Cursor vs Claude Code
Master AI pair programming in 2026. Compare GitHub Copilot, Cursor, and Claude Code for autocomplete, chat, and agentic workflows. Includes setup guides and productivity tips.
Enjoying this tool? Get more like it.
Weekly developer tool guides, productivity playbooks & AI tricks. Free. No spam.
Unlock AI-Powered Dev Tools
- ⚡ AI Code Review, Doc Generator & SQL Builder
- ⚡ All premium templates & early access
- ⚡ Member discounts on Gumroad products
$9/mo after trial · Cancel anytime
Want the full toolkit?
Get DevPlaybook Pro
Every template, guide, boilerplate, and automation script in one bundle. 13 premium products — grab them all at once and save big.
MIT licensed · Instant download · No subscription
See what's included → Browse all deals →Installation & Setup
LM Studio is distributed as a standalone desktop app. Download from lmstudio.ai — no package manager needed. It's available for macOS (Apple Silicon + Intel), Windows, and Linux (AppImage).
# macOS (Homebrew Cask)
brew install --cask lm-studio
# Or download directly from https://lmstudio.ai
# Linux AppImage
chmod +x LM_Studio-*.AppImage
./LM_Studio-*.AppImage
# Verify installation — check version in Help > About
# Default model storage: ~/Library/Application Support/LM-Studio/models (macOS)
# Windows: C:\Users\<user>\.lmstudio\modelsDownloading GGUF Models
LM Studio's model browser connects to HuggingFace and filters for GGUF-compatible files. Search for a model name, choose a quantization level, and click Download. Key quantization levels and their trade-offs:
| Quantization | 7B File Size | RAM Needed | Quality |
|---|---|---|---|
| Q2_K | ~2.7 GB | ~5 GB | Reduced |
| Q4_K_M | ~4.1 GB | ~6 GB | Good (recommended) |
| Q5_K_M | ~5.0 GB | ~7 GB | Very good |
| Q8_0 | ~7.7 GB | ~10 GB | Near lossless |
For most users, Q4_K_M is the sweet spot — great quality at half the file size of Q8. If you have plenty of RAM/VRAM, go for Q5_K_M or Q8_0.
Running the Local API Server
LM Studio's local server is a drop-in replacement for the OpenAI API. Navigate to the Local Server tab, load a model, set your port (default: 1234), and click Start Server.
# Test the server with curl
curl http://localhost:1234/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "local-model",
"messages": [
{"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "What is a neural network?"}
],
"temperature": 0.7,
"max_tokens": 512
}'
# Python integration using openai SDK
import openai
client = openai.OpenAI(
base_url="http://localhost:1234/v1",
api_key="lm-studio" # any string works
)
response = client.chat.completions.create(
model="local-model",
messages=[{"role": "user", "content": "Explain REST APIs"}]
)
print(response.choices[0].message.content)The server also exposes /v1/models and /v1/completions endpoints for legacy apps.
Hardware Requirements by Model Size
| Model Size | Min RAM | Recommended | GPU VRAM |
|---|---|---|---|
| 1B–3B | 4 GB | 8 GB | 2 GB+ |
| 7B | 8 GB | 16 GB | 4 GB+ |
| 13B | 16 GB | 24 GB | 8 GB+ |
| 30B–34B | 32 GB | 48 GB | 16 GB+ |
| 70B+ | 64 GB | 96 GB | 48 GB+ or multi-GPU |
LM Studio vs Ollama vs Jan
| Feature | LM Studio | Ollama | Jan |
|---|---|---|---|
| GUI chat | Built-in | Via third party | Built-in |
| Model browser | HuggingFace | ollama.com | Jan Hub |
| CLI / scripting | Limited | Excellent | Basic |
| OpenAI API | Yes (port 1234) | Yes (port 11434) | Yes (port 1337) |
| Extensions | No | No | Yes |
| Best for | GUI experimentation | Developer integration | Privacy + extensions |
Frequently Asked Questions
What is LM Studio and what makes it different?▼
LM Studio is a free desktop application for running GGUF-format LLMs locally on macOS, Windows, and Linux. Unlike CLI tools like Ollama, LM Studio provides a graphical chat interface, an in-app model browser connected to HuggingFace, and a visual local server panel — all in one app. It's ideal for users who want to experiment with local AI without touching a terminal.
What hardware do I need for LM Studio?▼
Minimum: 8 GB RAM for 7B models, 16 GB for 13B models, 32 GB+ for 30B+ models. GPU acceleration is optional but strongly recommended: NVIDIA GPUs use CUDA (4 GB+ VRAM for 7B), Apple Silicon uses Metal (M1/M2/M3/M4 are excellent). Without a GPU, LM Studio falls back to CPU inference — functional but slow (1–5 tokens/sec for 7B models).
What is GGUF format?▼
GGUF (GPT-Generated Unified Format) is the standard file format for quantized LLMs used by llama.cpp and tools built on it (including LM Studio and Ollama). Quantization reduces model precision (e.g., Q4_K_M = 4-bit quantization) to shrink file size and RAM usage at minimal quality loss. A 7B model at Q4_K_M is about 4.1 GB vs ~14 GB for the full-precision version.
How do I use LM Studio as an OpenAI-compatible API?▼
In LM Studio, go to the 'Local Server' tab, load a model, and click 'Start Server'. It runs on http://localhost:1234/v1 by default and implements the OpenAI Chat Completions API. Point any OpenAI SDK at this URL with api_key='lm-studio'. This lets your existing apps, LangChain pipelines, or custom scripts use local models without code changes.
Can LM Studio run multiple models simultaneously?▼
LM Studio supports loading multiple models and switching between them, but running them truly in parallel requires enough RAM/VRAM to hold all models. In practice, most users run one model at a time. The local server can serve one active model at a time. For true multi-model routing, tools like LocalAI or a custom proxy layer are better suited.
LM Studio vs Ollama — which should I use?▼
Choose LM Studio if you want a GUI, built-in chat, and easy model browsing without using a terminal. Choose Ollama if you're a developer who wants a scriptable CLI, headless server mode, and easy integration into apps via its API. Both support GGUF models and OpenAI-compatible APIs. Many developers use Ollama for production app integration and LM Studio for quick model testing.
Related Products
on GumroadAI Prompt Engineering Toolkit
58 structured prompt templates for Claude, ChatGPT, and Gemini — organized by use case. Code Review, Debugging, Documentation, Architecture, and 10 model-specific tips. Stop writing prompts from scratch.
Buy on Gumroad →AI Developer Prompts Pack
55 battle-tested prompt templates for the workflows developers actually use: code review, debugging, architecture, documentation, and testing. Stop writing prompts from scratch.
Buy on Gumroad →Developer Productivity Bundle
Stop rebuilding the same setup every project. 51 VSCode snippets, 40 Git aliases, 5 Docker Compose stacks, 5 GitHub Actions workflows, 5 README templates, and a dotfiles kit. Set up a professional dev environment in under an hour.
Buy on Gumroad →You Might Also Need
AI Hallucination Detector
Scan LLM-generated text for hallucination risk signals: fabricated citations, overconfident claims, suspect statistics, and verification gaps. Risk score 0-100 with highlighted problem spans.
Open free tool →
AI Safety Checklist Generator
Generate a customized AI safety evaluation checklist for your deployment. Covers technical safety, content moderation, security, bias, privacy, and regulatory compliance. Export to Markdown.
Open free tool →
CrewAI Agent Config Generator
Build CrewAI agent configurations visually. Define roles, goals, backstories, and tools. Generate YAML or Python code for multi-agent crews.
Open free tool →
More Free Tools
Related Articles
LLM Observability Tools 2026: OpenTelemetry, Langfuse, Arize Phoenix Compared
Compare LLM observability tools for 2026: Langfuse, Arize Phoenix, Helicone, LangSmith, and OpenTelemetry for LLMs. Tracing, evals, cost tracking, and self-hosting options.
Prompt Engineering Techniques 2026: Chain-of-Thought, RAG, and Advanced Patterns
Advanced prompt engineering guide for 2026: Chain-of-Thought, Tree-of-Thought, RAG integration, few-shot learning, prompt chaining, and evaluation techniques.
LLM Observability 2026: LangSmith vs Helicone vs Arize Phoenix Compared
Complete guide to LLM observability platforms in 2026. Compare LangSmith, Helicone, and Arize Phoenix for tracing, evaluation, cost tracking, and debugging AI applications in production.
Prompt Engineering Techniques 2026: Chain-of-Thought, Few-Shot, and RAG Patterns
Master practical prompt engineering in 2026. Learn chain-of-thought prompting, few-shot examples, RAG integration patterns, and advanced techniques like tree-of-thought and self-consistency with real code examples.
AI Observability in 2026: How to Monitor, Debug, and Improve LLM Applications
A comprehensive guide to AI observability for LLM applications: key metrics, tool comparisons (Langfuse, Helicone, Arize Phoenix, LangSmith), tracing code examples, evaluation frameworks, and production best practices for debugging and cost control.
Enjoying this tool? Get more like it.
Weekly developer tool guides, productivity playbooks & AI tricks. Free. No spam.
Unlock AI-Powered Dev Tools
- ⚡ AI Code Review, Doc Generator & SQL Builder
- ⚡ All premium templates & early access
- ⚡ Member discounts on Gumroad products
$9/mo after trial · Cancel anytime
Want the full toolkit?
Get DevPlaybook Pro
Every template, guide, boilerplate, and automation script in one bundle. 13 premium products — grab them all at once and save big.
MIT licensed · Instant download · No subscription
See what's included → Browse all deals →