MCPcopy
hub / github.com/unslothai/unsloth

github.com/unslothai/unsloth @v0.1.471-beta sqlite

repository ↗ · DeepWiki ↗ · release v0.1.471-beta ↗ · compare 2 versions
18,759 symbols 67,374 edges 1,454 files 4,513 documented · 24%
README

Unsloth logo

Unsloth Studio lets you run and train models locally.

FeaturesQuickstartNotebooksDocumentation

unsloth studio ui homepage

⚡ Get started

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Windows:

irm https://unsloth.ai/install.ps1 | iex

Community:

⭐ Features

Unsloth Studio (Beta) lets you run and train text, audio, embedding, vision models on Windows, Linux and macOS.

Inference

Training

  • Train and RL 500+ models up to 2x faster with up to 70% less VRAM, with no accuracy loss.
  • Custom Triton and mathematical kernels. See some collabs we did with PyTorch and Hugging Face.
  • Data Recipes: Auto-create datasets from PDF, CSV, DOCX etc. Edit data in a visual-node workflow.
  • Reinforcement Learning (RL): The most efficient RL library, using 80% less VRAM for GRPO, FP8 etc.
  • Supports full fine-tuning, RL, pretraining, 4-bit, 16-bit and, FP8 training.
  • Observability: Monitor training live, track loss and GPU usage and customize graphs.
  • Multi-GPU training is supported, with major improvements coming soon.

📥 Install

Unsloth can be used in two ways: through Unsloth Studio, the web UI, or through Unsloth Core, the code-based version. Each has different requirements.

Unsloth Studio (web UI)

Unsloth Studio (Beta) works on Windows, Linux, WSL and macOS.

  • CPU: Supported for Chat and Data Recipes currently
  • NVIDIA: Training works on RTX 30/40/50, Blackwell, DGX Spark, Station and more
  • macOS: Training, MLX and GGUF inference are ALL supported.
  • AMD: Chat + Data works. Train with Unsloth Core. Studio support is out soon.
  • Multi-GPU: Available now, with a major upgrade on the way

macOS, Linux, WSL:

curl -fsSL https://unsloth.ai/install.sh | sh

Use the same command to update.

Windows:

irm https://unsloth.ai/install.ps1 | iex

Use the same command to update.

Launch

unsloth studio -p 8888

For cloud or global access, add -H 0.0.0.0. By default, Unsloth is accessible only locally.

For a secure HTTPS link instead of a raw network port, use unsloth studio --secure. Studio stays bound to localhost and is served only through a free Cloudflare HTTPS tunnel (it fails closed if the tunnel can't start, so the raw port is never exposed).

Docker

Use our Docker image unsloth/unsloth container. Run:

docker run -d -e JUPYTER_PASSWORD="mypassword" \
  -p 8888:8888 -p 8000:8000 -p 2222:22 \
  -v $(pwd)/work:/workspace/work \
  --gpus all \
  unsloth/unsloth
  ```

#### Developer, Nightly, Uninstall
To see developer, nightly and uninstallation etc. instructions, see [advanced installation](#-advanced-installation).

### Unsloth Core (code-based)
#### Linux, WSL:
```bash
curl -LsSf https://astral.sh/uv/install.sh | sh
uv venv unsloth_env --python 3.13
source unsloth_env/bin/activate
uv pip install unsloth --torch-backend=auto

Windows:

winget install -e --id Python.Python.3.13
winget install --id=astral-sh.uv  -e
uv venv unsloth_env --python 3.13
.\unsloth_env\Scripts\activate
uv pip install unsloth --torch-backend=auto

For Windows, pip install unsloth works only if you have PyTorch installed. Read our Windows Guide. You can use the same Docker image as Unsloth Studio.

AMD, Intel:

For RTX 50x, B200, 6000 GPUs: uv pip install unsloth --torch-backend=auto. Read our guides for: Blackwell and DGX Spark.

To install Unsloth on AMD and Intel GPUs, follow our AMD Guide and Intel Guide.

📒 Free Notebooks

Train for free with our notebooks. You can use our new free Unsloth Studio notebook to run and train models for free in a web UI. Read our guide. Add dataset, run, then deploy your trained model.

Model Free Notebooks Performance Memory use
Gemma 4 (E2B) ▶️ Start for free 1.5x faster 50% less
Qwen3.5 (4B) ▶️ Start for free 1.5x faster 60% less
gpt-oss (20B) ▶️ Start for free 2x faster 70% less
Qwen3.5 GSPO ▶️ Start for free 2x faster 70% less
gpt-oss (20B): GRPO ▶️ Start for free 2x faster 80% less
Qwen3: Advanced GRPO ▶️ Start for free 2x faster 70% less
embeddinggemma (300M) ▶️ Start for free 2x faster 20% less
Mistral Ministral 3 (3B) ▶️ Start for free 1.5x faster 60% less
Llama 3.1 (8B) Alpaca ▶️ Start for free 2x faster 70% less
Llama 3.2 Conversational ▶️ Start for free 2x faster 70% less
Orpheus-TTS (3B) ▶️ Start for free 1.5x faster 50% less

🦥 Unsloth News

  • Connections: Connect any API provider (OpenAI, Anthropic) or server (vLLM, Ollama). Guide
  • MTP: Run Qwen3.6 MTP in Unsloth. MTP settings are autoset specific to your hardware. Guide
  • API inference endpoint: Deploy and run local LLMs in Claude Code, Codex tools. Guide
  • Qwen3.6: Qwen3.6-35B-A3B can now be trained and run in Unsloth Studio. Blog
  • Gemma 4: Run and train Google’s new models directly in Unsloth. Blog
  • Introducing Unsloth Studio: our new web UI for running and training LLMs. Blog
  • Qwen3.5 - 0.8B, 2B, 4B, 9B, 27B, 35-A3B, 112B-A10B are now supported. Guide + notebooks
  • Train MoE LLMs 12x faster with 35% less VRAM - DeepSeek, GLM, Qwen and gpt-oss. Blog
  • Embedding models: Unsloth now supports ~1.8-3.3x faster embedding fine-tuning. BlogNotebooks
  • New 7x longer context RL vs. all other setups, via our new batching algorithms. Blog
  • New RoPE & MLP Triton Kernels & Padding Free + Packing: 3x faster training & 30% less VRAM. Blog
  • 500K Context: Training a 20B model with >500K context is now possible on an 80GB GPU. Blog
  • FP8 & Vision RL: You can now do FP8 & VLM GRPO on consumer GPUs. FP8 BlogVision RL

📥 Advanced Installation

The below advanced instructions are for Unsloth Studio. For Unsloth Core advanced installation, view our docs.

Developer / Nightly / Experimental installs: macOS, Linux, WSL:

The developer install builds from the main branch, which is the latest (nightly) source.

git clone https://github.com/unslothai/unsloth
cd unsloth
./install.sh --local
unsloth studio -p 8888

To install into an isolated location (its own virtual env, auth/, studio.db, cache and llama.cpp build), set UNSLOTH_STUDIO_HOME and pass it again at launch:

UNSLOTH_STUDIO_HOME="$PWD/.studio" ./install.sh --local
UNSLOTH_STUDIO_HOME="$PWD/.studio" unsloth studio -p 8888

Then to update :

cd unsloth && git pull
./install.sh --local
unsloth studio -p 8888

Developer / Nightly / Experimental installs: Windows PowerShell:

The developer install builds from the main branch, which is the latest (nightly) source.

git clone https://github.com/unslothai/unsloth.git
cd unsloth
Set-ExecutionPolicy -Scope Process -ExecutionPolicy Bypass
.\install.ps1 --local
unsloth studio -p 8888

To install into an isolated locat

Extension points exported contracts — how you extend this code

SpeechRecognitionResultList (Interface)
* Minimal Web Speech API (Speech Recognition) types for browsers that support it. * Full types: @types/dom-speech-recog
studio/frontend/src/speech-recognition.d.ts
CodeExecutionArgs (Interface)
* Renders synthetic `_toolEvent` chunks from `_stream_anthropic` for the * `code_execution_20250825` tool. The backend
studio/frontend/src/components/assistant-ui/tool-ui-code-execution.tsx
ImageGenerationArgs (Interface)
* Renders the synthetic `_toolEvent` chunks emitted by * `_stream_openai_responses` when OpenAI's Responses-API `image_
studio/frontend/src/components/assistant-ui/tool-ui-image-generation.tsx
Tombstone (Interface)
* Tombstones mask deleted threads in the Dexie read fallback. Each carries a * `deletedAt` so old entries can be GC'd,
studio/frontend/src/features/chat/utils/chat-thread-tombstones.ts
ServerUsage (Interface)
Server-side usage data from llama-server (via stream_options.include_usage).
studio/frontend/src/features/chat/api/chat-adapter.ts

Core symbols most depended-on inside this repo

get
called by 1638
studio/backend/core/inference/api_monitor.py
set
called by 694
studio/frontend/src/features/chat/chat-settings-sheet.tsx
Field
called by 639
studio/frontend/src/components/ui/field.tsx
cn
called by 616
studio/frontend/src/lib/utils.ts
list
called by 429
studio/frontend/src/features/chat/runtime-provider.tsx
filter
called by 397
studio/backend/run.py
has
called by 280
studio/frontend/src/features/hub/lib/lru-map.ts
get
called by 240
studio/backend/plugins/data-designer-github-repo-seed/src/data_designer_github_repo_seed/scraper_impl/state_store.py

Shape

Function 11,943
Method 4,805
Class 1,376
Interface 339
Route 296

Languages

Python79%
TypeScript21%

Modules by API surface

tests/studio/install/test_rocm_support.py400 symbols
tests/studio/install/test_selection_logic.py322 symbols
studio/backend/tests/test_transformers_version.py270 symbols
studio/install_llama_prebuilt.py236 symbols
studio/backend/routes/inference.py235 symbols
studio/backend/core/inference/llama_cpp.py222 symbols
studio/backend/tests/test_openai_tool_passthrough.py214 symbols
studio/backend/tests/test_vram_estimation.py197 symbols
studio/backend/tests/test_gemini_provider.py168 symbols
studio/backend/tests/test_kv_cache_estimation.py160 symbols
unsloth/import_fixes.py151 symbols
studio/backend/tests/test_anthropic_messages.py130 symbols

Dependencies from manifests, versioned

@assistant-ui/core0.1.17 · 1×
@assistant-ui/react0.12.28 · 1×
@assistant-ui/tap0.5.10 · 1×
@base-ui/react1.2.0 · 1×
@biomejs/biome1.9.4 · 1×
@dagrejs/dagre2.0.4 · 1×
@dagrejs/graphlib3.0.4 · 1×
@eslint/js9.39.1 · 1×
@fontsource-variable/figtree5.2.10 · 1×
@fontsource-variable/space-grotesk5.2.10 · 1×
@hugeicons/core-free-icons4.1.1 · 1×

Datastores touched

appDatabase · 1 repos

For agents

$ claude mcp add unsloth \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact