1. Summary
Qwen3.8-27B is a dense vision-language model with 27B parameters based on the Qwen3.5 architecture. According to the Hugging Face Model Card, it achieves significant performance improvements over the previous generation in coding, research, and agent tasks.
It natively supports image and video understanding and features thought control.
Regarding quantized build performance, it has been reported that the 4-bit Q4_K_M quantization can maintain performance equivalent to the full model in specific benchmarks. On the other hand, performance degrades significantly at 1-bit.
Within the community, discussions have occurred regarding its practicality on devices such as the Mac Studio, as well as its output redundancy and inference speed. Mention has also been made of the impact that default thought control settings have on token consumption.
2. Bunrin Bench (BUNRIN LABO Original Test)
Results of the "Bunrin Bench" automated scoring benchmark (covering 7 categories including output contracts, fact retention, instruction following, and code traps) developed by we, conducted on local hardware. For the methodology, refer to About Bunrin Bench.
| Target | Test Version | Total | Contract | Number | Constraint | Hearsay | Code | Non-Fabrication | Title | Speed | Test Date |
|---|---|---|---|---|---|---|---|---|---|---|---|
| qwen3.8-27b-mtp (MacBook Pro (M5 Max, 128GB)) | ijiwaru-v1 | 35/41 (85%) | 2/3 | 9/9 | 3/6 | 3/3 | 11/11 | 5/5 | 2/4 | 49.1 tok/s | 2026-09-03 |
Testing Environment:
- qwen3.8-27b-mtp — Model: root4k/Huihui-Qwen3.8-27B-abliterated-oQ6e-mtp (MLX version). Runtime: oMLX 0.6.4 (mlx 0.32.2, mlx-lm 0.31.3). Sampling: temperature 1 / top_p 0.95 / top_k 20 / min_p 0.08 / presence_penalty 0
3. Various Benchmarks
The values listed on the Hugging Face Model Card are as follows:
| Category | Benchmark | Qwen3.8-27B | Qwen3.6-27B | Qwen3.7-Plus | Muse Glimmer-30B | Opus4.6 Max |
|---|---|---|---|---|---|---|
| Coding | Terminal Bench 2.1 | 73.0 | 63.4 | 64.0 | 51.7 | 78.2 |
| Coding | SWE-bench Pro | 61.7 | 53.5 | 57.6 | 51.2 | 53.4 |
| Coding | NL2Repo-Bench | 42.3 | 36.2 | 41.1 | -- | 47.6 |
| Coding | DeepSWE 1.1 | 42.2 | 13.3 | 14.2 | -- | -- |
| Coding | QwenSWEBench | 79.0 | 49.3 | 59.2 | -- | 63.8 |
Additionally, the evaluation results from Artificial Analysis are as follows:
| Metric | Value |
|---|---|
| Intelligence Index | 52 |
4. Official announcements
- According to the Hugging Face Model Card, Qwen3.8 is stated to be the most capable generation within the Qwen family.
- The same card indicates that a hosted version via Qwen Cloud is "coming soon."
5. Real-world performance (Community reception)
Artificial Analysis reported that the model scored 52 on the Intelligence Index. On the other hand, it was pointed out that the output is very redundant and the inference speed is slow at 47 tokens/s.
According to reports from Hacker News, the 17GB Q4_K_M quantized build maintains performance equivalent to the full model in Terminal-Bench 2.1. This allows the model to operate in environments with 24GB of VRAM, such as the RTX 4090, while retaining a context of approximately 64k tokens. However, performance drops significantly at 1-bit.
Simon Willison stated that after testing the Q4_K_M version in LM Studio and other tools, the default reasoning_effort (xhigh) setting consumes a vast number of tokens even for trivial problems.
According to Terminal Bytes, smooth operation is possible on Mac Studio through memory residency. The site provided examples of the model being utilized for everyday tasks, such as summarizing RSS feeds and organizing PDF files.
Users on Reddit mentioned an improvement in autonomous coding capabilities using screenshots. Additionally, a user on Reddit reported a case of creating a Minecraft clone using Q4 quantized build.
The llama.cpp release reported optimizations regarding KV cache restoration. This significantly reduces the time required to restore non-contiguous cells. Furthermore, the argument --tensor-read-lazy has been changed to --lazy-mode.
A user on Reddit pointed out that reducing thinking time in certain fine-tuned versions led to a decline in performance. Meanwhile, a user on Reddit mentioned the speed in an environment using two R9700s.
Additionally, users on Reddit are discussing the repetition_penalty=1.0 setting.
6. Recommended parameters
- The settings listed on the Hugging Face Model Card are as follows:
- thinking mode: On by default. Can be disabled per request.
reasoning_effort: Adjusts the depth of inference.preserve_thinking: Retains inference context from history messages.
7. Sources
Hugging Face Model Card (Official)
b10700 (llama.cpp, 2026-08-31)
b10699 (llama.cpp, 2026-08-31)
v0.6.16 (MLX-VLM, 2026-08-25)
Qwen3.8-27B "Unhacked" my PC (Reddit r/LocalLLaMA, 2026-09-06)
God damnit buun, there’s no binaries on your site: A Pragmatic Guide to Local Agentic LLMs (Reddit r/LocalLLaMA, 2026-09-06)
Is 3090 + 5070 & 5060s a good idea? (Reddit r/LocalLLaMA, 2026-09-06)
NInfer vs llama.cpp vs vLLM: quality + speed comparison for Qwen3.8-27B NVFP4 on RTX 5090 (Reddit r/LocalLLaMA, 2026-09-05)
AA Update! Here's how the Frontier ranks. (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8-27B on 2× RTX 5070 Ti 16GB — llama.cpp vs vLLM vs NInfer benchmarks (Reddit r/LocalLLaMA, 2026-09-05)
local vibecoding with Qwen 3.8 27B and Godot (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8 27B on Strix - the optimized setup (Reddit r/LocalLLaMA, 2026-09-05)
Which quant of qwen3.8 27b is the best for 16gb vram to get 100+ ctx and perfect for local Vibecoding? (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8 27b for agentic coding and next .... what? (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8-27B beat the Wikipedia game in 6 clicks. (Reddit r/LocalLLaMA, 2026-09-05)
Help me understand gguf size/ctx size (Reddit r/LocalLLaMA, 2026-09-05)
How to estimate tokens/sec for your hardware (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8 27B on RX 7900 XTX: Ollama ROCm vs llama.cpp Vulkan results (Reddit r/LocalLLaMA, 2026-09-05)
I benchmarked 21 Qwen3.8 27B variants on 16GB VRAM (Reddit r/LocalLLaMA, 2026-09-05)
Qwen3.8-27b is the first Local model im able to blindly trust (Reddit r/LocalLLaMA, 2026-09-05)
Even Qwen3.8 followed the instruction inside my translation data, and Gemma 4 beat the translation specialists I tested (Reddit r/LocalLLaMA, 2026-09-04)
We open-sourced Paddock, our Rust/C++ inference engine with its own CUDA kernels (MIT/Apache-2.0) (Reddit r/LocalLLaMA, 2026-09-04)
UPDATE: Qwen3.8-Flash-Next on 2x3090 + DDR4 (Part 2): 25-29 -> 37-41 t/s decode (UD-Q4_K_XL + expert cache + MTP), plus (Reddit r/LocalLLaMA, 2026-09-04)
Qwen 3.8 27B Vs. Qwen 3.6 27B on oMLX (Reddit r/LocalLLaMA, 2026-09-04)
Qwen3.8-27B at ~130 tok/s with full 262k context, on Kaggle's free TPU. OpenAI-compatible endpoint. (Reddit r/LocalLLaMA, 2026-09-04)
OrcaRouter begins providing frontier models including Google "Gemini 3.8 Flash," Alibaba "Qwen3.8 Max," and Anthropic "Claude Fable 5.1" - PR TIMES (Google News: Gemini, 2026-09-03)
Any more t/s maxxing I could do? 4060 TI 16GB, 32GB system RAM (Reddit r/LocalLLaMA, 2026-09-03)
MXFP4 quant for Qwen 3.8, llama.cpp supported? (Reddit r/LocalLLaMA, 2026-09-03)
Qwen3.8 27B Q8 hallucinated entire plan??? (Reddit r/LocalLLaMA, 2026-09-03)
ZCode Desktop App seems make qwen3.8 better? (Reddit r/LocalLLaMA, 2026-09-03)
DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored is a disappointment (Reddit r/LocalLLaMA, 2026-09-03)
Mac Heads: Is there any point to MLX in September 2026? (Reddit r/LocalLLaMA, 2026-09-03)
Mushroom hunting with LLMs: what can go wrong? (Hacker News Frontpage, 2026-09-03)
Suggested Qwen 3.8 config is repetition_penalty=1.0 but in coding repetitions are normal so what? (Reddit r/LocalLLaMA, 2026-09-03)
First local-LLM tuning attempt: Qwen3.8-27B true Q4_K_M at 13.2 tok/s near 50-61K context on RTX 5080 16GB (Reddit r/LocalLLaMA, 2026-09-02)
Do we forget about another Qwen model for a while now ? (Reddit r/LocalLLaMA, 2026-09-02)
LLMs: Intelligence vs. Cost (Hacker News Frontpage, 2026-09-02)
Your favorite fastest abliterated/safety removed 3.6 and 3.8 27b? (Reddit r/LocalLLaMA, 2026-09-02)
How I got 280 tok/s on Qwen3.8 27B on 2xr9700's and 940k tokens kv cache (Reddit r/LocalLLaMA, 2026-09-02)
Kaitchup posted Qwen3.8 27B Benchmarks for quants from Q4 to Q1 (Reddit r/LocalLLaMA, 2026-09-02)
Please help me decide my next hardware upgrade path (Reddit r/LocalLLaMA, 2026-09-01)
All currently popular local models in one table + Opus 4.8 results (Reddit r/LocalLLaMA, 2026-09-01)
I pushed Qwen3.8-27B to 2.000 prefill per second and 132 decode per second on A RTX 3090. (Reddit r/LocalLLaMA, 2026-09-01)
Which current local models that can run within 128GB generate the best SVG pelicans? (Reddit r/LocalLLaMA, 2026-09-01)
Don't sleep on Vision support for coding! (Reddit r/LocalLLaMA, 2026-09-01)
b10724 (llama.cpp, 2026-09-01)
The Chrono Trigger plot challenge - Crono awakens in his modest bedroom of 2095... (Reddit r/LocalLLaMA, 2026-08-31)
How bad do you think models like Qwen3.8-27B or GLM-5.3-Flash would be with H-Neurons disabled? (Reddit r/LocalLLaMA, 2026-08-31)
Does it make sense to quantize Qwen 3.8 myself when UD 3.0 exists? (Reddit r/LocalLLaMA, 2026-08-31)
How I got Qwen 3.8 27b running at ~75t/s decode on 16GB RTX 5080 (Reddit r/LocalLLaMA, 2026-08-31)
OrcaRouter releases "GLM-5.3-MLX", enabling a massive 1.5TB+ LLM "GLM-5.3" to run on a single Mac - PR TIMES (Google News: MLX, 2026-08-31)
Tencent releases AI model "Hy4 preview," outperforming GPT-5.6 Sol in some tests; 1-bit quantized build reduced to 213GB also released (GIGAZINE, 2026-08-31)
Qwen3.8-Flash-Next-NVFP4 vs Qwen3.8-27B-FP Test Results (Reddit r/LocalLLaMA, 2026-08-31)
Analyzing the new "Mac mini" and "Mac Studio": Changing positions in the era of local AI [Soka Nishida's Ima Tomirai] - watch.impress.co.jp (Google News: Mac mini LLM, 2026-08-31)
Some people said the Minecraft clone I fully vibecoded with Qwen3.8-27B Q4 is not that impressive because Minecraft is i (Reddit r/LocalLLaMA, 2026-08-30)
Creating this much for free! Local verification and explanation of MiniMax Music 3 music generation - YouTube (Google News: MiniMax, 2026-08-29)
Run Qwen3.8 27B locally: real numbers from my Mac Studio (HN 138pt, 99 comments) (HN Search (backfill), 2026-08-29)
OrcaRouter releases "Qwen3.8-Flash-Next-Uncensored," a model for security research based on the Alibaba-developed LLM "Qwen3.8-Flash-Next" - PR TIMES (Google News: MLX, 2026-08-28)
OrcaRouter releases MLX quantized build for Apple Silicon for the 320B-class open-weight LLM "GLM-5.3-Flash" in 5 variants from "2-bit Lite" to "6-bit" - PR TIMES (Google News: MLX, 2026-08-28)
Qwen3.8-Flash-Next goes open source, reviving n-grams from DeepSeek paper - Pasquale Pillitteri (Google News: DeepSeek, 2026-08-27)
M5 Mac Studio receives positive reviews. Which popular spec configuration to choose? - Gizmodo (Google News: Mac Studio LLM, 2026-08-27)
Can a local Mac Studio replace a $200/month AI subscription? - Pasquale Pillitteri (Google News: Mac Studio LLM, 2026-08-27)
Qwen3.8-Flash-Next (HN 701pt, 233 comments) (HN Search (backfill), 2026-08-26)
Qwen3.8 27B scores 52 on Artificial Analysis (HN 381pt, 180 comments) (HN Search (backfill), 2026-08-18)
Qwen3.8 27B at 256K: 50 TPS on a 24 GB GPU (HN 38pt, 36 comments) (HN Search (backfill), 2026-08-17)
Unsloth Qwen3.8-27B GGUF files (HN 69pt, 5 comments) (HN Search (backfill), 2026-08-15)
Qwen3.8-27B (HN 299pt, 3 comments) (HN Search (backfill), 2026-08-15)
Qwen 3.8 27B (HN 1438pt, 793 comments) (HN Search (backfill), 2026-08-15)
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses (Hacker News Frontpage, 2026-09-08)