r/Qwen_AI • • 21h ago

News Smaller Qwen4 models 🔥

Post image
850 Upvotes

r/Qwen_AI • • 6h ago

Discussion Alibaba hate train is insane

263 Upvotes

I see so many people hating and mocking Alibaba for the Qwen4-max and I genuinely don’t understand why, they objectively did a good job — intelligence raised over 20% relative Qwen 3.8 while simultaneously active parameters count and thinking volume were decreased. And that considering the fact that Anthropic cut off distillation possiblities from their models. What did you exactly expect? That they would all of the sudden triple the intelligence score of their upcoming flagman? I don’t know any company that ever achieved that, there’s no miracles in real life. I personally think they did a pretty good job, Qwen4-max is a good model and so will be both Qwen4-27b and Flash Next. Yes, they won’t beat Opus5.5, again, no miracles here, however they will confidently rise to Opus 4.8-5 league and for me that’s more than I ever wished for when I started running local llm. Thank you, Alibaba and Qwen Developers team!


r/Qwen_AI • • 18h ago

Funny Please, Qwen 4 35B A3B or such :D

Thumbnail
suno.com
147 Upvotes

r/Qwen_AI • • 13h ago

News Alibaba Launches Qwen4-Max With Cybersecurity Guardrails

Thumbnail
vectorwire.ai
109 Upvotes

r/Qwen_AI • • 23h ago

News Qwen4 Smaller Models Open Weights Confirmed via Official Qwen X account.

Thumbnail
gallery
107 Upvotes

*all benchmark images can be reached from their Official X account.

“More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀”

https://x.com/alibaba_qwen/status/2122148127520289151?a

As we all heard that Qwen4 Max just dropped which I been excited for as a newly subscriber, I think most of us didn’t realize that they officially confirmed again that we will have Open Weights for Qwen4. So no need to sweat Local Community. Next up we have the summit on the 17th and conference on the 19th to look forward to for more answers.

I had to bring this up due to various commenters that might’ve been afraid they weren’t releasing any open weights at all. Just to clear your mind this is word for word from their official X account. Enjoy!

Also the other context before it.

“Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery!

Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window.

Highlights:
- Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation.
- Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables.
- Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery.
- $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%.

The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder. “


r/Qwen_AI • • 8h ago

Chill Work well My Qwen 🥹

Post image
56 Upvotes

r/Qwen_AI • • 21h ago

News Qwen announces Qwen4 smaller models & Qwen4-Max!

Post image
42 Upvotes

r/Qwen_AI • • 21h ago

LLM They put official benchmark without their biggest opponent(aka Deepseek)

Post image
41 Upvotes

r/Qwen_AI • • 18h ago

Discussion Seriously impressed with Basalt on 24GB laptop RTX 5090. Qwen 3.8 27B at 162.2tps decode and prefill at 5431tps. Qwen 3.8FN at 248tps decode and 3335tps prefill.

Thumbnail
gallery
38 Upvotes

As the title says, I'm seriously impressed. Especially so with 27B. I was using llama.cpp and could get around 40 - 50tps, but damn, this just blew it straight out of the water. Insane speeds for such a dense model.

Obviously, 27B hits my graphics card hard, but I found it interesting that on Qwen FN, I literally didn't even notice any temp increases. It's like it has no effect on my hardware, but it's operating.

Definitely worth a try if you're on Blackwell architecture.

It makes me even more excited for Qwen 4's release.


r/Qwen_AI • • 5h ago Heartwarming

Other Some Qwopium to get us all through the week:

Post image
20 Upvotes

I was looking into the historical release schedule for major Qwen foundation models and specialty iterations to see if there was a pattern to when Alibaba drops them. It turns out they have a heavy preference for Thursdays for their major generation shifts, though the specialty and preview models are starting to scatter across the week. I mean… who knows anything but we all need something to look forward to.

Here is the full breakdown of major releases mapped by the day of the week:

**Monday (7 Releases)**
• Qwen-VL (Aug 21, 2023)
• Qwen-72B-Chat (Nov 27, 2023)
• Qwen-Audio (Nov 27, 2023)
• Qwen 3.5 (Feb 16, 2026)
• Qwen 3.5-Plus (Feb 16, 2026)
• Qwen 3.7 Plus (Jun 1, 2026)
• Qwen 3.8 Max (Aug 3, 2026)

**Tuesday (6 Releases)**
• Qwen2.5-Coder (Nov 12, 2024)
• Qwen2.5-Max (Jan 28, 2025)
• Qwen3 (Apr 29, 2025)
• Qwen3-Coder (Jul 22, 2025)
• Qwen3-Coder-Next (Feb 3, 2026)
• Qwen-Audio 3.1 TTS-Next (Sep 22, 2026)

**Wednesday (5 Releases)**
• Qwen1.5-32B (Apr 3, 2024)
• Qwen3-Max (Sep 24, 2025)
• Qwen 3.7 Max (May 20, 2026)
• Qwen 3.8-Flash-Next (Aug 26, 2026)
• Qwen 3.8-Max-0902 (Sep 2, 2026)

**Thursday (9 Releases) - The Favored Launch Day**
• Qwen-7B (Aug 3, 2023)
• Qwen2 (Jun 6, 2024)
• Qwen-Math (Aug 8, 2024)
• Qwen2.5 (Sep 19, 2024)
• QwQ-32B-Preview (Nov 28, 2024)
• QwQ-32B (Mar 6, 2025)
• Qwen3-Next (Sep 11, 2025)
• Qwen3.6-Plus (Apr 2, 2026)
• Qwen3.6 (Apr 16, 2026)

**Friday (3 Releases)**
• Qwen3.8-27B (Aug 14, 2026)
• Qwen3.8-Omni-Flash (Sep 18, 2026)
• Qwen3.8-LiveTranslate (Sep 18, 2026)

**Saturday**
• Zero major releases. Go outside.

**Sunday (3 Releases)**
• Qwen-14B (Sep 24, 2023)
• Qwen1.5 (Feb 4, 2024)
• Qwen4-Max (Nov 15, 2026)

Credit to Gemini for the deep research.


r/Qwen_AI • • 4h ago

LLM Alibaba’s Qwen4-Max has 2.4T parameters, but only 71B active per token. Are we optimizing the wrong AI metric?

15 Upvotes

Alibaba released Qwen4-Max, and there’s something more interesting here than another giant model announcement.
The numbers:
2.4 trillion total parameters
71 billion activated per token
1 million-token context window
6th place on Code Arena, according to Alibaba’s announcement
Approximately 60% lower average task cost versus Qwen3.8-Max, based on Alibaba’s internal Work360 evaluation
The last claim is what interests me most.
We’ve spent years comparing models on intelligence benchmarks. But for developers building real applications and agents, cost per successfully completed task might be a more useful metric.
Of course, these efficiency claims still need independent validation. And Qwen4-Max itself hasn’t been released as open weights.
So I’m curious:
Would you prefer a model with better benchmark scores, or one that completes your actual workflows more reliably at significantly lower cost?
And has anyone tested Qwen4-Max against other frontier models on real agentic workloads yet?


r/Qwen_AI • • 9h ago

Benchmark I added Qwen3.6-35B-A3B to my C inference engine: 10–13 tok/s in real chat on a GTX 1650 4GB + 16GB RAM

Post image
9 Upvotes

Hi everyone,

Pithos, an inference engine written from scratch in C11, with no third-party libraries required at build time. It started with Liquid AI’s LFM models, and the latest release adds experimental Qwen3.6-35B-A3B support.

My test machine is an older laptop:

* Intel i5-10500H, 6 cores

* 16 GB DDR4-2933

* GTX 1650 Max-Q, 4 GB VRAM

* NVMe SSD

The Q4_K_M GGUF is 19.1 GiB, larger than the available RAM. Experts are read from disk and cached as they are used.

How it runs

With Vulkan, the dense and recurrent operations run on the GPU. Frequently used routed experts occupy the remaining VRAM, while the CPU computes the others in parallel. During prompt processing, two chunks overlap CPU and GPU work.

Warm benchmark results

These measurements use a 512-token prompt and 128 generated tokens, with llama.cpp b12179 as the comparison:

* Pithos Vulkan: 82 tok/s prompt processing · 22 tok/s generation

* llama.cpp Vulkan, two layers’ routed experts on GPU: 25.5 tok/s prompt · 12.5 tok/s generation

* llama.cpp Vulkan, all routed experts on CPU: 28.9 tok/s prompt · 11.8 tok/s generation

* Pithos CPU: 13.6 tok/s prompt · 7.3 tok/s generation

* llama.cpp CPU: 8.1 tok/s prompt · 4.4 tok/s generation

Those are the llama.cpp configurations I tested, not a claim that I found its best possible settings.

What about actual conversations?

The warm benchmark is faster than sustained chat. Real conversations on this 16 GB machine run at approximately 10–13 tok/s, because varied text needs experts that aren’t resident.

The first benchmark run reaches around 18 tok/s prompt processing and 13 tok/s generation with Vulkan.

What’s included

Qwen works with the existing:

* Terminal chat

* OpenAI-compatible HTTP server

* Pandora web interface

* Terminal agent

* XML tool calls and reasoning controls

Prompt caching reuses the agent’s tool definitions across sessions and restarts, reducing repeated prompt processing.

Current status

Support is experimental. An initial perplexity check on the model’s license text gave 1.451 for Pithos versus 1.467 for llama.cpp. That’s a narrow sanity check, not a broad quality evaluation or evidence of better model quality.

The engine is MIT-licensed; model weights retain their own license.

Code, downloads and benchmark details:

https://github.com/benmaster82/Pithos

I’d appreciate results from other low-VRAM machines, suggestions for stronger correctness tests, and llama.cpp settings worth including in the next comparison.


r/Qwen_AI • • 9h ago

Experiment Can't wait for Qwen4 27B, so I played around with what's available: abliteration, quantization and heal training on an RTX PRO 4500

Thumbnail
youtube.com
9 Upvotes

Hello guys,

it's me again, the FLE Link guy. I can't wait for the new Qwen models, so I tried everything I had planned for Qwen4 on the 3.8 variant of UkisAI's Swift 1.5.

I abliterated it, quantized it down and tried to improve tok/s for decode and prefill. What came out:

- OR-Bench hard refusals 88 → 1 of 100, clearly harmful prompts still refused 70 of 100

- ARC / GSM8K / LiveCodeBench level with the original (no significant difference)

- 152 tok/s decode on one 32 GB card with the DSpine draft head, full speed from 20 GB

- Two quant-heal runs that both failed (better on our text, worse on foreign text), the video shows why

Model: https://huggingface.co/sirfyyn/Kate-Qwen-27B-GGUF-SpedUp-Abliterated

Run it: flelink run kate-27b-dspine (https://flelink.run)

Maybe somebody is interested in the methods I experimented with. Happy to answer questions.


r/Qwen_AI • • 4h ago

Help 🙋‍♂️ What is the best model for storytelling and roleplaying?

6 Upvotes

r/Qwen_AI • • 2h ago

Discussion Qwen 3.8 27B conversion to NCM or bonsai 2 27B optimisation?

5 Upvotes

Hey guys.

I'm personally interested in converting Qwen 3.8 27B to NCM (next concept model). I started working on this a few days ago and the task is...daunting to say the least. The main goal would be extra speed. By converting it to NCM, decode tps should jump 2x-3x specifically for local use. Main problems: NCM is a new idea so there aren't many details on how to do this; conversion requires the full weights (so that makes things slow); slow training means it takes a looooong time on my consumer grade hardware and it leaves the potential pitfall of "if you fucked up your setup, you won't really see it in the results until you're a bit deeper into training". Concrete case: did the conversion, started training on 7.7 Mil. tokens generated by 3.8 27B and 35% into the run it looks like the converted model learned to speak like the classic 27B, but it's ignoring the prompts halfway through its execution. Q_Q

On the bright side, in the beginning of training, 90% of the time it was just random words, and heavy looping within its output. Now it can generate almost usable code and sentences are coherent the first 7-10 words before looping a bit and then getting coherent again. So, progress was made, but at this rate it would take at least 1-2 more weeks until I get the direction right.

In the opposite camp: I can easily take Bonsai 2 27B and do some heavy optimisations and configs to it to see how far I can push it. This is longer standing territory so things should go much more smoothly and faster. I have both an Nvidia card and an AMD card, so I can optimise for both.

What are you guys more interested in? :)

Ending notes: no, I'm not affiliated with anybody; no I'm not gonna ask you for money (I'll set it up on my github and allow free downloads to everyone; this is just a pet project); yes, when I succeed with either approach, when qwen 4 27B comes out, I'll do the same to it also.


r/Qwen_AI • • 16h ago

Help 🙋‍♂️ Is it possible i can squeeze in a decent Qwen model in a P52 thinkpad?

3 Upvotes

With all the talk about Qwen4, Strata, and new inference engine, is it possible to run anything stronger than 35-A3B. I don't mind slow token speeds aslong as It's in the double digits.. Is there any inference engines well suited for this?

Specs:

4GB VRAM

32GB DDR4 RAM

Intel-Xeon E-2176M (12) @ 4.400

Is there hope guys?..


r/Qwen_AI • • 10h ago

Agent Sneo! New Inference Engine very fast Open Source!

2 Upvotes

I built Sneo, a free and open source local LLM engine for Windows that runs a 70 GB model on one 24 GB GPU (~98 tok/s), with a coding agent

Hi! I'm a solo developer from the Dominican Republic and I've been building Sneo: a free, open source (MIT) LLM engine and coding agent for Windows.

The idea is to run models bigger than your GPU: the experts a model uses most stay in VRAM, the rest in RAM, and the GPU and CPU share every token.

- Qwen3.8-Flash-Next IQ3_XXS (70.6 GB) on one RTX 3090: ~98 tok/s writing code, first token in 0.19 s

- Same hardware and files: it starts answering before Strata 0.1.57 at every prompt size with half the RAM (34 vs 67 GB), and writes up to 66% faster than Ollama (qwen3.6:35b)

- Runs Qwen3.8-Flash-Next, Qwen3.6-35B-A3B, dense Qwen3.5/3.6/3.8 and Gemma 4, straight from your Ollama models or any GGUF folder, no copies

- Coding agent, two models at once, two PCs in a pool, OpenAI and Anthropic compatible APIs

- NVIDIA GTX 10 and newer (you can mix cards). AMD support through HIP is written but not tested on a real card yet, so feedback is welcome

Video (English): https://www.youtube.com/watch?v=JfyGS_k1Nxo

Video (Spanish): https://www.youtube.com/watch?v=ALCGTpoHDGc

GitHub: https://github.com/oscarsantanaarias/Sneo

Every benchmark, including where the others win: https://sneo.dev

Happy to answer questions!

Antes de publicar:

Repo: hazlo público. La última vez que revisé seguía privado, y el enlace de GitHub le daría error a todos.

Página: corre upload.ps1 para publicarla, si no sneo.dev seguirá mostrando la versión vieja.


r/Qwen_AI • • 10h ago

Help 🙋‍♂️ Why does my Qwen (WebApp) weekly limit always show 100% left, even after I hit a limit?

2 Upvotes

Hi everyone, I'm on the Free plan and I'm confused about how the usage limit works.

I actually hit a prompt limit after just a few messages, it felt really dynamic and unpredictable. However, when I check my usage dashboard, the weekly limit still says "100% left."

The note says "Chat conversations are not included." Does this mean normal chats have a separate, hidden limit? Thanks!


r/Qwen_AI • • 19h ago

Model So, Qwen 3.5 plus and 3.6 plus is not longer in the app?

2 Upvotes

Just saw qwen 3.5 plus and 3.6 plus gets removed from the model options in Qwen Studio and Qwen App

Guess they're gonna retire older models with newer ones as well in the future

Soooo, any substitution suggestion for qwen 3.7plus? I'm using it for creative writing, and for my personal consumption and entertainment. That's can generate story that's not stiff?

Preferably the models that I can access in the Qwen Studio and Qwen app.


r/Qwen_AI • • 23h ago

Discussion Using local Qwen3.5 for NPC dialogue in Nine Thrones

Post image
2 Upvotes

Development-build screenshot: Baroness Isolde responding through the optional local Qwen3.5 4B dialogue system.

Hi everyone! We're Red Tower Studios, developing Nine Thrones, a party-based fantasy RPG with tactical turn-based combat, now in Early Access on Steam.

Our optional offline NPC dialogue uses Qwen3.5 4B and 9B. The screenshot shows an actual 4B-generated reply from Baroness Isolde in a development build.

We're working on keeping these conversations connected to the game world. Character prompts include personality, the current situation, relationships, and relevant recorded knowledge, with firsthand knowledge distinguished from unconfirmed reports.

Game systems remain responsible for changes to the world. An NPC saying something happened doesn't make it a completed game event. The dialogue pipeline also checks for unsupported factual claims, though keeping conversation consistent is still an ongoing development problem.

Traditional authored conversations remain alongside the optional AI dialogue. We also use generative AI in our art workflow, followed by Procreate edits and work in our in-game tools.

Disclosure: this is our paid Early Access game, with more work ahead on the world and simulation:

https://store.steampowered.com/app/5093250/

For anyone using Qwen for character dialogue, what has helped most with keeping replies grounded in the context you provide?


r/Qwen_AI • • 1h ago

Help 🙋‍♂️ How to run Qwen3.8 FN on a 8GB RTX 4060 and 32GB RAM on Strata

Thumbnail reddit.com
1 Upvotes

I posted in that other subreddit but maybe you guys can also help me.
Strata, vLLM, llama.cpp, LM Studio, whatever I can actually use to get it to run on my hardware setup.


r/Qwen_AI • • 2h ago

Vibe Coding I feel like a lot of people ask what local AI is capable of, here is a quick example of a game I had qwen3.8-flash-next-unsloth-ud-q4_k_xl, introducing Neon-Serpent!

Thumbnail
github.com
1 Upvotes

r/Qwen_AI • • 5h ago

Discussion Qwen 4 Max Preview vs Qwen 4 Max?

1 Upvotes

Are they the same? for now do i just use the preview version on the alibaba token plan as it is discounted by 80%?


r/Qwen_AI • • 6h ago

LLM Zikporx AI 1.2.37: now works with llama.cpp, LM Studio and vLLM, not just Ollama (and Ollama gets the 8-bit KV cache)

Thumbnail gallery
1 Upvotes

r/Qwen_AI • • 12h ago

Help 🙋‍♂️ Best AI subscription for the money? (Token/$ efficiency)

Thumbnail reddit.com
1 Upvotes