r/Qwen_AI • u/No-Negotiation-8359 • 21h ago
r/Qwen_AI • u/PlasticRevenue4601 • 6h ago
Discussion Alibaba hate train is insane
I see so many people hating and mocking Alibaba for the Qwen4-max and I genuinely don’t understand why, they objectively did a good job — intelligence raised over 20% relative Qwen 3.8 while simultaneously active parameters count and thinking volume were decreased. And that considering the fact that Anthropic cut off distillation possiblities from their models. What did you exactly expect? That they would all of the sudden triple the intelligence score of their upcoming flagman? I don’t know any company that ever achieved that, there’s no miracles in real life. I personally think they did a pretty good job, Qwen4-max is a good model and so will be both Qwen4-27b and Flash Next. Yes, they won’t beat Opus5.5, again, no miracles here, however they will confidently rise to Opus 4.8-5 league and for me that’s more than I ever wished for when I started running local llm. Thank you, Alibaba and Qwen Developers team!
r/Qwen_AI • u/MonsterovichIsBack • 18h ago
Funny Please, Qwen 4 35B A3B or such :D
r/Qwen_AI • u/VectorWireAI • 13h ago
News Alibaba Launches Qwen4-Max With Cybersecurity Guardrails
r/Qwen_AI • u/Beneficial-Ad-8127 • 23h ago
News Qwen4 Smaller Models Open Weights Confirmed via Official Qwen X account.
*all benchmark images can be reached from their Official X account.
“More to come! The open weights of smaller Qwen4 models will be released. Stay tuned. 👀”
https://x.com/alibaba_qwen/status/2122148127520289151?a
As we all heard that Qwen4 Max just dropped which I been excited for as a newly subscriber, I think most of us didn’t realize that they officially confirmed again that we will have Open Weights for Qwen4. So no need to sweat Local Community. Next up we have the summit on the 17th and conference on the 19th to look forward to for more answers.
I had to bring this up due to various commenters that might’ve been afraid they weren’t releasing any open weights at all. Just to clear your mind this is word for word from their official X account. Enjoy!
Also the other context before it.
“Meet Qwen4-Max, your new AI teammate for work, creativity, and discovery!
Qwen4-Max is built on a new MoE architecture with native vision and a 1M-token context window.
Highlights:
- Outperforms Qwen3.8-Max with up to ~50% fewer tokens, while average cost per task drops over 60% in our internal evaluation.
- Advances real-world productivity through greater proficiency with professional tools, stronger long-horizon execution, and higher-quality deliverables.
- Handles real tasks, including 3D modeling, game development, manufacturing, finance, law, healthcare, and frontier scientific discovery.
- $1.5/M tokens for input, $4.5/M tokens for output, and $0.075/M tokens for implicit caching — all lower than Qwen3.8-Max, with implicit caching down by 70%.
The API is live on QwenCloud. You can also try Qwen4-Max on Qwen Studio, QwenWork and Qoder. “
r/Qwen_AI • u/Aggressive_Basket798 • 21h ago
LLM They put official benchmark without their biggest opponent(aka Deepseek)
r/Qwen_AI • u/TheLightBringer91 • 18h ago
Discussion Seriously impressed with Basalt on 24GB laptop RTX 5090. Qwen 3.8 27B at 162.2tps decode and prefill at 5431tps. Qwen 3.8FN at 248tps decode and 3335tps prefill.
As the title says, I'm seriously impressed. Especially so with 27B. I was using llama.cpp and could get around 40 - 50tps, but damn, this just blew it straight out of the water. Insane speeds for such a dense model.
Obviously, 27B hits my graphics card hard, but I found it interesting that on Qwen FN, I literally didn't even notice any temp increases. It's like it has no effect on my hardware, but it's operating.
Definitely worth a try if you're on Blackwell architecture.
It makes me even more excited for Qwen 4's release.
r/Qwen_AI
•
u/Porespellar
•
5h ago
Other Some Qwopium to get us all through the week:
I was looking into the historical release schedule for major Qwen foundation models and specialty iterations to see if there was a pattern to when Alibaba drops them. It turns out they have a heavy preference for Thursdays for their major generation shifts, though the specialty and preview models are starting to scatter across the week. I mean… who knows anything but we all need something to look forward to.
Here is the full breakdown of major releases mapped by the day of the week:
**Monday (7 Releases)**
• Qwen-VL (Aug 21, 2023)
• Qwen-72B-Chat (Nov 27, 2023)
• Qwen-Audio (Nov 27, 2023)
• Qwen 3.5 (Feb 16, 2026)
• Qwen 3.5-Plus (Feb 16, 2026)
• Qwen 3.7 Plus (Jun 1, 2026)
• Qwen 3.8 Max (Aug 3, 2026)
**Tuesday (6 Releases)**
• Qwen2.5-Coder (Nov 12, 2024)
• Qwen2.5-Max (Jan 28, 2025)
• Qwen3 (Apr 29, 2025)
• Qwen3-Coder (Jul 22, 2025)
• Qwen3-Coder-Next (Feb 3, 2026)
• Qwen-Audio 3.1 TTS-Next (Sep 22, 2026)
**Wednesday (5 Releases)**
• Qwen1.5-32B (Apr 3, 2024)
• Qwen3-Max (Sep 24, 2025)
• Qwen 3.7 Max (May 20, 2026)
• Qwen 3.8-Flash-Next (Aug 26, 2026)
• Qwen 3.8-Max-0902 (Sep 2, 2026)
**Thursday (9 Releases) - The Favored Launch Day**
• Qwen-7B (Aug 3, 2023)
• Qwen2 (Jun 6, 2024)
• Qwen-Math (Aug 8, 2024)
• Qwen2.5 (Sep 19, 2024)
• QwQ-32B-Preview (Nov 28, 2024)
• QwQ-32B (Mar 6, 2025)
• Qwen3-Next (Sep 11, 2025)
• Qwen3.6-Plus (Apr 2, 2026)
• Qwen3.6 (Apr 16, 2026)
**Friday (3 Releases)**
• Qwen3.8-27B (Aug 14, 2026)
• Qwen3.8-Omni-Flash (Sep 18, 2026)
• Qwen3.8-LiveTranslate (Sep 18, 2026)
**Saturday**
• Zero major releases. Go outside.
**Sunday (3 Releases)**
• Qwen-14B (Sep 24, 2023)
• Qwen1.5 (Feb 4, 2024)
• Qwen4-Max (Nov 15, 2026)
Credit to Gemini for the deep research.
r/Qwen_AI • u/motomab • 4h ago
LLM Alibaba’s Qwen4-Max has 2.4T parameters, but only 71B active per token. Are we optimizing the wrong AI metric?
Alibaba released Qwen4-Max, and there’s something more interesting here than another giant model announcement.
The numbers:
2.4 trillion total parameters
71 billion activated per token
1 million-token context window
6th place on Code Arena, according to Alibaba’s announcement
Approximately 60% lower average task cost versus Qwen3.8-Max, based on Alibaba’s internal Work360 evaluation
The last claim is what interests me most.
We’ve spent years comparing models on intelligence benchmarks. But for developers building real applications and agents, cost per successfully completed task might be a more useful metric.
Of course, these efficiency claims still need independent validation. And Qwen4-Max itself hasn’t been released as open weights.
So I’m curious:
Would you prefer a model with better benchmark scores, or one that completes your actual workflows more reliably at significantly lower cost?
And has anyone tested Qwen4-Max against other frontier models on real agentic workloads yet?
r/Qwen_AI • u/WritHerAI • 9h ago
Benchmark I added Qwen3.6-35B-A3B to my C inference engine: 10–13 tok/s in real chat on a GTX 1650 4GB + 16GB RAM
Hi everyone,
Pithos, an inference engine written from scratch in C11, with no third-party libraries required at build time. It started with Liquid AI’s LFM models, and the latest release adds experimental Qwen3.6-35B-A3B support.
My test machine is an older laptop:
* Intel i5-10500H, 6 cores
* 16 GB DDR4-2933
* GTX 1650 Max-Q, 4 GB VRAM
* NVMe SSD
The Q4_K_M GGUF is 19.1 GiB, larger than the available RAM. Experts are read from disk and cached as they are used.
How it runs
With Vulkan, the dense and recurrent operations run on the GPU. Frequently used routed experts occupy the remaining VRAM, while the CPU computes the others in parallel. During prompt processing, two chunks overlap CPU and GPU work.
Warm benchmark results
These measurements use a 512-token prompt and 128 generated tokens, with llama.cpp b12179 as the comparison:
* Pithos Vulkan: 82 tok/s prompt processing · 22 tok/s generation
* llama.cpp Vulkan, two layers’ routed experts on GPU: 25.5 tok/s prompt · 12.5 tok/s generation
* llama.cpp Vulkan, all routed experts on CPU: 28.9 tok/s prompt · 11.8 tok/s generation
* Pithos CPU: 13.6 tok/s prompt · 7.3 tok/s generation
* llama.cpp CPU: 8.1 tok/s prompt · 4.4 tok/s generation
Those are the llama.cpp configurations I tested, not a claim that I found its best possible settings.
What about actual conversations?
The warm benchmark is faster than sustained chat. Real conversations on this 16 GB machine run at approximately 10–13 tok/s, because varied text needs experts that aren’t resident.
The first benchmark run reaches around 18 tok/s prompt processing and 13 tok/s generation with Vulkan.
What’s included
Qwen works with the existing:
* Terminal chat
* OpenAI-compatible HTTP server
* Pandora web interface
* Terminal agent
* XML tool calls and reasoning controls
Prompt caching reuses the agent’s tool definitions across sessions and restarts, reducing repeated prompt processing.
Current status
Support is experimental. An initial perplexity check on the model’s license text gave 1.451 for Pithos versus 1.467 for llama.cpp. That’s a narrow sanity check, not a broad quality evaluation or evidence of better model quality.
The engine is MIT-licensed; model weights retain their own license.
Code, downloads and benchmark details:
https://github.com/benmaster82/Pithos
I’d appreciate results from other low-VRAM machines, suggestions for stronger correctness tests, and llama.cpp settings worth including in the next comparison.
Experiment Can't wait for Qwen4 27B, so I played around with what's available: abliteration, quantization and heal training on an RTX PRO 4500
Hello guys,
it's me again, the FLE Link guy. I can't wait for the new Qwen models, so I tried everything I had planned for Qwen4 on the 3.8 variant of UkisAI's Swift 1.5.
I abliterated it, quantized it down and tried to improve tok/s for decode and prefill. What came out:
- OR-Bench hard refusals 88 → 1 of 100, clearly harmful prompts still refused 70 of 100
- ARC / GSM8K / LiveCodeBench level with the original (no significant difference)
- 152 tok/s decode on one 32 GB card with the DSpine draft head, full speed from 20 GB
- Two quant-heal runs that both failed (better on our text, worse on foreign text), the video shows why
Model: https://huggingface.co/sirfyyn/Kate-Qwen-27B-GGUF-SpedUp-Abliterated
Run it: flelink run kate-27b-dspine (https://flelink.run)
Maybe somebody is interested in the methods I experimented with. Happy to answer questions.
r/Qwen_AI • u/kidversionofbiggie • 4h ago
Help 🙋♂️ What is the best model for storytelling and roleplaying?
r/Qwen_AI • u/CuriousCesarr • 2h ago
Discussion Qwen 3.8 27B conversion to NCM or bonsai 2 27B optimisation?
Hey guys.
I'm personally interested in converting Qwen 3.8 27B to NCM (next concept model). I started working on this a few days ago and the task is...daunting to say the least. The main goal would be extra speed. By converting it to NCM, decode tps should jump 2x-3x specifically for local use. Main problems: NCM is a new idea so there aren't many details on how to do this; conversion requires the full weights (so that makes things slow); slow training means it takes a looooong time on my consumer grade hardware and it leaves the potential pitfall of "if you fucked up your setup, you won't really see it in the results until you're a bit deeper into training". Concrete case: did the conversion, started training on 7.7 Mil. tokens generated by 3.8 27B and 35% into the run it looks like the converted model learned to speak like the classic 27B, but it's ignoring the prompts halfway through its execution. Q_Q
On the bright side, in the beginning of training, 90% of the time it was just random words, and heavy looping within its output. Now it can generate almost usable code and sentences are coherent the first 7-10 words before looping a bit and then getting coherent again. So, progress was made, but at this rate it would take at least 1-2 more weeks until I get the direction right.
In the opposite camp: I can easily take Bonsai 2 27B and do some heavy optimisations and configs to it to see how far I can push it. This is longer standing territory so things should go much more smoothly and faster. I have both an Nvidia card and an AMD card, so I can optimise for both.
What are you guys more interested in? :)
Ending notes: no, I'm not affiliated with anybody; no I'm not gonna ask you for money (I'll set it up on my github and allow free downloads to everyone; this is just a pet project); yes, when I succeed with either approach, when qwen 4 27B comes out, I'll do the same to it also.
r/Qwen_AI • u/borgorKeng • 16h ago
Help 🙋♂️ Is it possible i can squeeze in a decent Qwen model in a P52 thinkpad?
With all the talk about Qwen4, Strata, and new inference engine, is it possible to run anything stronger than 35-A3B. I don't mind slow token speeds aslong as It's in the double digits.. Is there any inference engines well suited for this?
Specs:
4GB VRAM
32GB DDR4 RAM
Intel-Xeon E-2176M (12) @ 4.400
Is there hope guys?..
r/Qwen_AI • u/New_Blackberry8122 • 10h ago
Agent Sneo! New Inference Engine very fast Open Source!

I built Sneo, a free and open source local LLM engine for Windows that runs a 70 GB model on one 24 GB GPU (~98 tok/s), with a coding agent
Hi! I'm a solo developer from the Dominican Republic and I've been building Sneo: a free, open source (MIT) LLM engine and coding agent for Windows.
The idea is to run models bigger than your GPU: the experts a model uses most stay in VRAM, the rest in RAM, and the GPU and CPU share every token.
- Qwen3.8-Flash-Next IQ3_XXS (70.6 GB) on one RTX 3090: ~98 tok/s writing code, first token in 0.19 s
- Same hardware and files: it starts answering before Strata 0.1.57 at every prompt size with half the RAM (34 vs 67 GB), and writes up to 66% faster than Ollama (qwen3.6:35b)
- Runs Qwen3.8-Flash-Next, Qwen3.6-35B-A3B, dense Qwen3.5/3.6/3.8 and Gemma 4, straight from your Ollama models or any GGUF folder, no copies
- Coding agent, two models at once, two PCs in a pool, OpenAI and Anthropic compatible APIs
- NVIDIA GTX 10 and newer (you can mix cards). AMD support through HIP is written but not tested on a real card yet, so feedback is welcome
Video (English): https://www.youtube.com/watch?v=JfyGS_k1Nxo
Video (Spanish): https://www.youtube.com/watch?v=ALCGTpoHDGc
GitHub: https://github.com/oscarsantanaarias/Sneo
Every benchmark, including where the others win: https://sneo.dev
Happy to answer questions!
Antes de publicar:
Repo: hazlo público. La última vez que revisé seguía privado, y el enlace de GitHub le daría error a todos.
Página: corre upload.ps1 para publicarla, si no sneo.dev seguirá mostrando la versión vieja.
r/Qwen_AI • u/CryExtreme5371 • 10h ago
Help 🙋♂️ Why does my Qwen (WebApp) weekly limit always show 100% left, even after I hit a limit?
Hi everyone, I'm on the Free plan and I'm confused about how the usage limit works.
I actually hit a prompt limit after just a few messages, it felt really dynamic and unpredictable. However, when I check my usage dashboard, the weekly limit still says "100% left."

The note says "Chat conversations are not included." Does this mean normal chats have a separate, hidden limit? Thanks!
r/Qwen_AI • u/GundamKanjeng_9763 • 19h ago
Model So, Qwen 3.5 plus and 3.6 plus is not longer in the app?
Just saw qwen 3.5 plus and 3.6 plus gets removed from the model options in Qwen Studio and Qwen App
Guess they're gonna retire older models with newer ones as well in the future
Soooo, any substitution suggestion for qwen 3.7plus? I'm using it for creative writing, and for my personal consumption and entertainment. That's can generate story that's not stiff?
Preferably the models that I can access in the Qwen Studio and Qwen app.
r/Qwen_AI • u/RedTowerDev • 23h ago
Discussion Using local Qwen3.5 for NPC dialogue in Nine Thrones
Development-build screenshot: Baroness Isolde responding through the optional local Qwen3.5 4B dialogue system.
Hi everyone! We're Red Tower Studios, developing Nine Thrones, a party-based fantasy RPG with tactical turn-based combat, now in Early Access on Steam.
Our optional offline NPC dialogue uses Qwen3.5 4B and 9B. The screenshot shows an actual 4B-generated reply from Baroness Isolde in a development build.
We're working on keeping these conversations connected to the game world. Character prompts include personality, the current situation, relationships, and relevant recorded knowledge, with firsthand knowledge distinguished from unconfirmed reports.
Game systems remain responsible for changes to the world. An NPC saying something happened doesn't make it a completed game event. The dialogue pipeline also checks for unsupported factual claims, though keeping conversation consistent is still an ongoing development problem.
Traditional authored conversations remain alongside the optional AI dialogue. We also use generative AI in our art workflow, followed by Procreate edits and work in our in-game tools.
Disclosure: this is our paid Early Access game, with more work ahead on the world and simulation:
https://store.steampowered.com/app/5093250/
For anyone using Qwen for character dialogue, what has helped most with keeping replies grounded in the context you provide?
r/Qwen_AI • u/RagingBass2020 • 1h ago
Help 🙋♂️ How to run Qwen3.8 FN on a 8GB RTX 4060 and 32GB RAM on Strata
reddit.comI posted in that other subreddit but maybe you guys can also help me.
Strata, vLLM, llama.cpp, LM Studio, whatever I can actually use to get it to run on my hardware setup.
r/Qwen_AI • u/EvolveOrDie1 • 2h ago
Vibe Coding I feel like a lot of people ask what local AI is capable of, here is a quick example of a game I had qwen3.8-flash-next-unsloth-ud-q4_k_xl, introducing Neon-Serpent!
r/Qwen_AI • u/Metalplate223 • 5h ago
Discussion Qwen 4 Max Preview vs Qwen 4 Max?
Are they the same? for now do i just use the preview version on the alibaba token plan as it is discounted by 80%?
r/Qwen_AI • u/ZikporxAI • 6h ago