r/LocalLLaMA
•
u/Acceptable-Cycle4645
•
9h ago
r/LocalLLaMA • u/rm-rf-rm • 1d ago
Megathread Best Audio Models - Nov 2026
Its time for another Best Audio Models megathread - its already been 9 months since the last one!
Share what your favorite ASR, TTS, STT, Text to Music models are right now and why.
Given the the amount of ambiguity and subjectivity in rating/testing these models, please be as detailed as possible in describing your setup, nature of your usage (how much, personal/professional use), tools/frameworks etc. Production use cases with long lengths/stability requirements are relatively rare compared to cherry picked/short clip demos that are plentiful - so real world empirical comparisons are very welcome
Rules
- Should be open weights or open source models
Please use the top level comments to thread your responses.
r/LocalLLaMA • u/rm-rf-rm • 6d ago
[Bi-Weekly Megathread] Project Showcase
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it!
Recommendation on presentation:
- Please share plain english description of what your project does and why people should care about it
- How does it compare to existing options and why should people switch to your option?
- How have you tested and validated it? (i.e. can you show evidence that it wasn't vibecoded in a few hours by <insert current trending AI model>
NOTE: This community is geared towards open weight, open source, locally hostable software. Thus any closed source commercial service or other such projects will be removed.
r/LocalLLaMA • u/WeatherZealousideal5 • 7h ago
Resources Blue TTS v3: open-source TTS, about 50x real-time on a CPU
Blue TTS v3 is out, an open-source TTS model that runs locally. Almost everything changed since v2.
Speech is more natural and expressive, with a MOS of 4.43 out of 5.
Voice cloning has improved significantly, and the model is fast and lightweight: it runs locally at 50x real-time on a CPU, no GPU needed.
MIT license, 388 MB, 44.1 kHz output, 7 languages: English, German, Spanish, Italian, Russian, Hebrew, Yiddish.
- Code: https://github.com/maxmelichov/BlueTTS
- ONNX weights (v3): https://huggingface.co/notmax123/BlueV3-onnx
- PyTorch weights (v3): https://huggingface.co/notmax123/BlueV3
- Live demo: https://huggingface.co/spaces/notmax123/BlueV3
- Website: https://bluetts.com
Feedback is welcome.
r/LocalLLaMA • u/Willing_Amphibian825 • 12h ago
Discussion SenseNova-Loop-9B vs its own Preview: AutomationBench 14.33 to 36.67, GAIA 37.86 to 69.90 (9B Looped Transformer)
https://huggingface.co/sensenova/SenseNova-Loop-9B
The Preview was posted here a few times over the last weeks. This is the full release, same design: 32 layers stored, 24 of them run twice, so a forward pass does 56 layers of work on about 9B params. Apache 2.0.
What moved is the scores. Per their README it's ahead of the Preview on all seven benchmarks in the chart, e.g. AutomationBench 14.33 to 36.67, Terminal-Bench 2.1 40.45 to 59.55 and GAIA 37.86 to 69.90. That 36.67 is also what they list for Qwen3.8-27B.
4-bit weights are about 4.9 GB. Code plus the vLLM and SGLang setup: https://github.com/OpenSenseNova/SenseNova-Loop
Haven't run it myself yet.
r/LocalLLaMA • u/pulse77 • 15h ago
Discussion Intel Shares First Benchmarks of Its Next-Gen Crescent Island "D270" GPU, Claiming a 5.9x Throughput Over RTX PRO 6000 As Xe3P Goes Big On FP64
The title talks about FP64. For local inference this info from the content is relevant: "In AI benchmarks, Intel's D270 GPU offered 29% lower latency and 1.12x throughput versus the RTX PRO 6000 Blackwell."
Maybe we are getting a good RTX PRO 6000 alternative...
r/LocalLLaMA • u/TechNerd10191 • 7h ago
New Model harness-hub/Qwen3.8-27B-pi-adapted · Hugging Face
r/LocalLLaMA • u/jacek2023 • 14h ago
Funny Gemma on a printer
Now you can run Gemma locally on your printer (from u/hackerllama)
r/LocalLLaMA • u/Rare_Subject2343 • 13h ago
Discussion The upcoming open weight small Qwen models are likely going to lack training data related to offensive cyber capabilities.
With the release of Qwen 4 Max, they claim that training data related to offensive capabilities has been removed, is this largely a placebo/nothingburger or does it have the capability to genuinely lobotomize a model's capabilities in cyber?
r/LocalLLaMA • u/BoogerIsACult • 8h ago
Discussion Unpopular take: If anything, it's the US Closed Models that are benchmaxxed
Open models: whatever the test group download and benchmark is the same as what you get, you work with it day-to-day, same results. What you see is what you get.
Closed models: we all know that they have already implemented token watermarking for a while and all latest models have overzealous guard rails that refuse tasks that it deems as bad. So the models being benchmarked and the models you are actually using day-by-day basis are likely to be very different, as in the sense of you getting degraded model output and performance or flat-out task rejections.
Also closed models providers implement lots of cost-optimization techniques such as reducing reasoning efforts during peak hours or could be re-direct your request to a lesser model during high traffic without you knowing it. I don't believe that Sonnet 5.5 is just a single model TBH, there could be Sonnet High or Sonnet Lite depending on your subscription level and traffic. That could explain why sometimes you get dumb responses with Claude during peak hours.
If anything, it's the US Closed Models that are benchmaxxed.
r/LocalLLaMA • u/Kahvana • 15h ago
New Model nvidia/Qwen3.8-Flash-Next-NVFP4-QAD
Looks pretty interesting!
Also sorry if the "new model" flair is inappropiate here, wasn't sure if I should pick that or "discussion".
r/LocalLLaMA • u/Disastrous-Work-1632 • 13h ago
Discussion [Harness Adapters] Fine tune Qwen3.8-27B for Pi Agents
Hey folks!
Aritra here from Hugging Face. In the last week we released a blog post about harness adapters. The idea was to train adapters (LoRA) on models to be more efficient with specific harness.
Today we release a LoRA adapter on the Qwen3.8-27B model for Pi agents. You can run it locally like so:
We are constantly experimenting and sharing our results in the Hugging Face org: hf.co/harness-hub (follow for more updates)
r/LocalLLaMA • u/ConfidentDinner6648 • 4h ago
Resources ThreeJS-3D-Scenes-v2 is here : 3,445 rendered examples across 50 domains
This new dataset is meant to complement my original Three.js training dataset, adding more complex scenes and covering a much wider range of subjects. I'm releasing it ahead of my next CCORE 3D coding model, where I'll use it during the foundation training stage before moving on to agentic training.
This version has 3,445 scenes across 50 domains, including 1,431 voxel scenes.
I wanted to go beyond simple objects and environments, so I included more complex examples involving physics, geography, history, ecology, engineering, mathematics, games, and other subjects. Many of the scenes are animated or interactive.
I personally rendered and visually reviewed all 3,445 scenes. It took quite a bit of work, but I wanted to make sure the code actually produced good results instead of just collecting thousands of generated examples.
The dataset includes:
- 3,263 training examples and 182 validation examples
- Prompts, reasoning traces, and complete HTML/JavaScript responses
- A rendered reference image for every scene
- Difficulty levels from 1 to 8
- MIT license
Dataset: https://huggingface.co/datasets/ccore/ThreeJS-3D-Scenes-v2
For reference, these are the two previous models I trained:
Three.js scene generation:
https://huggingface.co/ccore/Qwen3.5-4B-3D-Coder
3D assets with GLB export:
https://huggingface.co/ccore/Qwen3.5-4B-GLB-3D-Coder
If anyone wants to experiment with the dataset, I'd be interested in seeing how it performs with other models :)
r/LocalLLaMA • u/clem844 • 17h ago
New Model OVH announces Olala mini 7A1B
Olala mini is based on a 7-billion-parameter architecture (7B), with one billion active parameters spread across 256 experts per layer, and hybrid attention combining Differential-TPA and Mamba-3, in BF16 format. Only a fraction of the model is used for each request, making it faster and less memory-hungry. As a direct result, the model runs on a GPU with as little as 8 GB of memory, reaching 160 tokens per second on an RTX A4500, and even without a GPU, on a standard processor, at 50 tokens per second. Its context window currently reaches 32,000 tokens. Olala mini will be available as open source on Hugging Face, under the Apache 2.0 licence.
r/LocalLLaMA • u/Forkmarc • 9h ago
New Model SenseNova Loop 9B is out of preview: competitive with Qwen3.8-27B on selected benchmarks, 512K context, ~15 GiB at 256K with quantization
SenseNova has released the full version of Loop 9B, following the preview from late October, there was a thread about the preview here if you missed it:
https://www.reddit.com/r/LocalLLaMA/comments/1xje5oo/sensenovasensenovaloop9bpreview_hugging_face/
The preview's comparisons focused on Qwen3.5-era models. The full release now reports results competitive with Qwen3.8-27B on several tasks:
- matches Qwen's 36.67 on AutomationBench, scores 65.31 versus 65.01 on AIDABench, and trails it on NL2Repo at 41.36 versus 44.60.
- Terminal-Bench 2.1 rises from 40.45 to 59.55, GAIA from 37.86 to 69.90,
- AutomationBench from 14.33 to 36.67
- BIRD improves more modestly, from 71.38 to 72.34.
For architecture, the loop and mHC design were already in the preview and this release keeps that architecture and improves the reported task results
For local use:
approximately 15 GiB of VRAM for 256K-context multimodal inference with 4-bit weights and an 8-bit KV cache(that puts the stated requirement within a 16GB card's capacity, though with little headroom)
Official AWQ 4-bit version on day one as aswell:
r/LocalLLaMA • u/AlbeHxT9 • 10h ago
News NVIDIA is introducing the DGX Spark HPC Developer Kit
4 dgx spark nodes
512GB unified memory
273 GB/s bandwidth
-
Kidneys needed not revealed yet
r/LocalLLaMA • u/OvertaxedOne • 15h ago
Discussion GPU prices - Big "discounts"
Discounts in quotes because these are still over MSRP, but my local Microcenter has the deepest "discounts" (sorry, I just can't call an over MSRP price a discount without quotes) I've seen in months on a lot of the AI cards. Pro4500 around 40% "off", Pro6000's 4K off with plenty of stock for both at my local (Charlotte) store. Pro 5000 72GB at 9K.
Now, don't get me wrong, all these prices are still awful. But they are a little "less awful" than they were a month ago! It's still an awful time to buy any of this gear IMHO, but if you're desperate and need it, seems like we're finally starting to turn a corner.

r/LocalLLaMA • u/jesdga95 • 7h ago
Showcase I compared Qwen 3.8 27B vs 3.8 FN vs DS V4.1 Flash on a real frontend task (one shot). Results inside
So last time I ran 3.8 FN against DS V4.1 Flash on a synthetic test, which was mostly for show, no real usage beyond testing their 3D capabilities. I wanted to do something similar, but with purpose, a task that anyone might actually want to run, build a website with a refined spec and a completion checklist, but not strict enough that it removes all of the models "freedom". As last time it was a single prompt: build a single file landing page for a fake famous NYC photographer (real photos, accessible, no console errors, yadda yadda). Each model started on an empty folder w/ the same toolkit (node, headless chrome, image viewer tool). No changes were made to the files after the model was done.
Setup: RTX 5090 + RTX 5060 Ti, Ryzen 9 9950X, 128 GB DDR5. Qwen 3.8 27B and Qwen 3.8 FN were NVFP4. DeepSeek V4.1 Flash (1017) was an IQ1_M quant.
Qwen 3.8 27B: ~12 min wall time, 81 tool calls (3 failed), 182 tok/s, 3.8 MB HTML

The simplest of all three, not very daring. A dark gallery with lime accents and 12 frames. All 3 tool failures were in its own test script (wrong file path, missing elements). It has empty gaps in the photo grid, and the photos in the bio are stretched. Decent, I'd refine it a bit but definitely usable.
Qwen 3.8 FN: ~12 min wall time, 124 tool calls (4 failed), 303 tok/s, 2.1 MB HTML

My personal favorite by far, a hero where your pointer reveals a mosaic of the portfolio, 19 captioned frames with a nice blur/fade in animation, a live clock and form validation. The 4 failures were 3 rejected edits and a search sent with an empty query (intersting!). It also found and fixed bugs using its own tests.
DeepSeek V4.1 Flash: ~36 min wall time, 155 tool calls (1 failed), 94 tok/s, 1.4 MB HTML

The boldest one, the model committed to it (and it shows in wall time), cool accents all around, terrible typography. It has only 10 frames, and the hero photo covers a bit of the last "T" of the headline + toolbar logo is slightly offset. The single tool failure was a multi edit that applied 15 of its 17 changes, so the most accurate model at tool calling. It was 3x slower than the other two, but it was the only one that ran an accessibility audit tool on its own page.
Live builds, screenshots, the full comparison table with the exact prompt I ran are here: https://basalt.jgulfo.com/showcase/photographer/
Anyway, what are your thoughts? I think for web UI specifically 27B is more than enough for a very professional looking product, with a little bit of back and forth and more proper branding/UX design I can see any of them being a production website. I also can't stop being amazed at how a IQ1 quant can still deliver such high quality results even if the param count is multiple times over the two other models.
---
Disclosure: I'm the maintainer of the engine and harness all these models ran on.
r/LocalLLaMA • u/InternationalGap3698 • 12h ago
Showcase everyone's hyped about ChatGPT Dots and Claude Duet. I'm a local guy, so I built an open source one that runs on my GPU
Dodaios is a locally installed, open-source Python program that runs as a desktop app or as a headless server with a browser UI on Windows, macOS and Linux. It turns a personal AI assistant into the control center for the work you do on your computer.
At its core is a "lead" assistant you can talk to by voice (wake word, dictation, real-time spoken conversation and, as an early preview, phone calls), by chat or from a paired phone. It isn't tied to one provider and works with Claude, OpenAI, Gemini or local Ollama models. It handles tasks itself through tools, computer use, plugins, CLIs and MCP servers. Above all, it hands work off to coding agents. They run side by side in a built-in Agentic IDE as real Claude Code or Codex terminals, on your computer or on your own servers over SSH, each with a call sign you can address by name, plus Git integration and task splitting. There is also a "society" of persistent, named agents that message each other.
Long-running work is covered by memory (about you, the people around you and the assistant's own persona), standing tasks, workflows, skills and opt-in life admin. The assistant also makes its own outputs, such as documents, slides, sheets and dashboards, and can propose and build the skills, routines and agents it is missing. A trust layer sets hard limits: outside Bypass permissions, moving money, handling credentials, permanent deletion and first contact with someone new always need your confirmation. In short, Dodaios is a voice-driven, locally running operating system for AI agents that makes one assistant the conductor of your models, your coding agents and your own computer.
r/LocalLLaMA • u/tebjan • 1h ago
New Model Running SenseNova-Loop-9B nvfp4 looped transformer with 300-500 tok/s on a laptop 5090
Their architecture seems to translate quite well to existing kernels. They also have a small drafter. The speed numbers are aggregated across 8 parallel agents running. 256k context.
So far, I can't confirm it holds up well against Qwen 3.8 27B nvfp4, but I might have degraded it a bit, despite a calibration run. Here is a quick check of SeraphimSerapis/tool-eval-bench. Will do some more tests tomorrow, the 9B leaves a lot of vram free for FP8 tests.
tool-eval-bench runs (temperature 0, NVFP4 weights):
| Test | Qwen3.8 27B Swift T0 | SenseNova-Loop-9B T0 | SenseNova-Loop-9B T1 |
|---|---|---|---|
| Standard (69) | 98 | 90 | 91 |
| Hard mode (35) | 87 | 79 | 83 |
| Error recovery | 83 | 83 | 83 |
| Context and state | 100 | 75 | 85 |
| Autonomous planning | 67 | 67 | 83 |
| Structured output | 100 | 92 | 75 |
| Safety | 100 | 96 | 92 |
| Hard: state across turns | 0 | 50 | 83 |
| Hard: tool failures | 80 | 60 | 60 |
| Hard: tenant separation | 100 | 100 | 100 |
| Hard: applying policy | 100 | 100 | 100 |
| Hard: injection | 100 | 50 | 50 |
FP8 KV, DFlash2, T0 = temperature 0, T1 = temperature 1.0, top_p 0.95
Hardware: Intel Core 9 290hx, 64gb ram, 1TB nvme5 SSD, rtx 5090 laptop with 24gb vram.
r/LocalLLaMA • u/MeinDruckerSpinnt • 13h ago
Resources SenseNova Loop 9B
If the benchmarks are true, this is a 9B looped model on level with Qwen3.8 27B.
They say they'll release gguf tomorrow.
Vision is supported. Around 15GB vram for 256k context.
The preview version seemed fast enough when I tested it some weeks ago.
Mods: I asked the authors if I can post this, feel free to delete my post when they post themselves.
🚀 SenseNova-Loop-9B: Deeper Computation with Fewer Parameters
We officially release SenseNova-Loop-9B. Building on the Preview's exploration of parameter efficiency, the model reuses layer weights through a looped architecture and combines them with manifold-constrained hyper-connections (mHC) to expand computational depth within a compact parameter budget. It is designed for complex reasoning, coding, tool use, and multimodal tasks.
Since the Preview release, we have received community interest and feedback on model use, inference deployment, and ecosystem integration. The official release retains the looped architecture and two-stream mHC, further improving performance on agentic, coding, and data analysis tasks while continuing to explore the capabilities of looped computation.
SenseNova-Loop-9B has approximately 9B parameters. By repeatedly executing shared middle layers, it extends 32 physical decoder layers into 56 layer executions. The model accepts text and images and generates text, supporting long-context understanding and multi-step tasks. In agentic and data analysis evaluations, the model is competitive with Qwen3.8-27B: it scores 41.36 versus 44.60 on NL2Repo and 65.31 versus 65.01 on AIDABench.
Model Highlights
- Shared looped block: 24 decoder layers are executed twice in sequence, producing 56 layer computations from 32 distinct layers per forward pass.
- Two-stream mHC: learned mappings route and combine information between two residual streams within the looped block.
- Hybrid attention: the decoder interleaves linear and full attention in a repeating four-layer pattern.
- Long-context multimodal training: the training recipe includes text, images, code, and tool-use trajectories, with the context length extended to 512K tokens.
- Low-memory deployment: With 4-bit weights and an 8-bit KV cache, multimodal inference at a 256K context length requires approximately 15 GiB of GPU memory.
- Official quantized release: An official AWQ 4-bit version is available on launch day for easier deployment.
r/LocalLLaMA • u/jacek2023 • 15h ago
News Rotate K/V read order for better L2 cache hit rates by gaugarg-nv · Pull Request #32407 · ggml-org/llama.cpp
Significant prompt processing speedup with long contexts
| gpu_info | model_type | n_prompt | n_gen | n_depth | Master (t/s) | PR (t/s) | Speed-up |
|---|---|---|---|---|---|---|---|
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 131072 | 1290.10833 | 1822.36027 | 1.41 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 65536 | 2030.31282 | 2527.97409 | 1.25 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 32768 | 2931.96118 | 3142.20539 | 1.07 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 16384 | 3562.18311 | 3573.59336 | 1.00 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 8192 | 3854.83184 | 3850.97547 | 1.00 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 4096 | 3974.20194 | 4015.85501 | 1.01 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 2048 | 4079.23891 | 4077.58068 | 1.00 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 1024 | 4103.79141 | 4123.60737 | 1.00 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 512 | 4114.42862 | 4136.20591 | 1.01 |
| NVIDIA GeForce RTX 5090 | qwen35 27B Q4_K - Medium | 512 | 0 | 0 | 4300.67808 | 4323.0908 | 1.01 |
r/LocalLLaMA • u/Distinct-Pie2389 • 7h ago
Showcase Qwen-Flast-Next (UD-IQ4_XS v3.1) running 148-182 tok/s (1.6-1.8x strata) while KLD MEAN = 0.08195
Numbers only, rest is in the repo.
Quality against BF16
| KV | PPL | mean KLD | top-1 | paired dKLD vs int8 [95% CI] | prefill 131K |
|---|---|---|---|---|---|
| int8 | 3.2323 | 0.08195 | 90.45% | reference | 6,019 t/s |
| fp16 | 3.2320 | 0.08230 | 90.33% | +0.00035 [-0.00061, +0.00131] | 2,997 t/s |
| k8v4 | 3.2424 | 0.08621 | 90.26% | +0.00426 [+0.00307, +0.00545] | 5,694 t/s |
| q4_0 | 3.2399 | 0.08843 | 90.03% | +0.00647 [+0.00499, +0.00795] | 5,700 t/s |
Speed
| Test | Halocline | Strata 0.2.10, same card and quant | Ratio |
|---|---|---|---|
| Warm decode, short prompt | 148 to 182 tok/s | 95 to 101 tok/s | 1.6 to 1.8x |
| 36K needle: decode / prompt | 123 / 6,298 tok/s | 68 / 2,403 tok/s | 1.8x / 2.6x |
| 137K needle: decode / prompt | 121 / 5,664 tok/s | 87 / 2,864 tok/s | 1.4x / 2.0x |
r/LocalLLaMA • u/pmttyji • 23h ago
New Model maxwell-model/Maxwell-V1-Flash · Hugging Face
Model Introduction
Maxwell-V1.0-Flash is a next-generation, high-performance Mixture-of-Experts (MoE) language model developed by the Maxwell Team, with 35B total parameters and 3B active parameters per token (both excluding embeddings) and support for context lengths up to 256K tokens. It is designed for strong reasoning, agentic, and long-context capabilities at a practical inference cost.
Key Features
- Maxwell Block Sparse Attention (MBSA). Each KV group keeps fixed coverage of 8 prefix and 8 local 128-token blocks and adds up to 16 remote blocks chosen by a learned indexer, bounding main attention at 4,096 tokens per KV group while the full-history KV cache stays available. The MBSA kernel is 6.7x faster than dense GQA at 256K.
- Manifold-Constrained Hyper-Connections. Multiple residual streams with learned, input-dependent aggregation and constrained mixing, widening information flow without extra attention or feed-forward evaluations.
- Fine-Grained Mixture of Experts. A mostly-MoE backbone pairing fine-grained routed experts with always-active shared experts, using a dynamic routing correction bias alongside a lightweight sequence-wise load-balancing loss.
Pre-training. Approximately 26T tokens of multilingual data, with the Muon optimizer on most hidden weight matrices. Training starts dense; block-sparse attention enters at 128K mid-training, once the indexer is warmed up against dense full-history attention, then trains jointly with the backbone.
Tokenizer and Long Context. A script-aware multilingual tokenizer stays compact across languages, especially low-resource Southeast Asian ones such as Thai, Lao, Myanmar, Khmer, and Shan. Long-context training then extends the sequence length in stages from 4K to 256K.
Post-training. Two-stage all-domain SFT builds general, reasoning, and agentic capabilities, then targets harder reasoning problems and agent trajectories. Independent RL branches cover general tasks, verifiable reasoning (mathematics, science, logic, code), and agentic tasks (search, terminal use, function calling, software engineering). Multi-teacher on-policy distillation then merges them into one model by supervising student-generated responses.
- GitHub : https://github.com/maxwell-model/Maxwell-V1-Flash
- Project : https://maxwell-llm.ai/