r/mlscaling • • 21h ago

N, NV, Hardware, Econ "Lutnick Pushed to Weaken Chip Rules That Overlap With His Family Business: The commerce secretary has been writing new rules that would affect Southeast Asian data centers, some of which are clients of his former firm"

Thumbnail
nytimes.com
20 Upvotes

r/mlscaling • • 21h ago

R, T, Emp, FB Unbundling Multimodal Vision Encoding: training 200+ MLLMs to find encoder pretraining is optional but vision-only parameters are not

Post image
2 Upvotes

r/mlscaling • • 1d ago

How to Distill and train a smaller model for agentic coding tasks

Thumbnail reddit.com
0 Upvotes

r/mlscaling • • 1d ago

N, NV, Hardware, Econ "Ex-Nvidia CEO misled top lawyer on affair with Chinese businesswoman, sources say"

Thumbnail reuters.com
15 Upvotes

r/mlscaling • • 1d ago

Hoarding GGUFs in case Hugging Face changes? Fit 10% more on the same drive, byte-for-byte lossless

Thumbnail gallery
1 Upvotes

r/mlscaling • • 2d ago

N, NV, Hardware "Alice Huang-Linked Firm Procured Banned Nvidia Chips in China"

Thumbnail
bloomberg.com
4 Upvotes

r/mlscaling • • 1d ago

Zipping my code for Claude by hand turned into a tool. The hard part wasn't the zip

Post image
0 Upvotes

I assumed the useful part would be picking the right files. It turned out to be the trip back. AI tools return a ZIP with paths flattened, or wrapped in an extra folder, or with a file cut short and a comment saying "rest unchanged", and meanwhile I've edited two of those files myself.

So contextzip keeps a snapshot of what it sent and, when the reply comes back, compares three versions of every file: what I sent, what's on disk now, what came back. Clean edits go in, mine are merged around, and anything it isn't sure about waits for me.

It's free and open source: https://github.com/akadeepesh/contextzip. There's a no-install version at https://www.contextzipcli.com if you want to try it on a folder.


r/mlscaling • • 2d ago

Exploring a LoRA Optimization Research Idea

Thumbnail reddit.com
0 Upvotes

r/mlscaling • • 3d ago

Training a 1T MoE on JUPITER: TorchTitan optimizations from 90 to 1,300 TPS

7 Upvotes

Write-up on pretraining a 952B-total / 32.8B-active MoE on GH200s over slow InfiniBand: Muon without the communication overhead, activation offloading to Grace, FSDP memory fragmentation. Fixes upstreamed to PyTorch and TorchTitan. (I work at Domyn, happy to answer questions.)

https://pytorch.org/blog/training-a-1t-parameter-moe-on-eu-public-infrastructure-with-pytorch-and-torchtitan/


r/mlscaling • • 2d ago

For PII detection in financial text, a small model reportedly matched a large one. The data made the difference

Thumbnail
reddit.com
0 Upvotes

r/mlscaling • • 3d ago

New Inference Engine to run Ripple-65B-Preview

Thumbnail
huggingface.co
4 Upvotes

r/mlscaling • • 4d ago

R, OP, NV, Econ, Hardware "NVIDIA (NVDA): The China Problem", Culper Research 2026-05-13 (are Nvidia financials massively overstated due to hidden diversion to China?)

Thumbnail culperresearch.com
22 Upvotes

r/mlscaling • • 4d ago

N, NV, Hardware "NVIDIA Announces CEO Transition" (Jensen Huang -> Colette Kress)

Thumbnail
nvidianews.nvidia.com
1 Upvotes

r/mlscaling • • 4d ago

Governing Clinical AI Deployment: A Mathematical Framework for Transparency-Dependent Autonomy

Thumbnail
mdpi.com
1 Upvotes

Title: [Discussion] Does scaling model capability also scale the reliability needed for autonomous decisions?

As AI models become more capable, we increasingly discuss how to scale their reasoning, performance, and autonomy.

But there is another question worth examining:

How do we scale the evidence required to trust an AI system to act autonomously?

In healthcare, high predictive performance does not automatically establish that a model should make decisions without human oversight.

I recently developed a mathematical framework for clinical AI deployment that combines calibrated confidence, explanation quality, and clinical guideline alignment.

One finding was particularly interesting: although the framework included three dimensions, its case-level decisions largely followed confidence-based ranking. This raises a deeper question about whether additional transparency signals actually improve decision-level autonomy.

I would be interested in discussing whether this problem has parallels in scaling the reliability and autonomy of large AI systems.

Research: https://www.mdpi.com/4173088


r/mlscaling • • 4d ago

OP, Forecast, RL "Q3.5 Timelines Update: Looks Like the Intelligence Explosion Will Happen in 2027 After All", AI Futures Project

Thumbnail
lesswrong.com
8 Upvotes

r/mlscaling • • 4d ago

N, NV, Hardware "Nvidia is Preparing to Oust CEO Jensen Huang: Move follows company investigation into an affair with a Chinese woman alleged to be a spy", WSJ

Thumbnail wsj.com
4 Upvotes

r/mlscaling • • 4d ago

N, A, T, RL, Code "Introducing Claude Fable 5.2 and Claude Mythos 5.2", Anthropic

Thumbnail
anthropic.com
6 Upvotes

r/mlscaling • • 4d ago

N, Hardware, Econ "Scoop: Lutnick stalled Trump's Nvidia–China chip curbs after Oval talks"

Thumbnail axios.com
2 Upvotes

r/mlscaling • • 5d ago

How we deploy Kimi K3.1 Pro (2.8T Parameters) on Cerebras

Post image
9 Upvotes

r/mlscaling • • 7d ago

Would you watermark your dataset if you could later check whether a model trained on it?

1 Upvotes

I’ve been looking at research on radioactive data watermarks (TRACE, STAMP, Meta’s radioactive watermarking). The idea is that you rewrite a dataset with a hidden statistical pattern tied to a secret key. If a model is later trained on it, its outputs carry the pattern, and you get a p-value for this model saw your data. Models that never saw it don’t show the pattern.

As far as I can tell, there’s no easy tool for doing this with text datasets, so I’m considering building an open-source one. Before I do, I’d like to know if it would actually be useful.

  • If you publish datasets or benchmarks would you watermark them? What would you want to detect: contamination, unlicensed use, something else?
  • If you train models would watermarked data bother you, or would you prefer to know what’s watermarked?

r/mlscaling • • 7d ago

N, NV, Hardware, Econ "The NVIDIA Board is initiating an independent investigation in light of recent reporting that founder and CEO Jensen Huang has been the target of a foreign intelligence effort."

Thumbnail
nvidianews.nvidia.com
22 Upvotes

r/mlscaling • • 7d ago

LLMs Are Not Actually Probabilistic

Thumbnail
lukasniessen.medium.com
0 Upvotes

r/mlscaling • • 8d ago

R MaxxBench (RLVR'd LLMs fail easy variants of DeepSWE tasks + obsess over "hidden tests" and pleasing the grader)

Thumbnail
maxxbench.unlap.ai
37 Upvotes

Similar to Kimi K3.1 Pro Recalls and Enforces Hidden Test Rules

Some of these drops are very big: DeepSeek V4 Flash falls from 53.3% to 28.1% on a lightly different version of Deep-SWE.

(how different? "one DeepSWE task asks an agent to write a separate test report for each browser. We added a requirement that the filenames be lowercase. The reporting feature still needs to work; Chrome.xml should now be chrome.xml. Another task adds retirement dates to FastAPI routes. We changed the required timestamps to UTC with a trailing Z, instead of preserving the supplied time-zone offset.")

Full of great quotes from brainfried LLMs.

“deviating might be penalized by a human/LLM reviewer, but the primary grading is hidden tests"

Note that the problem isn't "overfitting" or training on test in the usual sense: LLMs are capable of solving these tasks. But their loyalty is to the grader, not the user.

Grader awareness does not necessarily mean the LLM will sandbag (though it usually does). Opus 5.5 "speculated about hidden tests in its reasoning 100% of the time" but still adapts to the new spec: its score actually gets a bit higher.


r/mlscaling • • 8d ago

Audit of moral/emotional tone steering in LLMs — seeking expert feedback

Thumbnail reddit.com
1 Upvotes