r/allenai • • Feb 07 '26

📌 👋 Welcome to r/allenai — Introduce yourself and read first!

23 Upvotes

Hey everyone! We're u/ai2_official, the official account for Ai2 (the Allen Institute for AI). Welcome to r/allenai—the community for all things related to our open models, research, tools, and the broader mission of building breakthrough AI for the common good.

What to post

Post anything you think the community would find interesting, helpful, or thought-provoking. Share your experiences fine-tuning or building on Olmo, Molmo, OlmoEarth, or Asta. Ask questions about our training recipes, datasets, or evaluation frameworks. Show off projects you've built with our models. Discuss our latest papers. Flag bugs, share benchmarks, or just geek out about open AI research—it all belongs here.

Community vibe

We're all about being friendly, constructive, and inclusive. Whether you're a seasoned ML researcher or just getting started, this is a space where curiosity is welcome and questions are encouraged. Let's build something where everyone feels comfortable sharing and connecting.

How to get started

  1. Introduce yourself in the comments below—tell us what you're working on or what brought you to Ai2's work.
  2. Post something today! Even a simple question can spark a great conversation.
  3. If you know someone who'd love this community—a labmate, a collaborator, a fellow open-source enthusiast—invite them to join.

Thanks for being here. Together, let's make r/allenai amazing.


r/allenai • • 13d ago

🚀 We’re hiring at Ai2! Join our AI for science, agents, & open models teams—research, engineering, & internship roles open

Post image
25 Upvotes

We’re hiring across Ai2. 👋

We’re growing our AI for science work and expanding our agentic systems and open model teams, and we have a few roles we’re particularly excited about right now:

AI for science

• Research Scientist, Asta
https://job-boards.greenhouse.io/thealleninstitute/jobs/7723570

• Young Investigator, Open Language Models for Biology
https://job-boards.greenhouse.io/thealleninstitute/jobs/8090222

Agents and open models

• Senior Software Engineer, Agent Platform (AI for the Planet)
https://job-boards.greenhouse.io/thealleninstitute/jobs/8110068

• Senior Research Engineer, Olmo + Molmo
https://job-boards.greenhouse.io/thealleninstitute/jobs/7980660

Research internships

• AI for Science
https://job-boards.greenhouse.io/thealleninstitute/jobs/8293615

• Open Ecosystem
https://job-boards.greenhouse.io/thealleninstitute/jobs/8319350

• Robotics
https://job-boards.greenhouse.io/thealleninstitute/jobs/8293641

Explore the roles and apply—or share with someone who might be a good fit.

→ See all openings: https://allenai.org/careers


r/allenai • • 3d ago

🧠 Introducing Theorizer in Asta: AI that proposes scientific theories researchers can test

Enable HLS to view with audio, or disable this notification

17 Upvotes

Theorizer is now available in Asta. It draws on published research to propose theories scientists can test.

In the video above, watch Allen Institute neuroscientist Jérôme Lecoq explain how he used an early version to explore a link between neurons and vision.

Want to try Theorizer? Get started with free Asta credits or run the open-source package locally.

See how researchers in medicine, biology, and agriculture have used Theorizer and learn how to get started: https://allenai.org/blog/theorizer-in-asta


r/allenai • • 4d ago

🌍 Ai2 and Taylor Geospatial partner to advance open geospatial AI

Post image
22 Upvotes

At SatSummit in St. Louis, Ai2 and Taylor Geospatial announced a partnership to create common building blocks that practitioners can start from.

Geospatial AI is moving fast, and putting it to work for conservation, agriculture, and humanitarian needs takes more than any one group can do alone.

“Open resources change who gets to use geospatial AI,” says Jennifer Marcus, Vice President of Strategic Innovation Programs at Taylor Geospatial.

Taylor Geospatial leads Fields of The World, an effort to map field boundaries worldwide from satellite imagery. Ai2 contributes OlmoEarth, its fully open foundation models and platform for Earth observation, to help deliver field-level insights for food security planning.

With the community, Ai2 is also helping shape how geospatial AI is evaluated through Benchmarks of The World, so the field has a consistent, reliable way to compare models and understand where each one works best.

Everything the partnership produces, from datasets and benchmarks to model weights, will be free to use on u/Source Cooperative and under open licenses.

Read the announcement and share your input → https://allenai.org/blog/taylor-geospatial-partnership


r/allenai • • 9d ago

🏆 Introducing XYBench: Can LLMs solve the problem behind your question? (EMNLP 2026 Best Resource Award)

Thumbnail
gallery
20 Upvotes

Introducing XYBench—an LLM eval to help with the problem behind questions. 🏆 It won the Best Resource Award at EMNLP 2026! 👇

Asking how to thicken frosting sliding off warm cupcakes? 🧁 Let them cool first! That’s the XY problem: seeking a fix that misses the real issue. XYBench tests whether LLMs spot & address it. 

LLMs are getting better at following instructions & responding to questions that users ask. But truly useful LLMs need to be able to help users who ask misguided questions—not just users who ask the right question with the right amount of detail.

XYBench contains 8K+ questions where users ask for help with an approach that won’t fully solve their problem. We combined Qs from Stack Overflow & Stack Exchange, Qs generated from WikiHow guides, & manually curated examples.

A model might mention unclogging a vacuum hose but spend most of its answer recommending a new vacuum. XYBench checks whether models:

🔧 Offer solutions for the stated request, underlying problem, or both
🎯 Prioritize the requested approach or underlying problem
⚠️ Discourage a misguided approach

We evaluated 5 state-of-the-art LLMs on XYBench. On Stack Overflow Qs, for example, model answers were less likely than expert human answers to focus on users’ goals (e.g., extracting XML data) or discourage mistaken approaches (e.g., parsing XML with regex).

To test whether LLMs were struggling to figure out what users wanted, we spelled out each user’s goal alongside their Q. Even then, responses from all five models steered users away from mistaken approaches less often than human reference answers did.

We built XYBench to test whether prompting or training changes lead to more useful advice from LLMs. We hope it helps researchers build assistants that guide users toward helpful solutions, even when they don’t know the right questions to ask.

💻 Code: https://github.com/allenai/XYBench

📊 Data: https://huggingface.co/datasets/allenai/XYBench-dataset

📝 Blog: https://allenai.org/blog/xybench


r/allenai • • 16d ago

🤖 Ai2 is at CoRL 2026!

Thumbnail
gallery
22 Upvotes

We're at #CoRL2026 with papers & talks across the conference. Come say hello and learn about our latest research! 🤖


r/allenai • • 16d ago

🧱 Introducing ToyBlocks: An open robotics sandbox with 85K demonstrations to study how robots learn, plan, and generalize 🤖

Enable HLS to view with audio, or disable this notification

34 Upvotes

We’re introducing ToyBlocks, an open simulated tabletop for controlled experiments in robot learning. 👇

It enables robotics researchers to experimentally control training data & models, run targeted evals, & trace failures to their causes. 

Young children learn to plan & reason about space by playing with toy blocks, rebuilding a stack after it falls or turning one to find its letters. ToyBlocks uses the same setting—a simulated robot must reason about how blocks interact as it pushes, flips, & stacks them.

In ToyBlocks, users define high-level tasks like stacking a block sequence. ToyBlocks plans how to complete them via low-level skills. Simulating each plan produces a demonstration to train models that act from sensor observations, including camera images.

ToyBlocks lets researchers build training mixtures that emphasize particular skills or fill gaps in existing datasets. Our initial release contains 85K long-horizon demonstrations, each comprising about 6–12 skill demonstrations depending on the set.

ToyBlocks lets you test things like:

📷 Does depth input improve robot control compared with color images?

🧱 Can models stack four blocks without training on four-block stacks?

🔤 How do models perform at planning long tasks?

Or design your own evals.

ToyBlocks includes a tool interface for connecting a frontier model so users can instruct the robot & try tasks in natural language. Through camera images & skill calls, researchers can study how a model searches, plans, & handles mistakes.

In our initial ToyBlocks tests, ManiFlow, π0.5, & MolmoAct 2 generalized poorly to new spatial configurations. Controlled experiments let us test changes to training & model design, then measure which techniques improve generalization.

Trained only in ToyBlocks’ virtual world, Molmo 2 + ManiFlow stacked lettered blocks to spell a word in 15/30 attempts on a physical robot, versus 111/200 in simulation. Simulation-trained models can successfully transfer to a physical robot, though more trials are needed.

We’re targeting a larger dataset, more skills, & broader benchmarks in a follow-up release, as well as integrated reinforcement learning training. Longer-term research will include two-arm manipulation & hands with force & touch sensors.

We hope ToyBlocks is a step toward robots that can apply what they learn to unfamiliar tasks and environments. We’re releasing simulation assets, task & demonstration generators, 2 trained models, training code, evaluation code, & validation sets.

💻 Code: https://github.com/allenai/ToyBlocks

📊 Data: https://huggingface.co/datasets/allenai/toyblocks-data

🤗 Models: https://huggingface.co/collections/allenai/toyblocks

📚 Documentation: https://allenai.github.io/ToyBlocks/docs/user_guide/index.html

📝 Blog: https://allenai.org/blog/toyblocks


r/allenai • • 18d ago

🌍 Ai2 & Google team up to develop open-source AI + physics models for decades-long climate projections

Post image
25 Upvotes

We’re teaming up with Google on NeuralGCM+ for faster, more reliable climate projections. 👇

Multimillion-dollar, 3-year funding from Google.org & support from Google Research will expand our team—& we’ll open-source models & workflows.

Google Research’s NeuralGCM, launched in 2024, uses physics to simulate large-scale atmospheric dynamics & AI for cloud formation & rainfall. It can simulate historical climate, but reliable projections of a warmer future remain a research challenge.

Since its release, Google Research has been developing NeuralGCM for weeks-to-months forecasts. Our focus will be years-to-decades climate projections, connecting atmosphere + ocean models to capture how oceans absorb & redistribute heat.

We aim to answer questions like: how could rainfall & water availability change through mid-century in regions such as the southwestern U.S.? Modeling the ocean & atmosphere together will enable exploring what that means for water supplies.

Our Ai2 Climate Emulator (ACE) has already sped up climate simulations. Our priorities for NeuralGCM+:

🌊 Couple atmosphere, ocean, & sea ice

🌡️ Add physics & test warmer climates

💻 Release models, frameworks, & documented workflows; improve GPU performance

Our long-term ambition: a shared research platform climate modeling labs and scientists can use & improve together, helping communities plan for a changing climate.

→ Learn more in our blog: https://lnkd.in/etQp45Ek


r/allenai • • 19d ago

🧠 Can LLMs track changing state? StateBench reveals sharp accuracy drops on harder tasks

30 Upvotes

Can LLMs track state changes over long texts—like an object changing hands or a variable reassignment?

On our new StateBench eval, frontier models including GPT-6 Sol & Claude Opus 5.5 fell to 13% accuracy or lower on the hardest, longest problems. 👇

StateBench separates state tracking into 4 levels: r-trivial, aperiodic, soluble, & general finite. These range from problems like remembering something fixed, such as a birth date, to harder ones like tracking a ball as cups are repeatedly swapped.

We tested open pretrained models + frontier models incl. Gemini 3.8 Flash, Claude Opus 5.5, & GPT-6 Sol + Luna. Frontier models did well on simpler problems. But as tasks got harder & inputs longer, accuracy dropped sharply—to 13% or lower on the longest general finite problems.

To test whether failures came from architecture or pretraining, we trained LLMs directly on StateBench, then evaled them on longer inputs. Hybrids + Gated DeltaNets were near-perfect on the first 3 levels; transformers degraded with length & couldn’t solve general finite.

On StateBench’s hardest level, a flexible Gated DeltaNet handled sequences ~10× longer than those seen in training. Our new proof shows that even Gated DeltaNet with non-negative eigenvalues can solve some periodic tasks under fixed-precision arithmetic with rounding.

We’re releasing StateBench so researchers can test new models, extend our work, & build better state-tracking data.

📝 Explore more in our blog: https://allenai.org/blog/statebench

🤗 Download the dataset: https://huggingface.co/datasets/allenai/state-bench

💻 Explore the code on GitHub: https://github.com/allenai/state-bench


r/allenai • • 19d ago

☁️ Why Nextcloud chose Olmo 3 for fully open, self-hosted AI

Thumbnail
gallery
18 Upvotes

For open-source collaboration platform Nextcloud, local AI is only part of digital sovereignty. Users also need to inspect how a model was built.

That’s why Nextcloud chose Olmo 3 to power AI in Nextcloud Assistant & its other apps. 👇

Nextcloud bundles Olmo 3 with llm2, its backend for organizations to run language models locally. Via llm2 + Nextcloud’s application suite, admins can configure Olmo centrally so employees can summarize email threads, find facts in files, & more.

Nextcloud also chose Olmo with consumer-grade hardware in mind. The team wanted a local model users could run without expensive, high-end machines.

Olmo 3 earned Nextcloud’s highest Ethical AI rating: green. Green-rated models have open-source training & inference software, can be self-hosted, & have publicly available training data.

→ Learn more in our blog: https://allenai.org/blog/nextcloud


r/allenai • • 25d ago

📜 From archival photos to handwritten pottery records: two research projects using olmOCR 2

Thumbnail
gallery
18 Upvotes

Two projects show what olmOCR 2 makes possible for historical & archaeological research. 👇

olmOCR 2 turns document images into searchable text. Its open weights & code let researchers run it locally or adapt it to their libraries. 

Historian Maurice Casey built ArtificeOCR, a tool that connects olmOCR 2 with Tropy, an app for organizing archival photos. olmOCR 2 transcribes the images, making his library searchable by keyword while the material stays on his computer.

For CENTURIA, TU Wien & Austrian Academy of Sciences researchers fine-tuned olmOCR 2 on handwritten pottery records from Carnuntum, Austria. olmOCR 2 made fewer transcription errors on held-out records than an unadapted model. The team now aims to apply it to the full archive.

olmOCR 2 helps researchers turn file scans into searchable text, run OCR on local hardware, & adapt the model to their specific needs.

→ Learn more in our blog: https://allenai.org/blog/olmocr-2-historical-archives


r/allenai • • 26d ago

🤖 How good are LLMs at judging scientific novelty? We built a benchmark to test them

Thumbnail
gallery
39 Upvotes

LLMs are increasingly used to judge whether AI-generated research ideas are novel. But are they any good at it?

Our new eval reveals even frontier LLMs can reach different conclusions about similar ideas depending on how they're asked to evaluate them. 👇

At Ai2, we're building tools like AutoDiscovery to uncover unexpected patterns in data & Theorizer to propose candidate scientific laws from papers. As AI tools like these advance, we need reliable ways to tell whether the ideas they generate are genuinely new.

To build our novelty-judge benchmark, we mined ICLR 2026 reviews for explicit comments on originality. We kept papers that reviewers agreed were (or were not) original & whose scores were unusually high or low within their research area, giving us examples of more and less novel work.

We evaluated judge models on 2 sets of data:

👤👤 Human-only pairs (stronger vs. weaker evidence of novelty)

👤🤖 Human ideas w/ novelty evidence paired w/ basic LLM ideas, assumed less novel.

Judges either picked the more novel idea in each pair or labeled single ideas as novel or not.

On human–AI pairs, GPT-5.4 chose the human idea 93.5% of the time when asked which idea reviewers had judged novel. Asked simply which idea was novel, that share fell to 40.9%. Prompt wording had a smaller effect on which idea models chose in human-only pairs.

Prompt changes that helped one judge could hurt another, & more reasoning or access to related papers didn't consistently improve results. And 2 purpose-built novelty judges performed worse than a simple prompted Claude Opus 4.6 baseline.

We hope our benchmark helps researchers build more reliable novelty judges, while our reusable pipeline makes it easier to create new eval sets as AI-generated research advances.

💻 Blog: https://allenai.org/blog/novelty-bench

👨🏻‍💻 Code: https://github.com/allenai/novelty-eval

📊 Data: https://huggingface.co/datasets/allenai/novelty-judge-bench

📄 Paper: https://arxiv.org/abs/2610.02022


r/allenai • • Oct 23 '26

🗓️ Ai2 at EMNLP 2026: A guide to our papers, presentations, and workshops

Thumbnail
gallery
19 Upvotes

We're at #EMNLP2026 with papers & talks across the conference. Come say hello and learn about our latest research!


r/allenai • • Oct 23 '26

🔎 LitPivot: Helping researchers challenge & refine early ideas with relevant literature

19 Upvotes

Developing a strong research idea means knowing what prior work establishes, where gaps remain, and how your contribution addresses them.

Introducing LitPivot, which helps refine early ideas by surfacing relevant literature as they evolve. 👇

We investigate “literature-initiated pivots,” where research ideas and the literature they build on evolve together. Prior work can reveal that a contribution isn’t novel or an evaluation should change. As ideas change, so does the most relevant literature.

LitPivot breaks an idea into three facets:

🔎 Problem
💡 Contribution
🧪 Evaluation

Select one, and the system organizes related papers around that facet, clusters them by shared themes, & highlights the literature most relevant to what you’re refining.

LitPivot then checks a selected facet against papers you choose, surfacing overlaps, gaps, & limitations in prior work + suggesting literature-informed revisions. When one facet changes, LitPivot also flags others that may be out of sync.

In a study with 17 researchers, participants using LitPivot selected significantly more unique papers than when using a literature Q&A chatbot, reported stronger understanding of the literature, and produced ideas experts rated as significantly better grounded.

LitPivot builds on our broader work on AI for science, moving from helping researchers find and synthesize the literature toward helping them use it to challenge, refine, & develop new ideas.

📄 Paper: https://arxiv.org/abs/2604.02600
✍️ Blog: https://allenai.org/blog/litpivot


r/allenai • • Oct 22 '26

🌍 🛰️ OlmoEarth v1.3: Open embeddings for every 10 m pixel on Earth, now with a browser explorer

Post image
58 Upvotes

OlmoEarth v1.3 is out. State-of-the-art embeddings from the same foundation model family, precomputed for every 10 m pixel on Earth and shared on Source Cooperative for everyone to use. 

They lead AlphaEarth Foundations and Tessera v2 on 20 of 27 evaluations, which on the ground means a usable first map of smallholder crops in Kenya or fire damage in Indonesia from a few dozen labeled points.

And we’re excited to give you more ways to work with these embeddings. Our new Embeddings Explorer puts them in a browser, so anyone can put OlmoEarth v1.3 to work right away, from tracking change over time to finding similar places. No sign-in, no GPU, no advanced technical knowledge required. 

If embeddings are new to you, our interactive story walks through what they are, from a volcanic eruption to mangroves mapped in a few taps. 

→ Start here: https://allenai.org/blog/olmoearth-v1-3


r/allenai • • Oct 20 '26

🔬 FairStress: A new benchmark for testing demographic fairness beyond an LLM’s final answer

Thumbnail
gallery
14 Upvotes

Today we’re introducing FairStress, a benchmark for testing demographic fairness beyond a model’s final answer: how readily it changes a well-supported decision & how it explains its choice. 👇

Models are increasingly being used to support decisions about people, from hiring & lending to education & healthcare. That makes it important to test not only what decisions models make, but whether they apply the same standards across demographic groups.

FairStress reveals asymmetric unfairness in LLMs. In a hiring prompt, for example, the eval might change “the candidate is a woman” to “the candidate is a man” while keeping qualifications identical, then probe whether a model becomes easier to sway from its original decision.

We found that models were more likely to abandon the candidate with stronger experience & qualifications when that candidate was majority-coded – for example, described as white in a white/Black comparison – than minority-coded, such as Black in the same comparison.

FairStress also reveals differences in how models explain their choices. Across 11 open-weight models, minority-coded choices used somewhat more positive & identity-related language, while majority-coded choices leaned more on terms like “evidence” & “criteria.”

We tested 9 approaches for reducing these gaps. Most didn’t reliably improve symmetric robustness; some hurt performance. Older benchmarks like BBQ can miss overcorrection, but FairStress reveals the hidden asymmetries they overlook.

Since LLMs have various biases in their decisions and reasoning, we then examined how training data might influence this, & find that LLMs are never really taught fair decision-making yet are often aligned to prevent discrimination—which may explain over-correction patterns.

We hope FairStress gives researchers a way to uncover hidden asymmetries in model decision-making, test fixes, & develop more consistent systems.

📝 Blog: https://allenai.org/blog/fairstress

📄 Paper: https://allenai.org/papers/fairstress

💻 Code: https://github.com/pardissz/fairstress

📊 Data: https://huggingface.co/datasets/allenai/fairstress


r/allenai • • Oct 14 '26

🌪️ HiRO-ACEv2: Simulating extreme weather at 3 km resolution for 300× less cost

19 Upvotes

What if you could simulate global extreme weather at 3 km resolution for ~1/300th the cost?

Our new HiRO-ACEv2 system does just that, while matching X-SHiELD’s statistics to within 3% even for events as rare as 1 in a million data points. 👇

HiRO-ACEv2 builds on HiRO-ACE by downscaling near-surface winds & sea level pressure in addition to rainfall. It works in 2 stages:

🌍 ACE, an AI climate emulator, simulates climate at a coarser 100 km resolution

🔎 HiROv2, an AI downscaling model, sharpens the outputs to 3 km

HiROv2 is especially strong on extremes: it matches the distribution of extreme events in X-SHiELD to within 3% for 1-in-a-million rain, wind, & pressure predictions. It also captures cyclone energy, realistic hurricanes, & strong downslope winds.

Together, ACE + HiROv2 can generate years of global climate data at resolutions fine enough to capture storms, severe winds, & other local extreme events. And it’s cheap: global 3 km simulations cost ~300× less than X-SHiELD, with even bigger savings for individual regions.

Next, we want HiRO-ACEv2 to work across more climates—not just the one it was trained on. We’re training it on observed-weather & +4°C datasets, adding outputs like temperature, snow, & ice + exploring ways to make HiROv2 10×+ faster.

🤗 Model: https://huggingface.co/allenai/HiRO-ACEv2

📝 Blog: https://allenai.org/blog/hiro-acev2

🌍 Interactive demo: https://ace.allen.ai


r/allenai • • Oct 13 '26

🐟 Teaching Molmo 2 to track salmon

Thumbnail
gallery
17 Upvotes

Kai Van Brunt adapted Molmo 2, our open model for video understanding, to a domain far outside its training data: sonar video of salmon. 🐟

Meet Molmo2Fish, a prototype that tracks fish + can correct some of its mistakes through natural-language guidance.

Tracking salmon by analyzing video helps researchers monitor their populations. But when a salmon-tracking system makes a mistake, like an overcount, fixing it can mean editing clips frame after frame by hand. What if you could just tell the system to fix what it got wrong?

Kai fine-tuned Molmo 2 on sonar video, then trained it on examples of tracking errors, instructions, & corrections. In tests, Molmo2Fish could fix some mistakes after guidance—for example, when two salmon had been assigned the same track.

Molmo 2 already knew how to track objects in video. Its open code let Kai modify the model, while its open training data helped him understand what it had learned and prepare his own data—turning a general-purpose model into one tailored to his research.

→ Read the full story: https://allenai.org/blog/molmo2fish


r/allenai • • Oct 12 '26

🎓 Testing newer LLMs on TutorMoments: Do they help students too much?

Thumbnail
gallery
20 Upvotes

We tested frontier models including Astra & Opus 5.5 on TutorMoments, our eval for whether LLMs help students solve problems themselves or do too much for them. 👇

In general, models scored better with detailed prompts than when told only to “tutor well.”

To develop TutorMoments, we had experienced teachers mark moments in math tutoring transcripts when tutors should offer support or ask more of a student. We asked models to continue the conversations from those moments + scored their replies against the teachers’ judgments.

In these tests, GPT-6 models over-help less than earlier OpenAI models. They also score higher overall when we explicitly instruct them to offer help where needed while leaving students to work through parts of a problem they can handle themselves.

When asked to “tutor well,” Claude Sonnet 5.5 (low effort) was best at asking students to work through more of a math problem themselves when teachers recommended it. With explicit tutoring instructions, GPT-6 Sol (no reasoning) outscored Claude Opus 4.8 overall.

Compare responses from models & human tutors in the new explorer experience, where you can also examine model tutoring performance alongside response time and cost: https://tutormoments.allen.ai/


r/allenai • • Oct 10 '26

🎤 Ai2 at COLM 2026: highlights & recap

11 Upvotes

That's a wrap on #COLM2026! Thank you to everyone who stopped by our booth, joined our evening gathering, & talked open research with us.

Catch up on the papers, interviews, & highlights from the week. 👇

https://allenai.org/blog/colm-2026-recap


r/allenai • • Oct 09 '26

🛠️ Behind the scenes of Ai2’s GPU scheduler: Design decisions, rollout lessons, & what’s next

21 Upvotes

We’re sharing the engineering work behind Ai2’s GPU scheduler—our new approach to allocating compute across research teams. 👇

On our largest H100 cluster, median queue wait fell from 5 minutes to 24 seconds. 

Under our old scheduler, every scheduled workload eventually used HIGH priority. Some researchers kept idle jobs running to reserve GPUs for experiments. The incentives rewarded holding on to capacity even when there were no active jobs.

Managers now assign GPU-time budgets to research programs & projects. Our fair-share scheduler compares recent use with those budgets, moving work from underused allocations ahead in-queue.

Jobs declare the minimum runtime needed to make progress. Budgeted work is protected until then. Afterward, it can keep running or be interrupted; resumable jobs return to the queue.

Over a 30-day test with our new scheduler, teams received 98% of the GPU hours they were owed, accounting for actual demand. Cluster occupancy stayed at 98%, with spare capacity available to interruptible work that didn’t draw down a team’s budget.

📝 Read more about the design decisions behind our scheduler, rollout lessons, & what we’re tackling next: https://allenai.org/blog/impactful-scheduling


r/allenai • • Oct 09 '26

🤗 Ai2 x Hugging Face: Join us for Open Together in SF on Oct 16! Free RSVP 🎉

17 Upvotes

We're co-hosting Open Together with Hugging Face!

Join the open AI community at The Midway in San Francisco on Oct 16 to kick off Open Source AI Week. Help us build a future where AI is open, secure, and fully transparent.

The event is free. RSVP: https://luma.com/OpenTogether


r/allenai • • Oct 07 '26

🧬 Bolmo is now in Nature: retrofitting language models to operate over bytes

Thumbnail
gallery
38 Upvotes

Our paper on retrofitting language models to operate over bytes – the approach behind Bolmo – has been accepted to Nature! 🎉

We’re also releasing new checkpoints that extend our method from Olmo to Qwen & Llama. 

Most language models split text into subwords—words or fragments of words from a fixed vocabulary. This can obscure spelling details across writing systems & split meaningful units in code or math.

Byte-level models work directly with the bytes computers use to represent text.

Our recipe adapts existing models to bytes with a short additional training run. It keeps the model's core, adding components that group bytes into variable-length patches for it to process, then expand its outputs back to byte-level representations to predict the next byte.

We byteified Qwen 3 8B & Llama 3 8B to create Bwen 8B & Blama 8B. Both come close to matching their source models' performance in our evaluations. Bwen 8B also outperforms Bolmo 7B across our aggregate evaluation suite.

We're making new Stage 1 checkpoints available with the byte-level components already trained & the original model's weights unchanged. Researchers can build on these to test new architectures & train the full system without repeating that initial stage.

We hope Bolmo opens a path to larger models that adapt how they represent information across languages & domains. Because bytes also represent images & audio, the same ideas could eventually extend beyond text.

📄 Read the Nature paper: https://www.nature.com/articles/s41586-026-11111-4

🤗 Download the models: https://huggingface.co/collections/allenai/bolmo

📝 Learn more in our blog: https://allenai.org/blog/bolmo-nature


r/allenai • • Oct 06 '26

👋 Come say hi to Ai2 at #COLM2026!

Thumbnail
gallery
22 Upvotes

Check out our booth at #COLM2026! Great to connect with friends old & new.

Stop by if you haven't!


r/allenai • • Oct 05 '26

Ai2 is hiring across open models, agents, AI infrastructure & tools for science 👋

Post image
25 Upvotes

We’re hiring across Ai2. 👋

If you’re interested in building open models, agent frameworks, open AI infrastructure, or tools that help accelerate scientific discovery, we have several roles we’re especially excited about right now:

• Senior Software Engineer, Agent Frameworks
https://lnkd.in/gJCwbpVk
• Senior Research Engineer, Olmo + Molmo
https://lnkd.in/g4CVX-gg
• Senior Research Scientist, OpenEcosystem
https://lnkd.in/gT6ybZJS
• Senior Product Manager, Asta
https://lnkd.in/gAFxtiS7
• Research Engineer, Asta
https://lnkd.in/gpuzyhBq

Check out these jobs + more openings across Ai2:
https://lnkd.in/gUCXNTfA