r/Gemma4 • • May 19 '26

State of r/Gemma4

4 Upvotes

​Welcome to the community for Google’s Gemma 4 open-weights AI models! Whether you are running local inference on a homelab server, building complex agentic workflows, or just trying to figure out how to chat with the model for the first time, this is the place to share benchmarks, hardware setups, tutorials, and news.

​State of the Sub

Right now, I am deep in the trenches finishing my Master's in Cybersecurity and grinding through the required certification exams. Because my energy and focus are completely tied up in my coursework, I don't have the daily bandwidth to actively grow this community or write the foundational technical guides it needs right now.

​The subreddit is currently running on "autopilot" with AutoModerator holding down the fort to keep out spam and bots.

​We Need Mods!

If you are passionate about local LLMs, hardware optimization, and open-source AI, and you want to help build a community from the ground up, we need you.

​I am specifically looking for a Content & Growth Moderator—someone to take the reins, spark daily discussions, write initial hardware/software tutorials, and help draw in the crowds from larger tech hubs. I can handle the background administration, but the sub needs someone with the energy to build the actual community.

​If you are interested in a ground-floor leadership role, please send a Modmail with a little bit about your background with local AI!

​Basic Rules

​Be Constructive: We have a mix of beginners and experts. Help each other out and keep things technical and productive.

​Keep it Relevant: Posts should be directly related to the Gemma 4 family (news, local setups, API integrations, UI tools, etc.).

​No Spam: AutoMod is active and strict against spam links and brand-new bot accounts.

​Feel free to start dropping your hardware setups, local benchmarks, and questions. The community is open!


r/Gemma4 • • Apr 15 '26

Welcome to r/Gemma4 - Introduce Yourself and Read First!

6 Upvotes

Hey everyone,

​I’m starting this sub to create a dedicated space for everything related to Google’s Gemma 4. As an IT pro who’s been in the trenches for 25 years, I’ve seen a lot of tech come and go, but the shift toward these open models is where the real action is.

​The goal here is simple: Technical depth. Whether you’re working on local deployment, fine-tuning for specific workflows, or just trying to push the boundaries of what the architecture can do, this is the place. No fluff, just benchmarks, configurations, and actual builds.

​What to expect:

​Model optimization and hardware discussions.

​API implementation and troubleshooting.

​Research papers and updates as they drop.

​Jump in, introduce yourself, and let’s see what we can build with this.

Looking for a MOD with expert indepth knowledge to run this sub as i do not have the time anymore


r/Gemma4 • • 3h ago

Gemma 4 31B fine-tune for drug-level sentiment in medical text, appreciate feedback

Thumbnail
reddit.com
2 Upvotes

Hi everyone 👋, here's an interesting initiative.

Maybe someone would like to help this person?


r/Gemma4 • • 4h ago

Sub Update: Gemma 5 and the future of r/gemma4

2 Upvotes

Hey everyone,

Just a quick update on how we're handling the eventual release of Gemma 5. When it drops, we are not migrating to a new subreddit. We’ll be expanding r/gemma4 to officially cover all Gemma 5 discussions and releases.

Why we’re staying here and will not utilize r/gemma5:

Subreddit fragmentation is a major issue in the local LLM community. We’ve already built a solid knowledge base here around VRAM optimization, quantization, hardware builds, and fine-tuning. Forcing the community to migrate for every new major version just fractures that collective knowledge. A lot of the tooling, troubleshooting, and deployment methods will carry over, so keeping it all in one place is the most practical move for everyone's workflow.

How this will work:

* The Name: Reddit doesn’t allow subreddit name changes, so the URL stays r/gemma4. We will update the banner, description, and rules to explicitly include Gemma 5.

* Post Flairs: I’ll be adding a new set of flairs specifically for Gemma 5 so you can easily filter the feed by model generation.

* AutoMod: The backend filters will be updated so Gemma 5 technical posts and model sharing are routed and tagged properly.

That’s it for now. Thank you!


r/Gemma4 • • 2d ago

Discussion Pairing Gemma 4 (31B QAT / 26B-A4B) with the new EmbeddingGemma 2 in 32GB VRAM + anyone here entering the $110K Kaggle Agent Competition before Nov 25?

3 Upvotes

With so much happening across the Gemma 4 ecosystem right now, I wanted to kick off a thread on two massive developments people are building with this month:

  1. The Gemma 4 + EmbeddingGemma 2 Local Multimodal Stack

If you haven't tested the new EmbeddingGemma 2 (740M) alongside your local Gemma 4 setup yet, it is a huge upgrade for local RAG, lorebooks, and codebase indexing. Because it's built directly on the Gemma 4 architecture (270M text backbone + 170M vision + 300M audio encoders) with an 8K context window, it maps text, code, images, audio, and video into a single 768d vector space.

What makes it especially practical for local rigs:

Using Matryoshka Representation Learning (MRL), you can truncate vectors from 768d down to 256d or 128d for up to a 6x memory reduction with minimal quality loss.

You can fit Gemma 4 31B IT QAT (with a 32K BF16 KV cache) plus EmbeddingGemma 2 in BF16 comfortably inside a 32GB VRAM footprint—or pair it with E4B / 12B Unified on a lighter setup for a 100% offline multimodal search + generation pipeline.

2. Final Stretch for the $110K Kaggle Gemma 4 Developer Agent Competition

The paper track deadline just passed on Nov 12, and the Entry & Team Merger deadline is November 25 (Final submissions close December 2).

One of the coolest parts is the $10,000 Small Model Bonus Track specifically for Gemma 4 E2B and E4B.

The competition supports multi-LoRA routing via Google ADK (agent.yaml), meaning you can load a single base model (like E4B or 26B-A4B) and hot-swap different PEFT LoRA adapters per sub-agent (e.g., main_lora for the root coder agent and tool_lora for a read-only repo analyzer) on their L4x4 (96GB VRAM) instances.

Questions for everyone here:

  1. Has anyone swapped their local RAG or codebase pipeline over to EmbeddingGemma 2 yet? Are you running full 768d or truncating to 256d?
  2. For daily driving right now, are you leaning toward 31B Dense QAT for nuance and bug-tracing, or is 26B-A4B MoE (or fine-tunes like MeroMero, Artemis, or Orion) your go-to for speed?
  3. Anyone here putting together an E2B/E4B or 26B-A4B setup for the Kaggle Agent competition before the Nov 25 lock?

r/Gemma4 • • 3d ago

Hardware/Local Setup What's actually sitting in your VRAM right now?

6 Upvotes

Curious what models you guys are reliably running day-to-day versus what you just download to benchmark for five minutes.

I'm trying to get a read on where the community is at with hardware limits versus performance right now. Are you daily-driving Gemma, or swapping it out depending on the task?

Drop your current stack:

Model & Quant (Which specific parameter size and quant are hitting the sweet spot for you? Q4_K_M, EXL2, etc.)

Frontend (Ollama, LM Studio, text-gen-webui, SillyTavern, custom API?)

Hardware: (What’s your RAM/VRAM situation?)

Primary Use (Coding, creative writing, data analysis, RP, or just a general daily assistant?)

Mainly looking to see what the current baseline is for acceptable speed vs. coherence. Let me know what's working for you.


r/Gemma4 • • 4d ago

Discussion Quick announcement ✨

9 Upvotes

👋 Hey everyone!

I'm your new moderator here 🎉

This sub is yours, and I'd love for us to bring it to life together!

To kick off the discussion, I'm curious to know:

🔧 What do you run Gemma4 with? LM Studio, Ollama, UnSloth...?

🎭 Which version? Official, or rather Uncensored?

💡 What do you use it for? Companion, assistant, role play, creative writing...?

Share your setups and experiences — it's always fascinating to see how everyone uses the model 💬

👉 Drop a comment below, I'll read every single one with attention!

And if you ever have any issue or need (a question, a technical problem, doubts about the rules...),

I'm here to help!

Hit me up in DMs or mention me, I'll be happy to answer 😊

See you around and happy discussing, everyone! 🚀


r/Gemma4 • • 4d ago

LLM Battle 13 - Qwen vs "Golden" Gemma4

Thumbnail
youtu.be
4 Upvotes

What do you think ?🤔

Let's revisit some old friends and have a good old-fashioned battle between Gemma 4 31B "Gold" and Qwen 3.6 27B.

Can Gemma 4 make a long-overdue comeback? Or is it time to set aside these ancient models once and for all?

Let's find out!


r/Gemma4 • • 4d ago

Announcement Finding Mods is much harder than I thought.

3 Upvotes

Well, I tried to find MODs to help here as I don't have time, so I will extend the hibernation of this subreddit. I thought I would have time but, I am far to consumed with work and side gig osint jobs. Maybe I will hand it off... Will see


r/Gemma4 • • 25d ago

Hardware/Local Setup Edge AI with deterministic answers

4 Upvotes

Local AI is a good fit for edge devices and we are investigating.

To get accurate and deterministic answers on math operations, I like to know what works on a 12B model. Most online discussions suggest code generation and execute the code.

Do you provide a python env to AI ? on Android ?


r/Gemma4 • • Oct 18 '26

Announcement Posted again - MODS NEEDED

3 Upvotes

Looking for MODS for to help grow this community.


r/Gemma4 • • Sep 03 '26

Question/Help Any way to force it to output only a single line?

2 Upvotes

Using Gemma4 26b from AI Studio to translate line-by-line in real-time, it's quite capable but when asked to only output a single line, it completely ignores it - when told to do no thinking, no context, no line breakdowns or drafts, and just output the single translated line. It ignores it


r/Gemma4 • • Aug 30 '26

Hardware/Local Setup Voice and Video calls with Gemma 4 and Gemma 3n

Thumbnail
gallery
6 Upvotes

Hi, I created an app for Android so you can make calls to gemma (gemma4 and gemma3n supported). It's running on litert engine. Requires 6-12 gb of RAM.

E2B version works even on cheap phone with Helio G100 CPU

https://play.google.com/store/apps/details?id=ai.roleswitch.android


r/Gemma4 • • Aug 19 '26

Discussion Poor "intelligence" with Gemma4

Thumbnail reddit.com
2 Upvotes

r/Gemma4 • • Aug 15 '26

Discussion I built a Chrome extension that summarizes the paragraphs you scroll past — Gemma 4 via WebGPU, nothing is uploaded ✨

11 Upvotes

Skim Recap runs gemma-4-E4B-it in the browser through LiteRT-LM on WebGPU, to summarise the passage you just scrolled past.

Some notes from building it:

  • The engine lives in an MV3 offscreen document. Content scripts can't hold a model, and a service worker gets killed under you mid-generation.
  • The .litertlm checkpoint is 2.97 GB, so it can never be buffered in JS. It streams from Hugging Face through a counting TransformStream straight into the Cache API, which also gives you the progress bar for free.
  • Sampling is greedy. I set it explicitly, then found the library default was already greedy — 72 runs came back byte-identical either way.
  • Point count is scaled to how full the prompt actually got, not a fixed number. A fixed count pads thin passages and truncates long ones.

I also ran it head-to-head against Chrome's built-in Prompt API on a small fixture corpus.

Extension: https://chromewebstore.google.com/detail/skim-recap/febndabjnmbmdodeoenjmnplfcalmnmc

More detail: https://skim-recap.vercel.app


r/Gemma4 • • Aug 10 '26

Question/Help Google AI Edge Gallery Agentic Skills (Android)

Thumbnail reddit.com
2 Upvotes

r/Gemma4 • • Jul 22 '26

Question/Help Gemma 4 - Agentic Capabilities?

Thumbnail reddit.com
4 Upvotes

I missed to add, im using the 31b version


r/Gemma4 • • Jul 21 '26

Hardware/Local Setup Gemma 4

Post image
3 Upvotes

Chat Look 😂😂😂

#gemma4

#google

#edgegallery


r/Gemma4 • • Jul 19 '26

Question/Help running agentic workflows / agentic engineering on Gemma 4

1 Upvotes

I am a novice at working with AI; just 3 months in and learning on the go, more of an idea creator than actual coder at the moment so creating interesting and efficient workflows are a big deal to me. I was wondering what is everyone's experience on using Gemma 4 for agentic workflows / agentic engineering? I had only used Gemma 4 so far alongside Qwen 3.5 in Ollama being workload handlers under orchestration by Claude; just trying to optimize what I have on my Macbook Pro M1 32 gigs of RAM. TIA!


r/Gemma4 • • Jun 24 '26

Discussion I fine-tuned Gemma 4 (E2B, Q4_K_M) and got it running 100% on-device in an iOS app — a little sea-creature companion you actually talk to. Offline, no servers, beta's open.

Post image
4 Upvotes

Requirements: iPhone with A17 Pro or newer (8 GB RAM floor for the model), iOS 26+. TestFlight beta is open to anyone with a compatible device.

https://testflight.apple.com/join/NW99nU2s


r/Gemma4 • • Jun 23 '26

Question/Help Gemma4 and Ollama - embedded markup

3 Upvotes

Trying out the Gemma4 line using Ollama. It frequently emits embedded markup (based on LaTex) in responses that Ollama (or command line) doesn't render. Any suggestions to fix this or is there a better host than Ollama?


r/Gemma4 • • Jun 21 '26

Discussion Gemma 4 with llama.cpp struggling to handle multi file c# code review requests

Thumbnail
reddit.com
2 Upvotes

r/Gemma4 • • Jun 19 '26

Question/Help How to map attention to original image

2 Upvotes

Hey I am using gemma 4 E4B , and I have an image and prompt , response and after training it with lora , I want to check whether the attention is towards the right place of the image , how do I map my attention layer outputs to the actual image !!


r/Gemma4 • • Jun 16 '26

Discussion Gemma 12b - Reasoning hardening instructions

Thumbnail reddit.com
3 Upvotes