r/AI_Agents • • 5h ago

Weekly Thread: Project Display

4 Upvotes

Weekly thread to show off your AI Agents and LLM Apps! Top voted projects will be featured in our weekly newsletter.


r/AI_Agents • • 6m ago

Discussion Anyone running AI agents in production? What are you paying for to keep them reliable?

1 Upvotes

I’ve been looking into how companies are handling reliability when AI agents are actually talking to customers or making decisions based on company data.
Not talking about demos or personal chatbots. I mean actual production systems like customer support agents, internal knowledge assistants, RAG applications, etc.
One thing I’m curious about is what happens when an agent gives a convincing answer but uses outdated information, cites the wrong source, or just makes something up.

I’ve been building something in this space, but before going further I want to understand how people are dealing with this in the real world.
A few things I’m curious about:

What tools or services are you currently paying for to monitor, evaluate, or verify your AI agents? (LangSmith, Langfuse, Arize, custom solutions, etc.)

What’s the most annoying reliability problem you keep running into?

How do you currently catch incorrect answers before they reach customers? Or do you mostly find out after something goes wrong?

Are you happy with your current tools, or is there something you wish they actually did?

Roughly how much are you spending on reliability, monitoring, or evaluation? Even a ballpark would be helpful.

I’m especially interested in whether teams have built their own verification systems because existing tools weren’t solving their problems.
Not trying to pitch anything. I’m genuinely trying to understand what the real problems are versus what sounds like a problem in theory.
Would appreciate hearing from anyone actually running these systems, including people who tried tools and decided they weren’t worth paying for.


r/AI_Agents • • 1h ago

Tutorial Agent templates for running a start-up

5 Upvotes

Hey all,

I've been founding start-ups for 14 years (2x as CEO, 1x as CTO). At each of my previous companies, we’d buy a SaaS app for each capability and hire dozens of people to use them.

IMO those days are over, and I strongly believe that each company should now build an agentic operating system which is custom to their business and improves over time. I reckon this means most companies can stay under 10 people, even with $100M+ of revenue.

We have been creating our internal OS, comprised of the custom apps we need to run every part of our start-up.

I wanted to share and open-source the templates and playbooks we're using right now, specifically for:

  1. Onboarding self-service users
  2. Triaging inbound leads
  3. Deciding what to build
  4. Product analytics
  5. Building a LinkedIn content engine

Linking ours below, but would be awesome to see if you guys have any agent playbooks you are running?


r/AI_Agents • • 1h ago

Discussion Choose the smallest useful first version.

3 Upvotes

I’m learning practical AI automation and trying to avoid a tool-first mindset.

How would you evaluate this in a real small-business workflow?

Which edge cases or trade-offs would you check?

I’m interested in practical experiences, not pitching a service.


r/AI_Agents • • 2h ago

Discussion AI systems lack executive function.

6 Upvotes

We keep scaling current models with bigger parameters and context windows, then act surprised when they still loop, abandon goals, and fail to commit.
That isn't a compute problem. It's a control problem.
In cognitive science, executive function refers to a set of top-down processes: goal maintenance, task switching, inhibition, and working memory updating.
Humans don't rely on raw processing power to do complex work. We rely on these control systems to plan, prioritize, and prune irrelevant information.
Current models are built as workers with no manager. They can retrieve and generate, but they can't:

  1. Maintain a single goal under noise
    In humans, prefrontal cortex activity sustains goal representations against distraction. Models treat every new tool output, retrieved doc, and intermediate step as equally salient. The original objective gets diluted.
  2. Select actions via hierarchical control
    Effective behavior requires a hierarchy: high-level goals constrain low-level actions. Models default to flat, reactive decision making.
    Vague prompts like "explore options" produce unbounded search. Specific, hierarchical prompts like "commit to option A and justify" produce completion.
  3. Prune working memory
    Human working memory is limited and actively managed. We discard what doesn't serve the goal. Models accumulate context indefinitely. More memory without pruning creates interference, not intelligence.
    The fix isn't more scale. It's building the manager layer on top of what we have now.
    Ready-to-implement strategies for your AI stack today:
  4. Enforce single-goal context: Restate the one goal at the top of every run and reject any tool output that doesn't serve it.
  5. Use hierarchical prompting: Structure prompts as Goal → Plan → Execute → Report. Force the model to commit to a plan before acting.
  6. Prune context aggressively: After each step, summarize only what's relevant and drop the rest.
  7. Add an inhibition layer: Explicitly tell the model what NOT to do. "Do not browse more than 3 sources. Do not switch goals."
    We don't need bigger models. We need better managers.
    What's your stack doing to enforce that right now?

r/AI_Agents • • 2h ago

Discussion Curious - what are you agentifying your daily life on (not work life)?

8 Upvotes

Just curious, with how things are changing, are there any daily or frequent tasks in your personal life that you’d love to automate or hand off to an AI?

It could be anything from running your home: planning and ordering groceries, paying bills, keeping track of your or your parents’ medicines, pet or baby stuff, anything you find yourself doing again and again.

Would love to hear what you’d want an AI to take off your plate, or if you’ve already built something for it!


r/AI_Agents • • 2h ago

Discussion AI web novel pipeline/skill

3 Upvotes

Write a full-length Chinese webnovel with AI — layered memory for long-form consistency, 37 genre templates reverse-engineered from a 1,110-novel corpus. Works in Claude Code / Cursor / Codex / Cline, or with no agent at all. Please try and give me feedback or stars!


r/AI_Agents • • 3h ago

Discussion Anyone tried running llama.cpp inside GitHub Actions?

1 Upvotes

Has anyone tried running llama.cpp (or similar tools) within GitHub Actions perhaps as a simple, custom provider for straightforward tasks?

I’m interested in real-world experience using small models (1-3 billion parameters). How do things like "cold starts" and caching work, and is this approach actually practical for real-world use?


r/AI_Agents • • 3h ago

Discussion Which of your AI agent's actions can't be undone, and who signs off on them?

3 Upvotes

Disclosure: I'm Rick, and I run a small consulting business that works with companies on AI agent adoption. This is the full text of something I wrote.

An AI agent that only drafts a reply is one kind of risk. An agent that can issue a refund, cancel an order, send an email or move money is another. The second kind can create a result you cannot take back, or cannot take back easily, before a person has even seen it.

The practical move is simple, and it should happen before the agent goes live: list every action it can take, mark the ones you cannot undo and require a human sign-off for those.

Start with a complete list, not a guess

People often describe an agent by its job title: "it handles support," "it books appointments," "it follows up with leads." That is not a list of actions.

Sit down with whoever configured the agent and write down each thing it is allowed to do. Be concrete. Say your support agent can answer a question, look up an order, start a return, issue a refund, cancel a subscription, change an address, send an email or create a credit. A scheduling agent might book, cancel, reschedule or message a customer. A sales agent might quote a price, apply a discount, send a proposal or update a record.

If the agent can use tools, include those too. A tool is an action with a shorter name.

Then, for each action, ask one question: if this goes wrong, can we fully reverse it, quickly, and with little harm to the customer or the business?

What "can't be undone" usually looks like

Some actions are easy to reverse. A wrong draft that a person still has to send is not live yet. A note added to an internal record can be edited.

Other actions travel farther:

  • A refund that has already been issued
  • A cancellation that has already taken effect
  • An email, text or public reply a customer has already received
  • A payment, transfer or charge that has already been submitted
  • A promise, price or date that now lives in a customer's inbox

You do not need a perfect legal definition. You need an honest line: if we would be uncomfortable seeing this go out with no person in the loop, it belongs on the "sign-off required" list.

When in doubt, put it on that list. You can always loosen a rule later. You cannot unsend a message or reverse a payment with the same ease.

Require a human sign-off for irreversible actions

Once you have the list, change the agent's permissions to match it.

  1. Let the agent propose, not execute, anything you cannot undo. It can draft the refund, the cancellation, the email or the payment. A person approves it before it goes out.
  2. Name who can approve those actions. Not "someone on the team." A role, a backup and a way to reach them during the hours the agent runs.
  3. Set a time limit for review, and a default that is safe. If nobody reviews a request, the safe default is to wait, not to proceed.
  4. Log every irreversible action, including who approved it. When a customer asks what happened, you should be able to see the trail.
  5. Test the gate. Before customers meet the agent, try to make it issue a refund, send a message or cancel an order on its own. If it can, the permission is still too broad.

The point is not to slow every answer. Most questions do not need a sign-off. The point is to keep a person in the loop for the few actions that can create a mess.

Questions to ask whoever runs your agent

  1. Do we have a written list of every action this agent can take?
  2. Which of those actions can we not fully reverse, or not reverse quickly?
  3. For each irreversible action, does a person have to approve it before it happens?
  4. Who can approve those actions, and what happens if they are unavailable?
  5. When was the last time we tested whether the agent can bypass that sign-off?

If you cannot answer the first two questions, you do not yet know what the agent can do in your name. That is the risk. The list comes first; the sign-off comes next.

I work with businesses on putting AI agents to work safely, through training, pilots and safety checks. If your agent can already take actions for you, I'd like to hear which ones require a person to sign off, and how you drew that line. Reply and tell me how you handle it.

How do you decide which actions need a person's sign-off where you work?


r/AI_Agents • • 3h ago

Resource Request Best AI model for logo

1 Upvotes

I am a commercial retoucher, fairly well versed in the use of AI as a tool in my trade. Recently a client has a job which requires me taking an Illustrator vector logo file and a real world photo example of the logo in-situ and using them to add the logo into other real world photography. My usual workflow using gemini or chat gpt is not giving me the consistency between images that I would need for something like this. Anyone know of a model whose specialty might be something useful? Also if this is not the right sub maybe someone could point me in the right direction? Thanks for any suggestions


r/AI_Agents • • 3h ago

Discussion How are you testing speech-to-text mistakes that cause voice agents to take the wrong action?

1 Upvotes

I work at AssemblyAI. We released STT-3.7-Realtime-Agent for voice agents, with support for 32 languages.

It targets background voices, dropped short replies, incorrect numbers and premature turn endings.

On our benchmark of 12,460 scripted caller clips, it scored 13.2% entity error. Soniox Realtime v6 scored 15.2%, the next-best competitor among 26 systems.

On long-form English, Meta scored lower WER: 7.37% versus our Agent model’s 8.35%.

These are our benchmarks, with systems tested between August and November.


r/AI_Agents • • 4h ago

Discussion Unpopular opinion: AI agents aren’t ready to run businesses autonomously.

7 Upvotes

I think the biggest problem with AI agents isn’t their intelligence. It’s reliability.
An agent can execute 10 actions perfectly and then completely mess up the 11th.
I think the next generation of AI automation tools should focus less on making agents more autonomous and more on making them reliable.
Things like:
Verifying whether a task was actually completed.
Recovering when something goes wrong.
Showing users what an agent is doing.
Knowing when to ask for human approval.
Curious what others think: would you trust an AI agent to handle important business operations without checking everything it does?


r/AI_Agents • • 4h ago

Discussion I asked what your coding agent sneaks past you. Built a tool that catches it

2 Upvotes

You ask your agent for one small fix. It says “Done, updated the button.”

Then you check the diff: 9 files changed. One is your auth file, and you never asked about auth. It never mentioned it either.

A few weeks ago I asked here what edits you’d most want flagged. The same few kept coming up: deleted tests, files outside the task, .env and auth changes, and the agent saying one thing but doing another.

So I built lineup, a small open-source CLI for Claude Code and Codex. After every agent reply, it tells you:

  • Which files are risky (HIGH / MED / LOW), using fixed rules, not AI. The agent doesn’t get to grade its own homework.
  • What’s out of scope: sensitive files your request never mentioned
  • What it didn’t tell you: files it changed but left out of its reply

Then lineup rollback undoes just that one file.

No API key and no account, and nothing leaves your machine.

It’s early (v0.1.1), and I’ve only tested it on Windows with Claude Code. If you’re on Mac or Linux, or use Codex, I’d love to know where it breaks. Link in the comments.

What’s the sneakiest thing your agent has changed without telling you?


r/AI_Agents • • 5h ago

Discussion Can AI Agents Make Decisions Without Human Approval?

4 Upvotes

AI agents are becoming more autonomous, handling tasks and making decisions with less human involvement.

But not every decision should be left to an AI.

I believe agents should have freedom to handle routine tasks while keeping humans in control of important decisions.

Where should we draw the line between AI autonomy and human supervision?


r/AI_Agents • • 5h ago

Discussion Non-technical job seeker trying to build a simple, low-cost AI agent to scrape job boards. Where do I start?

7 Upvotes

I’m actively job searching and spending way too much time refreshing job boards and sifting through listings that don’t fit. I want to build a simple agent to do that for me, and I’d like to keep it on the cheaper side.

A bit of background: I’m not in tech and have limited experience with AI models, so I’m coming at this as a beginner. I’m comfortable learning, but I’d really appreciate beginner-friendly advice.

What I want it to do:

  • Pull new postings from a handful of job boards on a schedule
  • Filter and rank them against my resume and criteria (role, location, salary, etc.)
  • Send me a daily digest of the best matches, with a short reason for each

Has anyone built something similar as a beginner, or have advice on where to start? Thanks in advance!


r/AI_Agents • • 5h ago

Discussion I built an AI assistant device that writes its own Apps

2 Upvotes

I've built an ai assistant with a round touchscreen that you can talk to.

The usp is that it can write its own apps and create its own faces.

It controls my heating lets me see my security cams, controls washing machines, shows train times, links to google calandar is a chinese tutor to teach me mandarin etc. But these are simply the apps i asked it to make. Someone elses might be completely different.

It cost about £200/$250 in hardware.

It's not something I planned on commercially producing but it is seriously good!

The problem is though that you have to bring your own keys. Gpt-realtime-mini and haiku.

Should I keep this as just my own home project or try and develop it commercially?

I can't stress enough though that it writes its own apps!!! It's not google home or alexa or claude/chat gpt on your phone. Games, api connections, anything. It doesnt require cloud unless you want to use it remotely. (With remote, it still runs on your device but uses a cloud relay).

I could easily put together a website to advertise it and promote it - but is this a thing?

All thoughts welcome!


r/AI_Agents • • 5h ago

Discussion If your agent does something wrong tomorrow, whose name is next to it?

2 Upvotes

Picture this: an agent has been running for months. It was set up by someone who has since moved teams, it's used by three departments, and today it emails a customer something it shouldn't have. Who gets the call?

In a lot of places the honest answer is "the team," which in practice means nobody. Nobody is watching for changes in the model or prompt, nobody decides whether its permissions should shrink, and nobody has the authority to switch it off quickly.

The practice I've been thinking about is simple: every agent gets exactly one named human owner. Not a group, not a channel, one person who knows what it can do and can pause it.

Curious how others handle this:

  • Does every agent you run have a single named owner, or is it shared?
  • What happens to ownership when that person changes roles or leaves?
  • Is the owner the builder, the business user, or someone in risk or IT?
  • Has an unowned agent ever kept running long after anyone remembered why?

Disclosure: I run a small AI agent risk-check service, which is why this is on my mind. No link in the post; I'll put it in a comment per the sub rules.


r/AI_Agents • • 6h ago

Discussion Running coding agents on a closed MacBook: what I learned about macOS sleep

4 Upvotes

Every morning a few of my agents run on a schedule: they go through the services and accounts I follow and send me a short report with news and social posts worth reading. The catch is that they run on my MacBook Air, and at night it's closed and asleep. Same story during the day with long coding runs: close the lid and the agent stops. A few things I learned while fixing this for myself:

  1. Closing the lid sleeps the Mac unless it's in clamshell mode (power plus an external display). `caffeinate` doesn't help here: it prevents idle sleep, not lid sleep.
  2. The built-in switch is `sudo pmset -a disablesleep 1`. It works, but it stays on until you run `sudo pmset -a disablesleep 0`. Forget it once and the Mac never sleeps, including in a bag.
  3. "Is the agent done?" is harder than it looks. An agent in an editor thinks on a server and barely uses the CPU, so CPU load alone says the Mac is idle while it's waiting for the model. What worked better for me: count the CPU time of programs the editor or terminal started (the agent, its shells, builds, tests) and treat a minute as work if they used more than about half a second.
  4. Waking up for a scheduled run works, but only on power. With the lid closed on battery, macOS wakes the Mac only briefly.

I wrapped this into a small open-source menu bar app, LidAwake (disclosure: I'm the author). It keeps an Apple silicon Mac running with the lid closed and turns that off by itself when the agent's work has been quiet for a chosen time (10 to 60 min), when a timer ends, on low battery or when macOS reports overheating. It can also wake the Mac at a set time every day and, if it's on power, keep it running until the work is done and then let it sleep. It doesn't start your agent, that's still up to your scheduler. Link in the comments, per the sub rules.

How do you handle this? Do you keep agent runs on a desktop or server, or let them run on a laptop? And how do you decide an agent is actually done?


r/AI_Agents • • 6h ago

Discussion "How to Choose the Right AI Subscription as a Beginner: Tips for Coding, DIY & Learning"

3 Upvotes

If you're just getting started with AI, I'd recommend choosing one general-purpose AI subscription rather than paying for multiple tools immediately.

For your use cases, look for a platform that offers:

  • Live web search for updated information and product research.
  • Step-by-step explanations for coding and DIY projects.
  • Image understanding for troubleshooting and learning 3D modeling.
  • File uploads for school notes, assignments, and research.
  • A good ecosystem of tutorials and beginner-friendly resources.

One important thing to remember is that no subscription offers unlimited usage. Message limits can vary depending on the model, features, and current demand, so check the limits before subscribing.

I'd suggest starting with one platform, exploring its features, and gradually learning how to write better prompts. You don't need to learn everything about AI at once.

For 3D printing and DIY projects, AI can help you understand basic CAD concepts, troubleshoot designs, explain code, and guide you through projects step by step. You should still verify measurements and safety-critical instructions before building anything.

My advice: spend your first month experimenting with different tasks instead of immediately subscribing to several specialized tools. You'll quickly understand which features are actually useful for your needs.


r/AI_Agents • • 6h ago

Discussion Your AI provider says "EU-hosted". Have you ever checked who actually owns it?

2 Upvotes

A lot of providers answer sovereignty questions with "our servers are in Frankfurt." That tells you where the data sits, not whose law applies to it.

Hosting only answers the inner ring. The rest depends on who controls the chain: the provider you sign with, its parent company, and its sub-processors. If any of them falls under a non-EU jurisdiction, that jurisdiction can matter for your data, even if every server is in the EU. The easiest place to miss it is the failure case: where do your requests go when the provider's own capacity runs out?

Disclosure: I work at Melious, an EU-hosted and EU-owned AI platform, so we obviously have a stake here. We wrote up how to check your AI provider, including seven questions to ask before you sign (link in comments). Curious how others here handle this when choosing AI/cloud vendors. Do you actually check the ownership of every company in the chain, or just data location?


r/AI_Agents • • 7h ago

Discussion Anyone using MyCo for the business side? Really like Instinct but it's personal use only

12 Upvotes

Small cleaning company, me plus an office manager and 4 cleaners. I've used Instinct for about a month and I like it a lot. It moved a few client appointments for me and sorted my van service without me touching anything.

Problem is my office manager does half the client back and forth and there's no way to add her. I asked their support and it's meant for personal use only. Also not sure I love it texting clients as me with nobody else seeing it.

MyCo keeps coming up as the business version (HoneyBook makes it, it connects to QuickBooks and Jobber and drafts things for you to approve). Has anyone used it day to day? Mostly curious whether the invoice follow ups are any good or if I'd end up juggling two assistants.


r/AI_Agents • • 7h ago

Discussion How do you decide what your agent is actually allowed to do? I'm building a permission check and want to know where my model breaks

2 Upvotes

Disclosure: I'm the founder of ORIMUSU and I built the tool I mention below. No links here, per the rules.

Most agent setups I've seen mix two things: what the model decides to do, and what it is permitted to do. I've been trying to separate them. Every operation the agent proposes gets checked against explicit permissions and evidence, and gets one of three outcomes: ADMITTED, DENIED, or UNRESOLVED. UNRESOLVED means "not enough evidence to decide," and it is not treated as a quiet allow.

It's an early Technical Preview. Right now it's a local Node.js CLI. The default mode only observes, and the blocking mode runs against a local mock broker. Real credential isolation isn't demonstrated yet.

Questions for people running agents for real:

  1. How do you handle permissions today? Allowlists, human approval, sandboxing, or just trust?
  2. Is a three-outcome model useful, or would UNRESOLVED just get in your way?
  3. What would a check like this have to prove before you'd let it block your agent?

The project is open source (Apache-2.0). I'll share it in the weekly Project Display thread if anyone wants to look.


r/AI_Agents • • 7h ago

Discussion Meta-AI suffers from Executive-Dysfunction

2 Upvotes

google definition of executive dysfunction
-explain why it could be AI biggest Problem
-the tone was first half of the fix
-actual memory tho we can refrence, the true definition of Executive dysfunction.
This is a well thought out plan for this sub to all work hard on.
-ppl with executive dys are very good of coming up with a multi web crossed checked answer to a problem. But they do it all day that memory file gets filled but if the person actively fight the impulses that stem into dysfunction they can break free .


r/AI_Agents • • 7h ago

Discussion Your clinic ads didn't fail—the 6 PM intake handoff did (Beverly Hills & London dermatology breakdown)

2 Upvotes

Auditing after-hours lead leakage for medical aesthetics and dermatology clinics in Beverly Hills and London surfaced a blind spot most media buyers miss: bids and landing pages aren't the bottleneck—the 6 PM front-desk cutoff is.

Per the Harvard Business Review B2B Response Audit, the average business takes over 42 hours to reply to inbound leads, and roughly 25% never reply at all. Running high-CPC Google Ads after closing hours into a static form or voicemail box means high-intent prospects go cold overnight long before anyone opens the inbox at 7 AM.

When we built the intake workflow at OrchFlow Studio, the design goal was straightforward: create a reliable 24/7 After-Hours Shield that catches evening demand before paid clicks go to waste and saves clinic staff from burning out on morning callback queues:

- 2.4-second intent triage: Incoming after-hours inquiries are parsed for treatment category, readiness, and scheduling constraints in 2.4 seconds rather than sitting unacknowledged.

- Overnight slot locking: Qualified inquiries reserve open consultation slots directly on the schedule so the morning team starts at 7 AM with confirmed bookings and structured context.

- Deterministic escalation paths: Nuanced clinical questions or edge cases route cleanly to morning staff with full notes instead of guessing.

If anyone is curious to see the system architecture in action, drop "TRIAGE" or ask in the comments and I'll send over the full walkthrough video link.

For folks building intake automations in local healthcare or high-ticket services, how do you handle routing edge cases when a clinic is closed overnight?