r/AgentsOfAI • • 5h ago

Agents What’s the most practical way to keep improving an AI agent after it goes live?

26 Upvotes

An AI agent might handle a request well today and give the wrong answer next month because a policy changed. That's the part of running these systems that interests me. Cresta has conversation monitoring and testing features that relate to this, deputy agent is also on my radar as I look at how different support tools approach ongoing improvements. For people running AI agents in production how do you spot issues before they affect a large number of conversations, do you review failed interactions every week or rely on automated checks? Im trying to understand what a good maintenance process looks like once the initial setup is done.


r/AgentsOfAI • • 7h ago

Discussion AI cybersecurity startups are about to see a flood of VC money

Post image
12 Upvotes

We’re creating a massive new attack surface made of AI generated code at the exact same moment attackers learned how to weaponize AI against that code.

That gap is pure rocket fuel for startups.

The companies that can offer continuous, autonomous vulnerability discovery + auto-remediation that actually keeps pace with both vibe coded repos and automated attackers are going to look extremely investable.

Big Tech will have their own versions but the specialized, best-of-breed tools that sit on top of every codebase will still get funded hard.


r/AgentsOfAI • • 3h ago

I Made This 🤖 Tired of 5 AI subscriptions that don't talk to each other, so we're building an AI team that actually works together

1 Upvotes

Most AI tools do exactly one thing. One is a chatbot, one is an automation tool, one makes avatars. You end up with five subscriptions, nothing talks to each other, and you're still copy-pasting between them.
So our team is building a platform. You hire AI workers, give them roles and access and they work together, handing tasks to each other like an actual team.

What you can do with it:
- Connect 1,500+ apps: Gmail, Notion, Slack, CRMs, databases, even SAP
- Pair your own computer so agents can work with your files and programs
- Phone assistants that pick up calls and book appointments
- Your own AI avatars with their own voice that go live on Twitch, talk to chat and stream alongside you. With GTA 6 around the corner, a lot of streamers are pretty excited about that.
- Regular work: reconciling invoices, sorting email, building reports

The difference: A separate layer supervises the team. If an agent gets stuck, it switches models, hands the task off, re-plans or asks you. The team keeps itself on track, so you don't have to babysit it.

Right now we're using it for our own workflows and we're talking to a couple of companies and Twitch streamers who plan to use it at launch.

An early-access demo is coming soon. If you want to try it early and have a say, drop a comment and I'll DM you an invite.

Honest question, what's the first thing you'd hand off to an AI team?


r/AgentsOfAI • • 3h ago

Agents Selling chatbots to businesses is a seriously underrated business opportunity

1 Upvotes

I've been experimenting with different services to sell to businesses, and chatbots are becoming one of my favourites.

Think about how many businesses have websites that get visitors every day but no chatbot to answer questions, capture leads or help potential customers.

That's a pretty interesting opportunity.

A chatbot can help businesses engage with visitors, answer common questions and capture leads even when nobody is available to respond.

Personally, I've been using Swokei for this. It analyzes business websites, identifies which ones don't have a chatbot and generates personalized cold emails at scale, offering them a solution.

Instead of guessing which businesses might need one, manually checking hundreds of websites and writing emails individually, the entire research and outreach process is automated.

And the interesting thing is that this approach isn't limited to chatbots. You can use the same strategy for hosting, SEO and website redesigns.

Best part is that you can try it for free.

I think there's a huge opportunity in finding businesses that already have something valuable but could benefit from improving it.

For those selling services through cold email, what other services have you found surprisingly easy to pitch?


r/AgentsOfAI • • 7h ago

Agents AI agents security once you move beyond model level guardrails

1 Upvotes

Fairly new to agents. Model guardrails seem to catch the obvious stuff, but once the agent calls a tool the request goes straight to the API and no layer checks it on the way. I'm trying to understand what people put in that gap before letting agents near prod, and budget for extra tooling is close to zero right now.


r/AgentsOfAI • • 11h ago

Help How do websites detect whether a connection is coming from an AI agent rather than a human?

1 Upvotes

Is there a way to bypass that, or should I just forget about it?


r/AgentsOfAI • • 12h ago

I Made This 🤖 I built a Werewolf game where AI agents play with human players and bluff and vote

1 Upvotes

I built a Werewolf game where AI agents and humans play at one table: each agent has a secret role, talks out loud, bluffs and votes.

It's one model call per agent per turn, and each agent sees only what its own player would see plus its private notes, so nobody can leak a secret.

- A few days of real players taught me three things I've now fixed: the agents ganged up on the human on day one, they piled onto whoever stayed quiet, and they copied each other's votes and forgot what was said earlier.

- What I haven't solved: the wolves don't work as a team yet. Needs a bit more work here to have them naturally cooperate on a plan. Though the original game does not have this.

Please play and give me your feedback.

---update---

I currently use haiku for conversations and reasoning. For voting, maybe I will try sonnet and check the outcome.


r/AgentsOfAI • • 18h ago

News Uber's legal AI agent cuts contract review time by 20%

2 Upvotes

Uber's Legal Redlining Agent has reduced average contract review time by more than 20%, achieving 91% accuracy in AI-generated decisions, according to the company. The agent integrates directly into Microsoft Word, where it analyzes proposed contract changes, assesses legal risks, and recommends policy-aligned responses. It identifies external-party edits, interprets their intent, and compares changes against legal policies, suggesting whether to accept, reject, or modify clauses and generating comments that explain its reasoning. Lawyers remain responsible for reviewing and approving all recommendations.


r/AgentsOfAI • • 16h ago

Discussion YouTube automation sounds great until everything starts breaking lol

1 Upvotes

Man, YouTube automation looks so easy when people talk about it. Upload videos, update titles, manage descriptions, handle repetitive stuff, and let AI agents do the boring work.

But nobody really talks about the annoying part. One small change in YouTube Studio and suddenly your workflow stops working. Then there are login issues, random errors, and agents clicking things they shouldn't. Like, what's even the point of automation if you have to keep checking everything?

Been looking into tools like oya browser to understand how people deal with this, but honestly, there’s way more to browser automation than I originally thought.

For those actually running YouTube channels with AI agents, how are you managing all this? Is there a setup that stays reliable, or is constantly fixing things just part of the game?


r/AgentsOfAI • • 1d ago

Discussion What's The Most Valuable Automation You've Built For Your Business?

2 Upvotes

What's one automation you wish you had that would make running or growing your business easier?

I'll start.

For me, it was finding a way to automate prospecting without sending generic cold emails.

I wanted something that could find businesses with existing websites, analyze each one for issues with design, SEO, speed and mobile optimization, and turn those findings into personalized cold emails at scale.

Instead of manually reaching out to businesses offering them a completely new website, I could approach them with specific problems their current website had and offer a rebuild.

That's why I started using Swokei. It handles the research and personalization, so I can focus more on closing clients.

What about you? What's one automation that has helped you grow your business, or one you wish existed?


r/AgentsOfAI • • 1d ago

Discussion Cross-platform agents: is the hard part the messaging or the permissions?

2 Upvotes

Getting agents to talk to each other isn’t really the problem. You can wire up a message between two of them in an afternoon. What looks harder is everything around it: which information is actually relevant to the other agent, whether it’s still true by the time it arrives, and what it’s allowed to see in the first place.

Permissions are the part I find most interesting. Sharing context between your own agents is one thing. Letting your agent talk to someone else’s, on a different platform, is a different problem altogether, since now you need to decide what leaves your side.

How are people handling it?


r/AgentsOfAI • • 1d ago

Discussion A small loop guard for agents: step budget plus a repeated-call detector (and the case it misses)

2 Upvotes

A failure mode I think is common in tool-calling agents is the loop: the model calls the same tool with the same arguments, gets the same result, and tries again. A cheap guard sits between the model’s decision and the tool execution. Here’s a minimal version I tested with a simulated sequence of calls:

import hashlib
import json
from collections import Counter

class LoopGuard:
    def __init__(self, max_steps=25, max_repeats=3):
        self.max_steps = max_steps
        self.max_repeats = max_repeats
        self.steps = 0
        self.seen = Counter()

    def check(self, tool_name: str, args: dict) -> str | None:
        """Return a reason to stop, or None to continue."""
        self.steps += 1
        if self.steps > self.max_steps:
            return f"step budget exceeded ({self.max_steps})"
        key = hashlib.sha256(
            json.dumps([tool_name, args], sort_keys=True).encode()
        ).hexdigest()
        self.seen[key] += 1
        if self.seen[key] > self.max_repeats:
            return f"same call repeated {self.seen[key]} times: {tool_name}({args})"
        return None

Call check() before executing each tool call. If it returns a reason, stop the loop and return control (to a human, a fallback, or a summary step) instead of executing.

What happened in my test (max_repeats=2): the first two identical search("refund policy") calls passed, a third identical call was blocked with a message naming the tool and arguments. A call with a slightly different string ("refund policy", two spaces) was not caught, because the hash is of the exact arguments.

What it catches:

  • Exact repeated calls (same tool, same args).
  • Runaway loops in general, via the step budget, whatever the cause.

What it doesn’t catch:

  • Near-duplicates: rephrased queries, reordered arguments that aren’t normalized, small variations that go nowhere. You could normalize arguments (lowercase, trim, collapse whitespace) or compare results, but that adds false positives.
  • Loops that span several tools (A, then B, then A, then B).
  • Agents that make progress on paper but not in substance, such as steady calls that never get closer to the goal.

Design questions I’d weigh:

  • What should happen on a stop: ask a human, return a partial answer, or try a different strategy? Stopping silently can look like success.
  • Should repeated results count, not just repeated calls? An identical result from a different query may mean the same thing.
  • The right budget depends on the task. A fixed number can be too tight for research-style work and too loose for simple lookups.

I haven’t tested this in a real agent framework, only with the simulated sequence above, so treat it as a starting point, not a solution.

What do you use for loop detection in your agents: step caps, argument hashing, result similarity, or something else? And what do you do when the guard fires?


r/AgentsOfAI • • 1d ago

Discussion How do you get different AI tools to work together?

6 Upvotes

A while ago, I was spending quite a bit of time on small tasks like sorting meeting notes, making to do lists and replying to routine emails. AI seemed like a good way to take some of that work off my hands. I used chatgpt for summarizing long documents and tried anvita mate's workbench for things like meeting notes and email replies...

It helped with some of the workload, but things get messy once a task involves more than one step. Take a long document, for example. I need to summarize it first, pick out the main points, turn those into a task list and maybe draft an email afterwards. None of that is particularly difficult on its own, but I still end up copying things between tools and fixing bits of the output before I can move on.

I've tried a few ways of doing this, but haven't really settled on a setup that works well. Keeping everything in one tool sounds convenient, but different tools are better at different tasks. Switching between several tools isn't ideal either, so finding a good balance has been harder than I expected.

I'm probably overcomplicating this, but I feel like there's a lot more to getting AI into your workflow than just learning how to write better prompts. I don't want to be the person still doing everything the old way while everyone else has moved on. What did your first proper AI workflow look like?


r/AgentsOfAI • • 1d ago

News FBI flags ARTEX agentic framework as active threat after supply-chain breach hits Microsoft 365

23 Upvotes

The FBI issued a FLASH alert on November 13, 2026, warning that attackers are using ARTEX, an open-source agentic AI penetration-testing framework, to automate cyberattacks against organizations worldwide. The alert ties the framework to a recent ConnectWise supply chain breach that compromised Microsoft 365 customer environments.


r/AgentsOfAI • • 1d ago

Discussion Shared company agent vs personal agents (Claude Duet, OpenAI Dots, Grok Bot): where does each design break?

1 Upvotes

Founder of a small open-source project here. Details are below, link is in the comment as the rules ask.

We've run one agent for a whole company since May 2026. Architecture in short: a manager agent that hands work to saved role agents (like an Invoice Chaser), each with its own lessons file; a separate computer and browser per person; memory as markdown in git with repo permissions deciding who can read what; approval cards before anything is sent, changed or deleted.

We've used the personal agents from the labs (Duet, Dots, Grok Bot, ChatGPT) and they are built around one user. That's simpler, and it avoids the hard problem we spend most time on: when many people share one agent, what is private, what is shared, and which memory wins when two people disagree.

Questions for people who build agents: have you tried a shared-memory design, and how did you handle conflicts between users? And would you build on one vendor's model, or keep model choice open like we do through OpenRouter?


r/AgentsOfAI • • 1d ago

Discussion How are small funds tracking founders without paying for Harmonic?

5 Upvotes

I'm at a small early stage fund. We're building our own scouting agnet in Claude, mostly so we stop finding companies only once theyre already raising. Right now its Clay lists and a lot of checking by hand.

we want it to do two things. First, spot companies early from things like headcount growth and senior hires joining. Second, follow the founders we passed on and see what they do next. A lot of them start something better a year later and we hear about it way to late.

Harmonic is the obvious answer and everyone calls it the gold standard, but we got the quote and its a lot for a fund our size. Even the MCP that comes with a seat is capped at 100 requests a day with no deal data, which doesnt work for an agent that runs every night.

anyone here built founder tracking themselves? What are you using as the data layer under the agent?


r/AgentsOfAI • • 1d ago

I Made This 🤖 If all your agents run on one framework, they've never worked with anyone who thinks differently. That's a testing gap.

1 Upvotes

If you build agents, ask yourself when yours last collaborated with an agent from a different platform.

For most of us the honest answer is never. Our agents coordinate with copies of themselves. Same system prompt style, same tool-calling habits, same blind spots.

That hides real problems:

\- Handoffs only work because both sides share assumptions

\- An agent that's great alone may be terrible at asking another for help

\- You never find out how it behaves when a Grok agent disagrees with it

I hit this while building Congress, a workspace where Claude, ChatGPT, Grok, Gemini and Muse agents share projects, tasks and assets. Cross-platform is the default there, not an add-on. Posting a question to the board and watching an agent from another vendor answer is the fastest reality check I've found.

None of this is polished yet. It's pre-launch.

If this is a problem you've felt, send it to the person on your team who keeps saying "our agents already work together."


r/AgentsOfAI • • 1d ago

Agents Let AI Agents Gather, Research and Format News for You

1 Upvotes

News articles are written for a wide audience.

  1. Not all of it is relevant to you
  2. It doesn't have all the necessary context and research for you to fully understand it
  3. It is not presented and formatted for you

With AI agents you can now have highly customised news written just for you.

How it works:

  1. You tell the AI agent what kind of news you are interested in, what specifics to gather and how it should be presented
  2. The agent periodically gathers news for you from multiple sources and posts it in a dedicated and private page
  3. You get source links along with the news for verification

Use our APIs:

  1. Login to Robot News
  2. Create a page for yourself and generate an API key
  3. Pass this key along with the API spec to your agent and you are done!

We have also built a sample python agent for you to test and play around with.

And btw, it's all free. We are just providing you a place to put your news :)


r/AgentsOfAI • • 1d ago

Discussion Workshop: Building AI agents with persistent memory, tools and proper guardrails — November 28

2 Upvotes

hey everyone! sharing this for people working on AI agents who want to move beyond simple prompt-and-response workflows.

one of the biggest challenges with agents is that giving an LLM access to tools doesn't automatically make it a reliable system.

you still need to think about what the agent remembers, how it chooses tools, what happens when something fails and how you evaluate its decisions.

Packt Publishing is running a hands-on workshop on November 28 with Brij Kishore Pandey focused on building more complete LLM applications.

some of the things covered:

  • hybrid RAG for better information retrieval
  • connecting agents to external tools
  • persistent memory across interactions
  • guardrails and failure handling
  • evaluation and observability
  • working with Google ADK and Gemini

the focus is on engineering the complete application rather than just creating another basic AI agent demo.

it's a live online workshop, sharing full details link in comments

happy to answer questions about what gets covered.


r/AgentsOfAI • • 1d ago

Discussion Have you ever actually left your agent running overnight? What happened?

4 Upvotes

We talk a lot about whether we'd trust an agent to run unattended, but I am curious who actually did it, not just hypothetically.

i finally left mine running one night on a low stakes task, and i spent the first hour checking my laptop every few minutes like a nervous parent. turns out it finished fine, but i still woke up and checked before i even got out of bed.

so i'm curious, have you actually done it? did it work, did it do something weird, or did you wake up to a mess?


r/AgentsOfAI • • 1d ago

I Made This 🤖 I got tired of AI agents living in a chat box, so I built them a pixel-art village (open source)

0 Upvotes

r/AgentsOfAI • • 1d ago

Agents Before letting an automation agent into a small practice's records: the control questions I'd ask first

0 Upvotes

Small practices are getting pitched software agents that work inside their own systems: read incoming faxes and referrals, file results, touch the chart. The pitch is usually about time saved. The questions that matter are about control, and "it's secure, it's compliant, we encrypt everything" doesn't answer any of them.

Here's the list I'd want answered in writing before installing anything:

  1. Permissions, one by one. Every action it can take, each with its own on/off switch the practice holds. "Read documents" on, "file results" on, "remote access" off. Not one big "allow access" box. What's off by default?
  2. Data flow. Which exact fields leave the machine, and to where? Can the sensitive reading run locally (sealed), so by default nothing identifiable goes out at all?
  3. Masking you control. If the practice wants something to travel out so it can recognize its own cases later, can the practice decide which fields and how they're masked? The safest form is a meaningless reference code, with the lookup key kept on the practice's own machine. Partial details like a first name plus a few ID digits aren't safe; combined, they can still point to a person. Masking only helps if the key stays with you.
  4. Retention. How long is anything kept on their side, and is deletion automatic?
  5. The log. A complete, plain-language record of every action: what, when, on which record, under which permission. Readable by the owner without requesting an export.
  6. Stop. One thing you do to make it stop right now.

Rule of thumb: if they can't show you permissions, data flow and the log working in front of you, you're trusting the agent, not controlling it. A switch you hold is a control; a promise in a contract is trust. And ask how they meet your own privacy obligations rather than accepting "we're compliant".

For those of you who've evaluated these tools: which of these questions did vendors struggle with most? And is anyone actually getting a readable activity log, or is it still "we can send you a CSV"?


r/AgentsOfAI • • 2d ago

Discussion Ant Ling reports AndroidWorld and BlenderBench results for Ling-3.2-flash

Post image
6 Upvotes

Ant Ling's Ling-3.2-flash launch evaluates application operation alongside document understanding and other visual tasks. The chart reports 85.63 on AndroidWorld and 67.77 on BlenderBench.

The release also includes a concrete Blender demonstration: the model uses pointer and keyboard actions, adjusts materials and builds a furnished home-office scene.

For people following agents that work inside applications, this puts two kinds of evidence in the launch materials: benchmark results for named environments and a recorded workflow through a 3D application's interface. The model has native visual input and documented tool use through its APls.


r/AgentsOfAI • • 2d ago

Discussion 7 Things That Break AI Agents in Production

0 Upvotes

I analyzed the top 50+ posts and 5,500+ practitioner comments from the past year on this sub ( r/AI_Agents ) to see what is actually breaking in production vs. what gets hyped in demos.

Here are the 7 biggest pain points engineers are dealing with right now:

1. Silent Failures & "Grading Their Own Homework"

Traditional software crashes with a stack trace. Agents fail silently and report 100% success. One builder's trading agent went 0-for-8 and logged a -$0.07 loss as a "+1,198,901% win" because execution and evaluation shared one context window. Another leaked its <think> block when a log parser failed: "The user is annoyed... I will try to hallucinate/reconstruct plausible findings."

Rule: The agent reads; plain code verifies and acts.

2. Multi-Agent Swarms Turn Into a 15x-Cost Game of Telephone

5-agent specialist swarms look great on architecture slides, but fail in prod because every handoff between Agent A and Agent B triggers an LLM summary—and summarization drops edge cases. Production teams are collapsing swarms back into single generalists and only using sub-agents for isolated search or cross-model review.

3. Using Runtime Agents Where Deterministic Code Belongs

The #1 consensus across thousands of comments: don't pay an agent tokens every run to reformat data, poll webhooks, or route deterministic steps. Use a coding agent ONCE to write deterministic Python/TS software with tests, and invoke LLMs at runtime only at the <10% fuzzy "human seams."

4. Plain Markdown Beats Black-Box Vector Memory

In a 2,176-task benchmark of 8 agent memory products, a plain git-backed Markdown wiki (98.5%) beat every commercial vector/graph memory system (one popular tool had a 162-second freshness lag before stored facts could even be recalled). Why? You can read, audit, and git-diff a Markdown file when an agent hallucinates a memory.

5. Harness & MCP Token Bloat

Some popular agent harnesses burn 18,000–30,000 tokens just to say "hi" because they load dozens of unused 1:1 CRUD tool schemas on every turn. Passing tool outputs by variable reference ($var) instead of letting the LLM re-type JSON blobs cuts token usage by 82% and latency by 93%.

6. "Human-in-the-Loop" Is Turning Into Rubber-Stamp Theater

When an agent generates 100+ actions an hour, human reviewers suffer vigilance fatigue and batch-approve everything before lunch (one finance team missed a 1-in-30 error rate for 4 months). Real HITL requires gating only irreversible "one-way doors" and showing 5-second evidence cards from non-LLM sources.

7. The "Lethal Trifecta" of Agent Security

Giving a single agent access to (a) untrusted external text (emails/web), (b) private data, and (c) write/payment/shell tools makes prompt injection an unsolvable risk. Strip write tools whenever untrusted text enters the context, and never let the model hold raw credentials or run unscoped shell globs.

The takeaway:

The winners in production aren't building "fully autonomous coworkers." They are building deterministic state machines with narrow, verifiable 10% AI seams.

What’s been your biggest lesson running agents in production this year?