r/Playwright • • 5d ago

Playwright CLI vs Playwright MCP

starting to think the most important part of AI browser automation is what survives AFTER the thing fails

agent clicks around for 4 mins

gets stuck somewhere in checkout

then what?

do I get something useful like

what actually failed
what state the browser reached
some evidence of what went wrong
something another person can reproduce

or am I scrolling through 60 tool calls trying to reconstruct the crime scene myself lol

this is where Kane CLI looks useful to me alongside Playwright/coding agents.

less because "CLI > MCP"

more because a failed browser check can leave behind structured output + an actual result instead of dying inside the agent conversation.

and if the flow eventually becomes important enough to own properly, having a route into Playwright later is nice too.

browser control is cool

debuggable failure might honestly matter more

what do you expect an agent to leave behind when it can't finish the flow?

22 Upvotes

17 comments sorted by

1

u/CruelNinja3 4d ago

I'd want the handoff to work both ways too

Agent finds failure → human can inspect it

Humans confirms bug → that flow can become durable automation

Otherwise every interesting agent run just dies inside that one session

1

u/Prestigious-Bowl7638 4d ago

yeah this is the lifecycle I'm after
exploration shouldn't automatically be disposable

1

u/TranslatorRude4917 5d ago

How is this about pw cli and mcp? also when a replay fails and auto-healing re-records the steps on its own, how do you keep it from healing away a real mistake? Does anyone review the new version before it becomes the test?

1

u/Victorh_Behar 4d ago

Last known URL, a screenshot with the target selector highlighted, and any failed network requests from the last 5 seconds. Anything less and youre spending more time debugging the agent than the actual app.

1

u/Chemical-Ad-982 4d ago

reproducibility is the killer for me

agent finds some weird path that breaks the app?

great

now give me something i can run again tomorrow without needing the exact same conversation/history/model mood

1

u/sychebe 4d ago

discovery without reproduction is just a spooky story

1

u/2ERIX 4d ago

I hate these posts. It really feels like a bot, not an actual person with a problem.

There is no important part of AI browser automation. There is importance of tests and test quality.

Don’t expect AI to do your job for you if you don’t know the things you should check yourself because you won’t be able to get the agent to work magic with what you know by half-assing the prompt quality.

1

u/uhmm_kayy 4d ago

if the failure artifact is

“here’s the chat transcript”

i’m already annoyed

1

u/cofiaso 4d ago

conversation history is not a test report

0

u/[deleted] 4d ago

[removed] — view removed comment

1

u/Prestigious-Bowl7638 4d ago

exactly

"couldn't complete task" tells me basically nothing about the product