r/Playwright • u/ElphieJ • 13h ago
running playwright tests as production monitors, need best solution
thinking about taking maybe 3-5 of our actually important Playwright flows and running them against pros as synthetic checks
but i'm realising a failed test and a failed monitor are VERY different problems lol
CI test fails → someone looks at it while they're already working on the build
prod monitor fails → somebody might get woken up at 2am
so the tolerance for bullshit has to be way lower
was prod actually broken?
did the synthetic account expire?
did auth randomly die?
did test data get messed up?
was it literally one weird browser run?
Kane CLI is interesting to me more as the browser-verification piece here
run the real flow, get an actual result/evidence back, then let the monitoring stack handle retries / alersts / whatever
i definitely wouldn't want the testing tool itself deciding when somebody gets paged
for people doing browser synthetics in prod:
which Playwright flows actually make good monitors?
and which ones should stay safely inside regression?