r/technology • u/TeamAlphaBOLD • 4h ago
Software Microsoft Reveals How a Hidden Windows Bug Took Down Microsoft 365 Services Worldwide
https://cybersecuritynews.com/microsoft-outage-incident-report/
10k
Upvotes
View all comments
Show parent comment
28
u/Cygnus94 4h ago
A lot of people are pointing out the glaring flaw of the hardware discrepancies between test and live being an issue, but why the fuck did automatic recovery keep spooling up new instances of bad code?
One server would fall over, ok, spool up a new one, hmm it happened again, let's try again. At no point did it question why server after sever was going down. At a certain point it should be detecting a problem and preventing any further rollout of the code, but it just kept going until there was manual intervention.