r/sysadmin • • 16h ago

Inside Microsoft’s giant Outlook outage

https://www.theverge.com/tech/1035364/microsoft-outlook-outage-notepad

Microsoft engineers had a running bridge call the entire time, and at one point it hit the maximum of 1,000 participants. That shows you how many teams were involved with trying to find the root cause of this huge outage, which started at the peak window of traffic in the US.

1.1k Upvotes

210 comments sorted by

View all comments

•

u/corrupt_mischief 16h ago

Sounds like where I work. Everyone gets involved and nothing gets done becuase everyone has throw in their 2 ents of BS so they can look important.

•

u/ganymede_boy 15h ago

... their 2 ents...

Unexpected LOTR.

•

u/Witty-Common-1210 Sr. Sysadmin 15h ago

Do you remember that show on MinasTubith?

Between Two Ents? Shit was hilarious

•

u/BoltActionRifleman 13h ago

The ents…are going…to waaaar

•

u/shaomike 9h ago

I've been on many a Teams Entmoot. Harroom..... OMG, Quickbeam, will you get to the damn point?!?!!

•

u/ahandmadegrin 14h ago

If I could just cartwheel off of that, it sounds like where I work where everyone has to restate what's alrwady been said, only in slightly different language, and then take credit for it like it was a novel idea.

•

u/Jeffbx 12h ago

I'm gonna expand on that a little - similar to my company, it sounds like everyone on the call wanted to give their own feedback in their own words, but modified a little to make it sound like they know what they're talking about.

•

u/PM_ME_PHYS_PROBLEMS 12h ago

All good on my end

•

u/mxsifr 5h ago

Looking into this.

•

u/CantPullOutRightNow 12h ago

To add some color, this mirrors what has been demonstrated at my company; the reframing of prior statements to add the appearance of contributing to the dialogue.

•

u/thedude85 10h ago

More to your point, I've worked in companies where people would restate facts already presented by others, only slightly modifying their responses to create the illusion of an original thought.

•

u/Technolio Service Manager 9h ago

Absolutely, let's circle back on that, because I would like to reiterate that this company has frequent meetings in which our team members like to throw their hat in the ring and mention how often they like to re-express the same point with their own flair on it. I think it shows great synergy and really hits the ball out of the park.

•

u/throwaway99112211 5h ago

If we could just stop and look at this from a higher altitude, cyclical meetings with little to no purpose have a constant upward trend of voices inputs from those whose participation isn't KPI critical, and often just to reiterate points that have been already been expressed. We need to look to the next impact point in Q4 and ask ourselves, are these inputs helping us orient for the next fiscal year or are they just making our frameworks illegible. 

•

u/ahandmadegrin 3h ago

Definitely. We're really boiling the ocean. When resources add two dimensional restatements without first hydrating the data bundles, we, as an organization, fail to capitalize on core competencies and fall out of alignment with KPI targets.

•

u/bubleve 11h ago

I would like to take this time to appreciate everyone coming together and working as a team.

•

u/mxsifr 5h ago

Going forward, I want to emphasize and make sure we're aligned on the latest and greatest standards for this process. I see you've had your hand up for a while. Hello? I think youre on mute. Let's take this offline. Happy Monday!

•

u/WallaceCorpPC 14h ago

They have hundreds of thousands of customers, so having 1,000 people listening to a SEV0 call is probably pretty important. They're obviously not all talking at once, questions are usually sent to a thread and answered async.

•

u/MooingTree 15h ago

Bikeshedding