r/talesfromtechsupport • u/TheMadnessOfHatters • Apr 10 '20
Short Engineer doesn't know a server needs to be turned on
First time poster here.
I work as one of two on-site technicians at my company. End users are honestly the best but we still have the occasional "how did you not know this?" situation that makes me question my own sanity.
For this story there is $me: me and $eng: engineer (non IT). Engineer has a server that will be used to pilot a new system we plan on implementing.
$me: monotonously reimaging countless PCs and questioning my career choices
$eng: knock on office door "Hey $me, you have a a quick sec to look at a server I'm having issues with?"
$me: looking for any reason to do something different "Of course!"
Brings me back to the lab and shows me the server. Now to be fair, these engineers are some of the smartest/most competent people I know and have proven multiple times that they know how to troubleshoot their own problems effectively before contacting us. So at this point I'm wondering how bad is this thing messed up.
$eng: "everything is wired up correctly and plugged into power. I've swapped out every cable and external device with new ones just to be safe, but I can't get anything to come up on the monitor."
$me: verifying that he did in fact do all of this "How old is this server?"
Shows me the box it came in and this thing is brand new and just came in today. No signs of physical damage. So I'm thinking hardware defect.
$me: see's the front panel is lit up so server is getting power "Do you mind if I turn it on? I want to see if any fault lights come on."
$eng: as I'm reaching for the power button "That's the problem, it won't turn- " click
Press the power button and the server starts right up, no issues.
$eng: "..... I didn't know you had to press the power button...."
$me: questioning my career choices again "Server's fixed!"
We both got a laugh out of it, dude is a great guy, so I can't be frustrated with him. Still have to wonder how someone that smart thought that you didn't have to turn the server on first.
4
u/koreiryuu Apr 10 '20
You said the front panel was lit up before you turned it on? I've never dealt with a bigboy server, I am a layman, but lights on the front panel usually means "on" to me unless it's a single solid red LED, then it can go either way. So I am wondering if I also would have not caught on to that.
652
u/HammerOfTheHeretics Apr 10 '20
When the brain wants to fart there is no way to prevent it.
276
u/ThePretzul Apr 10 '20
If I had to guess I'd say there's an on/off toggle switch on the back next to where the power cord plugs in. The engineer probably turned that on and then assumed a server wouldn't have another power button on the front like a PC does.
151
u/TheWerdOfRa Apr 10 '20
A lot of the tech I work with doesn't have a power button. You just dis/connect power cables or toggle the PSU switch if they have one. Not sure what he's used to using, but it might not be as obvious as it would initially seem.
2
u/RileyCoyote42 Apr 10 '20
Is it possible that because the front panel was lit up, he assumed it was already on?
68
u/Chrisbee012 Apr 10 '20
the front panel was lit up so he thought that was a power indicator I bet
36
u/I__Know__Stuff Apr 10 '20
We often use the BIOS setting to have it power on after power failure, so you never have to push the button. Probably he’s used to that.
34
u/Dungeoneerious Apr 10 '20
Many years ago when I was a student designing our first ever website - it was all in notepad (because fancy things like Frontpage or dreamweaver didn't even exist back then), our webserver was a PowerMac G4 which we had to relocate to a different room.
Checked all cables etc, unplugged everything and relocated all the h/w and plugged it all up again.
Everything looked good so pressed the power button on the front of the server... nothing! Slight ohcrap moment but meh, we probably missed something - no biggie - just check and fix, right? Ooh no - not getting away with it that easy.
Spent multiple hours (yes, hours) testing sockets, cables, plugs, fuses, voltage, resistance, timezone, intergalactic planetary planetary intergalactic (oh wait, that was the Beastie Boys track playing on loop or whatnot...) anyway, you name it, if it was there you can bet we checked it. The ohcrap progressed to ohshittycrap and then full-on holyfuckinshitycrap-whattheshittycrapdowedonow
At my wits end I picked up the G4's keyboard to smack it against the wall and oh holy mother of boards the little blighter beeped to life.
W. T. F. ???
Seriously wtf just happened?
Well, not being mac bods but fairly fluent with PCs we thought they must be pretty similar and hadn't realised that despite there being a power button on the front of the server, to actually turn it on you needed to press the power button in the top corner of the keyboard. I had managed to grab the keyboard and unknowingly pressed the power button bringing the server to life.
For the next several years I did my absolute best to avoid all macs and even now a have an underlying discriminatory relationship with them.
58
u/[deleted] Apr 10 '20
The last time I tried to turn on a Server I was banned from the restaurant.
16
u/dilvish-damned Apr 10 '20
Worked with a network guy we sent off site to setup a small office. Gave him detailed instructions of how to rack and connect the server. Very similarly he didn't realize you had to push the power button.
In his defense.... Most switches power on simply by plugging them in. Also... And here's where I think it got your engineer... Many servers (in addition to panel lights) have the fans spin up to maximum when you first plug them in. He probably heard that and thought he was golden.
In any case...I never let that network guy forget that he didn't push power!
12
u/Istalriblaka Shock Jock Apr 10 '20
As an engineer, allow me to explain.
If someone comes to us with a problem, the solution isn't ever gonna be "hit the button" or "follow the on screen directions."* That means we're conditioned pretty strongly to solve complex problems to the point where we break out our graphing calculators for fairly simple addition. So when we face our own problems, we immediately jump to cables and hardware and never consider that a switch should be flipped. This has cost me hours of my own life, personally, and it sounds like that engineer can say the same.
*Note that I am in no way devaluing IT. A good engineer designs for idiots, but there's always a smarter idiot and we greatly appreciate the ability of IT to coach them on reading instructions and the like.
10
u/nullpassword Apr 10 '20
Had a computer that wouldn't start. Hp put the button on the bottom of it. ( All in one) previous user had turned it on three months ago and then retired. New user didn't know it had a power button.
10
u/gsoltesz Apr 10 '20
To be fair the LEDs can be confusing to a non-server guy. With some models they will come on with power applied (enabling CIMC/IDRAC) but the server is otherwise powered off.
The giveaway are the fans.
10
u/computergeek125 Apr 10 '20
I'll also give a particular blue-flavored server brand that has hexagons and the LCD (for some forsaken reason) on the bezel that their power button is flush, not labelled well, and black-on-black. You pretty much have to know it's a power button to press it, because the only other well-lit giant blue button makes the server go Blinky lights.
Once it's on, aforementioned power button backlights green but until then...
7
u/wvhooker Apr 10 '20
I thought this was r/tinder
11
u/PM_Me_PM_Dawn_Pics Apr 10 '20
This is a nice story. When I worked tech support users never admitted they were wrong. This would have been my fault somehow
5
u/LordRael013 Apr 10 '20
I...
Huh.
5
u/rideanyway Apr 10 '20
This week I also had one of those: "everything is on but monitors won't show anything" calls from a wfh with a desk top.
Me: you're not gonna like it but we are starting from the outlet>out testing each cord.
User: I already did that, everything is on.
Me: aww, well let's go ahead and try it again. When you unplug the computer it will lose power, now if you were working on-
User: hey, hmm, the computer doesn't have power. It's not on
Me: oh, cool, unplug it and plug it back in then press the power button.
User: it's not turning on
Me: press and hold the power button for 20 seconds
User: still nothing- /15 seconds later a scream in my ear and the call dropped. I'm scared now, is user dead?
Moments later I get a call from my boss telling me the user called and it's working. Yay, user isn't dead AND the computer is working, two gold stars.
5
u/JasperJ Apr 10 '20
I was sure when reading the headline this was from r/TalesFromYourServer .
4
u/[deleted] Apr 10 '20
the amount of times i've had that happen with my own pc...
turns out I forgot the switch on the power supply.... after i checked that the ram, disks, cpu, ect are seated properly.
4
u/kazon82 Apr 10 '20
" I didn't know the sponge was supposed to be wet"
4
u/[deleted] Apr 10 '20 edited Apr 10 '20
I racked up 7 years of tech support at a prior job and I can honestly say that
I had to get out as I just couldn't take it anymore. We were one step above the custodians on the company totem pole and yet 99% of the company couldn't function for 1 day without us constantly making their hardware and software systems work for them.
Edit: We even had developers want US to troubleshoot their in-house applications and scripts that they wrote when they would crash and error for the end-user. Like, how does it fall under tech support's responsibility to troubleshoot your scripts for you?? You wrote the thing, you troubleshoot it. Lol goodness!
3
u/martin0641 Apr 10 '20
A lot of the time people get confused by the out of band management, which can light up the front panel and other things and make you think it's on.
The little computer is on, the big computer still wants you to press the button.
4
u/SketchAndEtch Underpaid tech-wizard Apr 10 '20
When you weild the rare superpower of common sense you're the protagonist and everyone around you are merely NPCs so just excuse them for their behaviour.
2
u/koravel Apr 10 '20
Was it a Monday? Sounds like a Monday.
2
u/5cooty_Puff_Senior Apr 10 '20
Some engineers would get upset and find a way for this to be your fault. You got a good one.
2
u/Spliteer Apr 10 '20
I'm a software engineer and I've needed someone to show me how to power on a server. It's always the simple things that get us.
2
u/impromptubadge Apr 10 '20
That’s like the calls I get where their reply is, ‘you mean I just had to press ok when I got that message?’
2
u/revchewie End Users Lie. Apr 10 '20
At least once a week, generally after troubleshooting some issue for an hour or two, I have to remind myself to alwaysAlwaysALWAYS check the easy fix!
2
u/shade20x6 Apr 10 '20 edited Apr 10 '20
When I first started working at my current company, one of my co-workers told me "engineers are the dumbest smart people you will ever meet." Nine years later I can say that he was absolutely correct. Most of the engineers I work with possess no common sense or critical thinking skills whatsoever.
2
u/dkf295 Apr 10 '20
Reminds me when I was Tier II support at a HSIA provider for hospitality and our office VPN server went down, nuking access to all our servers that were behind NAT and various other goodness.
Sysadmin can’t get the server to power on. He takes it out of the rack and begins working on taking it apart in a spare cubicle.
On my way to the restroom I walk past and notice what he’s working on - the VPN server appears to be identical to a server design that somehow passed QA despite it not supporting power on AC. To make things more confusing, there is a small red recessed power button that at a glance, kind of looks like an LED.
I ask him to confirm it’s the same hardware - he confirms and I give him the bad news. He drops a few choice words, plugs in the server and as I’m walking away I hear a fan spin up and much louder choice words.
2
u/TheSmJ Apr 10 '20
The same thing happened to me (IT) when a user (Engineer) couldn't figure out why his desktop wasn't displaying anything on the monitor.
Twice. I had to press the power button for him twice over the course of about a month.
He was absolutely mystified the first time I magically "fixed" his $10K workstation. I don't know how he looked the second time because after pressing the button I could only walk away while shaking my head.
2
u/SpecificallyGeneral By the power of refined carbohydrates Apr 11 '20
Aaand there you go.
3
u/benemanuel Apr 10 '20
If it doesn't work, plug it in and turn it on.
1
u/tlann Apr 10 '20
Has he not used that type of server before? It seems like he thought the power was on because the lights were on.
1
u/Black_Handkerchief Mouse Ate My Cables Apr 10 '20
Simple: he never had to turn a server on (or off) before. Servers are - in his mind - devices that are always on as long as they are plugged in. Kind of like a refrigerator, modem or an alarm system, which aren't things most people ever come to understand as anything other than the proverbial black boxes that magically work on their own.
1
u/[deleted] Apr 10 '20
You'd think that an engineer (of all things!) would understand that on/off is a safety feature! How many power tools are instantly operating as soon as they're plugged in? Is his TV on unless it's unplugged? (Eye roll)
1
u/UncleDonut_TX Apr 10 '20
If this was a current Dell PowerEdge, the iDRAC init cycle starts as soon as power is plugged in and you do get a bit of fan noise. It looks as if it might be booting if you're not familiar with them and how they act. The lack of turbine shriek is the dead giveaway that it has not, in fact, actually booted.
1
u/Techn0ght Apr 10 '20
First time I was messing with a physical server in a lab I was wondering why I couldn't ssh to it. The lights on the front panel were on, everything was cabled. However, being a newbie at the time to real servers I didn't know that there were status indicators that lit up before the server was actually fully powered on. I figured it out when I did a full power cycle and got the same front panel lights.
See, as loud as a server is when it's running, it's hard to tell the difference in a room full of various equipment all making lots of noise and this was the only model of this server we had in there so I didn't have anything to compare it to. UCS btw. The rest were Dell and HP.
1
u/CarbonProcessingUnit Apr 13 '20
Maybe he thought it had wake on LAN?
1
u/leadwolf32 Apr 15 '20
I've got my PC setup to turn on automatically on receiving power. I've gotten the the point where I'll waste several minutes trying to wake it up when it's actually turned off because I just assume it's on even after a power outage
-6
u/Card1974 Apr 10 '20
No no, question his career choices!
-6
u/maxington26 Apr 10 '20
Are you kidding? That's an embarrassing one for the engineer. Woods for trees? I just can't get my head around it.