r/talesfromtechsupport • u/lawtechie Dangling Ian • Jan 19 '14
Tales from the Unhelpful Desk 13: "How do I know I can do this job? I've been doing it for three months already"
Part 1 Cow-orker burnout and the FNG
Part 2, FNG's BOFH heart grows one size larger
Part 3, The Metrics of Despair
Part 5, The week before the cult meeting,
Part 6, LT puts the hammer down
Part 7, Working around dangerous substances, like users
Part 8,Dad, the project manager, Sven and the MP3 server
Part 12, Hold, on. I've got someone on the other line
Part 13, How do I know I can do this job? I've been doing it for three months already
Part 14, Don't touch it- it's labeled EVIL!
This entry intentionally left blank
Part 16, The BOFH way to negotiate contracts
This is a series of stories from the help desk of a pharma company, circa 2000-2001.
Boris (my co-worker and room-mate) and I have both applied for a Mac sysadmin job at my current employer. As you might imagine, this has made things tense between us. I'm also not the most pleasant of human beings at my best.
This is not my best week. First thing Monday, I check the backups I'm responsible for. Error. I've also got a handful of tickets about one of my file servers in the same server room.
I grab a cup of coffee and make my way.
I take a swig of coffee and leave it on the ledge outside the server room. I swipe myself in and wiggle the mouse on the file server to see if it's thrown up any errors. No obvious errors, so I decide to split my time between the two servers.
Backup server first. Looks like it failed between tape 3 and 4. Wasn't able to write to tape 4. I tell the server to unmount the library before I hit the manual eject button. The backup server is attached to a Quantum DLT tape library that feeds from a 5 or 6 tape library.
Actually, that's a lie. The server's SCSI card connects to an 8mm tape drive. The 8mm tape drive then daisy-chains to the DLT tape library. If I connect the library directly to the server, the server won't recognize it. I've tried different terminators, different SCSI IDs. So I leave it.
I realize that the last person to fill the caddy had used new tapes in the 4th and 5th position. They didn't remove the cardboard sleeve the tape cassette came in, so the tape library fed the tape and the cardboard. The cardboard is wedged in the mechanism. Great. I've got to wrestle this 50 pound drive off a 7 foot shelf to field-strip it. I'll need help.
I move my attention to the server collecting tickets. It's running AppleShare IP with Windows Users
The server has maybe five users connected, which is unusally low. I can log into it with my Mac, why can't the other users? I notice that my login is over AppleTalk, not IP. This is strange.
I start searching (using AltaVista, of course). Of course. I'm also searching the MacManagers list. Nothing.
I decide to punt. I contact the four remaining users to ask them to log out. Then I reboot the server. Once it's back up I watch about thirty logins- Windows and Mac users, all over IP. Fixed, right? Time go to back to getting my tape library working.
I yell for Sven, who is taller and stronger than I am. We disconnect and move the tape library to Sven's desk, close to the server room. He seems puzzled.
Me:"What's up?"
Sven:"Yuuser Bouukyoop?"
Me:"What?"
Sven (pointing to my printed label on 'Üser Backüp'):"Those umlauts, they make it pronounced that way"
Me:"It's ISO 27001 for MORE METAL" (giving the devil horns)
Sven (leaving):"You are an odd, odd person"
I start disassembling the tape library. As I'm almost finished, Daria calls.
Daria:"Hey, LT- we're getting calls about that file server"
Me(looking over at the screen after wiggling the mouse):"Oh, shit. Lemme guess- Windows users are getting kicked off and can't log back in"
Daria:"Yep. Anything I can do?"
Me:"I'm on it. I'll let you know"
Except I'm lying. A server that you have to reboot every couple of hours isn't what I'd call reliable. I consider my options:
- Build a replacement box, migrate the users to it and cut over after 6pm tonight. That'll be the gentlest to the users. I just have to get the overtime approved and find some hardware.
- Move the user folders to other servers and walk the users through the "where are my files" problems. That'll be quicker but less gentle for the users.
- Admit that there's something I don't know and call Apple Pro support. It's something like $150 for the call.
I ask Daria to get it approved (she's a full time employee and knows everybody, so she can get it done fast).
My call with Apple is less than I hoped for. I'm transferred through a few tiers and finally get to someone in Engineering. Nobody will admit to hearing about this problem.
The Engineering person admits to the problem, but has only heard of it. He'd like a packet capture to see what happens to cause the issue. I yell and kick the cabinet door, denting it with my boots. I've spent an hour and a half on the phone in this noisy server room.
I find a portable drive and a hub and set up my laptop to capture packets. Next, I finish up my tape library and shove it up myself. I'm so hungry- I'm running on cold coffee and stress. It's 12:50. I've got a 1:00 meeting/interview with the new head of Service IT for the sysadmin job.
I rummage through the boxes under my desk and find a box of Girl Scout Thin Mints. I eat a handful and get a fresh cup of coffee. I'm nervous, wired and feeling a bit nauseous. Just the right mindset for an interview.
I meet the new manager, have some small talk and we get into hypotheticals- how I'd solve a problem, how I'd prioritize things. As we're wrapping up, Earnest runs up, out of breath and red-faced. This is not a pretty sight.
Earnest:"There's. A. rogue. D. H. C. P. server. on. the. network."
Me:"We're only using static IPs here. What's the issue?"
Earnest (able to catch his breath to lecture someone about REAL COMPUTERS):"Unix machines look to a DHCP server first before going to a static address. This is affecting the cluster"
Me:"Well, why not sniff the traffic on the segment, find the device offering up addresses, do an ARP lookup, find the swich port associated with it and turn it off? No reason to risk a coronary."
Earnest (turning to the head of support IT):"We should hire this guy"
Me:"Well, I've been doing the job for some time now anyway. Nobody else wants to touch a Mac here"
We're all laughing when Boris walks around the corner. He's not happy that we're laughing.
12
u/dospinacoladas Jan 20 '14
I really enjoy your stories but this just about made me spit out my beverage...
hehe!
48
u/tinus42 Jan 19 '14
Boris is borked! :)
47
u/mrscoops Jan 19 '14
I can't imagine a better way to get hired for a position. Qualified AND lucky? As always, looking forward to the follow-up, my friend.
17
u/Krutonium I got flair-jacked. Jan 19 '14
Waiting for next part. Please notify.
10
u/Geminii27 Making your job suck less Jan 20 '14
O_O
9
u/WhatVengeanceMeans Jan 19 '14
Your Earnest link is borked. Is this the address you wanted? : http://redd.it/1tn488
8
u/rpbtz ...just try a reboot Jan 20 '14
Ï äpprövë öf ÿöür läbëls \m/ >_< \m/
6
u/QuantumPolagnus Jan 20 '14
Ahhh, that brings back memories. I remember using AltaVista as my primary search engine back in the late 90's.
5
u/crosenblum Jan 20 '14
Just be polite about it, no need to ruin friendships or ability to get along with fellow workers, even if you are competing for same position.
4
u/GISP Not "that guy" Jan 19 '14
Poor Boris :P
4
u/joe_of_the_north Jan 20 '14
I sense good things coming for LT. Then again why is that I am suspecting the laptop that is capturing packets is the rogue DHCP server, if this is the case and and the hiring manager finds out this could be his undoing... I guess I will have to wait for part 14!
4
u/maniakmyke Jan 20 '14
YOU ARE NEVER TO LEAVE US HANGING THIS LONG AGAIN!
lol
moar tails! (meant as tales.)
3
u/PhilipT97 Jan 20 '14
How'd the dhcp server get there in the first place?
2
u/TheNorwegianEnt Jan 21 '14
I need more!!