About an hour after I got into work today, I found myself in the datacenter swapping out the hardware for one of the servers that belongs to a legendary rock singer/band. So, I apologize if you were trying to buy tickets and couldn’t for about an hour and a half. The power supply was dead, and it would have taken me longer to extract the old one and insert a new one, so I pulled the drives and put them in a new machine.

Then, a different server had the PCI bus die and needed a hardware swap. I left a co-worker take care of that while I went to cover monitoring. Which was crazy busy until about 8pm. Named (bind, DNS service) died randomly on one of our nameservers. I restarted it but there could be a problem with it. A couple vps instances suddenly became inaccessible even though they were running fine – the server they were on previously still contained routes for them. And server reboots, reboots, reboots. Yargh.

Just now I went to get some dinner at Wendy’s, and came back to find a JIANTSPIDEROMGWTFBBQ hanging over the front door. EEEEEEEEEEyaaaaaahhhhh *shudder convulse* bleagh…!