Just FYI, there was an unplanned outage in phx2 today.
There was some cabling work being done and a switch in one of our racks didn't properly failover to it's second power supply when power was moved from it's primary. This resulted in a approx 10min outage to servers in that rack.
Additionally, one machine had a network cable that wasn't reseated properly, so it couldn't reach anything after the switch came back.
Investigation of how to fix the switch is ongoing.
kevin
infrastructure@lists.fedoraproject.org