[Sephiroth]

Failover is usually soft in my world - the backup protocols are all there on Cisco kit. A SPOF is not how VM's network is designed otherwise you'd see everyone routing through that point in the traceroutes.

The engineer goes to the racks to replace or reset the kit in question after reading the logs and when the emergency change manager decides would be the best time.