Wireless Network (Wi-Fi)
Incident Report for Ohio University
Postmortem

On November 30, 2016, we started receiving reports of intermittent wireless service disruptions that affected a relatively small number of customers across campus. Engineers at Juniper Networks ultimately identified the cause of these issues to be one of two line cards in our primary core router. They also noted some unexpected behavior in the router’s operating system, possibly related to the failing hardware. They shipped two replacement cards to us, and we installed them during scheduled maintenance on December 3. 

After we replaced the cards and made some configuration changes, we discovered that one of the replacement cards was experiencing minor errors. These errors were not noticeable to our customers, but they did indicate that something was wrong with that replacement card.  We contacted Juniper, and they confirmed that the card in question was faulty and shipped us another replacement.

During the early morning of Dec. 7, before the new card could arrive, the faulty card caused a larger disruption to the wireless network.  The router that contained the faulty card was immediately taken out of service, and all network traffic sent through a backup/secondary unit.

The replacement card will be installed at 2:00 AM on Saturday, Dec. 10 during our normal maintenance window. This work should not cause any disruptions for our customers.

We hope to have additional details on why this outage happened once Juniper has time to complete further testing on the bad cards. We apologize for the inconvenience and will continue to work on improving the reliability of the university’s network.

Posted Dec 09, 2016 - 11:23 EST

Resolved
Wireless network has been stable since work late last week. While technicians continue to work with the vendor (Juniper), service itself has been resolved.
Posted Dec 05, 2016 - 09:29 EST
Investigating
UPDATE: 3:02PM, 11/30/16
We experienced a brief recurrence of the wireless network outage from 2:52-2:55PM today.
Technicians continue to research underlying cause with vendor.

ORIGINAL OCCURRENCE:
Some users experienced a brief wireless network interruption this morning at approximately 8:15am, and resolved by 8:30am. Multiple locations were affected by this outage.

OIT technicians are working with our vendor, Juniper, to determine the root cause.

Please contact the IT Service Desk at 740-593-1222 if you are experiencing lingering issues.
Posted Nov 30, 2016 - 15:35 EST
This incident affected: Internet & Phones (Internet & phones on all campuses).