The Tuesday Broadcast Storm in IDF-3
IDF-3 in Building B holds three Aruba CX 6300M switches. SW1 dual-homes to the 8360 core pair, SW2 and SW3 each connect to SW1, and a 10G DAC cross-connects SW2 to SW3. MSTP runs two instances (MST1 = VLANs 10-40, MST2 = VLANs 50-90) with the core as root for both. Trunks converge cleanly and the redundant cross-link blocks as expected. Three weeks ago facilities installed an unmanaged 5-port switch under a reception desk to add a printer, plugged into an access port in VLAN 30. Since then, every Tuesday near 10:00, voice quality drops for four to six minutes, MAC entries on SW2 alternate between the uplink and the cross-link, and 6300 CPU peaks at 92%. That desk port is an edge port with BPDU filter applied. Uplink utilization stays at 35%.
1. A junior engineer proposes leaving BPDU filter in place and enabling loop-protect on every access port instead. Assess that plan and state what you would configure.
Read the worked answer
Assessment: the filter is the cause, not part of the fix.
- BPDU filter suppresses BPDUs in both directions on that edge port. The unmanaged switch never sees spanning tree, so the desk port is never blocked; the 6300s learn the printer MAC from two directions and flood unknown unicast until the unicast storm saturates the segment. That matches the MAC flapping, the TC bursts and the CPU peak.
- Loop-protect is a per-port safety net: it sends probe PDUs and err-disables a port that receives its own probe back. It is genuinely useful for dumb-switch loops, but it fires only after frames are already circulating, and it acts on one port. It is defense in depth, not a substitute for guarding the edge.
- Running both on one port is contradictory: with the filter suppressing transmission, the guard never sees a BPDU and never err-disables.
What I would configure:
- Remove
spanning-tree bpdu-filterfrom all user-facing edge ports. - Add
spanning-tree bpdu-guardon every access port, so a received BPDU err-disables the port and logs the event with the port name. - Keep
spanning-tree port-type admin-edgefor immediate forwarding. - Add
spanning-tree root-guardon SW2/SW3 ports facing anything that might be a switch, including the cross-link and spare wall ports, so a rogue device cannot win the root election. - Keep loop-protect for loops that generate no BPDU at all.
- Set err-disable auto-recovery to a long delay (300 s or more) so the offending device is investigated rather than silently re-enabled.
2. Which evidence would you collect to prove the loop originates at the reception port, and what result would confirm it?
Read the worked answer
Build a timeline first, then confirm causally.
show spanning-treeandshow spanning-tree detailon SW1/SW2/SW3 - record the topology-change count and compare its rate at 10:00 with the reported voice outages. A TC burst that starts and stops with the outage is the strongest single indicator.show mac-address-tableon SW2, repeated every few seconds during the event - the printer's MAC alternating between the uplink and the cross-link proves a loop rather than a single-path failure.show eventsfiltered around 10:00 for STP, MAC-learning and port-state entries - this shows which port started the disturbance before anything else reacted.show interface <desk-port>and per-queue counters - inbound broadcast/multicast rate pinned near line rate on an access port is abnormal.show interfaceon the trunks for output drops and runts, which distinguishes a storm from a duplex or cabling fault.
Controlled test: err-disable or shut the desk port for one Tuesday cycle. If the TC counter flattens and voice quality is clean, the loop source is confirmed. Then re-enable it with BPDU guard in place and watch for the guard event, which names the port without needing a human to watch counters.
3. The business wants the printer kept and no port permanently disabled. What is the least-disruptive permanent arrangement?
Read the worked answer
Remove the condition that makes the loop possible.
- Replace the unmanaged switch with a managed 6300-class access switch or with a small Aruba AP-style workgroup device that runs spanning tree, and connect it to SW2 or SW3 with a single uplink. That converts an invisible loop into a normal blocked port.
- If a second cable is unavoidable, ensure the upstream ports carry BPDU guard plus loop-protect, and that only one path is active.
- Put the printer on a documented static IP in VLAN 30 so it is visible in monitoring, and add it to NAE or your NMS so an unknown MAC appearing on two ports raises an alert.
- Add a facilities-facing rule: no unmanaged switching on the production LAN; a separate small managed switch is the approved pattern.
- Finally, reduce the blast radius for next time: enable storm control on user-facing ports so a repeat degrades one port instead of the building, and keep root-guard on all ports that face downstream equipment.