Don't get stuck with "speed-groups"

Share on:

I was working with a Cisco 9372TX switch, and on it I had two 40Gbps uplinks that we where using out of the available four. Talking with our VAR because we where planning on connecting in additional equipment that only supported SFP+ interfaces. So the solution was to connect to this switch  with QSFP to SFP+ adapters.

Thinking this would be a simple change because we are just plugging in additional adapters on the QSFP ports we planned our maintenance window and rollback plans but I wasn't expecting a rollback for this one :)   The interfaces were configured in a shutdown status before we plugged in the adapters and cables so didn't see anything out of the ordinary, when it was time to do the maintenance let's bring up the interfaces with the command of no shutdown and we should be up...

Well not exactly, I first thought it was the other end so I checked that and its reporting the link is down but it was not in a shutdown status. Looking at the Nexus switch interface I see the words "check speed-group config" under the interface and its in a err-disable status and I'll be honest I haven't worked with interfaces that are speed-grouped together so I didn't know that it was even a thing. A quick search to see if I could "break" the speed-group and configure interfaces individually on their own speed turned up nothing.

We ended up doing a rollback which looked pretty ridiculous because these where just interfaces we couldn't bring online. It become apparent that I was stuck because with the equipment we had I couldn't use that 40Gbps uplink, the hardware only supported one speed for all six ports, hence the name "speed-group". 

We would have to downgrade the link 10Gbps and then we would be able to connect in our additional gear. It's this kind of stuff where planning out for growth and understanding your hardware limits becomes very important, I didn't catch it because I have never heard of such thing and our VAR didn't catch it either. In this case we weren't maxing out that 40Gbps link and we could afford a downgrade in speed in the meantime. Others may not be so lucky and this could be a problem if you really needed that 40Gbps link or only had 40Gbps on your upstream switches. In the end don't get stuck with speed-groups! :)