Cisco delivers 10 Gigabit Ethernet to the closet

27.12.2005
Gigabit Ethernet to the desktop isn't for every infrastructure, but it's become a popular push both by switching vendors and network admins. And no wonder: Servers are generally using bonded gigabit links to the network, the cost of Gigabit Ethernet closet switches are dropping, and many corporate desktops are now shipping with Gigabit Ethernet NICs by default.

The problem is that many infrastructures can't push much more than a gigabit or two from the core to the closet switch itself. Thus, 48 Gig ports ride 1Gbps or 2Gbps uplinks back to the core, which can significantly reduce the available throughput within that closet.

To combat this issue, Cisco recently revealed a new supervisor engine for its Catalyst 4500 series modular switch, specifically aimed at the 4503, 4506 (which I tested), and 4507R. Sporting two Xenpak 10 Gig ports, the new Cisco Catalyst 4500 Series Supervisor Engine II-Plus-10GE is really an edge supervisor, providing rudimentary routing capabilities but extensive QoS support. It's not really suitable for core switching duties, given the lack of routing protocol support beyond RIP (Routing Information Protocol), but in the lab it made an impressive showing for duties at the network edge.

A few trillion packets, give or take

In order to put the new Catalyst 4506 with Supervisor Engine II-Plus-10GE though its paces, I teamed the switch up with a Cisco 4948-10GE switch with full core switching and routing functions. The 4948-10GE has 48 Gig ports and two 10-Gig Xenpak uplink ports. To test the 4506, I relied on a Spirent TestCenter SPT-5000A armed with 16 Gig copper ports and two 10-Gig ports. The SPT-5000A proved absolutely invaluable throughout the testing and allowed me to really stress the 4506 and the new supervisor under a wide variety of simulated conditions.

First, I linked the 4948 and the 4506 via a single 10-Gig connection and ran the Spirent 10-Gig test modules into the remaining 10-Gig ports on either switch. Based on IP with varying packet sizes, the tests were aimed at maxing out the single 10-Gig uplink between the two switches. Throughout this test, the packet loss was absolutely zero, and wire-rate 15 mpps (million packets per second) was consistently achieved.

Next, I kept the single 10-Gig link between the two switches and ran eight copper Gig connections to each switch, balanced among three six-port Gig blades on the 4506, and across several ASICs in the 4948. Running fully meshed throughput tests with packet sizes ranging from 64 to 1,518 bytes between the two switches, I again witnessed wire-rate performance with packet loss measured in hundredths of a percent. With this same test bed, I ran more tests to exercise the address learning and broadcast forwarding functions, and again the 4506 performed flawlessly.

Per VLAN, per port

It was time to give the per-port and per-VLAN QoS a try. I constructed a rather large QoS match list comprising more than 500 TCP and UDP (User Datagram Protocol) ports and bound that ACL (access control list) to a QoS configuration on every Gig port on the 4506. The QoS parameters were to limit the bandwidth of any inbound or outbound TCP connection that matched on the ACL to 20Mbps, dropping packets that exceeded this threshold. Again running with the 16 Gig connections to either switch, I ran another meshed test with the Spirent TestCenter SPT-5000A. I still couldn't make the 4506 break a sweat.

I then adapted the test on a per-VLAN basis, assigning several VLANs to each active port to simulate a VoIP/workstation scenario, this time limiting the bandwidth in a similar fashion on one specific VLAN, and reran the tests. Again, the 4506 performed with aplomb, successfully keeping up with the traffic flow at the highest levels that I could push it.

In another test run, I began the meshed streaming test with QoS disabled on the 4506 and then enabled QoS halfway through the test. There was a several-second hesitation in the CLI but no other ramifications of popping the clutch in this fashion, as might be necessary in production. The limiting began immediately and performed as expected.

I performed further testing using EtherChannel to bond the two 10 Gig uplinks between the switches and again running meshed 16-port Gig throughput and forwarding tests. The balancing between the uplinks is fully configurable and dealt well with the load presented. Using that test bed and 802.1q trunking between the two switches with the 4948-10GE as a switching core, I spanned the test links across eight VLANs and again ran throughput tests. Again, the resulting packet loss was measured in hundredths of a percent, or basically indistinguishable from wire-rate 10 Gigabit Ethernet.

Ready to roll

Try as I might, I couldn't get the Supervisor Engine II-Plus-10GE in the 4506 to stumble, even when presented with oversubscribed workloads and heavy QoS overhead. The port density offered by the 4506 chassis is substantial: My evaluation unit came with 48 10/100 copper ports, 48 SFP (Small Form-Factor Pluggable) 10/100 fiber ports, and 18 SFP/copper gigabit interfaces. The 4506 can handle a maximum of 240 gigabit copper interfaces, each supporting 802.3af power over Ethernet. Also, 240 gigabit fiber ports are supported, making the 4506 with the Supervisor Engine II-Plus-10GE a large distribution layer possibility.

With redundant 1,000W power supplies, the power consumption isn't as substantial as one might think -- and I ran all my tests using a single power supply.

For use in a redundant configuration, the Cisco 4507R chassis is required, and two Supervisor II-Plus-10GE supervisors may be used in a fail-over fashion. Although four 10-Gig ports are present between the two supervisors, only two may be utilized in this configuration.

The Supervisor Engine II-Plus-10GE supports CLI and SNMP management but doesn't support Web management of a useful sort. However, Cisco's Network Assistant will work with the Supervisor Engine II-Plus-10GE and provide SNMP-driven GUI management for most common functions, such as VLAN port changes and general switch management.

So, given a solid fiber plant, pushing 20Gbps each way to closets or other buildings on a campus or within a MAN (metropolitan area network) is easily possible with this switch. Cisco's Supervisor Engine II-Plus-10GE and the 4506 chassis are meant to perform some heavy lifting, and together they stand as another nail in the coffin for ATM as an enterprise interconnect.

BOTTOM LINE: Cisco Catalyst 4506 with Supervisor Engine II-Plus-10GE

Company: Cisco Systems,http://www.cisco.com/

Verbal Score: Excellent

Numeric Score: 9.1

CriteriaScoreWeightPerformance10.030.0Configuration8.020.0Management9.020.0Scalability9.020.0Value9.010.0

Criteria Score Weight

Performance 10.0 30.0

Configuration 8.0 20.0

Management 9.0 20.0

Scalability 9.0 20.0

Value 9.0 10.0

Product: Cisco Catalyst 4506 with Supervisor Engine II-Plus-10GE

Cost: 4506 chassis, $4,995; Supervisor Engine II-Plus-10GE, $11,995

Bottom Line: I couldn't make it cry uncle. Paired with the Cisco 4506, the Supervisor Engine II-Plus-10GE delivered wire-rate 10-Gig switching and quite granular QoS support for the edge in a switch with substantial port density. The lack of local Web management is a given for Cisco, but the use of Cisco's Network Assistant can mitigate that drawback. All told, lots of bang in a little bundle.