Amphenol

Benchmarking High-Speed Cables Using Xena Ethernet Traffic Generators

Amphenol logo

This case study describes how Amphenol used Teledyne LeCroy’s test solutions to measure the performance differences between passive and active cables to present a more consistent message to customers about the relative performance of each type of solution. A large range of DAC, ACC, and AEC cables up to three meters in length were evaluated.

Cables in server rack

BACKGROUND

With the move to high-speed Ethernet – 400G, 800G and eventually 1.6T connections – traditional passive copper cables (also known as Direct Attach Cables, DACs) find themselves challenged by the need to transmit 112Gbps PAM4 signals over distances up to 3 meters, from the bottom to the top of the racks.

Optical solutions offer the required reach, but they are expensive and consume much more power. Moreover, the transition to 800G switch ports means many data centers are connecting several Network Interface Card (NIC) to 100/200/400G ports via break-out cables, adding further complexity to the scenario.

In response to this demand and the highlighted challenges, Active Copper Cables (ACCs) featuring linear equalizers positioned at one or both ends of the cable, and Active Electrical Cables (AECs) with DSPs at one or both ends, have emerged as the best cabling solutions helping for extending the copper-based ecosystem.

Amphenol Communications Solutions is one of the world’s largest developers and manufacturers of connectors and interconnect systems. With advanced cabled solutions supporting data rates up to 224Gbps per lane and beyond, Amphenol is well positioned to meet the demand in data centers. By providing reliable and consistent high-speed connectivity between racks, Amphenol facilitates the seamless transfer of data across the expansive infrastructure of modern data centers and hyperscale data centers

Amphenol’s Octal Small Form-factor Pluggable (OSFP) and Quad Small Form-factor Pluggable, Double Density (QSFP-DD) copper cable assemblies are designed to meet the needs of data center, networking and high-performance computing applications for high-density cabling interconnect systems capable of data rates from 10Gpbs per lane to 224Gbps per lane transmission rates.

OSFP and QSFP-DD transceivers from Amphenol

Figure 1: QSF-DD and OSFP assemblies from Amphenol Communications Solutions.

THE CHALLENGE

Being a cable vendor, Amphenol naturally needs to test and document the performance differences between different ACC or AEC and DAC interconnect. Additionally, they must investigate the performance in real installations with tightly bent, densely packed cables which could result in varying intra-pair skews across different lanes.

After conducting numerous interoperability tests, Amphenol determined that the absolute Bit Error Rate (BER) measurements can vary across different ports and lanes. Consequently, to accurately assess the performance of one cable relative to another cable or a previous test, it was essential to conduct measurements using the same SerDes implementation. Furthermore, the test module must allow tuning of its TX equalizer to optimize the BER for each type of cable and cable length.

For DACs and even ACCs, it is typical to employ Vector Network Analyzers (VNAs) for analyzing the performance of a cable in the frequency domain. “Meeting the industry standard specifications is the benchmark for shipping to customers, however, when customers report field issues, the differences in the frequency spectrum are often so minor, that it is a bit like finding a needle in a haystack,” says Samuel Kocsis, Director of Standards and Technology at Amphenol Communications Solutions. “For this reason, customers are requesting improved methods for quantifying cable performance, with as close to an in-situ test as possible in a way that is both time and cost effective.” Amphenol aims to find the optimal approach that balances the testing effort with the insights gained.

Pseudo-Random Binary Sequence (PRBS) represents a natural progression from VNAs to enable BER measurements relative to a benchmark. However, sometimes PRBS alone is insufficient – for instance, rigid cable bends can lead to divergent skew patterns across lanes, necessitating the use of AN/LT or measuring packet drops at Layer 2.

THE SOLUTION

Amphenol set out to determine whether the Teledyne LeCroy Z800 Freya traffic generator could be used to test the compliance of both active and passive cables. The Z800 Freya supports testing at speeds ranging from 10Gbps to 800Gbps, using 10/25G NRZ or 56G/112G PAM4 SerDes. The test modules are available with either OSFP or QSFP-DD interfaces, allowing cables with both interface types to be tested within the same rack setup. With its in-house PHY design, the Z800 Freya offers a comprehensive feature set for Layer 1 testing, along with full Layer 2-3 testing capabilities.

The XenaManager software (included free with all Xena traffic generators) simplifies the configuration and monitoring of per-port and per-lane statistics and facilitates the setup and execution of packet streams at wire-speed. For example, Figure 2 below shows the pre-FEC BER measured at both ends of a 2-meter DAC. Moreover, Xena OpenAutomation (XOA), a free open-source automation and Python API scripting framework, allows customers to automate and integrate Z800 Freya with their own test scripts. Automating cable testing with the Z800 Freya and XOA, eliminates days of cumbersome manual testing.

Amphenol cables

Initially, Amphenol used the Z800 Freya to transmit PRBS streams and measure BER performance differences among various cables and test scenarios. Using a traffic generator, enabled Amphenol to detect subtle differences in post-FEC system performance degradation that were not discernible through frequency domain analysis alone.

For more advanced testing, such as minor skew differences between different lanes on a cable, Amphenol used both Link Training and L2 packet streams to monitor per-lane performance.

A wide range of DAC, ACC, and AEC cables of varying lengths were tested at 800Gbps using the Teledyne LeCroy Z800 Freya traffic generator. For a comprehensive list of all test results, see the Appendix at the end of this document. Both OSFP and QSFP-DD transceivers were included in the tests, and cables with different gauges ranging from 25 AWG to 32 AWG were evaluated.

Amphenol fig 6

As shown in Figure 3 above, high-speed Ethernet connections involve multiple equalizers – at the transmitter, the receiver, and, in the case of active cables, within the cable itself. To ensure a fair comparison between the various cable types, it was important to tune the transmitter equalizer taps of the test module transceiver for optimal performance based on each cable’s type, gauge, and length.

Figure 4 below presents an example of the relative BER improvements obtained on ACC cables using two different transmitter equalizer settings. In one case, the same equalizer setting was applied across all three cable lengths (labeled w/o tuning), while in the other case, the settings were manually optimized for the best possible BER at each length (labeled w tuning). As shown, proper tuning improved BER in this specific example by up to two orders of magnitude.

BER tuning

In general, it is beneficial to implement a lookup table in the host network equipment that stores the optimal equalizer settings for all cable types and lengths used in the network. In some cases, a test module like the Z800 Freya can be used as a link partner to automatically tune the host’s transmitter equalizer through Link Training.

Figure 5 illustrates a benchmarking test conducted on a subset of DAC, ACC, and AEC cables using PRBS to measure pre-FEC BER across different cable lengths and gauge values. The transmitter equalizer taps were adjusted for each measurement. The dotted lines indicate the expected performance trends for DAC, ACC, and AEC cables. The results show that DAC cables perform quite well at lengths below 1.5–2 meters, whereas at longer lengths, ACC and AEC cables exhibit nearly identical performance.

Fig 8 Amphenol case study

The BER measured for an 800Gbps link can vary due to differences in BER across the individual 8 lanes. The Z800 Freya Signal Integrity View (SIV) provides a quick way to identify whether one or more lanes are experiencing poorer PAM4 signal quality compared to the others.

Figure 6 below shows an example where lanes 0, 1, and 4 are performing well, while the remaining lanes exhibit poor performance.

Amphenol case study figure 9

On top of the BER measurement Ethernet packets of 64 bytes and 1588 bytes were also tested. The packet loss was 0 in all measurements indicating that the achieved BER was adequate. The Z800 Freya test module was also used to measure the end-to-end latency for all cables.

“Freya let us quickly quantify the performance variances among our different cabling solutions by emulating real-world systems,” explains Samuel Kocsis. “The platform is highly attractive from the standpoint that we can plug different test modules into the same chassis mainframe, so we can test a mix of OSFP and QSFP-style ports.”

Using Z800 Freya made it easy for Amphenol to compare their various active and passive cable solutions against a well-functioning 112Gbps SerDes implementation. This capability proved valuable in both the development and promotion of new cable types, as well as analyzing cable issues reported by customers. Samuel Kocsis anticipates that Amphenol will utilize the Teledyne LeCroy XOA Python API to further integrate Z800 Freya into their test environment.

Looking ahead, Amphenol envisions using Freya in their production processes because whenever new processes or materials are implemented, it is imperative to prove that these changes have not altered the product’s performance.

SUMMARY

Amphenol is one of the world’s largest developers and manufacturers of connectors and interconnect systems including advanced passive and active solutions supporting data rates of 112G, 224G, and beyond.  They are always in need of market-leading metrology equipment to evaluate the performance differences between various passive and active cable types.

The Teledyne LeCroy Z800 Freya traffic generator, with extensive L1, L2, and L3 test capabilities enabled Amphenol to perform the kind of testing needed for this task.

A key capability of the Z800 Freya is its ability to precisely tune the equalizers in the test equipment to achieve optimal performance for each cable type and length.

Using the Z800 Freya, Amphenol was able to quantitatively compare BER versus length across a wide range of DACs, ACCs, and AECs. The results clearly demonstrated that ACCs and AECs significantly extend the maximum usable transmission distance compared with passive DACs.

APPENDIX:

Below is the data Amphenol collected for the various cables. Please note:

Amphenol data results
  • The latency is measured as “last bit out” to “first bit in”. This effectively measures the PHY-to-PHY datapath latency – independent of the packet length and FEC – but sensitive to cable type and direction‑dependent retimer delays.
  • The same Tx equalizer setting was used for all 8 lanes of each cable type test.