Broadcom unveiled a novel on-chip, neural-network inference engine called NetGNT (Networking General-purpose Neural-network Traffic-analyser) in its new, software-programmable Trident 5-X12 chip.
NetGNT works in parallel to augment the standard packet-processing pipeline. The standard pipeline is one-packet/one-path, meaning that it looks at one packet as it takes a specific path through the chip’s ports and buffers. NetGNT, in contrast, is an ML inference engine and can be trained to look for different types of traffic patterns that span the entire chip.
For example, NetGNT can look for a traffic pattern common in AI/ML workloads called “incast” in which many packet flows all converge on the same port and buffer at roughly the same time causing congestion. NetGNT can recognise this pattern in real-time as it begins and invoke congestion-control techniques to avoid degraded network performance. And since NetGNT runs in hardware at full line rate— there is no impact to throughput or latency.
“We continue to push the envelope and introduce brand-new technologies such as NetGNT to the market. We also listen very closely to our customers who have made it clear that one size does not fit all. They rely on us to deliver a broad portfolio of chips, customised for different applications,” said Ram Velaga, senior vice president and general manager, Core Switching Group, Broadcom. “Trident 5-X12 is the most power-efficient ToR (Top of Rack) on the market, while still adding cutting-edge new features that our customers have come to expect from an innovator such as Broadcom.”
Trident 5-X12 is software-programmable, field-upgradable and provides 16.0 Terabits/second of bandwidth, which is double that of the market-leading Trident 4-X9. It also adds support for 800G ports, allowing direct connection to Broadcom’s leading-edge Tomahawk 5, which is used as the spine/fabric in the newest compute and AI/ML data centres. This chip is uniquely positioned to enable a 1RU data centre ToR supporting 48x200G downlink ports and 8x800G uplink ports.