Ethernet outperforms all other networking technologies in terms of efficiency, as measured by the lowest job completion time (JCT) for AI training and inference. It has become the go-to choice for expansive AI clusters, offering the unique capability to link over a million AI accelerators essential for scaling AI networks. The creation of AI systems is an intricate task that requires interoperability, standardization, and technology prowess among various suppliers, spotlighting the necessity of a shared, open platform to unite these components. Ethernet uniquely delivers networking solutions that ensure peak performance and scalability with cost-effectiveness and agility, due primarily to its foundation on open standards and its extensive ecosystem support.
In contrast, InfiniBand technology is commonly deployed in high-performance computing (HPC) scenarios, where attaining low unloaded latency is the primary focus. However, from our view, when it comes to AI training and inference clusters, Ethernet outperforms InfiniBand. Specifically, Ethernet can offer several advantages, including greater bandwidth, higher radix, multi-vendor standard solutions, lower cost, power-efficient economics, improved throughput, and overall better performance. As such, for large-scale AI workloads that demand high bandwidth, reliable transport, and predictable tail latency, Ethernet is the preferred choice over InfiniBand.
In our latest white paper, Why Ethernet is Vital to Fulfilling AI’s Potential, we explore why the Broadcom portfolio provides Ethernet solutions and capabilities that assure lower costs and address network congestion challenges by optimizing network efficiency, especially for scaling and optimizing fast expanding AI workloads. Broadcom solutions, such as the switch-scheduled fabric based on Jericho 3-AI switch, endpoint-scheduled fabric based on the Tomahawk switch family, and Broadcom’s 400G Ethernet NICs, enable the AI infrastructure and fabric vital to making the network the compute platform essential to fulfilling the unique distributed computing demands of AI.
This paper provides insights into:
- The evolving Ethernet landscape
- Why Ethernet meets the AI scaling challenge
- Why Broadcom Ethernet solutions are essential to AI workload optimization
- How the Broadcom E2E Ethernet portfolio provides major cost improvements and sharp power advantages
- The Ultra Ethernet Consortium’s vital role in advancing AI training and inference
Ethernet is best suited for meeting the demands of rapidly evolving networking and scaling demands of AI clusters. Broadcom E2E networking solutions are integral to ensuring the successful implementation of the largest Ethernet installations worldwide and AI clusters are clearly no exception. The foundation for the competitive advantages of Broadcom’s portfolio are the delivery of major cost and power efficiency improvements over alternative solutions. The portfolio-wide merits of Broadcom’s E2E networking solution is underpinned by the company’s strategic commitment to keeping Ethernet open. To learn more, download Why Ethernet is Vital to Fulfilling AI’s Potential today!
In partnership with:
Download Now
Author Information
Ron is an experienced, customer-focused research expert and analyst, with over 20 years of experience in the digital and IT transformation markets, working with businesses to drive consistent revenue and sales growth.
He is a recognized authority at tracking the evolution of and identifying the key disruptive trends within the service enablement ecosystem, including a wide range of topics across software and services, infrastructure, 5G communications, Internet of Things (IoT), Artificial Intelligence (AI), analytics, security, cloud computing, revenue management, and regulatory issues.
Prior to his work with The Futurum Group, Ron worked with GlobalData Technology creating syndicated and custom research across a wide variety of technical fields. His work with Current Analysis focused on the broadband and service provider infrastructure markets.
Ron holds a Master of Arts in Public Policy from University of Nevada — Las Vegas and a Bachelor of Arts in political science/government from William and Mary.
David Nicholson is Chief Research Officer at The Futurum Group, a host and contributor for Six Five Media, and an Instructor and Success Coach at Wharton’s CTO and Digital Transformation academies, out of the University of Pennsylvania’s Wharton School of Business’s Arresty Institute for Executive Education.
David interprets the world of Information Technology from the perspective of a Chief Technology Officer mindset, answering the question, “How is the latest technology best leveraged in service of an organization’s mission?” This is the subject of much of his advisory work with clients, as well as his academic focus.
Prior to joining The Futurum Group, David held technical leadership positions at EMC, Oracle, and Dell. He is also the founder of DNA Consulting, providing actionable insights to a wide variety of clients seeking to better understand the intersection of technology and business.
Daniel is the CEO of The Futurum Group. Living his life at the intersection of people and technology, Daniel works with the world’s largest technology brands exploring Digital Transformation and how it is influencing the enterprise.
From the leading edge of AI to global technology policy, Daniel makes the connections between business, people and tech that are required for companies to benefit most from their technology investments. Daniel is a top 5 globally ranked industry analyst and his ideas are regularly cited or shared in television appearances by CNBC, Bloomberg, Wall Street Journal and hundreds of other sites around the world.
A 7x Best-Selling Author including his most recent book “Human/Machine.” Daniel is also a Forbes and MarketWatch (Dow Jones) contributor.
An MBA and Former Graduate Adjunct Faculty, Daniel is an Austin Texas transplant after 40 years in Chicago. His speaking takes him around the world each year as he shares his vision of the role technology will play in our future.
