Search
Close this search box.

Intel Pushes AI Ambitions Forward With Third Generation Xeon Scalable

The News: Intel is taking a bifurcated approach with the launch of its new third-generation Xeon Scalable processors, releasing 14-nanometer parts first that only target four- and eight-socket servers and then dropping 10nm SKUs for one- and two-socket servers later this year.

The Santa Clara, Calif.-based company announced the new third-generation Xeon Scalable processors, code-named Cooper Lake, on Thursday, pitching the 11 SKUs as a good fit for data-intensive artificial intelligence workloads, in part because of a new instruction set that boosts inference and training.

Analyst Take: This past week Intel presented an update to its roadmap for its datacenter silicon, introducing (once again), its Cooper Lake processors for 4 and 8 socket servers. The company also updated on its next generation Ice Lake product that will focus on 10nm and 1 and 2 socket servers. None of these announcements were necessarily a surprise given that the roadmap had been in place for some time, but the company did offer some additional input on the road map, timing and features–Some of which could be important for the company to win deals with large cloud providers. 

Key Upgrades in Cooper Lake from Cascade Lake

For this newest generation, Intel is offering three significant upgrades. For more in depth technical analysis on these updates, I enjoyed AnandTech’s piece. However, here is my quick analysis for those looking for the punchline. 

  1. BFloat 16: An encoding method which can enable memory bandwidth requirements as well as system-to-system network requirements to theoretically be halved leading to lower cost and hardware requirements. 
  2. Improved Socket-to-Socket Interconnect Speed: Cooper Lake will double to six UPI links also running at 10.4 GT/s, however, these links will only have three controllers (like previous generations) behind them such that each CPU can only connect to three other CPUs. This will enable a doubling of bandwidth, but will not have any direct impact on reduced power consumption or latency from prior generations.
  3. Supporting Optane Memory: Intel updated a previous generation issue that some had with Cascade Lake where even distribution of memory DIMM was not possible. With Cooper lake’s new base models, it can support 12 DIMM, six of which could be 128 GB Optane Modules. There is also a HL series that will support up to 4.5 TB per socket.

AI Core to Intel’s Next Generation Processors

Above I reference the new bfloat16, but it is important to reiterate the importance of this announcement. To explain a little more fully is important because for Intel, gaining momentum in the AI Acceleration space is important and what the company did here is important.

The new generation adds 16-bit floating point processor support, which Intel is calling bfloat16. Cutting FP32 models’ bit-width in half accelerates processing itself, but more importantly, halves the RAM needed to keep models in memory. Taking advantage of the new data type is also simpler for programmers and codebases using FP32 models than conversion to integer would be. (Arstechnia)

I believe the focus on creating a vehicle for programmers and codebases to function more efficiently will yield greater returns for companies as investment continues to be poured into AI. 

Overall Impressions Of Intel 3rd Generation Xeon Scalable Launch

Cooper Lake is a big step forward offering incremental value for Intel. The company is sticking with its 14nm platform for now and I’m sure there will be some critics that will point that out. However, it looks like 2020 is the year that 10nm will hit the streets and support the 1 and 2 socket variants. This should close some of the technology gap that AMD has been touting over the past 12-18 months. Of course, AMD is likely to be making some announcements in this time frame. 

The advances in socket-to-socket connectivity offering greater bandwidth along with the improvements to Optane offering better application performance and cost savings are also material as companies continue to weigh investments in tech and incremental spending. 

The teasing of next year’s Sapphire Rapids also brought some things to be encouraged by. Of course, a roadmap is only as good as the ability to deliver so we will all be watching to see if Ice Lake and Sapphire Rapids stay on schedule, which will be important for Intel that they do. 

Futurum Research provides industry research and analysis. These columns are for educational purposes only and should not be considered in any way investment advice.

Read more analysis from Futurum Research:

Qualcomm’s New Snapdragon 690 to Bring 5G Connectivity to Budget-friendly Phones

Cisco Live Collaboration Launch Focuses In On Workplace Transformation

SAS Partners With Microsoft Azure To Bring Its Analytics to the Cloud

Image Credit: Intel

Author Information

Daniel is the CEO of The Futurum Group. Living his life at the intersection of people and technology, Daniel works with the world’s largest technology brands exploring Digital Transformation and how it is influencing the enterprise.

From the leading edge of AI to global technology policy, Daniel makes the connections between business, people and tech that are required for companies to benefit most from their technology investments. Daniel is a top 5 globally ranked industry analyst and his ideas are regularly cited or shared in television appearances by CNBC, Bloomberg, Wall Street Journal and hundreds of other sites around the world.

A 7x Best-Selling Author including his most recent book “Human/Machine.” Daniel is also a Forbes and MarketWatch (Dow Jones) contributor.

An MBA and Former Graduate Adjunct Faculty, Daniel is an Austin Texas transplant after 40 years in Chicago. His speaking takes him around the world each year as he shares his vision of the role technology will play in our future.

SHARE:

Latest Insights:

Mark Patterson, EVP and Chief Strategy Officer at Cisco, joins Patrick Moorhead and Daniel Newman to shed light on Cisco's strategic foray into AI, discussing its potential industry impact and the importance of collaboration in driving innovation.
Twilio’s Q3 Results Showcase Strong Financials and Cutting-Edge Technological Advancements, Positioning It as a Leader in AI-Driven Customer Engagement
Keith Kirkpatrick, Research Director at The Futurum Group, explores Twilio's Q3 earnings, focusing on how AI advancements and robust data integration are driving growth and transforming customer engagement for today's leading brands.
OpenText’s Strategic Focus on Cloud, AI, and Cybersecurity Propels Growth Despite Revenue Adjustments Following AMC Divestiture
Keith Kirkpatrick, Research Director at The Futurum Group, discusses OpenText's Q1 2025 results, reflecting strategic technological advancements and emphasizing growth in cloud services, artificial intelligence, and cybersecurity.
Gary Steele, Go-to-Market President at Cisco, shares his insights on enhancing digital resilience in the age of AI, emphasizing the synergy between Cisco and Splunk.