Compute Architectures for AI Workloads Face a Dilemma

A fork in the road is emerging in computing architectures that could rise up the ranks of today’s top chipmakers.

For nearly half a century, the dominant architecture for CPUs was the x86, developed by Intel. Most of the world’s computers are servers and Data centers use the x86 architecture. Since then is around FROM 1978indicated as part of the Intel 8086 processor, this architecture ensures that older software written for earlier x86 processors can run on newer x86 CPUs. Intel and AMD are the two biggest users of x86.

But a rising star is the British chip designer Arm, which uses another CPU architecture that is not compatible with x86. It’s simpler, customizable and energy efficient, which enables it to get 99% market share in mobile devices because it is better for battery powered gadgets. In contrast, x86 is intended for higher computing performance.

When Amazon Web Services (AWS) introduced its Arm-based processor Graviton in 2018, the duopoly of Intel and AMD took notice, according to Steve McDowellCEO of Nand Research, writing on Forbes. Graviton is the first custom chip deployed at scale by a major cloud provider.

“Amazon doesn’t intend to change the microprocessor market,” he said. “The company first built Graviton to control its roadmap, a way for the famously bottom-line-focused company to regain the margin it felt it was sacrificing to Intel and AMD.” But, “what does it do has begun a movement.”

AWS’ Graviton is the “first serious alternative” to the dominant x86-based server processors in the industry, McDowell added. It also opens the door to other tech giants who think the same thing: Microsoft, Google, Apple, Nvidia, Meta, Qualcomm, Samsung, Huawei and Alibaba followed suit with their usual Arm-based chips.

Intel and AMD Circle the Wagons

Last October, fierce chip rivals Intel and AMD joined forces to test to stem the tide towards Arm and other architectures, such as the open source RISC-V. The two chipmakers formed the x86 Ecosystem Advisory Group to formalize standards as the industry moves toward artificial intelligence (AI) workloads.

Joining them is a who’s who of tech: Microsoft, Google Cloud, Dell, Oracle, Broadcom, Lenovo, HP, HPE, Red Hat and luminaries Linus Torvalds (Linux creator) and Tim Sweeney (CEO of Epic Games and creator of Unreal Engine).

“X86 has been the de facto industry standard for the past four decades (with) the widest compatibility,” said Justin Hotardexecutive vice president and general manager of Intel’s data center and AI group, at a recent conference. Most software is developed and runs mostly on x86, even on the edge, on PCs, laptops. or in the data center.

It is also the CPU architecture of choice for AI frameworks because it works with older software. That means x86 “ensures your investments are future-proof while being backward-compatible,” Hotard said.

Both CPUs and GPUs are used for AI workloads. While CPUs can technically handle AI workloads, GPUs are the preferred choice because they can better handle the massive computational demands of training and running complex AI models. CPUs handle general purpose computing tasks.

The advice the group’s goal is to to “make it easier and simpler for the entire ecosystem in the AI ​​era to continue to use and benefit from x86,” Hotard said.

Arm Chief Commercial Officer Abbeywho recently SPOKE with PYMNTS, said his company welcomes the competition. “We’re big believers in choice.” However, he declined to comment on rumors that Arm intends to make chips this year.

Energy Efficiency Is Key

Hotard said that going forward, x86 chips will also be more energy efficient. “AI is creating an unquenchable demand for energy. Research shows that data center energy consumption will double, at least, in the next four years. We cannot make the world a better place with of AI if we don’t make the world a greener place powered by AI.

Energy efficiency is a critical priority for our investments in the Intel ecosystem, he added. It includes the Intel Core Ultra chip and Xeon family of processors.

But Suren Nihalani, senior software engineer at Zooxthe Amazon-owned robotaxi company, believes the x86 advisory group is too late. “They’ve already lost the Arm war because of Apple,” he said in an interview with PYMNTS. Thus, the working group is only a “distraction.”

In 2020, Apple switched the chips in Mac computers from Intel to it YOURSELF custom M1 chips, using Arm designs. These chips are now in the iPhone and other Apple devices.

Especially, Apple is a co-founder of ARMS in 1990 (formerly known as Advanced RISC Machines Ltd.), joined VLSI Technology (now NXP Semiconductors) and Acorn Computers. In 1993, Apple launched the now defunct Newton handheld device using the Arm architecture.