ARM Neoverse explained
The ARM Neoverse is a group of 64-bit ARM processor cores licensed by Arm Holdings. The cores are intended for datacenter, edge computing, and high-performance computing use. The group consists of ARM Neoverse V-Series, ARM Neoverse N-Series, and ARM Neoverse E-Series.[1] [2]
Neoverse V-Series
The Neoverse V-Series processors are intended for high-performance computing.
Neoverse V1
Neoverse V1 (code named Zeus[3]) is derived from the Cortex-X1[4] and implements the ARMv8.4-A instruction set and some part of ARMv8.6-A.[5] It was officially announced by Arm on September 22, 2020.[6] It is said to be initially realized with a 7 nm process from TSMC. One of the changes from the X1 is that it supports SVE 2x256-bit.
According to The Next Platform, the AWS Graviton3 is based on the Neoverse V1.[7] [8]
Neoverse V2
Neoverse V2 (code named Demeter) is derived from the ARM Cortex-X3 and implements the ARMv9.0-A instruction set. It was officially announced by Arm on September 14, 2022.[9] [10] NVIDIA Grace,[11] AWS Graviton4[12] and Google Axion[13] are based on the Neoverse V2.
Notable changes from the Neoverse V1:[14]
- BTB capacity: 12K entries
- TAGE predictor: 8-table
- micro-op cache: 1536 entries (reduced for efficiency)
- Decode width: 6
- Rename / Dispatch width: 8
- ROB: 320 entry
- Execution ports: 15
- L2 cache: 1024-2048 KB per core
- CMN-700 mesh interconnect
- Up to 256 cores per die
- Up to 512 MB SLC
- Up to 4 TB/s bandwidth
Neoverse V3
Neoverse V3 (code named Poseidon) was teased by Arm alongside the V2 and E2 announcements. It is targeted for systems including DDR5, PCIe gen6, and CXL 3.0. The codename Poseidon was first used for the generation succeeding Zeus, now V1, and targeted for 2021 on a 5nm node.[15]
Neoverse N-Series
The Neoverse N-Series processors are intended for core datacenter usage.
Neoverse N1
On February 20, 2019, Arm announced the Neoverse N1 microarchitecture (code named Ares) derived from the Cortex-A76 redesigned for infrastructure/server applications. The reference design supports up to 64 or 128 Neoverse N1 cores.[16] [17]
Notable changes from the Cortex-A76:
- Coherent I-cache and D-cache with 4-cycle LD-use
- L2 cache: 512–1024 KB per core
- Mesh interconnect instead of 1–4 cores per cluster
Neoverse N1 implements the ARMv8.2-A instruction set.
The Ampere Altra (2-socket 80-core) and AWS Graviton2 (64-core) CPU platforms are based on Neoverse N1 cores and were released in 2020.[18]
Neoverse N2
The Neoverse N2 (code named Perseus) is derived from the Cortex-A710 and implements the ARMv9.0-A instruction set.[18] It was officially announced by Arm on September 22, 2020.[6] On August 28, 2023, Arm announced the Neoverse CSS N2 (Genesis), a customizable CPU subsystem implementation by Arm to reduce the time to market for customers.[19] [20] [21] [22] Microsoft Azure Cobalt 100 128 Core CPU uses Neoverse N2.[23]
Notable changes from the Neoverse N1:[24] [25]
- BTB capacity: 8K entries
- micro-op cache: 1536 entries
- Rename / Dispatch width: 5
- ROB: 160+ entry
- Pipeline depth: 10 cycles
- Execution ports: 13
- SVE2 support
- CMN-700 mesh interconnect
Neoverse N-Next
Neoverse N-Next, presumably N3, was teased by Arm alongside the V2 and E2 announcements. It is targeted for systems including DDR5, PCIe gen6, and CXL 3.0.
Neoverse E-Series
The Neoverse E-Series processors are intended for edge computing. They are designed for increased data throughput at decreased power consumption.
Neoverse E1
Neoverse E1 is derived from the Cortex-A65AE[26] and implements the ARMv8.2-A instruction set. It support SMT.
Neoverse E2
Neoverse E2 is derived from the Cortex-A510[27] and implements the ARMv9-A instruction set.
Neoverse E-Next
Neoverse E-Next, presumably E3, was teased by Arm alongside the V2 and E2 announcements.[27] It is targeted for systems including DDR5, PCIe gen6, and CXL 3.0.
Matrix multiplication theoretical performance
ops/cycle per core | INT8 | BF16 | FP32 | FP64 |
---|
Neoverse N1[28] | 64 | 32 | 16 | 8 |
---|
Neoverse N2 | 128 | 64 | 16 | 8 |
---|
Neoverse V1 | 256 | 128 | 32 | 16 |
---|
Intel 3rd Gen Xeon SP[29] | 256 | | 64 | 32 |
---|
Intel 4th Gen Xeon SP | 2048 | 1024 | 64 | 32 | |
---|
Successors
With code name Poseidon a successor for Neoverse V1 (aka Zeus)[30] was first publicly mentioned on TechCon 2018. Actual introduction (used by third party chip designers in their products) was given in form of a rough target date of 2021. Its initial realization process is said to be 5 nm by TSMC.
Notes and References
- Web site: Arm Neoverse.
- Web site: Arm Puts Some Muscle Into Future Neoverse Server CPU Designs. 27 April 2021 .
- Web site: Neoverse V1 - Microarchitectures - ARM - WikiChip .
- Web site: Arm Announces Neoverse V1, N2 Platforms & CPUs, CMN-700 Mesh: More Performance, More Cores, More Flexibility .
- Web site: Neoverse V1 . 2023-04-16.
- Web site: Accelerating the next generation cloud-to-edge infrastructure . 2023-04-16 .
- Web site: Inside Amazon's Graviton3 Arm Server Processor. 4 January 2022 .
- Web site: 2022-05-29 . Graviton 3: First Impressions . 2023-09-16 . Chips and Cheese . en-US.
- Web site: Redefining the global computing infrastructure with next-generation Arm Neoverse platforms .
- Web site: Neoverse V2 . 2023-09-16 . developer.arm.com.
- Web site: NVIDIA Grace CPU and Arm Architecture . NVIDIA . 2023-04-16.
- Web site: Join the preview for new memory-optimized, AWS Graviton4-powered Amazon EC2 instances (R8g) . 23 December 2023 . AWS.
- Web site: Introducing Google’s new Arm-based CPU . 2024-04-10 . Google Cloud Blog . en-US.
- Web site: 2023-09-11 . Hot Chips 2023: Arm’s Neoverse V2 . 2023-09-16 . Chips and Cheese . en-US.
- Web site: Kennedy . Patrick . 2018-10-16 . Arm Neoverse Brand Launched for Infrastructure Servers to Edge . 2024-02-02 . ServeTheHome . en-US.
- Web site: Frumusanu. Andrei. Arm Announces Neoverse N1 & E1 Platforms & CPUs: Enabling A Huge Jump In Infrastructure Performance. 2020-06-17. www.anandtech.com.
- Web site: 2019-02-20. Arm Launches New Neoverse N1 and E1 Server Cores. 2020-06-17. WikiChip Fuse. en-US.
- Web site: Frumusanu. Andrei. Arm Announces Neoverse V1, N2 Platforms & CPUs, CMN-700 Mesh: More Performance, More Cores, More Flexibility. 2022-05-05. www.anandtech.com.
- Web site: 2023-08-28 . Neoverse CSS Fastest Path to Production Silicon - Infrastructure Solutions blog - Arm Community blogs - Arm Community . 2023-09-16 . community.arm.com . en.
- Web site: Ltd . Arm . Neoverse Compute Subsystems . 2023-09-16 . Arm The Architecture for the Digital World . en.
- Web site: 2023-09-13 . Arm at HC35 (2023): CSS-Genesis . 2023-09-16 . Chips and Cheese . en-US.
- Web site: Morgan . Timothy Prickett . 2023-08-31 . Arm Gets Closer To Creating Full-Blown Server CPU Designs - The Next Platform . 2023-09-16 . www.nextplatform.com . en-US.
- https://www.servethehome.com/microsoft-azure-cobalt-100-128-core-arm-neoverse-n2-cpu-launched/
- Web site: 2023-08-18 . ARM’s Neoverse N2: Cortex A710 for Servers . 2023-09-16 . Chips and Cheese . en-US.
- Web site: Frumusanu . Andrei . Arm Announces Neoverse V1, N2 Platforms & CPUs, CMN-700 Mesh: More Performance, More Cores, More Flexibility . 2023-09-16 . www.anandtech.com.
- Web site: Arm Announces Neoverse N1 & E1 Platforms & CPUs: Enabling a Huge Jump in Infrastructure Performance .
- Web site: Arm Announces Neoverse V2 and E2: The Next Generation of Arm Server CPU Cores .
- Web site: Arm Announces Neoverse V1, N2 Platforms & CPUs, CMN-700 Mesh: More Performance, More Cores, More Flexibility . 2023-04-16 .
- Web site: Accelerate Artificial Intelligence (AI) Workloads with Intel Advanced Matrix Extensions (Intel AMX) . 2023-04-13 . Intel.
- Web site: Poseidon - Microarchitectures - ARM - WikiChip .