Cheyenne (supercomputer) explained

The Cheyenne supercomputer at the NCAR-Wyoming Supercomputing Center (NWSC) in Cheyenne, Wyoming operated for seven years as one of the world's most powerful and energy-efficient computers from 2017 to 2024.[1] Ranked in November 2016 as the 20th most powerful computer in the world[2] and November 2023 as 159th[3] by its TOP500 rank, the 5.34-petaflops system[4] is capable of more than triple the amount of scientific computing[5] performed by NCAR's previous supercomputer, Yellowstone. It also is three times more energy efficient[6] than Yellowstone, with a peak computation rate of more than 3 billion calculations per second for every watt of energy consumed.[7]

The National Science Foundation and the State of Wyoming through an appropriation to the University of Wyoming funded Cheyenne[8] to provide the United States with a major new tool to advance understanding of the atmospheric and related Earth system sciences. High-performance computers such as Cheyenne allow researchers to run increasingly detailed models that simulate complex processes to estimate how they might unfold in the future. These predictions give resource managers and policy experts valuable information for planning ahead and mitigating risk.[9] Cheyenne's users advanced the knowledge needed for saving lives, protecting property, and enabling U.S. businesses to better compete in the global marketplace.[10]

Scientists across the country used Cheyenne to study phenomena ranging from weather and climate to wildfires, seismic activity, and airflows that generate power at wind farms. Their findings lay the groundwork for better protecting society from natural disasters, lead to more detailed projections of seasonal and longer-term weather and climate variability and change, and improve weather and water forecasts that are needed by economic sectors from agriculture and energy to transportation and tourism.

The supercomputer's name was chosen to honor the people of Cheyenne, Wyoming, who supported the installation of the NWSC and its computers there.[11] The name also commemorates the 150th anniversary of the city, which was founded in 1867 and named for the Native American Cheyenne Nation.[12]

In April 2024, Cheyenne was listed for auction on a government surplus site, with bidding starting at $2,500.[13] [14] After 27 bids, the auction closed on May 3, 2024 at a final bid of .[15]

Replacement

Cheyennes' replacement 'Derecho' was announced on January 27, 2021. It is a 19.87 petaflop HPE Cray System capable of 20 quadrillion calculations per second, said to be 3.5 times faster than Cheyenne. It was scheduled to be operational in early 2022,[16] but officially launched on July 7, 2023.[17]

It has 2488 homogenous (CPU) compute nodes and 82 heterogenous (GPU) compute nodes, 382 NVidia A100 graphics processing units, and 692 terabytes of total memory.[18]

System Description

The Cheyenne supercomputer was built by Silicon Graphics International Corporation (SGI) in coordination with centralized file system and data storage components provided by DataDirect Networks (DDN). The SGI high-performance computer is a 5.34-petaflops system, meaning it can carry out 5.34 quadrillion calculations per second. The data storage system for Cheyenne was integrated with NCAR's existing GLobally Accessible Data Environment (GLADE) file system. The DDN storage provides an initial capacity of 20 petabytes, expandable to 40 petabytes with the addition of extra drives. This, combined with 16  petabytes of GLADE, totals 36 petabytes of high-speed storage[9] as of February 2017.

Cheyenne is an SGI ICE XA system with 4,032 dual-socket scientific computation nodes running 18-core 2.3-GHz Intel Xeon E5-2697v4 processors with 203 [now 315] terabytes of memory.[19] Interconnecting these nodes is a Mellanox EDR InfiniBand network with 9-D enhanced hypercube topology that performs with a latency of only 0.5 microseconds.[20] Cheyenne runs the SUSE Linux Enterprise Server 12 SP1 operating system.[19]

Cheyenne was integrated with many other high-performance computing resources in the NWSC. The central feature of this supercomputing architecture is its shared file system that streamlines science workflows by providing computation, analysis, and visualization work spaces common to all resources. This GLADE common data storage pool,[21] provides 36.4 petabytes of online disk capacity shared by the supercomputers, two data analysis and visualization (DAV) cluster computers,[22] data servers for both local and remote users, and a data archive with the capacity to store 320 petabytes of research data. High-speed networks connect this Cheyenne environment to science gateways,[23] data transfer services, remote visualization resources, Extreme Science and Engineering Discovery Environment (XSEDE)[24] sites, and partner sites around the world.

This integration of computing resources, file systems, data storage, and broadband networks allowed scientists to simulate future geophysical scenarios at high resolution, then analyze and visualize them on one computing complex. This improved scientific productivity by avoiding the delays associated with moving large quantities of data between separate systems. Further, this reduced the volume of data that needed to be transferred to researchers at their home institutions. Cheyenne made more than 1.2 billion core-hours available each year to researchers in the Earth system sciences.[20]

Notes and References

  1. Web site: Hosansky . David . "An extraordinary success" . news.ucar.edu . NSF National Center for Atmospheric Research . September 21, 2024 . January 12, 2024.
  2. Web site: Feldman . Michael . NCAR Launches Five-Petaflop Supercomputer . . September 21, 2024 . January 30, 2017 .
  3. Web site: TOP500 List - November 2023 . top500.org . September 21, 2024.
  4. Web site: Moss . Sebastian . NCAR's 5.34-petaflop supercomputer 'Cheyenne' comes online . Data Centre Dynamics Ltd (DCD) . September 21, 2024. February 2, 2017.
  5. http://insidehpc.com/2017/01/cheyenne-supercomputer/ Video: Introduction to the Cheyenne Supercomputer
  6. Web site: Brennan . Charlie . Boulder's NCAR boasts powerful new supercomputer at Wyoming site . Boulder Daily Camera . MediaNews Group . September 21, 2024 . February 4, 2017.
  7. http://cacm.acm.org/news/213262-turbocharging-science/fulltext Turbocharging Science
  8. http://www.wyomingnews.com/news/supercomputer-cheyenne-starts-operations/article_d05613ac-e848-11e6-9d92-43981c7a8e6e.html Supercomputer Cheyenne starts operations
  9. http://cheyenneleads.org/ncar-announces-new-supercomputer-named-cheyenne-to-be-located-in-the-north-range-business-park/ NCAR announces new supercomputer named “Cheyenne” to be located in the North Range Business Park
  10. News: Staff Writers . Star-Tribune . New supercomputer starts work in Cheyenne . September 21, 2024 . . . 5 February 2017 . en . subscription.
  11. Web site: National Center for Atmospheric Research . New Cheyenne supercomputer triples scientific capability with greater efficiency . phys.org . September 21, 2024 . en . January 31, 2017.
  12. Web site: Staff . Cheyenne Supercomputer Triples Scientific Capability at NCAR . High-Performance Computing News Analysis insideHPC . September 21, 2024 . January 30, 2017.
  13. Web site: Zuhair . Muhammad . 2024-04-30 . Iconic "5.34 PFLOPs" Cheyenne Supercomputer Gets Listed On Government Auction, Currently Bidding At $10,000 . 2024-04-30 . Wccftech . en-US.
  14. Web site: Moss . Sebastian . US government puts retired Cheyenne supercomputer up for auction . Data Centre Dynamics Ltd (DCD) . September 21, 2024 . April 30, 2024.
  15. Web site: Personal Property Management System . 2024-05-04 . gsaauctions.gov.
  16. News: New supercomputer in Wyoming to rank among world's fastest . 28 January 2021 . AP . 27 January 2021.
  17. Web site: NCAR's new Derecho supercomputer launches operations Computational and Information Systems Lab . 2024-04-30 . www.cisl.ucar.edu.
  18. Web site: Documentation - Using Derecho . 2024-04-30 . arc.ucar.edu.
  19. https://www.top500.org/system/178965 Cheyenne - SGI ICE XA, Xeon E5-2697v4 18C 2.3GHz, Infiniband EDR
  20. https://www2.cisl.ucar.edu/sites/default/files/Cheyenne_Briefing_MesaLab_20160624e.pdf Cheyenne: NCAR's Next-Generation Data-Centric Supercomputing Environment
  21. https://nar.ucar.edu/2016/cisl/provide-centralized-high-speed-data-storage Provide Centralized High-speed Data Storage
  22. https://nar.ucar.edu/2016/cisl/provide-data-analysis-and-visualization-resources Provide Data Analysis and Visualization Resources
  23. https://nar.ucar.edu/2016/cisl/provide-science-gateways-and-data-sharing-services Provide Science Gateways and Data-sharing Services
  24. https://www.xsede.org/overview Overview of XSEDE