IBM FlashSystem explained

IBM FlashSystem
Image-Size:275px
Manufacturer:TMS (2001-2013)IBM (2013-current)
Introduced:Jan 2001 (as TMS RamSan)April 11, 2013 (as IBM FlashSystem)
Type:Enterprise solid state computer data storage system
Processor:x86 (Intel Xeon)[1] [2] [3]

IBM FlashSystem is an IBM Storage enterprise system that stores data on flash memory. Unlike storage systems that use standard solid-state drives, IBM FlashSystem products incorporate custom hardware based on technology from the 2012 IBM acquisition of Texas Memory Systems.[4]

According to Gartner, IBM was the number one all-flash storage array vendor in 2014 selling over 2,100 FlashSystems totaling 62 petabytes (PB) of capacity. The IBM FlashSystem commanded 33% of the total all-flash capacity sold by all vendors for the year.[5]

As of February 12, 2020, the FlashSystem brand has replaced both the Storwize and XIV brands in IBM.[6]

History

Origin

The IBM FlashSystem architecture was originally developed by Texas Memory Systems (TMS) as their RamSan product line. TMS was a small private company founded in 1978 and based in Houston, Texas, that supplied solid-state drive products to the market longer than any other company.[7] The TMS RamSan line of enterprise solid state storage products was first launched in the early 2000s with the RamSan-520,[8] and over seven RamSan technology generations were released through 2012, when TMS was acquired by IBM.[9] As RamSan technology evolved, TMS adapted the systems to different storage media (DRAM, single-level cell flash memory, and multi-level cell flash memory) and external storage area network interfaces (Fibre Channel and InfiniBand), but the core system design principles remained relatively constant: custom hardware with a shared internal network to maximize speed, particularly latency. The last RamSan products available were the RamSan-710, RamSan-810, RamSan-720, and RamSan-820 systems, which were replaced directly with corresponding IBM FlashSystem products in 2013.[10] [11]

Integration into IBM

IBM FlashSystem products were first made generally available on April 11, 2013, in conjunction with the announcement of a US$1 billion investment in flash optimization research and development.[12] At the Flash Ahead event, IBM emphasized the economic "tipping point" that flash had reached versus traditional storage devices for high-performance applications.[13]

On January 16, 2014, IBM announced the FlashSystem 840 product, which was the first FlashSystem designed entirely by IBM post-acquisition of TMS. The key enhancements of the new generation were RAS enhancements, higher capacities, higher performance, new 16 Gbit Fibre Channel and 10 Gbit Fibre Channel over Ethernet interfaces, and a new management GUI. IBM also announced the FlashSystem Enterprise Performance Solution, which added software features and functions to the 840, including real-time compression, replication, and snapshots.[14]

IBM refreshed the product line on February 19, 2015 by announcing the FlashSystem 900 model AE2, a direct replacement for the FlashSystem 840, and the FlashSystem V9000 which combined a FlashSystem 900 model AE2 enclosure with a pair of San Volume Controllers. The V9000 brought software-defined storage into the FlashSystem brand for the first time, all managed under one management domain, also called a single-pane-of-glass. Both of these products relied on Micron Technology's MLC flash chip technology[15]

The product line was expanded on April 27, 2016 when IBM announced two new products, the FlashSystem A9000 and A9000R model 415. Both of these products included features specifically designed for cloud environments. They incorporated pattern removal, data de-duplication, and real-time compression combined with the IBM FlashCore technology to deliver consistent low latency performance. The A9000 was a fully configured solution, while the A9000R enabled a grid architecture and the ability to scale to petabytes of storage.[16] These products relied on Spectrum Accelerate (formerly XIV) running on dedicated grid controllers to perform the software defined storage functions coupled with FlashSystem 900 storage enclosures. The A9000 included the ability to migrate from XIV Gen3 systems.[17]

FlashSystem brand replaces XIV brand

IBM announced an update to the FlashSystem 900 on October 23, 2017, with new models AE3 and UF3. This marks the first time that the FlashSystem brand offered a consumption model UF3 for the product line whereby a customer would only pay for what they used.[18] The update tripled the capacity of the array and added at-line-speed hardware user data compression. The MicroLatency flash modules were updated to 32-layer 3D TLC NAND flash from Micron. Rather than the compression feature slowing down data access as usually happens with software based compression, the 900 continued to advertise 1.2 million I/O operations per second (IOPs) due to the hardware compression implementation and hardware only data path. The compression engines were implemented in each flash module and, with the capability to have up to 12 modules per enclosure, a fully loaded enclosure therefore would have a total of 12 hardware compression engines.[19]

The very next day on October 24, 2017 IBM announced an update to the FlashSystem A9000 with the new model 425. This new model would incorporate the previously-announced FlashSystem 900 model AE3, but retain the same grid controllers as the 415 model.[20] With two generations of FlashSystem A9000 now in the market, the 415 model and the 425 model, IBM on February 27, 2018 announced the end of marketing for the XIV storage systems models 214 and 314, commonly known as "XIV Gen3". They listed the replacement product as the A9000 model 425. This announcement marked the end of the XIV Storage System brand with the FlashSystem brand taking its place.

FlashSystem brand replaces Storwize brand

With the announcement of the FlashSystem 9100 on July 10, 2018, the product line added a new enclosure that was designed with NVM Express (NVMe) from end-to-end. The 9100 was the first FlashSystem product which combined the Spectrum Virtualize software stack with the IBM Flash Core Module technology in a single enclosure. To achieve this, IBM redesigned the proprietary custom form-factor MicroLatency Flash Modules with FlashCore technology into a standard 2 1/2 inch form-factor NVMe SSD.[21] The included Flash Core Modules were available in 4.8TB, 9.6TB, and 19.2TB capacities with up to 5:1 compression.[22]

On February 12, 2020, IBM announced an expansion of the FlashSystem line to include the FlashSystem 7200, FlashSystem 9200, and FlashSystem 9200R.[23] Additionally, IBM announced the FlashSystem 5010, 5030, and 5100 which are re-branded Storwize storage enclosures.[24] With this announcement, IBM retired the Storwize brand and simplified the distributed storage portfolio underneath the FlashSystems brand. The Storwize V5000 and V5100 are replaced by the FlashSystem 5000 and 5100 respectively. The FlashSystem 900 and Storwize V7000 are replaced by the FlashSystem 7200. The FlashSystem V9000 and 9100 are replaced by the FlashSystem 9200. The FlashSystem A9000R is replaced by the FlashSystem 9200R.[25] With this announcement, the FlashSystem product line will no longer include enclosures with end-to-end hardware only data path technology from the Texas Memory Systems (RamSan) acquisition nor will it include enclosures running Spectrum Accelerate software from the (XIV) acquisition, however, the product still retains the IBM FlashCore based flash modules developed at TMS[26] [27]

Technology

IBM FlashSystem products are based on a custom hardware architecture that incorporates field-programmable gate arrays (FPGAs). The FlashSystem design omits traditional server-based array controllers. The primary components of each FlashSystem unit include custom flash modules, external storage area network interfaces, and FPGA logic that spreads data through the system. Each flash module within a FlashSystem incorporates enterprise multi-level cell or single-level cell flash chips and FPGAs that provide IBM Variable Stripe RAID data protection as well as standard flash memory controller functions. IBM claims that these architectural attributes provide strong performance, reliability, and efficiency. In August 2013, IBM submitted a single FlashSystem 820 SPC-1 benchmark result to the Storage Performance Council that showed fast response time (SPC-1 LRT) and high SPC-1 IOPS per external storage port - common measures of high storage performance - as well as low power consumption.[28]

IBM claims that enterprise multi-level cell flash plus Variable Stripe RAID and other IBM reliability technology forms a good balance between reliability and economics for most enterprise environments. IBM Variable Stripe RAID is a patented[29] highly granular RAID 5 type data protection arrangement implemented across each set of 10 flash chips in the system. IBM FlashSystem 900, 840, 820, and 720 products also include a second layer of RAID 5 implemented within the data distribution logic at the system level, providing "two-dimensional" data protection within the system. IBM claims that this two-dimensional protection is strongly differentiated within the industry.[30]

Models

FlashSystem model list
PositionForm Factorbefore201320142015201620172018201920202021
EntryRack-mount2UIBM Storwize50#0[31] 50#5[32]
1U51005200[33] [34]
Mid-range2U7200
1UTMS RamSan710[35]
810
Hi-end720
820
2U840900 AE2900 UF2900 AE3900 UF3
6Uv840V900091#0[36] 92009200R
8UA9000
Rack cabinetIBM XIVA9000R

FlashSystem A9000 and A9000R

IBM FlashSystem A9000 is a 8U rackmount unit with up to 300 TB[37] of usable storage capacity provided by FlashSystem 900 modules, managed by IBM Spectrum Accelerate software. It's scalable sibling, the FlashSystem A9000R, consists of a minimum of two units, scaling to 6 units or 1.8 PB[38] usable in a 42U rack. A9000R units share CPU, cache and access paths with their neighbours, leveraging a zero-tuning data distribution design. The FlashSystem A9000 family supports IBM Real-time Compression, real-time global deduplication and real-time pattern removal, while maintaining average access times of 250 μs under database workloads. Up to 144 instances of FlashSystem A9000 and XIV Storage Systems can be combined into one HyperScale cluster with client multitenancy. Since A9000, A9000R and XIV Storage Systems share the Spectrum Accelerate management software, the FlashSystem A9000R is occasionally referred to as XIV Gen4.

FlashSystem 900 and V9000

FlashSystem V9000

IBM FlashSystem V9000 is a 6U rackmount with up to 57 TB of usable storage capacity provided by FlashSystem 900 modules, managed by IBM Spectrum Virtualize software. The system supports a wide range of advanced data services such as IBM Real-time Compression and external storage virtualization. With scalability up to 456 TB of usable capacity (over 2 PB of effective capacity when using Real-time Compression), FlashSystem V9000 is targeted for mixed workload environments.

FlashSystem 900

IBM FlashSystem 900 is composed of IBM enhanced MLC flash technology. The system is a 2U rackmount unit with up to 57TB of RAID-5, usable storage capacity. The system supports a high-availability architecture with redundant and hot-swappable components, IBM optimized ECC, IBM Variable Stripe RAID, and two-dimensional flash RAID for data protection. With read IOPS of 1,100,000 and write IOPS of 600,000, FlashSystem 900 is targeted for OLTP and OLAP databases.

On October 24, 2017 IBM announced an update to the FlashSystem 900 to add support for hardware-accelerated, inline data compression, but update loosened flash technology to 3D triple-level cell (TLC).[39]

FlashSystem 840 and V840

Both products were released in jan 2014 and were improved in May 2014 with new entry level capacity points and more protocols.[40] Both models supports ECC, IBM Variable Stripe RAID, and two-dimensional flash RAID for data protection and offers hot-swap flash modules and power supplies. The systems also supports a wide range of software-defined storage services including: Real-time Compression, external storage virtualization, snapshots, replication, IBM Easy Tier, VAAI, and thin provisioning.

FlashSystem V840

IBM FlashSystem V840 was a 6U rackmount with up to 40TB of usable storage capacity and targeted for workloads that need high velocity data access and advanced storage services.[41] It is the predecessor of the FlashSystem V9000.

FlashSystem 840

FlashSystem 840 was composed of enterprise multi-level cell (eMLC) flash technology and was a 2U rackmount unit with up to 48TB of usable storage capacity, 40TB with RAID 5. With read IOPS of 1,100,000 and write IOPS of 600,000, FlashSystem 840 is targeted for OLTP and OLAP databases, scientific applications and cloud services.[42] It is the predecessor of the FlashSystem 900.

Early models

Specifications
Product Machine Type / Model (MTM) Capacity Performance Reliability Efficiency Marketing Withdrawn Family
IBM FlashSystem A90009836-425, 9838-4252020/02/11XIV
IBM FlashSystem A90009836-415, 9838-4152018/03/27XIV
IBM FlashSystem A9000R9835, 9837XIV
IBM FlashSystem 91009110-AF7, 9150-AF8Storwize
IBM FlashSystem V9000 9846/8-AC2, 9846/8-AE2 Up to 57 TB per building block, Up to 456 TB with full scale-out of control enclosuresLess than 200 μs min. latencyup to 630,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 6U rackspace - Storwize
IBM FlashSystem v840 9846/8-AC1, 9846/8-AE1 Up to 40 TB per building block, Up to 320 TB with full scale-out of control enclosuresLess than 200 μs min. latencyup to 630,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 6U rackspace - Storwize
IBM FlashSystem 900 9840-AE3, 9843-AE3, 9845-AE3 Up to 180 TB usable or 220 TB effective with RAID 5 Less than 155 μs min. latencyup to 1,200,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 2U rackspace, 625 Watts 2020/02/11 RamSan
IBM FlashSystem 900 9840-AE2, 9843-AE2, 9845-AE2 Up to 57 TB usable with RAID 5 Less than 155 μs min. latencyup to 1,100,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 2U rackspace, 625 Watts 2018/07/12 RamSan
IBM FlashSystem 840 9840-AE1, 9843-AE1 Up to 40 TB usable with RAID 5 (65 TB raw) Less than 135 μs min. latencyup to 1,100,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 2U rackspace, 625 Watts 2015/06/02 RamSan
IBM FlashSystem 820 9831-AE2 Up to 20.6 TB usable with RAID 5 (33 TB raw) Less than 160 μs min. latencyup to 525,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 1U rackspace, 300 Watts 2014/07/22 RamSan
IBM FlashSystem 720 9831-AS2 Up to 10.3 TB usable with RAID 5 (16.5 TB raw) Less than 145 μs min. latencyup to 525,000 random read IOPSTwo-dimensional flash RAID with Variable Stripe RAID 1U rackspace, 350 Watts 2014/03/28 RamSan
IBM FlashSystem 810 9830-AE1 Up to 10.3 TB usable (13.7 TB raw) Less than 160 μs min. latencyup to 550,000 random read IOPSVariable Stripe RAID 1U rackspace, 350 Watts 2014/07/22 RamSan
IBM FlashSystem 710 9830-AS1 Up to 5.2 TB usable (6.9 TB raw) Less than 145 μs min. latencyup to 570,000 random read IOPSVariable Stripe RAID 1U rackspace, 280 Watts 2014/03/28 RamSan

See also

External links

Notes and References

  1. Web site: Mellor. Chris. IBM's FlashSystem 900: 'Better capacity in less rack space'. 2021-05-23. www.theregister.com. en.
  2. Web site: Evans. Chris. IT. Architecting. Quick as a flash: A quick look at IBM FlashSystem. 2021-05-23. www.theregister.com. en.
  3. Book: 2016-09-30. IBM FlashSystem V840 IBM Redbooks. 2021-05-23. www.redbooks.ibm.com. en-US.
  4. Web site: Flash or SSD: Why and When to Use IBM FlashSystem . Gilge . Megan . Orlando . Karen . . June 26, 2013 . January 3, 2014 .
  5. . IBM Sells More All-Flash Storage in 2014 Than Any Other Competitor . ARMONK, N.Y . IBM . 2015-05-11 . 2020-03-31.
  6. Web site: Hardware withdrawal: IBM XIV Storage System Model 214 and 314 - Replacements available . February 27, 2018 . IBM . March 31, 2020 .
  7. Web site: Who's who in SSD? - Texas Memory Systems . Kerekes . Zsolt . ACSL . January 3, 2014.
  8. Texas Memory Systems Announces Availability of RAM-SAN 520 . . January 8, 2001 . https://web.archive.org/web/20011109205042/http://www.superssd.com/pressrelease/01082001.htm . November 9, 2001 . January 3, 2014 .
  9. IBM Completes Acquisition of Texas Memory Systems . . October 1, 2012 . January 3, 2014 .
  10. News: Mellor . Chris . IBM pours $1 BEELLION into flash SSDs . The Register . April 15, 2013 . January 3, 2014 .
  11. Web site: 2013-04-11. New IBM FlashSystem 720 and FlashSystem 820 high-performance flash storage systems. 2021-05-23. www-01.ibm.com. en-US.
  12. Web site: IBM to Invest $1B in Flash Promotion . Handy . Jim . Objective Analysis . April 15, 2013 . January 3, 2014 .
  13. News: Big Blue's billion-dollar bet on SSD includes all-flash storage array . Lelii . Sonia . TechTarget . April 12, 2013 . January 3, 2014 .
  14. Web site: IBM Introduces X6 Architecture, Optimizes x86-Based Servers for Cloud, Analytics. IBM. 23 January 2014.
  15. . IBM Unveils Next Generation Flash Storage Solutions . ARMONK, N.Y . IBM . 2015-02-19 . 2020-03-31.
  16. . IBM Expands Flash Storage Solutions to Target New, Intelligent Apps in the Cloud . ARMONK, N.Y . IBM . 2016-04-27 . 2020-03-31.
  17. Web site: A Bridge Across Generations: XIV Gen3 to FlashSystem A9000 & A9000R . Siles . Yossi . IBM developerWorks . February 20, 2018 . March 30, 2020 .
  18. Web site: IBM FlashSystem 900 supports the next-generation MicroLatency module and FC-NVMe interface to accelerate all-flash applications . October 23, 2018 . IBM . March 31, 2020 .
  19. News: Mellor . Chris . IBM wheels out upgraded FlashSystem: Now breathe in and squeeeeze . The Register . October 26, 2017 . March 31, 2020 .
  20. Web site: IBM FlashSystem A9000 leverages the latest 3D-TLC NAND flash technology to deliver improved cost, scale, and density . October 24, 2018 . IBM . March 31, 2020 .
  21. Web site: A New Form Factor for IBM FlashCore . Yardley . Brent . August 6, 2018 . IBM . March 31, 2020 .
  22. News: Armstrong . Adam . IBM Announces FlashSystem 9100 . StorageReview . July 10, 2018 . March 30, 2020 .
  23. Web site: Storage made simple for hybrid multicloud. 12 February 2020 . IBM. 30 March 2020.
  24. Web site: Announcing the new IBM FlashSystem family — one platform to simplify your hybrid multicloud storage. IBM. 30 March 2020.
  25. News: Mellor . Chris . So long, farewell, Storwize. IBM melds storage array line under FlashSystems brand. Blocks & Files. February 11, 2020 . 30 March 2020.
  26. Web site: Hardware withdrawal: IBM FlashSystem 900 models AE3 and UF3 - Replacements available . February 11, 2020 . IBM . March 31, 2020 .
  27. Web site: Hardware withdrawal: IBM FlashSystem A9000 and A9000R - Replacements available . February 11, 2020 . IBM . March 31, 2020 .
  28. Web site: SPC Benchmark 1/Energy™ Executive Summary - IBM FlashSystem 820 (#AE00006) . August 16, 2013 . Storage Performance Council . January 3, 2014 . May 20, 2014 . https://web.archive.org/web/20140520081810/http://www.storageperformance.org/benchmark_results_files/SPC-1E/IBM/AE00006_IBM_FlashSystem-820/ae00006_IBM_FlashSystem-820_SPC-1E_executive-summary.pdf . dead .
  29. Frost . Holloway H. . Camp . Charles J. . FLASH-based memory system with static or variable length page stripes including data protection information and auxiliary protection stripes . October 15, 2013 . US8560881 B2 . US.
  30. Web site: Enterprise Reliability features of the IBM FlashSystem . Pearson . Tony . IBM developerWorks . November 22, 2013 . January 3, 2014 .
  31. Web site: Whyte. Barry. 2020-03-11. Introducing FlashSystem 5000, 7200 & 9200. FCM Gen2 & SCM. 2021-05-23. Barry Whyte and Andrew Martin : IBM Storage. en.
  32. Web site: 2021-02-09. IBM Storage launches the FlashSystem 5015, 5035 and 5200. 2021-05-23. ITCandor. en-US.
  33. Web site: Whyte. Barry. 2021-02-09. Introducing IBM FlashSystem 5200. 2021-05-23. Barry Whyte and Andrew Martin : IBM Storage. en.
  34. Web site: McDowell. Steve. IBM Upgrades Entry Enterprise Flash Storage. 2021-05-23. Forbes. en.
  35. Web site: 2018-09-04. Family 9830+01 IBM FlashSystem 710 and FlashSystem 810. 2021-05-23. www-01.ibm.com. en-US.
  36. Web site: Whyte. Barry. 2020-02-26. Introducing the IBM FlashSystem 9100 – with NVMe Flash-Core-Modules (FCM). 2021-05-23. Barry Whyte and Andrew Martin : IBM Storage. en.
  37. 1 TB = 1000 billion bytes
  38. 1 PB = 1000 TB
  39. Web site: IBM FlashSystem 900 accelerates applications with the extreme, consistent, and predictable performance of a low latency, ultra-dense, all-flash storage system. 24 October 2017 . IBM. 9 July 2019.
  40. Web site: IBM FlashSystem 840 Enhancements. 26 May 2014 . Storage Newsletter. 7 October 2014.
  41. Web site: IBM FlashSystem V840 Enterprise Performance Solution. IBM. 7 October 2014.
  42. Web site: Implementing IBM FlashSystem 840. IBM. 23 January 2014.