NEC HYDRAstor explained

NEC HYDRAstor
Latest Release Version:HS8-5000
Latest Release Date:2016
Programming Language:C++
Platform:Cross-platform
Genre:Backup and Archive
License:proprietary

NEC HYDRAstor is a disk-based grid storage system with data deduplication for backups and archiving, developed by NEC Corporation. A HYDRAstor storage system can be composed of multiple nodes, starting from one up to 100+ nodes. Each node contains standard hardware including disk drives, CPU, memory and network interfaces and is integrated with the HYDRAstor software into a single storage pool. HYDRAstor software incorporates multiple features of distributed storage systems: content-addressable storage, global data deduplication, variable block size, Rabin fingerprinting, erasure codes, data encryption and load balancing.

History

HYDRAstor project was started in 2002 by Cezary Dubnicki and Cristian Ungureanu in NEC Research in Princeton, NJ. Prototype version was implemented and evaluated in 2004.[1] After another 3 years of development, first version of HYDRAstor was brought to the market in US and Japan. Subsequent version with improved software and hardware were released in following years, with latest version, HS8-5000, providing 72TB raw storage per node, up to 11.88PB of raw capacity in its maximum configuration.[2]

Main features

HYDRAstor can be scaled from single node to 165 nodes in a multi-rack grid appliance.[3] Capacity and bandwidth can be scaled independently by using different types of nodes:

HYDRAstor supports online expansion, with automatic data migration and with no downtime.[4] In standard configuration, HYDRAstor provides resiliency to up to 3 concurrent disk or node failures.[5] Failures are automatically detected and data reconstruction is automatically performed, which means that if time between failures is enough to reconstruct data, system can withstand any number of them.[4]

Notes and References

  1. Cezary Dubnicki. Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004. 120–128. Cristian Ungureanu. Wojciech Kilian . FPN: a distributed hash table for commercial applications . 13th IEEE International Symposium on High performance Distributed Computing (HPDC '04) . 10.1109/HPDC.2004.1323509 . IEEE. 2004. 0-7695-2175-4.
  2. Web site: HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive . NEC America . 2017-01-11.
  3. Web site: HYDRAstor HS8-5000: Scale-out Global Dedupliaction Storage for Backup and Archive . NEC America . 2017-01-11.
  4. Cezary Dubnicki. Leszek Gryz. Łukasz Heldt. Michał Kaczmarczyk. Wojciech Kilian. Przemysław Strzelczak. Jerzy Szczepkowski. Cristian Ungureanu. Michał Wełnicki . HYDRAstor: a Scalable Secondary Storage . Proceedings 7th USENIX Conference on File and Storage Technologies . . February 24–27, 2009 . San Francisco, California . 2015-04-29.
  5. Web site: HYDRAstor - FAQ . NEC America . 2015-04-29.