Converged storage explained

Converged storage is a storage architecture that combines storage and computing resources into a single entity. This can result in the development of platforms for server centric, storage centric or hybrid workloads where applications and data come together to improve application performance and delivery.[1] The combination of storage and compute differs to the traditional IT model in which computation and storage take place in separate or siloed computer equipment.[2] The traditional model requires discrete provisioning changes, such as upgrades and planned migrations, in the face of server load changes, which are increasingly dynamic with virtualization, where converged storage increases the supply of resources along with new VM demands in parallel.[3]

Design considerations

The goal of converged storage is to bring together server and storage [4] and/or application and data to deliver services that are better optimized for target workloads.[5] This can mean server and storage converged within a common hardware platform. For example, a blade server enclosure, applications and storage can be brought together within a server by virtualization. Server and storage can be managed as a resource pool, for example in infrastructure- as-a-service (IaaS).

Common hardware platform

Industry standard servers, such as those using Intel processors (x86), form the basis of converged storage.[6] [7] As these servers follow Moore’s Law and increase power and performance they have the capabilities to run storage workloads, in addition to being compute servers. Data centers can further consolidate and minimize the use of physical space and energy by using industry-standard –based blade server for both server and storage.[8] [9]

Common software

In server virtualization, multiple "virtual" servers operate on a single platform using hypervisor technology. These virtual servers could be running traditional server tasks, such as applications programming. By using storage controller software, these servers could also be made into data storage systems.[10] This latter architecture is known as virtual machine-based storage. The storage software is often called a VSA−virtual SAN appliance[11] or virtual storage appliance. VSA products from companies such as HP, Nutanix and VMware allow users to build storage-area networks using their existing servers.[12] [13] [14] [15]

Infrastructure-as-a-Service (IaaS)

The goal of IaaS is to provide a pool of resources[16] that can be quickly deployed to deliver new services. This requires a service designer to lay out the required characteristics for a new service or application and an orchestration (computing) engine[17] to configure the underlying infrastructure to deliver the new service.

Characteristics

Scale-out architecture

Scale-out architecture is a component of converged storage. Scale-out storage is the combination of modular computers and standardized storage components to create federated storage pools.[18] The result is an increase of computer power, bandwidth and storage capacity that can exceed that of a single traditional storage array or high performance computer.[19] Storage vendors such as NetApp, Dell, Hewlett-Packard and EMC provide scale-out storage to address both the growth of unstructured data and the need to simplify data center operations.[20] At the file system level, parallel file systems like BeeGFS are available to provide a single namespace with automatic data distribution for shared network access across the internal storage devices of multiple servers.

Scale-out storage differs from scale-up architectures in traditional storage, which primarily scales by adding many individual disk drives to a single non-clustered storage controller.[21] In a scale-out architecture, management software is used to manage the multiple storage devices, to act like a single system.[22] Storage analyst company, Enterprise Strategy Group, writes that scale-out storage can help to provide timely IT provisioning, improve system availability and provide better resource utilization.[23]

Federation

Storage federation (also known as federated storage) uses distributed volume management to shift workloads from busy arrays to those with available capacity. This is done using native peer-to-peer communication.[24] Multiple autonomous storage systems are combined and managed as a single storage pool.[25] This helps to improve storage utilization, balance workloads and ease storage migration.

Multitenant architecture

Converged storage supports the multitenant (multitenancy) architecture of cloud computing, in which multiple machines or users access the virtual and physical resources at the same time. In addition to storage, the other resources accessed in this architecture are processors and networks.[26] A converged storage does this by moving application workloads between disk systems.[27]

Comparisons to traditional storage architectures

Monolithic storage architectures

Monolithic storage architectures share RAM across multiple IO controllers. They have been characterized as large storage arrays that require a large upfront investment and resources. Hitachi Vantara, is quoted as saying such storage requires enterprises to spend $500,000 on customizing their data centers to support the power requirements of monolithic equipment.[28] Monolithic arrays provide failover benefits. The shared cache architecture of monolithic arrays ensures that if one cache module fails, another cache is used to process the user's request. However once you have more than a single system this architecture is complex and requires investment to manage and control the interactions between the different components.[29] Monolithic architectures support both block and file-based architectures, either independently or in a unified storage system that brings together both block and file.[30]

Direct-attached storage

Direct-attached storage (DAS) provides scaling of storage directly attached to the server. The storage is dedicated to a single server and is not sharable among multiple servers. Data stored on a Storage area network (SAN) and network-attached storage (NAS) architectures can be shared among several server applications.[31]

Notes and References

  1. Jedras, Jeff. “Data centre model ‘broken,’ HP says,” June 7, 2011, IT World Canada (See the text about MD Anderson Cancer Center at the University of Texas for how converged storage improves application performance and delivery).http://www.itworldcanada.com/news/data-centre-model-broken-hp-says/143277?sub=333057
  2. Talbot, Chris, “HP Adds to Converged Infrastructure Lineup,” June 7, 2011, ChannelInsider http://www.channelinsider.com/c/a/Hewlett-Packard/HP-Adds-to-Converged-Infrastructure-Lineup-636059/
  3. Madden, Brian."Did Nutanix just create the ultimate server/storage big data combo hardware for VDI?" http://www.brianmadden.com/blogs/brianmadden/archive/2011/08/16/did-nutanix-just-create-the-ultimate-server-storage-big-data-combo-hardware-for-vdi.aspx
  4. TechTarget, "Unraveling the secrets of converged storage networks," page 6, February 2011 http://media.techtarget.com/searchNetworking/downloads/Network_Evolution_Feb_2011_final.pdf
  5. Baburajan, Rajani. "The Rising Cloud Storage Market Opportunity Strengthens Vendors," TMCnet, August 24, 2011 http://it.tmcnet.com/channels/cloud-storage/articles/211183-rising-cloud-storage-market-opportunity-strengthens-vendors.htm
  6. Floyer, David. "HP Converged Storage Sets the Stage for the Next Era of Computing", August 15, 2011, Wikibonhttp://wikibon.org/wiki/v/HP_Converged_Storage_Sets_the_Stage_for_the_Next_Era_of_Computing
  7. Wexler, Steve. "Nutanix: Time To Ban The SAN", August 16. 2011, Network Computing http://www.networkcomputing.com/virtualization/231500067
  8. Grayson, Ian. "Heat is on in search for perfect host as growth creates storage challenge," August 23, 2011, The Australian http://www.theaustralian.com.au/australian-it/cloud-computing/heat-is-on-in-search-for-perfect-host-as-growth-creates-storage-challenge/story-fn8lu7wm-1226116870431
  9. Burt, Jeffrey. "Cisco Surprise In x86 Blade Server Top Five, IDC Says," May 26, 2011, eWeek Europe http://www.eweekeurope.co.uk/news/cisco-surprise-in-x86-blade-server-top-five-idc-says-30232
  10. Asaro, Tony. "The impact of virtual storage appliances," SearchStorage.com http://searchstorage.techtarget.com/magazineContent/The-impact-of-virtual-storage-appliances
  11. http://searchstorage.techtarget.com/definition/virtual-SAN-appliance SearchStorage.com, "What is virtual SAN appliance (VSA)"
  12. Paul Ferril. "Two Virtual Storage Appliances – Worth a Look?," May 23, 2013, Enterprise Storage Forum http://www.enterprisestorageforum.com/storage-management/two-virtual-storage-appliances-worth-a-look.html
  13. Brian Beeler. "Why We Don't Have a Nutanix NX-8150 Review" August 2015, StorageReview http://www.storagereview.com/why_we_don_t_have_a_nutanix_nx8150_review
  14. Simon Sharwood. "Nutanix to release 'community version' of its secret software sauce" Feb 2015, The Register https://www.theregister.co.uk/2015/02/19/nutanix_to_release_community_version_of_its_secret_software_sauce/
  15. Eduardo Meirelles da Rocha. "vSphere Storage Appliance End of Availability" June 2014, Just Another IT blog http://www.justait.net/2014/06/vsphere-storage-appliance-end-of.html
  16. https://web.archive.org/web/20111028140712/http://www.zdnet.com/blog/virtualization/do-you-need-a-private-cloud/3648 Hess, Ken. "Do you need a private cloud?" ZDNet, August 21, 2011
  17. Bernier, Paula. "Telcos Continue to Buy Into the Cloud," TMCnet, May 1. 2011http://www.tmcnet.com/ngnmag/columns/articles/187269-telcos-continue-buy-into-cloud.htm
  18. http://www.enterprisestrategygroup.com/2010/06/scale-out-storage/ Mark Peters, Briefs: Scale-out Storage, Enterprise Strategy Group
  19. Gary Orenstein, "Doubling Down on Scale-out Storage", GigaOm, April 10, 2010 http://gigaom.com/2010/04/10/doubling-down-on-scale-out-storage/
  20. Mellor, Chris. "HP P10000 storage array more and less than expected," August 23, 2011, The Register https://www.theregister.co.uk/2011/08/23/hp_p10000_peer_motion/
  21. http://www.enterprisestrategygroup.com/2010/06/scale-out-storage/ Mark Peters, Briefs: Scale-out Storage, Enterprise Strategy Group
  22. Gary Orenstein, "Doubling Down on Scale-out Storage", GigaOm, April 10, 2010 http://gigaom.com/2010/04/10/doubling-down-on-scale-out-storage/
  23. http://www.enterprisestrategygroup.com/2010/06/scale-out-storage/ Mark Peters, Briefs: Scale-out Storage, Enterprise Strategy Group
  24. Mellor, Chris. "HP P10000 storage array more and less than expected," August 23, 2011, The Register https://www.theregister.co.uk/2011/08/23/hp_p10000_peer_motion/
  25. Vellante, David. "Virtualizing Globally Federated Cache Coherent Storage for the Cloud," March 12, 2010, Wikibonhttp://wikibon.org/blog/virtualizing-globally-federated-cache-coherent-storage-for-the-cloud/
  26. Linthicum, David. "Face the facts: Cloud performance isn't always stable," August 18, 2011, InfoWorld http://www.infoworld.com/d/cloud-computing/face-the-facts-cloud-performance-isnt-always-stable-170066
  27. Violino, Bob. "HP Unveils Storage Software For Cloud, Virtualized Environments," August 23, 2011, Information Managementhttp://www.information-management.com/news/HP-Unveils-Storage-Software-For-Cloud-Virtualized-Environments-10020993-1.html
  28. Tay, Liz. "Hitachi ditches monolithic storage," September 27, 2010, IT News http://www.itnews.com.au/News/233251,hitachi-ditches-monolithic-storage.aspx
  29. Evans, Chris. "Choosing Between Monolithic and Modular Architectures – Part I," August 24, 2011, Sys-Con Media http://chrisevans.sys-con.com/node/1509672
  30. SearchStorage.com

    Midrange storage arrays do not share RAM, but they typically have active/passive dual controller architectures with some mirrored NVRAM. The shared compute and cache elements are still potential bottlenecks if workloads change dynamically. They are subject to neighbor noise from competing server workloads. These systems do not require RAID rebuilds on controller failure, unlike converged systems. It is also more common to find advanced data services (RoW snapshots, deduplication, compression, zero-space clones) here than in converged systems because all data is managed in a single operating footprint.

    definition of unified storage (network unified storage or NUS) http://searchstorage.techtarget.com/definition/unified-storage

  31. Mellor, Chris. "Direct-attached storage vs SAN: Clustered DAS model gaining favor in virtualised, solid-state world?," SearchStorage.co.uk http://searchstorage.techtarget.co.uk/Direct-attached-storage-vs-SAN-Clustered-DAS-model-gaining-favor-in-virtualised-solid-state-world