Data defined storage explained

Data defined storage (also referred to as a data centric approach) is a marketing term for managing, protecting, and realizing value from data by combining application, information and storage tiers.^[1]

This is achieved through a process in which users, applications, and devices gain access to a repository of captured metadata. This access enables them to access, query and manipulate the relevant data, transforming it into information, while also providing a flexible and scalable platform for storing the underlying data. The technology abstracts the data entirely from the storage, allowing fully transparent access for users.

Core technology

Data defined storage focuses on metadata with an emphasis on the content, meaning and value of information over the media, type and location of data. Data centric management enables organizations to take a single, unified approach to managing data across large, distributed locations which includes the use of content and metadata indexing. The technology pillars include:

1. Media Independent Data Storage: Data defined storage removes media centric data storage boundaries within and across solid-state drive, hard disk drive, cloud storage and tape storage platforms, enables linear scale out functionality through a grid based Map Reduce architecture that leverages enterprise object storage technology and provides transparent data access across globally distributed repositories for high volume storage performance.
2. Data Security & Identity Management: Data defined storage allows organizations to gain end-to-end identity management down to the individual user and device level to address growing enterprise mobility requirements and enhanced data security and information governance.
3. Distributed metadata repository: Data defined storage enables organizations to virtualize aggregate file systems into a single global namespace. At ingestion; file, full text index and custom metadata is collected and stored in a distributed metadata repository. This repository is leveraged to enable speed and accuracy of search and discovery, and to extract value leading to informed business decisions and analytics.

Data defined storage builds on the benefits of both object storage and software-defined storage technologies, however, object and software-defined storage can only be mapped to media independent data storage, which enables a media agnostic infrastructure - utilizing any type of storage, including low cost commodity storage to scale out to petabyte-level capacities. Data defined storage unifies all data repositories and exposes globally distributed stores through the global namespace, eliminating data silos and improving storage utilization.

Usage

The first marketing using this term was by Tarmin, in its GridBank product. The data defined storage term might have been mentioned in 2013.^[2] Tamrin issued press releases about customers.^{[3] [4]}

The data defined storage term was used for object storage with open protocol access for file system virtualization, such as CIFS, NFS, FTP as well as REST APIs and other cloud protocols such as Amazon S3, CDMI and OpenStack.

External links

• New Storage Platforms: What's the Difference?
• Top Tips for Object Storage
• Object Storage Buying Guide
• A Data-Centric Approach to Managing Data in the Cloud
• Stop Buying Storage. Start Managing Information

Notes and References

1. Web site: Peters . Mark . Unlocking the Power of Data with Data-Defined Storage . ESG . 30 June 2013 . dead . https://web.archive.org/web/20141129113204/http://www.esg-global.com/default/cache/File/2D9FD2A8-B6D3-4D17-A23527EF427F6C96.pdf . 2014-11-29 .
2. Web site: Goyal. Ambuj. Edge2013 General Session Keynote Speech. IBM Edge. 2016-11-27. 2016-04-13. https://web.archive.org/web/20160413094508/https://www.youtube.com/watch?v=JfHTDnspaaQ&feature=c4-overview-vl&list=PLUbRx39vvOvj0meMsZiU6DWYEDmi0iali. live.
3. News: Miller. Dan. Tarmin and IBM help Premier Oil manage rapidly growing unstructured data. PR Newswire. 12 July 2013. 1 August 2013. 31 July 2013. https://web.archive.org/web/20130731025614/http://www.prnewswire.com/news-releases/tarmin-and-ibm-help-premier-oil-manage-rapidly-growing-unstructured-data-reduce-storage-cost-simplify-compliance-and-increase-business-agility-215185111.html. live.
4. News: Miller. Dan. Leading U.K. MSP brightsolid sees a shining future with Tarmin. PR Newswire. 17 December 2012. 1 August 2013. 29 November 2014. https://web.archive.org/web/20141129023902/http://www.prnewswire.com/news-releases/leading-uk-msp-brightsolid-sees-a-shining-future-with-tarmin-183736071.html. live.