RozoFS explained
RozoFS is a free software distributed file system. It comes as a free software, licensed under the GNU GPL v2. RozoFS uses erasure coding for redundancy.[1]
Design
Rozo provides an open source POSIX filesystem, built on top of distributed file system architecture similar to Google File System, Lustre or Ceph. The Rozo specificity lies in the way data is stored. The data to be stored is translated into several chunks using Mojette Transform[2] and distributed across storage devices in such a way that it can be retrieved even if several pieces are unavailable. On the other hand, chunks are meaningless alone.[3] Redundancy schemes based on coding techniques like the one used by RozoFS allow to achieve significant storage savings as compared to simple replication.[4] [5]
The file system comprises three components:
- Exports server — (Meta Data Server) manages the location (layout) of chunks (managing capacity load balancing with respect to high availability), file access and namespace (hierarchy). Multiple replicated metadata servers are used to provide failover. The Exports server is a user-space daemon; the metadata are stored synchronously to a usual file system (the underlying file system must support extended attributes).
- Storage servers — (Chunk Server) store the chunks. The Chunk server is also a user-space daemon that relies on the underlying local file system to manage the actual storage.
- Clients — talk to both the exports server and chunk servers and are responsible for data transformation. Clients mount the file system into user-space via FUSE.
See also
Press articles
External links
Notes and References
- Microsoft Research . ZHANG, Z. . DESHPANDE, A. . MA, X. . THERESKA, E. . NARAYANAN . amp. Does erasure coding have a role to play in my data center?. Tech. Rep. MSR-TR-2010-52 . May 2010 .
- Book: Jeanpierre, Guédon. The Mojette Transform theory and applications. 2009. ISTE-WILEY. 9781848210806.
- J. P. Guédon . B. Parrein . N. Normand . Secure Distributed Storage based on the Mojette transform. Integrated Computer-Aided Engineering V.8 N.3. August 2001. 205–214. 10.3233/ICA-2001-8303 .
- Weatherspoon, Hakim. Kubiatowicz, John. amp. Erasure Coding Vs. Replication: A Quantitative Comparison. Revised Papers from the First International Workshop on Peer-to-Peer Systems. 2002. IPTPS '01. 328–338. Springer-Verlag.
- Book: Rodrigues, Rodrigo . Liskov, Barbara . Peer-to-Peer Systems IV . High Availability in DHTS: Erasure Coding vs. Replication . amp . Proceedings of the 4th International Conference on Peer-to-Peer Systems. 3640 . 2005. IPTPS'05. 226–239. 10.1007/11558989_21. Springer-Verlag. 978-3-540-29068-1 . 10.1.1.59.6053 .