Disk image explained

A disk image is a snapshot of a storage device's structure and data typically stored in one or more computer files on another storage device.[1]

Traditionally, disk images were bit-by-bit copies of every sector on a hard disk often created for digital forensic purposes, but it is now common to only copy allocated data to reduce storage space.[2] Compression and deduplication are commonly used to reduce the size of the image file set.[3]

Disk imaging is done for a variety of purposes including digital forensics,[4] [5] cloud computing,[6] system administration,[7] as part of a backup strategy, and legacy emulation as part of a digital preservation strategy.[8] Disk images can be made in a variety of formats depending on the purpose. Virtual disk images (such as VHD and VMDK) are intended to be used for cloud computing,[9] [10] ISO images are intended to emulate optical media[11] and raw disk images are used for forensic purposes. Proprietary formats are typically used by disk imaging software.

Despite the benefits of disk imaging the storage costs can be high, management can be difficult and they can be time consuming to create.[12]

Background

Disk images were originally (in the late 1960s) used for backup and disk cloning of mainframe disk media. Early ones were as small as 5 megabytes and as large as 330 megabytes, and the copy medium was magnetic tape, which ran as large as 200 megabytes per reel.[13] Disk images became much more popular when floppy disk media became popular, where replication or storage of an exact structure was necessary and efficient, especially in the case of copy protected floppy disks.

Disk image creation is called disk imaging and is often time consuming, even with a fast computer, because the entire disk must be copied. Typically, disk imaging requires a third party disk imaging program or backup software. The software required varies according to the type of disk image that needs to be created. For example, RawWrite and WinImage create floppy disk image files for MS-DOS and Microsoft Windows.[14] [15] In Unix or similar systems the dd program can be used to create raw disk images. Apple Disk Copy can be used on Classic Mac OS and macOS systems to create and write disk image files.

Authoring software for CDs/DVDs such as Nero Burning ROM can generate and load disk images for optical media. A virtual disk writer or virtual burner is a computer program that emulates an actual disc authoring device such as a CD writer or DVD writer. Instead of writing data to an actual disc, it creates a virtual disk image.[16] [17] A virtual burner, by definition, appears as a disc drive in the system with writing capabilities (as opposed to conventional disc authoring programs that can create virtual disk images), thus allowing software that can burn discs to create virtual discs.[18]

Uses

Digital forensics

Forensic imaging is the process of creating a bit-by-bit copy of the data on the drive, including files, metadata, volume information, filesystems and their structure. Often, these images are also hashed to verify their integrity and that they have not been altered since being created. Unlike disk imaging for other purposes, digital forensic applications take a bit-by-bit copy to ensure forensic soundness. The purposes of imaging the disk is to not only discover evidence preserved in digital information but also to examine the drive to gather clues of how the crime was committed.

Virtualization

Creating a virtual disk image of optical media or a hard disk drive is typically done to make the content available to one or more virtual machines. Virtual machines emulate a CD/DVD drive by reading an ISO image. This can also be faster than reading from the physical optical medium.[19] Further, there are less issues with wear and tear. A hard disk drive or solid-state drive in a virtual machine is implemented as a disk image (i.e. either the VHD format used by Microsoft's Hyper-V, the VDI format used by Oracle Corporation's VirtualBox, the VMDK format used for VMware virtual machines, or the QCOW format used by QEMU). Virtual hard disk images tend to be stored as either a collection of files (where each one is typically 2GB in size), or as a single file. Virtual machines treat the image set as a physical drive.

Rapid deployment of systems

Educational institutions and businesses can often need to buy or replace computer systems in large numbers. Disk imaging is commonly used to rapidly deploy the same configuration across workstations. Disk imaging software is used to create an image of a completely-configured system (such an image is sometimes called a golden image).[20] [21] This image is then written to a computer's hard disk (which is sometimes described as restoring an image).[22]

Network-based image deployment

Image restoration can be done using network-based image deployment. This method uses a PXE server to boot an operating system over a computer network that contains the necessary components to image or restore storage media in a computer.[23] This is usually used in conjunction with a DHCP server to automate the configuration of network parameters including IP addresses. Multicasting, broadcasting or unicasting tend to be used to restore an image to many computers simultaneously. These approaches do not work well if one or more computers experience packet loss. As a result, some imaging solutions use the BitTorrent protocol to overcome this problem.

Network-based image deployment reduces the need to maintain and update individual systems manually. Imaging is also easier than automated setup methods because an administrator does not need to have knowledge of the prior configuration to copy it.

Backup strategy

A disk image contains all files and data (i.e., file attributes and the file fragmentation state). For this reason, it is also used for backing up optical media (CDs and DVDs, etc.), and allows the exact and efficient recovery after experimenting with modifications to a system or virtual machine. Typically, disk imaging can be used to quickly restore an entire system to an operational state after a disaster.[24]

Digital preservation

Libraries and museums are typically required to archive and digitally preserve information without altering it in any manner.[25] Emulators frequently use disk images to emulate floppy disks that have been preserved. This is usually simpler to program than accessing a real floppy drive (particularly if the disks are in a format not supported by the host operating system), and allows a large library of software to be managed. Emulation also allows existing disk images to be put into a usable form even though the data contained in the image is no longer readable without emulation.

Limitations

Disk imaging is time consuming, the space requirements are high and reading from them can be slower than reading from the disk directly because of a performance overhead.

Other limitations can be the lack of access to software required to read the contents of the image. For example, prior to Windows 8, third party software was required to mount disk images.[26] [27] When imaging multiple computers with only minor differences, much data is duplicated unnecessarily, wasting space.

Speed and failure

Disk imaging can be slow, especially for older storage devices. A typical 4.7 GB DVD can take an average of 18 minutes to duplicate. Floppy disks read and write much slower than hard disks. Therefore, despite their small size, it can take several minutes to copy a single disk. In some cases, disk imaging can fail due to bad sectors or physical wear and tear on the source device. Unix utilities (such as dd) are not designed to recognize or cope with failures causing the disk image creation process to fail. When data recovery is the end goal, it is instead recommended to use more specialised tools (such as ddrescue).

See also

External links

Notes and References

  1. Book: 2022-11-02 . Disk Imaging as a Backup Tool for Digital Objects . https://www.taylorfrancis.com/chapters/edit/10.4324/9781003034865-17/disk-imaging-backup-tool-digital-objects-eddy-colloton-jonathan-farbowitz-caroline-gil-rodr%C3%ADguez . Conservation of Time-Based Media Art . en . 204–222 . 10.4324/9781003034865-17. Colloton . Eddy . Farbowitz . Jonathan . Rodríguez . Caroline Gil . 9781003034865 .
  2. High-performance Disk Imaging With Deduplicated Storage . Pullakandam . R. . Lin . X. . Hibler . M. . Eide . E. . Ricci . R. . 23rd ACM Symposium on Operating Systems Principles . October 23–26, 2011 . Cascais, Portugal.
  3. Lee . Sang Su . Kyong . Un Sung . Hong . Do Won . 2008 . A high speed disk imaging system . 2008 IEEE International Symposium on Consumer Electronics . 1–3 . 10.1109/ISCE.2008.4559553. 5932241 .
  4. Garfinkel . Simson L. . 2009 . Automating Disk Forensic Processing with SleuthKit, XML and Python . 2009 Fourth International IEEE Workshop on Systematic Approaches to Digital Forensic Engineering . 73–84 . 10.1109/SADFE.2009.12. 978-0-7695-3792-4 . 1624033 .
  5. Woods . Kam . Lee . Christopher A. . Garfinkel . Simson . 2011-06-13 . Extending digital repository architectures to support disk image preservation and access . Proceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries . New York, NY, USA . Association for Computing Machinery . 57–66 . 10.1145/1998076.1998088 . 978-1-4503-0744-4. 2628912 . 10945/44252 . free .
  6. Kazim . Muhammad . Masood . Rahat . Shibli . Muhammad Awais . 2013-11-26 . Securing the virtual machine images in cloud computing . Proceedings of the 6th International Conference on Security of Information and Networks . New York, NY, USA . Association for Computing Machinery . 425–428 . 10.1145/2523514.2523576 . 978-1-4503-2498-4. 2474546 .
  7. Blackham . N. . Higby . C. . Bailey . M. . June 2004 . Re-Imaging Computers For Multipurpose Labs . 2004 American Society for Engineering Education Annual Conference . Salt Lake City, Utah . 10.18260/1-2--14125. free .
  8. Day . Michael . Pennock . Maureen . May . Peter . Davies . Kevin . Whibley . Simon . Kimura . Akiko . Halvarsson . Edith . 2016 . The preservation of disk-based content at the British Library: Lessons from the Flashback project . Alexandria: The Journal of National and International Library and Information Issues . en . 26 . 3 . 216–234 . 10.1177/0955749016669775 . 63617004 . 0955-7490.
  9. Arunkumar . G. . Venkataraman. . Neelanarayanan . 2015-01-01 . A Novel Approach to Address Interoperability Concern in Cloud Computing . Procedia Computer Science . Big Data, Cloud and Computing Challenges . en . 50 . 554–559 . 10.1016/j.procs.2015.04.083 . 1877-0509. free .
  10. Barrowclough . John Patrick . Asif . Rameez . 2018-06-11 . Securing Cloud Hypervisors: A Survey of the Threats, Vulnerabilities, and Countermeasures . Security and Communication Networks . en . 2018 . e1681908 . 10.1155/2018/1681908 . 1939-0114. free .
  11. Colloton . E. . Farbowitz . J. . Fortunato . F. . Gil . C. . 2019 . Towards Best Practices In Disk Imaging: A Cross-Institutional Approach . Electronic Media Review . 6.
  12. Book: Stewart . Dawid . Need for speed : A study of the speed of forensic disk imaging tools . Arvidsson . Alex . 2022.
  13. Web site: IBM Mainframe Operating Systems. 2014-06-17. dead. https://web.archive.org/web/20140701185435/http://www.demorton.com/Tech/$OSTL.pdf. 2014-07-01.
  14. Book: McCune, Mike . Integrating Linux and Windows . 2000 . Prentice Hall Professional . 978-0-13-030670-8 . en.
  15. Li . Hongwei . Yin . Changhong . Xu . Yaping . Guo . Qingjun . 2010 . Construction of the Practical Teaching System on Operating Systems Course . 2010 Second International Workshop on Education Technology and Computer Science . 1 . 405–408 . 10.1109/ETCS.2010.184. 978-1-4244-6388-6 . 15706012 .
  16. Web site: Phantom Burner Overview . dead . https://web.archive.org/web/20110819141722/http://phantombility.com/en/prod/phantomburner . 19 August 2011 . 19 July 2011 . Phantombility, Inc.
  17. Web site: Virtual CD - The original for your PC . live . https://web.archive.org/web/20110924022331/http://www.virtualcd.de/vcd/apps/overview/original.cfm?lg=0 . 24 September 2011 . 19 July 2011 . Virtual CD website . H+H Software GmbH.
  18. Web site: Virtual CD/DVD-Writer Device . live . https://web.archive.org/web/20110217075400/http://sourceforge.net/projects/virtualmedia/ . 17 February 2011 . 19 July 2011 . . Geeknet, Inc..
  19. Web site: pcguide.com - Access Time . https://web.archive.org/web/20190110014217/http://www.pcguide.com/ref/cd/perfAccess-c.html . 10 January 2019 . dead.
  20. Bowling . Jeramiah . 2011-01-01 . Clonezilla: build, clone, repeat . Linux Journal . 2011 . 201 . 6:6 . 1075-3583.
  21. Web site: Create a golden image in Azure . learn.microsoft.com.
  22. Shiau . Steven J. H. . Huang . Yu-Chiang . Tsai . Yu-Chin . Sun . Chen-Kai . Yen . Ching-Hsuan . Huang . Chi-Yo . 2021 . A BitTorrent Mechanism-Based Solution for Massive System Deployment . IEEE Access . 9 . 21043–21058 . 10.1109/ACCESS.2021.3052525 . 2021IEEEA...921043S . 231851821 . 2169-3536. free .
  23. Shiau . Steven J. H. . Sun . Chen-Kai . Tsai . Yu-Chin . Juang . Jer-Nan . Huang . Chi-Yo . 2018 . The Design and Implementation of a Novel Open Source Massive Deployment System . Applied Sciences . en . 8 . 6 . 965 . 10.3390/app8060965 . 2076-3417 . free.
  24. Web site: Fast, Scalable Disk Imaging with Frisbee . 2023-01-12 . www.cs.utah.edu.
  25. Durno . John . Trofimchuk . Jerry . 2015-01-21 . Digital forensics on a shoestring: a case study from the University of Victoria . The Code4Lib Journal . 27 . 1940-5758.
  26. Web site: 30 August 2011 . Accessing data in ISO and VHD files . dead . https://web.archive.org/web/20120419080359/http://blogs.msdn.com/b/b8/archive/2011/08/30/accessing-data-in-iso-and-vhd-files.aspx . 19 April 2012 . 27 April 2012 . Building Windows 8 (TechNet Blogs) . Microsoft.
  27. Web site: Mount-DiskImage . Microsoft.