Zswap Explained

zswap
zswap
Developer:Seth Jennings and others
Released: (Linux 3.11)
Programming Language:C
Operating System:Linux
Genre:Linux kernel features
License:GNU GPL

zswap is a Linux kernel feature that provides a compressed write-back cache for swapped pages, as a form of virtual memory compression. Instead of moving memory pages to a swap device when they are to be swapped out, zswap performs their compression and then stores them into a memory pool dynamically allocated in the system RAM. Later writeback to the actual swap device is deferred or even completely avoided, resulting in a significantly reduced I/O for Linux systems that require swapping; the tradeoff is the need for additional CPU cycles to perform the compression.[1] [2] [3]

As a result of reduced I/O, zswap offers advantages to various devices that use flash-based storage, including embedded devices, netbooks and similar low-end hardware devices, as well as to other devices that use solid-state drives (SSDs) for storage. Flash memory has a limited lifespan due to its nature, so avoiding it to be used for providing swap space prevents it from wearing out quickly.[4]

Internals

zswap is integrated into the rest of Linux kernel's virtual memory subsystem using the API provided by frontswap, which is a mechanism of the Linux kernel that abstracts various types of storage that can be used as swap space.[5] As a result, zswap operates as a backend driver for frontswap by providing what is internally visible as a pseudo-RAM device. In other words, the frontswap API makes zswap capable of intercepting memory pages while they are being swapped out, and capable of intercepting page faults for the already swapped pages; the access to those two paths allows zswap to act as a compressed write-back cache for swapped pages.[6]

Internally, zswap uses compression modules provided by the Linux kernel's crypto API, which makes it possible, for example, to offload the compression tasks from the main CPU using any of the hardware compression accelerators supported by the Linux kernel. The selection of the desired compression module can be performed dynamically at the boot time through the value of kernel boot parameter ; if not specified, it selects the Lempel–Ziv–Oberhumer (LZO) compression. As of version 3.13 of the Linux kernel, zswap also needs to be explicitly enabled by specifying value for the kernel boot parameter .

The maximum size of the memory pool used by zswap is configurable through the parameter, which specifies the maximum percentage of total system RAM that can be occupied by the pool. The memory pool is not preallocated to its configured maximum size, and instead grows and shrinks as required. When the configured maximum pool size is reached as the result of performed swapping, or when growing the pool is impossible due to an out-of-memory condition, swapped pages are evicted from the memory pool to a swap device on the least recently used (LRU) basis. This approach makes zswap a true swap cache, as the oldest cached pages are evicted to a swap device once the cache is full, making room for newer swapped pages to be compressed and cached.[7]

zbud is a special-purpose memory allocator used internally by zswap for storing compressed pages, implemented as a rewrite of the zbud allocator used by the Oracle's zcache,[8] which is another virtual memory compression implementation for the Linux kernel. Internally, zbud works by storing up to two compressed pages ("buddies", hence the allocator name) per physical memory page, which brings both advantages due to easy coalescing and reusing of freed space, and disadvantages due to possible lower memory utilization. However, as a result of its design, zbud cannot allocate more memory space than it would be originally occupied by the uncompressed pages.[9]

History

Both zswap and zbud were created by Seth Jennings. The first public announcement was in December 2012, and the development continued until May 2013 at which point the codebase reached its maturity although still having the status of an experimental kernel feature.[10]

zswap (together with zbud) was merged into the Linux kernel mainline in kernel version 3.11, which was released on September 2, 2013.[12]

Since version 3.15 of the Linux kernel, which was released on June 8, 2014, zswap properly supports multiple swap devices.[13] [14]

Since version 6.8 of the Linux kernel, which was released on March 11, 2024, zswap supports disabling writeback for specific cgroups.[15]

Alternatives

One of the alternatives to zswap is zram, which provides a similar but still different "swap compressed pages to RAM" mechanism to the Linux kernel.

The main difference is that zram provides a compressed block device using RAM for storing data, which acts as a regular and separate swap device.

In comparison, zswap acts as a RAM-based cache for swap devices. This provides zswap with an eviction mechanism for less used swapped pages, which zram lacked until the introduction of in kernel version 4.14. Though, as a result of its design, at least one already existing swap device is required for zswap to be used.[16]

See also

Notes and References

  1. Web site: The zswap compressed swap cache . February 12, 2013 . January 22, 2014 . Seth Jennings . LWN.net.
  2. Web site: New Linux zswap compression functionality . December 11, 2012 . January 31, 2014 . Jenifer Hopper . IBM.
  3. Web site: Zswap Merged Into The Linux 3.11 Kernel . July 11, 2013 . February 5, 2014 . Michael Larabel . Phoronix.
  4. Web site: Linux kernel documentation: Documentation/vm/zswap.txt . November 22, 2013 . January 22, 2014 . kernel.org.
  5. Web site: Frontswap [PATCH 0/4] (was Transcendent Memory): Overview . April 22, 2010 . December 23, 2014 . Dan Magenheimer . gmane.org.
  6. Web site: Cleancache and Frontswap . May 4, 2010 . March 26, 2014 . Jonathan Corbet . LWN.net.
  7. Web site: Linux kernel source tree: kernel/git/torvalds/linux.git: zswap: add to mm/ . July 11, 2013 . February 5, 2014 . kernel.org.
  8. Web site: Zcache and RAMster (oh, and frontswap too): Overview and some benchmarking . March 29, 2012 . August 19, 2015 . Dan Magenheimer . oss.oracle.com . PDF . 12.
  9. Web site: Linux kernel source tree: kernel/git/torvalds/linux.git: zbud: add to mm/ . July 11, 2013 . February 5, 2014 . kernel.org.
  10. Web site: [PATCHv10 0/4] zswap: compressed swap caching ]. May 8, 2013 . January 5, 2014 . gmane.org].
  11. Web site: [PATCH 0/8] zswap: compressed swap caching | date = December 11, 2012 | access-date = January 5, 2014 | website = gmane.org}}[10] .
  12. Web site: September 2, 2013 . Linux kernel 3.11, Section 9. Zswap: A compressed swap cache . January 22, 2014 . kernelnewbies.org.
  13. Web site: June 8, 2014 . Linux kernel 3.15, Section 4. Memory management . June 15, 2014 . kernelnewbies.org.
  14. Web site: Linux kernel source tree: kernel/git/torvalds/linux.git: mm/zswap: support multiple swap devices . April 7, 2014 . June 15, 2014 . kernel.org.
  15. Web site: zswap: memcontrol: implement zswap writeback disabling · torvalds/linux@501a06f. GitHub.
  16. Web site: In-kernel memory compression . April 3, 2013 . March 8, 2014 . Dan Magenheimer . LWN.net.