GNU Hurd explained

GNU Hurd
Developer:GNU Project
Thomas Bushnell
Roland McGrath
Marcus Brinkmann
Neal Walfield
Samuel Thibault
Programmed In:Assembly, C
Family:Unix-like
Working State:Current
Supported Platforms:x86-64, IA-32, i686, ARM[1]
License:GPL-2.0-or-later[2]

GNU Hurd is a collection of microkernel servers written as part of GNU, for the GNU Mach microkernel. It has been under development since 1990 by the GNU Project of the Free Software Foundation, designed as a replacement for the Unix kernel, and released as free software under the GNU General Public License. When the Linux kernel proved to be a viable solution, development of GNU Hurd slowed, at times alternating between stasis and renewed activity and interest.[3]

The Hurd's design consists of a set of protocols and server processes (or daemons, in Unix terminology) that run on the GNU Mach microkernel. The Hurd aims to surpass the Unix kernel in functionality, security, and stability, while remaining largely compatible with it. The GNU Project chose the multiserver microkernel[4] for the operating system, due to perceived advantages over the traditional Unix monolithic kernel architecture, a view that had been advocated by some developers in the 1980s.

Name and logo

In December 1991 the primary architect of the Hurd described the name as a mutually recursive acronym:[5]

As both hurd and hird are homophones of the English word herd, the full name GNU Hurd is also a play on the words herd of gnus, reflecting how the kernel works.

The logo is called the Hurd boxes and it also reflects on architecture. The logo is a graph where nodes represent the Hurd kernel's servers and directed edges are IPC messages.[5]

Development history

Richard Stallman founded the GNU Project in September 1983 with an aim to create a free GNU operating system. Initially the components required for kernel development were written: editors, shell, compiler, debugger etc. By 1989, the GPL came into being and the only major component missing was the kernel.[6]

Development on the Hurd began in 1990 after an abandoned kernel attempt in 1986, based on the research TRIX operating system developed by Professor Steve Ward and his group at MIT's Laboratory for Computer Science (LCS). According to Thomas Bushnell, the initial Hurd architect, their early plan was to adapt the 4.4BSD-Lite kernel and, in hindsight, "It is now perfectly obvious to me that this would have succeeded splendidly and the world would be a very different place today." In 1987 Richard Stallman proposed using the Mach microkernel developed by Richard Rashid at Carnegie Mellon University. Work on this was delayed for three years due to uncertainty over whether CMU would release the Mach code under a suitable license.

With the release of the Linux kernel in 1991, the primary user of GNU's userland components soon became operating systems based on the Linux kernel (Linux distributions), prompting the coining of the term GNU/Linux.

Development of the Hurd has proceeded slowly. Despite an optimistic announcement by Stallman in 2002 predicting a release of GNU/Hurd later that year, the Hurd is still not considered suitable for production environments. Development in general has not met expectations, and there are still a significant number of bugs and missing features. This has resulted in a poorer product than many, including Stallman, had expected. In 2010, after twenty years under development, Stallman said that he was "not very optimistic about the GNU Hurd. It makes some progress, but to be really superior it would require solving a lot of deep problems", but added that "finishing it is not crucial" for the GNU system because a free kernel already existed (Linux), and completing Hurd would not address the main remaining problem for a free operating system: device support.

The Debian project, among others, have worked on the Hurd project to produce binary distributions of Hurd-based GNU operating systems for IBM PC compatible systems.

After years of stagnation, development picked up again in 2015 and 2016, with four releases during these two years,[7] but no more since then.

On August 20, 2015, amid the Google Summer of Code, it was announced that GNU Guix had been ported to GNU Hurd.[8]

Architecture

Unlike most Unix-like kernels, the Hurd uses a server–client architecture, built on a microkernel that is responsible for providing the most basic kernel services – coordinating access to the hardware: the CPU (through process management and scheduling), RAM (via memory management), and other various input/output devices (via I/O scheduling) for sound, graphics, mass storage, etc. In theory, the microkernel design would allow for all device drivers to be built as servers working in user space, but today most drivers of this kind are still contained in the GNU Mach kernel space.

According to Hurd developers, the main advantage of microkernel-based design is the ability to extend the system: developing a new module would not require in depth knowledge of the rest of the kernel, and a bug in one module would not crash the entire system. Hurd provides a concept of translators, a framework of modules used to extend a file system functionality.[9]

From early on, the Hurd was developed to use GNU Mach as the microkernel. This was a technical decision made by Richard Stallman, who thought it would speed up the work by saving a large part of it. He has admitted that he was wrong about that. Other Unix-like systems working on the Mach microkernel include OSF/1, Lites, and MkLinux. macOS and NeXTSTEP use hybrid kernels based on Mach.

Other microkernels

From 2004 onward, various efforts were launched to port the Hurd to more modern microkernels. The L4 microkernel was the original choice in 2004, but progress slowed to a halt. Nevertheless, during 2005, Hurd developer Neal Walfield finished the initial memory management framework for the L4/Hurd port, and Marcus Brinkmann ported essential parts of glibc; namely, getting the process startup code working, allowing programs to run, thus allowing the first user programs (trivial ones such as the hello world program) in C to run.

Since 2005, Brinkmann and Walfield started researching Coyotos as a new kernel for HURD. In 2006, Brinkmann met with Jonathan Shapiro (a primary architect of the Coyotos Operating System) to aid in and discuss the use of the Coyotos kernel for GNU/Hurd. In further discussion HURD developers realised that Coyotos (as well as other similar kernels) are not suitable for HURD.[10]

In 2007, Hurd developers Neal Walfield and Marcus Brinkmann gave a critique of the Hurd architecture, known as "the critique", and a proposal for how a future system may be designed, known as "the position paper". In 2008, Neal Walfield began working on the Viengoos microkernel as a modern native kernel for HURD., development on Viengoos is paused due to Walfield lacking time to work on it.

In the meantime, others have continued working on the Mach variant of Hurd.

Unix extensions

A number of traditional Unix concepts are replaced or extended in the Hurd.

Under Unix, every running program has an associated user id, which normally corresponds to the user that started the process. This id largely dictates the actions permitted to the program. No outside process can change the user id of a running program. A Hurd process, on the other hand, runs under a set of user ids, which can contain multiple ids, one, or none. A sufficiently privileged process can add and remove ids to another process. For example, there is a password server that will hand out ids in return for a correct login password.

Regarding the file system, a suitable program can be designated as a translator for a single file or a whole directory hierarchy. Every access to the translated file, or files below a hierarchy in the second case, is in fact handled by the program. For example, a file translator may simply redirect read and write operations to another file, like a Unix symbolic link. The effect of Unix mounting is achieved by setting up a filesystem translator (using the "settrans" command). Translators can also be used to provide services to the user. For example, the ftpfs translator allows a user to encapsulate remote FTP sites within a directory. Then, standard tools such as ls, cp, and rm can be used to manipulate files on the remote system. Even more powerful translators are ones such as UnionFS, which allows a user to unify multiple directories into one; thus listing the unified directory reveals the contents of all the directories.

The Hurd requires a multiboot-compliant boot loader, such as GRUB.

Architecture of the servers

According to the Debian documentation, there are 24 servers (18 core servers and 6 file system servers) named as follows:

Core servers

Filesystem servers

ext2fs
  • The ext2 filesystem translator. It receives disk blocks from the microkernel and gives files and directories to the applications.
    isofs
  • The translator for the ISO 9660 filesystem. Translates blocks of a CD or DVD to files and directories for the applications.
    nfs
  • See Network File System.
    ftpfs
  • File transfer protocol filesystem translator.
    storeio
  • The storage translator.

    The servers collectively implement the POSIX API, with each server implementing a part of the interface. For instance, the various filesystem servers each implement the filesystem calls. The storage server will work as a wrapping layer, similar to the block layer of Linux. The equivalent of VFS of Linux is achieved by libdiskfs and libpager libraries.

    GNU distributions running Hurd

    Hurd-based GNU distributions include:

    See also

    Notes and References

    1. Web site: GNU Hurd ported to AArch64, and more Hurd news. osnews.com. 22 April 2024.
    2. Web site: COPYING - hurd/hurd.git - Hurd. Git.savannah.gnu.org. 25 February 2019.
    3. Web site: 30 Years On, HURD Lives: GNU Updates Open Source Unix Kernel. Tozzi. Christopher. 2015-04-20. https://web.archive.org/web/20150424014208/http://thevarguy.com/open-source-application-software-companies/042015/30-years-hurd-lives-gnu-updates-open-source-. 2015-04-24. en . The VAR Guy .
    4. Web site: What is a Multiserver Microkernel? . GNU . 2013-04-13 . 2015-08-11.
    5. Web site: Vervloesem . Koen . July 7, 2010 . The Hurd: GNU's quest for the perfect kernel . . October 5, 2012.
    6. Web site: Hillesley . Richard . GNU HURD: Altered visions and lost promise . June 30, 2010 . October 1, 2012.
    7. News: Free Software Foundation changes priorities - SD Times. 2017-01-17. SD Times. 2017-04-17. en-US.
    8. [GSoC update] Porting Guix to GNU/Hurd]. August 20, 2015. August 20, 2015. Manolis. Ragkousis. guix-devel.
    9. Book: Doeppner, Thomas W. . 20 December 2010 . Operating Systems In Depth: Design and Programming . John Wiley & Sons . 978-0-471-68723-8 . 160 . 29 November 2012 .
    10. Web site: Porting the Hurd to another microkernel . 2017-05-06 . Free Software Foundation . GNU Hurd .
    11. Web site: 1996-10-10 . GNU/Hurd - Documentation . Debian . 2012-07-12.
    12. Web site: GNU Hurd/ hurd/ running/ distrib . GNU . 2015-05-03 . 2017-09-21.
    13. Web site: GNU Hurd/ hurd/ running/ live cd . GNU . 2013-04-09 . 2017-09-21.