Protected mode explained

In computing, protected mode, also called protected virtual address mode,[1] is an operational mode of x86-compatible central processing units (CPUs). It allows system software to use features such as segmentation, virtual memory, paging and safe multi-tasking designed to increase an operating system's control over application software.[2] [3]

When a processor that supports x86 protected mode is powered on, it begins executing instructions in real mode, in order to maintain backward compatibility with earlier x86 processors.[4] Protected mode may only be entered after the system software sets up one descriptor table and enables the Protection Enable (PE) bit in the control register 0 (CR0).[5]

Protected mode was first added to the x86 architecture in 1982,[6] with the release of Intel's 80286 (286) processor, and later extended with the release of the 80386 (386) in 1985.[7] Due to the enhancements added by protected mode, it has become widely adopted and has become the foundation for all subsequent enhancements to the x86 (IA-32) architecture,[8] although many of those enhancements, such as added instructions and new registers, also brought benefits to the real mode.

History

The Intel 8086, the predecessor to the 286, was originally designed with a 20-bit address bus for its memory.[9] This allowed the processor to access 220 bytes of memory, equivalent to 1 megabyte. At the time, 1 megabyte was considered a relatively large amount of memory,[10] so the designers of the IBM Personal Computer reserved the first 640 kilobytes for use by applications and the operating system and the remaining 384 kilobytes for the BIOS (Basic Input/Output System) and memory for add-on devices.[11]

As the cost of memory decreased and memory use increased, the 1 MB limitation became a significant problem. Intel intended to solve this limitation along with others with the release of the 286.

The 286

The initial protected mode, released with the 286, was not widely used;[11] for example, it was used by Coherent (from 1982),[12] Microsoft Xenix (around 1984)[13] and Minix.[14] Several shortcomings such as the inability to access the BIOS or DOS calls due to inability to switch back to real mode without resetting the processor prevented widespread usage.[15] Acceptance was additionally hampered by the fact that the 286 only allowed memory access in 16-bit segments via each of four segment registers, meaning that only equivalent to 256 kilobytes, could be accessed at a time.[11] Because changing a segment register in protected mode caused a 6-byte segment descriptor to be loaded into the CPU from memory, the segment register load instruction took many tens of processor cycles, making it much slower than on the 8086; therefore, the strategy of computing segment addresses on-the-fly in order to access data structures larger than 128 kilobytes (the combined size of the two data segments) became impractical, even for those few programmers who had mastered it on the 8086/8088.

The 286 maintained backward compatibility with its precursor the 8086 by initially entering real mode on power up. Real mode functioned virtually identically to the 8086, allowing the vast majority of existing 8086 software to run unmodified on the newer 286. Real mode also served as a more basic mode in which protected mode could be set up, solving a sort of chicken-and-egg problem. To access the extended functionality of the 286, the operating system would set up some tables in memory that controlled memory access in protected mode, set the addresses of those tables into some special registers of the processor, and then set the processor into protected mode. This enabled 24-bit addressing, which allowed the processor to access 224 bytes of memory, equivalent to 16 megabytes.[9]

The 386

With the release of the 386 in 1985, many of the issues preventing widespread adoption of the previous protected mode were addressed. The 386 was released with an address bus size of 32 bits, which allows for 232 bytes of memory accessing, equivalent to 4 gigabytes.[16] The segment sizes were also increased to 32 bits, meaning that the full address space of 4 gigabytes could be accessed without the need to switch between multiple segments. In addition to the increased size of the address bus and segment registers, many other new features were added with the intention of increasing operational security and stability.[17] Protected mode is now used in virtually all modern operating systems which run on the x86 architecture, such as Microsoft Windows, Linux, and many others.[18]

Furthermore, learning from the failures of the 286 protected mode to satisfy the needs for multiuser DOS, Intel added a separate virtual 8086 mode,[19] which allowed multiple virtualized 8086 processors to be emulated on the 386. Hardware x86 virtualization required for virtualizing the protected mode itself, however, had to wait for another 20 years.[20]

386 additions to protected mode

With the release of the 386, the following additional features were added to protected mode:

Entering and exiting protected mode

Until the release of the 386, protected mode did not offer a direct method to switch back into real mode once protected mode was entered. IBM devised a workaround (implemented in the IBM AT) which involved resetting the CPU via the keyboard controller and saving the system registers, stack pointer and often the interrupt mask in the real-time clock chip's RAM. This allowed the BIOS to restore the CPU to a similar state and begin executing code before the reset. Later, a triple fault was used to reset the 286 CPU, which was a lot faster and cleaner than the keyboard controller method (and does not depend on IBM AT-compatible hardware, but will work on any 80286 CPU in any system).

To enter protected mode, the Global Descriptor Table (GDT) must first be created with a minimum of three entries: a null descriptor, a code segment descriptor and data segment descriptor. In an IBM-compatible machine, the A20 line (21st address line) also must be enabled to allow the use of all the address lines so that the CPU can access beyond 1 megabyte of memory (Only the first 20 are allowed to be used after power-up, to guarantee compatibility with older software written for the Intel 8088-based IBM PC and PC/XT models).[22] After performing those two steps, the PE bit must be set in the CR0 register and a far jump must be made to clear the prefetch input queue.[23] [24]

MASM program
  • enter protected mode (set PE bit)mov EBX, CR0 ; save control register 0 (CR0) to EBXor EBX, PE_BIT ; set PE bit by ORing, save to EBXmov CR0, EBX ; save EBX back to CR0
  • clear prefetch queue; (using far jump instruction jmp)jmp CLEAR_LABELCLEAR_LABEL:

    With the release of the 386, protected mode could be exited by loading the segment registers with real mode values, disabling the A20 line and clearing the PE bit in the CR0 register, without the need to perform the initial setup steps required with the 286.[25]

    Features

    Protected mode has a number of features designed to enhance an operating system's control over application software, in order to increase security and system stability. These additions allow the operating system to function in a way that would be significantly more difficult or even impossible without proper hardware support.[26]

    Privilege levels

    In protected mode, there are four privilege levels or rings, numbered from 0 to 3, with ring 0 being the most privileged and 3 being the least. The use of rings allows for system software to restrict tasks from accessing data, call gates or executing privileged instructions.[27] In most environments, the operating system and some device drivers run in ring 0 and applications run in ring 3.[27]

    Real mode application compatibility

    According to the Intel 80286 Programmer's Reference Manual,[28]

    For the most part, the binary compatibility with real-mode code, the ability to access up to 16 MB of physical memory, and 1 GB of virtual memory, were the most apparent changes to application programmers.[29] This was not without its limitations. If an application utilized or relied on any of the techniques below, it would not run:[30]

    In reality, almost all DOS application programs violated these rules.[32] Due to these limitations, virtual 8086 mode was introduced with the 386. Despite such potential setbacks, Windows 3.0 and its successors can take advantage of the binary compatibility with real mode to run many Windows 2.x (Windows 2.0 and Windows 2.1x) applications in protected mode, which ran in real mode in Windows 2.x.[33]

    Virtual 8086 mode

    See main article: Virtual 8086 mode.

    With the release of the 386, protected mode offers what the Intel manuals call virtual 8086 mode. Virtual 8086 mode is designed to allow code previously written for the 8086 to run unmodified and concurrently with other tasks, without compromising security or system stability.[34]

    Virtual 8086 mode, however, is not completely backward compatible with all programs. Programs that require segment manipulation, privileged instructions, direct hardware access, or use self-modifying code will generate an exception that must be served by the operating system.[35] In addition, applications running in virtual 8086 mode generate a trap with the use of instructions that involve input/output (I/O), which can negatively impact performance.[36]

    Due to these limitations, some programs originally designed to run on the 8086 cannot be run in virtual 8086 mode. As a result, system software is forced to either compromise system security or backward compatibility when dealing with legacy software. An example of such a compromise can be seen with the release of Windows NT, which dropped backward compatibility for "ill-behaved" DOS applications.[37]

    Segment addressing

    Real mode

    In real mode each logical address points directly into a physical memory location, every logical address consists of two 16-bit parts: The segment part of the logical address contains the base address of a segment with a granularity of 16 bytes, i.e. a segment may start at physical address 0, 16, 32, ..., 220 − 16. The offset part of the logical address contains an offset inside the segment, i.e. the physical address can be calculated as physical_address = segment_part × 16 + offset, if the address line A20 is enabled, or (segment_part × 16 + offset) mod 220, if A20 is off. Every segment has a size of 216 bytes.

    Protected mode

    In protected mode, the is replaced by a 16-bit selector, in which the 13 upper bits (bit 3 to bit 15) contain the index of an entry inside a descriptor table. The next bit (bit 2) specifies whether the operation is used with the GDT or the LDT. The lowest two bits (bit 1 and bit 0) of the selector are combined to define the privilege of the request, where the values of 0 and 3 represent the highest and the lowest privilege, respectively. This means that the byte offset of descriptors in the descriptor table is the same as the 16-bit selector, provided the lower three bits are zeroed.

    The descriptor table entry defines the real linear address of the segment, a limit value for the segment size, and some attribute bits (flags).

    286

    The segment address inside the descriptor table entry has a length of 24 bits so every byte of the physical memory can be defined as bound of the segment. The limit value inside the descriptor table entry has a length of 16 bits so segment length can be between 1 byte and 216 byte. The calculated linear address equals the physical memory address.

    386

    The segment address inside the descriptor table entry is expanded to 32 bits so every byte of the physical memory can be defined as bound of the segment. The limit value inside the descriptor table entry is expanded to 20 bits and completed with a granularity flag (G-bit, for short):

    The 386 processor also uses 32 bit values for the address offset.

    For maintaining compatibility with 286 protected mode a new default flag (D-bit, for short) was added. If the D-bit of a code segment is off (0) all commands inside this segment will be interpreted as 16-bit commands by default; if it is on (1), they will be interpreted as 32-bit commands.

    Structure of segment descriptor entry

    80286 Segment descriptor
    3130292827262524232221201918171615141312111009080706050403020100
    Base[0..15]Limit[0..15]
    6362616059585756555453525150494847464544434241403938373635343332
    UnusedPDPLSXCRABase[16..23]
    80386 Segment descriptor
    3130292827262524232221201918171615141312111009080706050403020100
    Base[0..15]Limit[0..15]
    6362616059585756555453525150494847464544434241403938373635343332
    Base[24..31]GD0ULimit[16..19]PDPLSXCRABase[16..23]

    Where:

    Paging

    In addition to adding virtual 8086 mode, the 386 also added paging to protected mode.[39] Through paging, system software can restrict and control a task's access to pages, which are sections of memory. In many operating systems, paging is used to create an independent virtual address space for each task, preventing one task from manipulating the memory of another. Paging also allows for pages to be moved out of primary storage and onto a slower and larger secondary storage, such as a hard disk drive.[40] This allows for more memory to be used than physically available in primary storage.

    The x86 architecture allows control of pages through two arrays: page directories and page tables. Originally, a page directory was the size of one page, four kilobytes, and contained 1,024 page directory entries (PDE), although subsequent enhancements to the x86 architecture have added the ability to use larger page sizes. Each PDE contained a pointer to a page table. A page table was also originally four kilobytes in size and contained 1,024 page table entries (PTE). Each PTE contained a pointer to the actual page's physical address and are only used when the four-kilobyte pages are used. At any given time, only one page directory may be in active use.[41]

    Multitasking

    Through the use of the rings, privileged call gates, and the Task State Segment (TSS), introduced with the 286, preemptive multitasking was made possible on the x86 architecture. The TSS allows general-purpose registers, segment selector fields, and stacks to all be modified without affecting those of another task. The TSS also allows a task's privilege level, and I/O port permissions to be independent of another task's.

    In many operating systems, the full features of the TSS are not used.[42] This is commonly due to portability concerns or due to the performance issues created with hardware task switches. As a result, many operating systems use both hardware and software to create a multitasking system.[43]

    Operating systems

    Operating systems like OS/2 1.x try to switch the processor between protected and real modes. This is both slow and unsafe, because a real mode program can easily crash a computer. OS/2 1.x defines restrictive programming rules allowing a Family API or bound program to run in either real or protected mode. Some early Unix operating systems, OS/2 1.x, and Windows used this mode.

    Windows 3.0 was able to run real mode programs in 16-bit protected mode; when switching to protected mode, it decided to preserve the single privilege level model that was used in real mode, which is why Windows applications and DLLs can hook interrupts and do direct hardware access. That lasted through the Windows 9x series. If a Windows 1.x or 2.x program is written properly and avoids segment arithmetic, it will run the same way in both real and protected modes. Windows programs generally avoid segment arithmetic because Windows implements a software virtual memory scheme, moving program code and data in memory when programs are not running, so manipulating absolute addresses is dangerous; programs should only keep handles to memory blocks when not running. Starting an old program while Windows 3.0 is running in protected mode triggers a warning dialog, suggesting to either run Windows in real mode or to obtain an updated version of the application. Updating well-behaved programs using the MARK utility with the MEMORY parameter avoids this dialog. It is not possible to have some GUI programs running in 16-bit protected mode and other GUI programs running in real mode. In Windows 3.1, real mode was no longer supported and could not be accessed.

    In modern 32-bit operating systems, virtual 8086 mode is still used for running applications, e.g. DPMI compatible DOS extender programs (through virtual DOS machines) or Windows 3.x applications (through the Windows on Windows subsystem) and certain classes of device drivers (e.g. for changing the screen-resolution using BIOS functionality) in OS/2 2.0 (and later OS/2) and 32-bit Windows NT, all under control of a 32-bit kernel. However, 64-bit operating systems (which run in long mode) no longer use this, since virtual 8086 mode has been removed from long mode.

    See also

    External links

    Notes and References

    1. Web site: Memory access control method and system for realizing the same . US Patent 5483646 . 2007-07-14 . May 23, 1995 . Patent . The memory access control system according to claim 4, wherein said first address mode is a real address mode, and said second address mode is a protected virtual address mode. . dead . https://web.archive.org/web/20070926220520/http://www.patentstorm.us/patents/5483646-claims.html . September 26, 2007 .
    2. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 2.1.3 The Intel 386 Processor (1985) . May 2019 .
    3. Web site: Guide: What does protected mode mean? . 2007-07-14 . root . July 14, 2007 . Guide . . The purpose of protected mode is not to protect your program. The purpose is to protect everyone else (including the operating system) from your program. .
    4. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 3.1 Modes of Operation . May 2019 .
    5. Web site: [ftp://ftp.utcluj.ro/pub/users/nedevschi/PMP/protected86/collinsprot.PDF Protected Mode Basics ]. 2009-07-31 . Collins . Robert . 2007 . ftp.utcluj.ro . dead . http://archive.wikiwix.com/cache/20110707003604/ftp://ftp.utcluj.ro/pub/users/nedevschi/PMP/protected86/collinsprot.PDF . 2011-07-07 .
    6. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 2.1.2 The Intel 286 Processor (1982) . May 2019 .
    7. Web site: Intel Global Citizenship Report 2003 . 2007-07-14 . Timeline . 1985 Intel launches Intel386 processor . https://web.archive.org/web/20080322075839/http://www.intel.com/intel/finance/gcr03/39-years_of_innovation.htm . 2008-03-22 .
    8. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 2.1 Brief History of Intel 64 and IA-32 Architecture . May 2019 .
    9. Web site: A+ - Hardware . PC Microprocessor Developments and Features Tutorials . 2007-07-24 . Tutorial/Guide . BrainBell.com .
    10. Web site: A CPU History . 2007-07-24 . Risley . David . March 23, 2001 . Article . PCMechanic . What is interesting is that the designers of the time never suspected anyone would ever need more than 1 MB of RAM. . https://web.archive.org/web/20080829165311/http://www.pcmech.com/show/processors/35/ . August 29, 2008.
    11. Web site: Introduction to Protected-Mode . 2007-07-24 . Kaplan . Yariv . 1997 . Article . Internals.com . dead . https://web.archive.org/web/20070622205752/http://www.internals.com/articles/protmode/introduction.htm . 2007-06-22 .
    12. Web site: General Information FAQ for the Coherent Operating System . January 23, 1993.
    13. Microsoft XENIX 286 Press Release . Microsoft . 2015-08-17 . 2014-10-21 . https://web.archive.org/web/20141021111609/http://www.tenox.net/docs/xenix/microsoft_xenix_30_286_press_release.pdf . dead .
    14. Web site: MINIX Information Sheet . https://web.archive.org/web/20140107074722/http://minix.net/minix/minix.html . January 7, 2014.
    15. Book: Mueller, Scott . Upgrading and Repairing PCs, 17th Edition . March 24, 2006 . Book . 2017-07-11 . 17 . Que . 0-7897-3404-4 . P2 (286) Second-Generation Processors . http://www.informit.com/articles/article.aspx?p=481859&seqNum=13 . registration .
    16. Book: 80386 Programmer's Reference Manual . 1986 . Intel . Santa Clara, CA . Section 2.1 Memory Organization and Segmentation .
    17. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 3.1 Modes of Operation . May 2019 .
    18. Book: Hyde, Randall . Write Great Code . O'Reilly . 12.10. Protected Mode Operation and Device Drivers . November 2004 . 1-59327-003-8 . http://safari.oreilly.com/1593270038/ns1593270038-CHP-12-SECT-10 .
    19. [Charles Petzold]
    20. Web site: Sending software to do hardware's job. Tom Yager. 6 November 2004. InfoWorld. 24 November 2014.
    21. Web site: Intel 80386 processor family . 2007-07-24 . Shvets . Gennadiy . June 3, 2007 . Article . 80386SX — low cost version of the 80386. This processor had 16 bit external data bus and 24-bit external address bus. .
    22. Web site: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide. Section 21.33.1 Segment Wraparound, page 21-34. en. Intel.
    23. Web site: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide. 9.9.1 Switching to Protected Mode, page 9-13. en. Intel.
    24. Web site: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide. Section 9.10.2 STARTUP.ASM Listing, page 9-19. en. Intel.
    25. Web site: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide. Section 9.9.2 Switching Back to Real-Address Mode, page 9-14. en. Intel.
    26. Book: Intel 80386 Programmer's Reference Manual 1986 . 1986 . Intel . Santa Clara, CA . Chapter 7, Multitasking .
    27. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Volume 1: Basic Architecture . . Section 6.3.5 Calls to Other Privilege Levels . May 2019 .
    28. Book: 80286 and 80287 Programmer's Reference Manual . 1987 . Intel . Santa Clara, CA . Section 1.2 Modes of Operation .
    29. Book: 80286 and 80287 Programmer's Reference Manual . 1987 . Intel . Santa Clara, California . Section 1.3.1 Memory Management .
    30. Book: 80286 and 80287 Programmer's Reference Manual . 1987 . Intel . Santa Clara, California . Appendix C 8086/8088 Compatibility Considerations .
    31. Web site: Memory access control method and system for realizing the same . US Patent 5483646 . 2007-07-25 . May 6, 1998 . Patent . This has been impossible to-date and has forced BIOS development teams to add support into the BIOS for 32 bit function calls from 32 bit applications. .
    32. Web site: Virtual 8086 Mode . 2007-07-25 . Robinson . Tim . August 26, 2002 . Guide . berliOS . ... secondly, protected mode was also incompatible with the vast amount of real-mode code around at the time. . dead . https://web.archive.org/web/20021003235610/http://osdev.berlios.de/v86.html . October 3, 2002 .
    33. Web site: Virtual 8086 Mode . 2007-07-25 . Robinson . Tim . August 26, 2002 . Guide . berliOS . dead . https://web.archive.org/web/20021003235610/http://osdev.berlios.de/v86.html . October 3, 2002 .
    34. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide . . Section 20.2 Virtual 8086 Mode . May 2019 .
    35. Book: Intel 64 and IA-32 Architectures Software Developer's Manual Combined Volumes 3A, 3B, 3C, and 3D: System Programming Guide . . Section 20.2.7 Sensitive Instructions . May 2019.
    36. Web site: Virtual 8086 Mode . 2007-07-25 . Robinson . Tim . August 26, 2002 . Guide . berliOS . A downside to using V86 mode is speed: every IOPL-sensitive instruction will cause the CPU to trap to kernel mode, as will I/O to ports which are masked out in the TSS. . dead . https://web.archive.org/web/20021003235610/http://osdev.berlios.de/v86.html . October 3, 2002 .
    37. Book: Dabak, Prasad . Millind Borate . Undocumented Windows NT . Book . October 1999 . Hungry Minds . 0-7645-4569-8.
    38. Web site: Global Descriptor table - OSDev Wiki.
    39. Web site: ProtectedMode overview [deinmeister.de] ]. 2007-07-29 . Website .
    40. Web site: What Is PAE X86? . 2007-07-29 . May 28, 2003 . Article . Microsoft TechNet . The paging process allows the operating system to overcome the real physical memory limits. However, it also has a direct impact on performance because of the time necessary to write or retrieve data from disk. . 2008-04-22 . https://web.archive.org/web/20080422184656/http://technet2.microsoft.com/windowsserver/en/library/efc41320-713f-4004-bc81-ddddfc8552651033.mspx?mfr=true . dead .
    41. Web site: Advanced Embedded x86 Programming: Paging . 2007-07-29 . Gareau . Jean . Guide . Embedded.com . Only one page directory may be active at a time, indicated by the CR3 register. . 2008-05-16 . https://web.archive.org/web/20080516202434/http://www.embedded.com/98/9806fe2.htm . dead .
    42. Web site: news: Multitasking for x86 explained #1 . NewOrer . 2007-07-29 . zwanderer . May 2, 2004 . Article . NewOrder . The reason why software task switching is so popular is that it can be faster than hardware task switching. Intel never actually developed the hardware task switching, they implemented it, saw that it worked, and just left it there. Advances in multitasking using software have made this form of task switching faster (some say up to 3 times faster) than the hardware method. Another reason is that the Intel way of switching tasks isn't portable at all . https://web.archive.org/web/20070212161434/http://neworder.box.sk/newsread.php?newsid=10562 . 2007-02-12 .
    43. Web site: news: Multitasking for x86 explained #1 . NewOrer . 2007-07-29 . zwanderer . May 2, 2004 . Article . NewOrder . ... both rely on the Intel processors ability to switch tasks, they rely on it in different ways. . https://web.archive.org/web/20070212161434/http://neworder.box.sk/newsread.php?newsid=10562 . 2007-02-12 .