Stackless Python Explained

Stackless Python
Author:Christian Tismer
Developer:Anselm Kruis
Programming Language:C, Python
Operating System:Linux, macOS, Windows
Genre:Interpreter
License:Python Software Foundation License

Stackless Python, or Stackless, is a Python programming language interpreter, so named because it avoids depending on the C call stack for its own stack. In practice, Stackless Python uses the C stack, but the stack is cleared between function calls.[1] The most prominent feature of Stackless is microthreads, which avoid much of the overhead associated with usual operating system threads. In addition to Python features, Stackless also adds support for coroutines, communication channels, and task serialization.

Design

With Stackless Python, a running program is split into microthreads that are managed by the language interpreter itself, not the operating system kernelcontext switching and task scheduling is done purely in the interpreter (these are thus also regarded as a form of green thread). Microthreads manage the execution of different subtasks in a program on the same CPU core. Thus, they are an alternative to event-based asynchronous programming and also avoid the overhead of using separate threads for single-core programs (because no mode switching between user mode and kernel mode needs to be done, so CPU usage can be reduced).

Although microthreads make it easier to deal with running subtasks on a single core, Stackless Python does not remove CPython's Global Interpreter Lock, nor does it use multiple threads and/or processes. So it allows only cooperative multitasking on a shared CPU and not parallelism (preemption was originally not available but is now in some form[2]). To use multiple CPU cores, one would still need to build an interprocess communication system on top of Stackless Python processes.

Due to the considerable number of changes in the source, Stackless Python cannot be installed on a preexisting Python installation as an extension or library. It is instead a complete Python distribution in itself. The majority of Stackless's features have also been implemented in PyPy, a self-hosting Python interpreter and JIT compiler.[3]

Use

Although the whole Stackless is a separate distribution, its switching functionality has been successfully packaged as a CPython extension called greenlet.[4] It is used by a number of libraries (e.g. gevent[5]) to provide a green threading solution for CPython. Python since has received a native solution for green threads: await/async.

Stackless is used extensively in the implementation of the Eve Online massively multiplayer online game as well as in IronPort's mail platform.

See also

External links

Notes and References

  1. Archived at Ghostarchive and the Wayback Machine: The story of stackless Python . YouTube.
  2. Web site: About Stackless . a round robin scheduler is built in. It can be used to schedule tasklets either cooperatively or preemptively. . 26 August 2016 . 23 June 2020 . https://web.archive.org/web/20200623233250/https://bitbucket.org/stackless-dev/stackless/wiki/Home . dead .
  3. Web site: Application-level Stackless features — PyPy documentation. pypy.readthedocs.org.
  4. Web site: greenlet: Lightweight concurrent programming — greenlet 0.4.0 documentation. greenlet.readthedocs.org.
  5. Web site: What is gevent? — gevent 1.3.0.dev0 documentation. www.gevent.org.