Node.js explained

Node.js
Author:Ryan Dahl
Developer:OpenJS Foundation
Released:[1]
Programming Language:JavaScript, C++, Python, C
Operating System:z/OS, Linux, macOS, Microsoft Windows, SmartOS, FreeBSD, OpenBSD, IBM AIX[2]
Genre:Runtime environment
License:MIT License[3] [4]

Node.js is a cross-platform, open-source JavaScript runtime environment that can run on Windows, Linux, Unix, macOS, and more. Node.js runs on the V8 JavaScript engine, and executes JavaScript code outside a web browser.

Node.js lets developers use JavaScript to write command line tools and for server-side scripting. The ability to run JavaScript code on the server is often used to generate dynamic web page content before the page is sent to the user's web browser. Consequently, Node.js represents a "JavaScript everywhere" paradigm,[5] unifying web-application development around a single programming language, as opposed to using different languages for the server- versus client-side programming.

Node.js has an event-driven architecture capable of asynchronous I/O. These design choices aim to optimize throughput and scalability in web applications with many input/output operations, as well as for real-time Web applications (e.g., real-time communication programs and browser games).[6]

The Node.js distributed development project was previously governed by the Node.js Foundation,[7] and has now merged with the JS Foundation to form the OpenJS Foundation. OpenJS Foundation is facilitated by the Linux Foundation's Collaborative Projects program.[8]

History

Node.js was initially written by Ryan Dahl in 2009,[9] about 13 years after the introduction of the first server-side JavaScript environment, Netscape's LiveWire Pro Web.[10] The initial release supported only Linux and Mac OS X. Its development and maintenance was led by Dahl and later sponsored by Joyent.[11]

Dahl criticized the limited capability of Apache HTTP Server to handle many (10,000+) concurrent connections, as well as the dominant programming paradigm of sequential programming, in which applications could block entire processes or cause the creation of multiple execution stacks for simultaneous connections.[12]

Dahl demonstrated the project at the inaugural European JSConf on November 8, 2009.[13] [14] [15] Node.js combined Google's V8 JavaScript engine, an event loop, and a low-level I/O API.[16]

In January 2010, a package manager was introduced for the Node.js environment called npm.[17] The package manager allows programmers to publish and share Node.js packages, along with the accompanying source code, and is designed to simplify the installation, update and uninstallation of packages.[16]

In June 2011, Microsoft and Joyent implemented a native Windows version of Node.js.[18] The first Node.js build supporting Windows was released in July 2011.

In January 2012, Dahl yielded management of the project to npm creator Isaac Schlueter.[19] In January 2014, Schlueter announced that Timothy J. Fontaine would lead the project.[20]

In December 2014, Fedor Indutny created io.js, a fork of Node.js created because of dissatisfaction with Joyent's governance as an open-governance alternative with a separate technical committee. The goal was to enable a structure that would be more receptive to community input, including the updating of io.js with the latest Google V8 JavaScript engine releases, diverging from Node.js's approach at that time.[21]

The Node.js Foundation, formed to reconcile Node.js and io.js under a unified banner, was announced in February 2015.[22] The merger was realized in September 2015 with Node.js v0.12 and io.js v3.3 combining into Node v4.0.[23] This merge brought V8 ES6 features into Node.js and started a long-term support release cycle.[24] By 2016, the io.js website recommended returning to Node.js and announced no further io.js releases, effectively ending the fork and solidifying the merger's success.[25]

In 2019, the JS Foundation and Node.js Foundation merged to form the OpenJS Foundation.

On September 6, 2023, Node.js 20.6.0 was released. The update brought the addition of built-in support for .env files, the unflagging of import.meta.resolve, the introduction of a new node:<var>module</var> API register for module customization hooks and a new initialize hook. Additionally, the module customization load hook now supports CommonJS, and Node.js C++ add-ons have gained experimental support for cppgc (Oilpan), which is a C++ garbage collection library for V8.[26]

Branding

The Node.js logo features a green hexagon with overlapping bands to represent the cross-platform nature of the runtime.[27] The Rocket Turtle was chosen as the official Node.js mascot in February 2024 following a design contest.[28]

Overview

Node.js allows the creation of web servers and networking tools using JavaScript and a collection of "modules" that handle various core functionalities.[13] [16] [29] Modules are provided for file system I/O, networking (DNS, HTTP, TCP, TLS/SSL or UDP), binary data (buffers), cryptography functions, data streams and other core functions.[16] [30] Node.js's modules use an API designed to reduce the complexity of writing server applications.[16] [31]

JavaScript is the only language that Node.js supports natively, but many compile-to-JS languages are available.[32] As a result, Node.js applications can be written in CoffeeScript,[33] Dart, TypeScript, ClojureScript and others.

Node.js is primarily used to build network programs such as web servers.[34] The most significant difference between Node.js and PHP is that most functions in PHP block until completion (commands execute only after previous commands finish), while Node.js functions are non-blocking (commands execute concurrently or even in parallel,[35] [36] and use callbacks to signal completion or failure).[34]

Node.js is officially supported by Linux, and Microsoft Windows 8.1 and Server 2012 (and later), with Tier 2 support for SmartOS and IBM AIX and experimental support for FreeBSD. OpenBSD also works, and LTS versions are available for IBM i (AS/400).[37] The source code may also be built on similar operating systems that are not officially supported, such as NonStop OS[38] and Unix servers.

Platform architecture

Node.js enables development of fast web servers in JavaScript using event-driven programming.[16] Developers can create scalable servers without using threading by using a simplified model that uses callbacks to signal the completion of a task.[16] Node.js connects the ease of a scripting language (JavaScript) with the power of Unix network programming.[16]

Node.js was built on top of Google's V8 JavaScript engine since it was open-sourced under the BSD license, and it contains comprehensive support for fundamental protocols such as HTTP, DNS and TCP.[13] JavaScript's existing popularity made Node.js accessible to the web-development community.[13]

Industry support

There are thousands of open-source libraries for Node.js, most of which are hosted on the npm website. Multiple developer conferences and events are held that support the Node.js community, including NodeConf, Node Interactive and Node Summit, as well as a number of regional events.

The open-source community has developed web frameworks to accelerate the development of applications. Such frameworks include Express.js, Socket.IO, Sails.js, Next.js and Meteor.[16] [39] Various packages have also been created for interfacing with other languages or runtime environments such as Microsoft .NET.[40]

Modern desktop IDEs provide editing and debugging features specifically for Node.js applications. Such IDEs include Atom, Brackets, JetBrains WebStorm,[41] [42] Microsoft Visual Studio (with Node.js Tools for Visual Studio,[43] or TypeScript with Node definitions[44] [45] [46] [47]), NetBeans,[48] Nodeclipse Enide Studio[49] (Eclipse-based) and Visual Studio Code.[50] [51] Some online IDEs also support Node.js, such as Codeanywhere, Eclipse Che, Cloud9 IDE and the visual flow editor in Node-RED.

Node.js is supported across a number of cloud-hosting platforms such as Jelastic, Google Cloud Platform, AWS Elastic Beanstalk, Azure Web Apps and Joyent.

Releases

Release[52] StatusCode nameRelease dateMaintenance end
2013-03-112016-10-31
2015-02-062016-12-31
Argon2015-09-082018-04-30
2015-10-292016-06-30
Boron2016-04-262019-04-30
2016-10-252017-06-30
Carbon2017-05-302019-12-31
2017-10-012018-06-30
Dubnium2018-04-242021-04-30
2018-10-232019-06-01
Erbium2019-04-232022-04-30
2019-10-222020-06-01
Fermium2020-04-212023-04-30
2020-10-202021-06-01
Gallium2021-04-202023-09-11[53]
2021-10-192022-06-01
Hydrogen2022-04-192025-04-30
2022-10-182023-06-01
Iron[54] 2023-04-182026-04-30
2023-10-172024-06-01
Jod 2024-04-242027-04-30
2024-10-142025-06-01
Krypton 2025-04-222028-04-30

New major releases of Node.js are cut from the GitHub main branch every six months. Even-numbered versions are cut in April and odd-numbered versions are cut in October. When a new odd version is released, the previous even version undergoes transition to Long Term Support (LTS), which gives that version 18 months of active support from the date it is designated LTS. After these 18 months expire, an LTS release receives an additional 12 months of maintenance support. An active version receives non-breaking backports of changes a few weeks after they land in the current release. A maintenance release receives only critical fixes and documentation updates.[55] The LTS Working Group manages strategy and policy in collaboration with the Technical Steering Committee of the Node.js Foundation.

Technical details

Node.js is a JavaScript runtime environment that processes incoming requests in a loop, called the event loop.

Internals

Node.js uses libuv under the hood to handle asynchronous events. Libuv is an abstraction layer for network and file system functionality on both Windows and POSIX-based systems such as Linux, macOS, OSS on NonStop, and Unix. Node.js relies on nghttp2 for HTTP support. As of version 20, Node.js uses the ada library which provides up-to-date WHATWG URL compliance. As of version 19.5, Node.js uses the simdutf library for fast Unicode validation and transcoding. As of version 21.3, Node.js uses the simdjson library for fast JSON parsing.

Threading

Node.js operates on a single-thread event loop, using non-blocking I/O calls, allowing it to support tens of thousands of concurrent connections without incurring the cost of thread context switching.[56] The design of sharing a single thread among all the requests that use the observer pattern is intended for building highly concurrent applications, where any function performing I/O must use a callback. To accommodate the single-threaded event loop, Node.js uses the libuv library—which, in turn, uses a fixed-sized thread pool that handles some of the non-blocking asynchronous I/O operations.

A thread pool handles the execution of parallel tasks in Node.js. The main thread function call posts tasks to the shared task queue, which threads in the thread pool pull and execute. Inherently non-blocking system functions such as networking translate to kernel-side non-blocking sockets, while inherently blocking system functions such as file I/O run in a blocking way on their own threads. When a thread in the thread pool completes a task, it informs the main thread of this, which in turn, wakes up and executes the registered callback.

A downside of this single-threaded approach is that Node.js does not allow vertical scaling by increasing the number of CPU cores of the machine it is running on without using an additional module, such as cluster, StrongLoop Process Manager,[57] or pm2.[58] However, developers can increase the default number of threads in the libuv thread pool. The server operating system (OS) is likely to distribute these threads across multiple cores.[59] Another problem is that long-lasting computations and other CPU-bound tasks freeze the entire event-loop until completion.

V8

See main article: V8 (JavaScript engine). V8 is the JavaScript execution engine which was initially built for Google Chrome. It was then open-sourced by Google in 2008. Written in C++, V8 compiles JavaScript source code to native machine code at runtime. As of 2016, it also includes Ignition, a bytecode interpreter.

Package management

npm is the pre-installed package manager for the Node.js server platform. It installs Node.js programs from the npm registry, organizing the installation and management of third-party Node.js programs.

Event loop

Node.js registers with the operating system so the OS notifies it of asynchronous I/O events such as new connections. Within the Node.js runtime, events trigger callbacks and each connection is handled as a small heap allocation. Traditionally, relatively heavyweight OS processes or threads handled each connection. Node.js uses an event loop for concurrent I/O, instead of processes or threads.[60] In contrast to other event-driven servers, Node.js's event loop does not need to be called explicitly. Instead, callbacks are defined, and the server automatically enters the event loop at the end of the callback definition. Node.js exits the event loop when there are no further callbacks to be performed.

WebAssembly

Node.js supports WebAssembly and as of Node 14 has experimental support of WASI, the WebAssembly System Interface.

Native bindings

See also: Foreign function interface. Node.js provides a way to create "add-ons" via a C-based API called N-API, which can be used to produce loadable (importable) .node modules from source code written in C/C++.[61] The modules can be directly loaded into memory and executed from within JS environment as simple CommonJS modules. The implementation of the N-API relies on internal C/C++ Node.js and V8 objects requiring users to import (

  1. include
) Node.js specific headers into their native source code.

As the Node.js API is subject to breaking changes at a binary level, modules have to be built and shipped against specific Node.js versions to work properly. To address the issue, third parties have introduced open-sourced С/С++ wrappers on top of the API that partially alleviate the problem. They simplify interfaces, but as a side effect they may also introduce complexity which maintainers have to deal with. Even though the core functionality of Node.js resides in a JavaScript built-in library, modules written in C++ can be used to enhance capabilities and to improve performance of applications.

In order to produce such modules one needs to have an appropriate C++ compiler and necessary headers (the latter are typically shipped with Node.js itself), e.g., gcc, clang or MSVC++.

The N-API is similar to Java Native Interface.

Project governance

See main article: OpenJS Foundation. In 2015, various branches of the greater Node.js community began working under the vendor-neutral Node.js Foundation. The stated purpose of the organization "is to enable widespread adoption and help accelerate development of Node.js and other related modules through an open governance model that encourages participation, technical contribution, and a framework for long-term stewardship by an ecosystem invested in Node.js' success."[62]

The Node.js Foundation Technical Steering Committee (TSC) is the technical governing body of the Node.js Foundation. The TSC is responsible for the core Node.js repo as well as dependent and adjacent projects. Generally the TSC delegates the administration of these projects to working groups or committees.[63] The LTS group that manages long term supported releases is one such group. Other current groups include Website, Streams, Build, Diagnostics, i18n, Evangelism, Docker, Addon API, Benchmarking, Post-mortem, Intl, Documentation, and Testing.[64]

In August 2017, a third of the TSC members resigned due to a dispute related to the project's code of conduct.[65]

Current TSC Members[66] ! Username !! Full Name
aduh95 Antoine du Hamel
apapirovski Anatoli Papirovski
benjamingr Benjamin Gruenbaum
BridgeAR Ruben Bridgewater
GeoffreyBooth Geoffrey Booth
gireeshpunathil Gireesh Punathil
jasnell James M Snell
joyeecheung Joyee Cheung
legendecas Chengzhong Wu
marco-ippolito Marco Ippolito
mcollina Matteo Collina
mhdawson Michael Dawson
MoLow Moshe Atlow
RafaelGSS Rafael Gonzaga
richardlau Richard Lau
ronag Robert Nagy
ruyadorno Ruy Adorno
ShogunPanda Paolo Insogna
targos Michaël Zasso
tniessen Tobias Nießen

Further reading

Notes and References

  1. Web site: node-v0.x-archive on GitHub. 2 August 2014. GitHub.
  2. Web site: nodejs/node. GitHub. 13 April 2022.
  3. Web site: node/LICENSE at master. GitHub. Node.js Foundation. 17 September 2018. 17 September 2018.
  4. Web site: The MIT License. Open Source Initiative. 17 September 2018. 17 September 2018.
  5. Web site: gcuomo . 24 October 2013 . JavaScript Everywhere and the Three Amigos (Into the wild BLUE yonder!) . https://web.archive.org/web/20131114212619/https://www.ibm.com/developerworks/community/blogs/gcuomo/entry/javascript_everywhere_and_the_three_amigos?lang=en . November 14, 2013 . 2013-10-24 . www.ibm.com.
  6. Web site: Laurent Orsini . 2013-11-07 . What You Need To Know About Node.js . 2022-02-06 . readwrite.com.
  7. Web site: Node.js Foundation - Node.js . 4 July 2015 . nodejs.org.
  8. Web site: 2015-07-04 . Linux Foundation Collaborative Projects . 4 July 2015 . linuxfoundation.org.
  9. Web site: 2016-09-11 . About Node.js, and why you should add Node.js to your skill set? . 23 October 2016 . Training.com . training.com . 1 April 2017 . https://web.archive.org/web/20170401061100/http://blog.training.com/2016/09/about-nodejs-and-why-you-should-add.html . dead .
  10. News: Staff . CNET News . 1996-10-15 . Netscape opens intranet attack . en . CNET . 2017-04-20.
  11. Web site: Joyent and Node. Ryan Dahl. Google Groups. 2010-11-09. 2015-02-05.
  12. Web site: Garbar . Dzmitry . PHP 7 vs Node.js? They Can Be Partners, Not Competitors For a Developer! . 21 December 2016 . belitsoft.com.
  13. https://books.google.com/books?id=KGt-FxUEj48C&dq=nodejs&pg=PT24 Sams Teach Yourself Node.js in 24 Hours
  14. Web site: Ubl . Malte . 2009-09-09 . JSConf.eu 2009, Berlin, Germany . 2009-09-09 . www.jsconf.eu.
  15. Web site: Ryan Dahl: Original Node.js presentation. https://ghostarchive.org/varchive/youtube/20211215/ztspvPYybIY . 2021-12-15 . live. www.youtube.com.
  16. https://books.google.com/books?id=ZH6bpbcrlvYC&q=nodejs Professional Node.js: Building JavaScript Based Scalable Software
  17. Web site: Earliest releases of npm . GitHub . 27 July 2016.
  18. Web site: Ryandahl . 2011-06-23 . Porting Node to Windows With Microsoft's Help . 17 April 2016 . nodejs.org.
  19. Web site: New gatekeeper. Dahl. Ryan. 26 October 2013.
  20. Web site: The Next Phase of Node.js. Schlueter. Isaac. 15 January 2014. 21 January 2014.
  21. http://www.infoworld.com/article/2855057/application-development/why-iojs-decided-to-fork-nodejs.html Q&A: Why io.js decided to fork Node.js
  22. Web site: Node.js Foundation Advances Community Collaboration, Announces New Members and Ratified Technical Governance. 4 July 2015. dead. https://web.archive.org/web/20150624075643/http://www.linuxfoundation.org/news-media/announcements/2015/06/nodejs-foundation-advances-community-collaboration-announces-new. 24 June 2015.
  23. Web site: 2015-09-14 . Node.js Foundation Combines Node.js and io.js Into Single Codebase in New Release . 28 January 2016 . nodejs.org.
  24. Web site: 19 May 2015 . io.js and Node.js merge . 27 June 2015 . medium.com.
  25. https://iojs.org/en/ Io.js, JavaScript I/O
  26. Web site: Previous Releases . Node.js.
  27. Web site: Brand Guide . Node.js . OpenJS Foundation . 22 March 2024.
  28. Web site: Node.JS on X: "Meet Rocket Turtle there are many ways " . 22 March 2024.
  29. https://books.google.com/books?id=G1y_5kpmatUC&q=nodejs Smashing Node.js: JavaScript Everywhere
  30. https://nodejs.org/api/ Modules
  31. https://books.google.com/books?id=dPaoCwAAQBAJ&q=nodejs Node.js Essentials
  32. Web site: List of languages that compile to JS. Github.
  33. Book: CoffeeScript on Node.js . O'Reilly Media, Inc. . 15 April 2013 . 17 May 2015. 9781449316846 .
  34. https://books.google.com/books?id=KZQQAlhTOBgC&q=nodejs Node.js for PHP Developers
  35. Web site: Node.js's cluster module . 19 October 2017 . nodejs.org.
  36. Web site: Node.js's child_process module . 19 October 2017 . nodejs.org.
  37. Web site: Foundation . Node js . Installing Node.js via package manager . 2019-05-19 . Node.js . en.
  38. Web site: bomBora - Node.js for NonStop . 14 August 2015 . infrasoft.com.au . Infrasoft . 11 March 2018 . https://web.archive.org/web/20180311040354/http://infrasoft.com.au/bomBora.html . dead .
  39. https://books.google.com/books?id=5eGRAwAAQBAJ&q=nodejs Express.js Guide: The Comprehensive Book on Express.js
  40. http://www.techrepublic.com/article/edge-js-bridges-the-gap-between-node-js-and-net/ Edge.js bridges the gap between Node.js and .NET
  41. https://www.jetbrains.com/webstorm/help/node-js.html Node.js
  42. https://www.jetbrains.com/webstorm/help/running-and-debugging-node-js.html Running and Debugging Node.js
  43. Web site: Node.js Tools for Visual Studio . 1 Feb 2016 . microsoft.com.
  44. https://github.com/soywiz/typescript-node-definitions soywiz/typescript-node-definitions TypeScript's typings for some popular node.js modules
  45. https://github.com/DefinitelyTyped/DefinitelyTyped DefinitelyTyped
  46. Web site: The repository for high quality TypeScript type definitions. https://web.archive.org/web/20160203083254/http://definitelytyped.org/. dead. 3 February 2016. definitelytyped.org.
  47. https://www.typescriptlang.org/Samples#ImageBoard ImageBoard, A Node.js + Express + MongoDB application built using TypeScript on the server
  48. Web site: Krill . Paul . 2015-11-10 . Node.js takes center stage in NetBeans 8.1 . 2015-11-10 . infoworld.com . InfoWorld.
  49. http://www.nodeclipse.org/ Nodeclipse, Enide -- Node.JS development in Eclipse
  50. https://channel9.msdn.com/Blogs/cloud-with-a-silver-lining/hello-visual-studio-code-nodejs Hello Visual Studio Code (with NodeJS)
  51. https://code.visualstudio.com/Docs/runtimes/nodejs Node.js Applications with VS Code
  52. Web site: Releases. Node.js. 23 August 2023 .
  53. https://nodejs.org/en/blog/announcements/nodejs16-eol/ Bringing forward the End-of-Life Date for Node.js 16
  54. Web site: Node.JS CODENAMES.md . 6 September 2023 . GitHub . en.
  55. Web site: nodejs/Release. GitHub. en. 2018-05-03.
  56. Web site: Node.js w/1M concurrent connections!. caustik's blog. 19 August 2012.
  57. Web site: StrongLoop Process Manager. strong-pm.io.
  58. Web site: GitHub - Unitech/pm2: Production process manager for Node.js applications with a built-in load balancer. GitHub. 12 June 2021.
  59. Web site: On problems with threads in node.js - Future Processing. Aleksander Kasiuk. 22 April 2015.
  60. https://nodejs.org/about/ About Node.js
  61. Web site: C++ addons Node.js v14.12.0 Documentation. 2020-09-26. nodejs.org.
  62. Web site: Node.js Foundation Node.js. Foundation. Node.js. nodejs.org. en. 2017-03-08.
  63. Web site: nodejs/TSC. GitHub. en. 2017-03-08.
  64. Web site: Working Groups Node.js. Foundation. Node.js. nodejs.org. en. 2017-03-08. 27 February 2017. https://web.archive.org/web/20170227070535/https://nodejs.org/en/about/working-groups/. dead.
  65. Whittaker, Zack, After governance breakdown, Node.js leaders fight for its survival, ZDNet, 25 August 2017
  66. Web site: tsc-voting-members. Github.com. 16 May 2024 .