Iterative and incremental development explained

Iterative and incremental development is any combination of both iterative design (or iterative method) and incremental build model for development.

Usage of the term began in software development, with a long-standing combination of the two terms iterative and incremental[1] having been widely suggested for large development efforts. For example, the 1985 DOD-STD-2167[2] mentions (in section 4.1.2): "During software development, more than one iteration of the software development cycle may be in progress at the same time." and "This process may be described as an 'evolutionary acquisition' or 'incremental build' approach." In software, the relationship between iterations and increments is determined by the overall software development process.

Overview

The basic idea behind this method is to develop a system through repeated cycles (iterative) and in smaller portions at a time (incremental), allowing software developers to take advantage of what was learned during development of earlier parts or versions of the system. Learning comes from both the development and use of the system, where possible key steps in the process start with a simple implementation of a subset of the software requirements and iteratively enhance the evolving versions until the full system is implemented. At each iteration, design modifications are made and new functional capabilities are added.[3]

The procedure itself consists of the initialization step, the iteration step, and the Project Control List. The initialization step creates a base version of the system. The goal for this initial implementation is to create a product to which the user can react. It should offer a sampling of the key aspects of the problem and provide a solution that is simple enough to understand and implement easily. To guide the iteration process, a project control list is created that contains a record of all tasks that need to be performed. It includes items such as new features to be implemented and areas of redesign of the existing solution. The control list is constantly being revised as a result of the analysis phase.

An iteration involves redesign and implementation, which is meant to be simple, straightforward, and modular, supporting redesign at that stage or as a future task added to the project control list. The level of design detail is not dictated by the iterative approach. In a light-weight iterative project the code may represent the major source of documentation of the system; however, in a critical iterative project a formal Software Design Document may be used. The analysis of an iteration is based upon user feedback and the program analysis facilities available. It involves analysis of the structure, modularity, usability, reliability, efficiency, and achievement of goals. The project control list is modified in light of the analysis results.

Phases

Incremental development slices the system functionality into increments (portions). In each increment, a slice of functionality is delivered through cross-discipline work, from the requirements to the deployment. The Unified Process groups increments/iterations into phases: inception, elaboration, construction, and transition.

Each of the phases may be divided into 1 or more iterations, which are usually time-boxed rather than feature-boxed. Architects and analysts work one iteration ahead of developers and testers to keep their work-product backlog full.

Usage/History

Many examples of early usage are provided in Craig Larman and Victor Basili's article "Iterative and Incremental Development: A Brief History",[4] with one of the earliest being NASA's 1960s Project Mercury.

Some of those Mercury engineers later formed a new division within IBM, where "another early and striking example of a major IID success [was] the very heart of NASA’s space shuttle software—the primary avionics software system, which [they] built from 1977 to 1980. The team applied IID in a series of 17 iterations over 31 months, averaging around eight weeks per iteration. Their motivation for avoiding the waterfall life cycle was that the shuttle program’s requirements changed during the software development process."

Some organizations, such as the US Department of Defense, have a preference for iterative methodologies, starting with MIL-STD-498 "clearly encouraging evolutionary acquisition and IID". The DoD Instruction 5000.2 released in 2000 stated a clear preference for IID:

There are two approaches, evolutionary and single step [waterfall], to full capability. An evolutionary approach is preferred. … [In this] approach, the ultimate capability delivered to the user is divided into two or more blocks, with increasing increments of capability...software development shall follow an iterative spiral development process in which continually expanding software versions are based on learning from earlier development. It can also be done in phases.
Recent revisions to DoDI 5000.02 no longer refer to "spiral development," but do advocate the general approach as a baseline for software-intensive development/procurement programs.[5] In addition, the United States Agency for International Development (USAID) also employs an iterative and incremental developmental approach to its programming cycle to design, monitor, evaluate, learn and adapt international development projects with a project management approach that focuses on incorporating collaboration, learning, and adaptation strategies to iterate and adapt programming.[6]

Contrast with Waterfall development

The main cause of the software development projects failure is the choice of the model, so should be made with a great care.[7]

For example, the Waterfall development paradigm completes the project-wide work-products of each discipline in one step before moving on to the next discipline in a succeeding step. Business value is delivered all at once, and only at the very end of the project, whereas backtracking is possible in an iterative approach. Comparing the two approaches, some patterns begin to emerge:

Implementation guidelines

Guidelines that drive software implementation and analysis include:

Use in hardware and embedded systems

While the term iterative and incremental development got started in the software industry, many hardware and embedded software development efforts are using iterative and incremental techniques.

Examples of this may be seen in a number of industries. One sector that has recently been substantially affected by this shift of thinking has been the space launch industry, with substantial new competitive forces at work brought about by faster and more extensive technology innovation brought to bear by the formation of private companies pursuing space launch. These companies, such as SpaceX[8] and Rocket Lab,[9] are now both providing commercial orbital launch services in the past decade, something that only six nations had done prior to a decade[10] ago. New innovation in technology development approaches, pricing, and service offerings—including the ability that has existed only since 2016 to fly to space on a previously flown (reusable) booster stage—further decreasing the price of obtaining access to space.[11] [8]

SpaceX has been explicit about its effort to bring iterative design practices into the space industry, and uses the technique on spacecraft, launch vehicles, electronics and avionics, and operational flight hardware operations.[12]

As the industry has begun to change, other launch competitors are beginning to change their long-term development practices with government agencies as well. For example, the large US launch service provider United Launch Alliance (ULA) began in 2015 a decade-long project to restructure its launch business—reducing two launch vehicles to one—using an iterative and incremental approach to get to a partially-reusable and much lower-cost launch system over the next decade.[13]

See also

References

Notes and References

  1. Larman . Craig . June 2003 . Iterative and Incremental Development: A Brief History . Computer . 36 . 6 . 47–56 . 10.1109/MC.2003.1204375 . 9240477 . 0018-9162 . We were doing incremental development as early as 1957, in Los Angeles, under the direction of Bernie Dimsdale [at IBM's ServiceBureau Corporation]. He was a colleague of John von Neumann, so perhaps he learned it there, or assumed it as totally natural. I do remember Herb Jacobs (primarily, though we all participated) developing a large simulation for Motorola, where the technique used was, as far as I can tell ...' .
  2. http://www.everyspec.com/DoD/DoD-STD/DOD-STD-2167_278/ DOD-STD-2167 Defense Systems Software Development (04 JUN 1985)
  3. Web site: Software Development Models: Iterative and Incremental Development. Viktor. Farcic. January 21, 2014. Technology Conversations.
  4. http://doi.ieeecomputersociety.org/10.1109/MC.2003.1204375 Iterative and Incremental Development: A Brief History
  5. Web site: Kendall. Frank. Gilmore. J. Michael. Halvorsen. Terry. Operation of the Defense Acquisition System. DoD Issuances. Under Secretary of Defense for Acquisition, Technology, and Logistics. 2017-08-09. https://web.archive.org/web/20170809221013/http://www.esd.whs.mil/Portals/54/Documents/DD/issuances/dodi/500002_dodi_2015.pdf. 2017-08-09. 12–14. en. 2017-02-02.
  6. USAID. "ADS Chapter 201 Program Cycle Operational Policy" . Retrieved April 19, 2017
  7. Web site: Kudryashov . Alexey . February 29, 2024 . Incremental vs Waterfall Model in Software Development . Cyfrania: Custom Software Development & Consulting . "Choosing the incremental model for stable-requirement projects can lead to scope creep and increased complexity, while selecting the waterfall model might cause rigidity and inefficiency in adapting to changes.".
  8. News: Belfiore . Michael . The Rocketeer . . 9 December 2013 . 11 November 2018 . 10 December 2013 . https://web.archive.org/web/20131210233009/http://www.foreignpolicy.com/articles/2013/12/02/the_rocketeer_elon_musk . dead .
  9. News: Exclusive Inside Look at Rocket Lab's Previously-secret new Mega Factory! . Everyday Astronaut . 11 October 2018 . 11 November 2018 . 12 October 2018 . https://web.archive.org/web/20181012134827/https://everydayastronaut.com/inside-rocketlab/ . dead .
  10. Web site: Clark. Stephen . Sweet Success at Last for Falcon 1 Rocket . 28 September 2008 . Spaceflight Now . 11 November 2018 . the first privately developed liquid-fueled rocket to successfully reach orbit..
  11. News: Berger. Eric . Russia's Proton rocket, which predates Apollo, will finally stop flying Technical problems, rise of SpaceX are contributing factors. . arsTechica . 2018-06-25 . 2018-06-26 . the rapid rise of low-cost alternatives such as SpaceX's Falcon 9 rocket, have caused the number of Proton launches in a given year to dwindle from eight or so to just one or two. .
  12. News: Fernholz. Tim . What it took for Elon Musk's SpaceX to disrupt Boeing, leapfrog NASA, and become a serious space company . . 21 October 2014 . 11 November 2018 . But SpaceX always thought of itself as a tech firm, and its clashes with NASA often took a form computer developers—or anyone familiar with the troubled roll-out of healthcare.gov—would recognize as generational. SpaceX followed an iterative design process, continually improving prototypes in response to testing. Traditional product management calls for a robust plan executed to completion, a recipe for cost overruns. .
  13. News: Gruss. Mike . Evolution of a Plan : ULA Execs Spell Out Logic Behind Vulcan Design Choices . 25 April 2015 . Space News . 2015-04-24 . ULA’s April 13 announcement that it would develop a rocket dubbed Vulcan using an incremental approach whose first iteration essentially is an Atlas 5 outfitted with a new first stage..