Duplicate code explained

In computer programming, duplicate code is a sequence of source code that occurs more than once, either within a program or across different programs owned or maintained by the same entity. Duplicate code is generally considered undesirable for a number of reasons.[1] A minimum requirement is usually applied to the quantity of code that must appear in a sequence for it to be considered duplicate rather than coincidentally similar. Sequences of duplicate code are sometimes known as code clones or just clones, the automated process of finding duplications in source code is called clone detection.

Two code sequences may be duplicates of each other without being character-for-character identical, for example by being character-for-character identical only when white space characters and comments are ignored, or by being token-for-token identical, or token-for-token identical with occasional variation. Even code sequences that are only functionally identical may be considered duplicate code.

Emergence

Some of the ways in which duplicate code may be created are:

It may also happen that functionality is required that is very similar to that in another part of a program, and a developer independently writes code that is very similar to what exists elsewhere. Studies suggest that such independently rewritten code is typically not syntactically similar.[2]

Automatically generated code, where having duplicate code may be desired to increase speed or ease of development, is another reason for duplication. Note that the actual generator will not contain duplicates in its source code, only the output it produces.

Fixing

Duplicate code is most commonly fixed by moving the code into its own unit (function or module) and calling that unit from all of the places where it was originally used. Using a more open-source style of development, in which components are in centralized locations, may also help with duplication.

Costs and benefits

Code which includes duplicate functionality is more difficult to support because,

On the other hand, if one copy of the code is being used for different purposes, and it is not properly documented, there is a danger that it will be updated for one purpose, but this update will not be required or appropriate to its other purposes.

These considerations are not relevant for automatically generated code, if there is just one copy of the functionality in the source code.

In the past, when memory space was more limited, duplicate code had the additional disadvantage of taking up more space, but nowadays this is unlikely to be an issue.

When code with a software vulnerability is copied, the vulnerability may continue to exist in the copied code if the developer is not aware of such copies.[3] Refactoring duplicate code can improve many software metrics, such as lines of code, cyclomatic complexity, and coupling. This may lead to shorter compilation times, lower cognitive load, less human error, and fewer forgotten or overlooked pieces of code. However, not all code duplication can be refactored.[4] Clones may be the most effective solution if the programming language provides inadequate or overly complex abstractions, particularly if supported with user interface techniques such as simultaneous editing. Furthermore, the risks of breaking code when refactoring may outweigh any maintenance benefits.[5] A study by Wagner, Abdulkhaleq, and Kaya concluded that while additional work must be done to keep duplicates in sync, if the programmers involved are aware of the duplicate code there weren't significantly more faults caused than in unduplicated code.[6]

Detecting duplicate code

A number of different algorithms have been proposed to detect duplicate code. For example:

Example of functionally duplicate code

Consider the following code snippet for calculating the average of an array of integers

extern int array_a[];extern int array_b[]; int sum_a = 0;

for (int i = 0; i < 4; i++) sum_a += array_a[i];

int average_a = sum_a / 4; int sum_b = 0;

for (int i = 0; i < 4; i++) sum_b += array_b[i];

int average_b = sum_b / 4;

The two loops can be rewritten as the single function:int calc_average_of_four(int* array)

or, usually preferably, by parameterising the number of elements in the array.

Using the above function will give source code that has no loop duplication:extern int array1[];extern int array2[];

int average1 = calc_average_of_four(array1);int average2 = calc_average_of_four(array2);

Note that in this trivial case, the compiler may choose to inline both calls to the function, such that the resulting machine code is identical for both the duplicated and non-duplicated examples above. If the function is not inlined, then the additional overhead of the function calls will probably take longer to run (on the order of 10 processor instructions for most high-performance languages). Theoretically, this additional time to run could matter.

See also

External links

Notes and References

  1. Web site: The Bad Code Spotter's Guide. InformIT.com. 2008-06-06. Diomidis. Spinellis.
  2. https://www.cqse.eu/publications/2010-code-similarities-beyond-copy-paste.pdf Code similarities beyond copy & paste
  3. Li. Hongzhe. Kwon. Hyuckmin. Kwon. Jonghoon. Lee. Heejo. CLORIFI: software vulnerability discovery using code clone verification. Concurrency and Computation: Practice and Experience. 25 April 2016. 28. 6. 1900–1917. 10.1002/cpe.3532. 17363758.
  4. Arcelli Fontana. Francesca. Zanoni. Marco. Ranchetti. Andrea. Ranchetti. Davide. Software Clone Detection and Refactoring. ISRN Software Engineering. 2013. 2013. 1–8. 10.1155/2013/129437. free.
  5. Kapser, C.; Godfrey, M.W., ""Cloning Considered Harmful" Considered Harmful," 13th Working Conference on Reverse Engineering (WCRE), pp. 19-28, Oct. 2006
  6. Book: Wagner. Stefan. Abdulkhaleq. Asim. Kaya. Kamer. Paar. Alexander. 2016 IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER) . On the Relationship of Inconsistent Software Clones and Faults: An Empirical Study . 2016. http://elib.uni-stuttgart.de/opus/volltexte/2016/10526/. 79–89. 10.1109/SANER.2016.94. 1611.08005. 978-1-5090-1855-0. 3154845.
  7. [Brenda Baker|Brenda S. Baker]
  8. Ira D. Baxter, et al. Clone Detection Using Abstract Syntax Trees
  9. http://www.iam.unibe.ch/~scg/Archive/Papers/Rieg98aEcoopWorkshop.pdf Visual Detection of Duplicated Code
  10. Yuan, Y. and Guo, Y. CMCD: Count Matrix Based Code Clone Detection, in 2011 18th Asia-Pacific Software Engineering Conference. IEEE, Dec. 2011, pp. 250–257.
  11. Chen, X., Wang, A. Y., & Tempero, E. D. (2014). A Replication and Reproduction of Code Clone Detection Studies. In ACSC (pp. 105-114).
  12. Bulychev, Peter, and Marius Minea. "Duplicate code detection using anti-unification." Proceedings of the Spring/Summer Young Researchers’ Colloquium on Software Engineering. No. 2. Федеральное государственное бюджетное учреждение науки Институт системного программирования Российской академии наук, 2008.