Duplicate code

Duplicate code is a computer programming term for a sequence of source code that occurs more than once, either within a program or across different programs owned or maintained by the same entity. Duplicate code is generally considered undesirable for a number of reasons.^[1] A minimum requirement is usually applied to the quantity of code that must appear in a sequence for it to be considered duplicate rather than coincidentally similar. Sequences of duplicate code are sometimes known as code clones or just clones, the automated process of finding duplications in source code is called clone detection.

The following are some of the ways in which two code sequences can be duplicates of each other:

character-for-character identical
character-for-character identical with white space characters and comments being ignored
token-for-token identical (see Token (parser) for details)
token-for-token identical with occasional variation (i.e., insertion/deletion/modification of tokens)
functionally identical

How duplicates are created

There are a number of reasons why duplicate code may be created, including:

Copy and paste programming, or scrounging, in which a section of code is copied "because it works". In most cases this operation involves slight modifications in the cloned code such as renaming variables or inserting/deleting code. The language nearly always provides facilities to allow one copy of the code to serve multiple purposes, but a copy is created due to the programmer not truly knowing the language, not having the time to do it properly, or not caring about the increased active software rot.
Functionality that is very similar to that in another part of a program is required and a developer independently writes code that is very similar to what exists elsewhere. Studies suggest, that such independently rewritten code is typically not syntactically similar.^[2]^[3]
Plagiarism, where code is simply copied without permission or attribution.
Generated code, where having duplicate code may be desired to increase speed or ease of development. Note that the actual generator will not contain duplicates in its source code, only the output it produces.

https://www.researchgate.net/publication/305992168_Clones_Clustering_Using_K-Means?ev=prf_pub

Problems associated with duplicate code

Inappropriate code duplication generally makes editing more difficult due to unnecessary increases in complexity and length. This may lead to increased maintenance costs, more human error, forgotten or overlooked pieces of code, greater file size and may be indicative of a sloppy design. Small differences between clones can be indications of missed fault fixes leading to the hypothesis that such clones are related to faults. This, however, is still debated in the scientific community. Probably, there are further factors, such as the developers' awareness of clones, which play a role in this relationship.^[4] Appropriate code duplication may occur for many reasons, including facilitating the development of a device driver for a device that is similar to some existing device ^[5]

Detecting duplicate code

A number of different algorithms have been proposed to detect duplicate code. For example:

Baker's algorithm.^[6]
Rabin–Karp string search algorithm.
Using Abstract Syntax Trees.^[7]
Visual clone detection.^[8]
Count Matrix Clone Detection.^[9]^[10]

Example of functionally duplicate code

Consider the following code snippet for calculating the average of an array of integers

extern int array_a[];
extern int array_b[];
 
int sum_a = 0;

for (int i = 0; i < 4; i++)
   sum_a += array_a[i];

int average_a = sum_a / 4;
 
int sum_b = 0;

for (int i = 0; i < 4; i++)
   sum_b += array_b[i];

int average_b = sum_b / 4;

The two loops can be rewritten as the single function:

int calc_average_of_four(int* array) {
   int sum = 0;
   for (int i = 0; i < 4; i++)
       sum += array[i];

   return sum / 4;
}

Using the above function will give source code that has no loop duplication:

extern int array1[];
extern int array2[];

int average1 = calcAverage(array1);
int average2 = calcAverage(array2);

Note that in this trivial case, the compiler may choose to inline both calls to the function, such that the resulting machine code is identical for both the duplicated and non-duplicated examples above. If the function is not inlined, then the additional overhead of the function calls will probably take longer to run (on the order of 10 processor instructions for most high-performance languages). This additional could theoretically be a problem.

References

↑ Spinellis, Diomidis. "The Bad Code Spotter's Guide". InformIT.com. Retrieved 2008-06-06.
↑ Code similarities beyond copy & paste by Elmar Juergens, Florian Deissenboeck, Benjamin Hummel.
↑ Stefan Wagner, Asim Abdulkhaleq, Ivan Bogicevic, Jan-Peter Ostberg, Jasmin Ramadani. How are functionally similar code clones syntactically different? An empirical study and a benchmark PeerJ Computer Science 2:e49. doi:10.7717/peerj-cs.49
↑ Wagner, Stefan; Abdulkhaleq, Asim; Kaya, Kamer; Paar, Alexander (2016). "On the relationship of inconsistent software clones and faults: an empirical study". Proc. 23rd IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER 2016).
↑ Kapser, C.; Godfrey, M.W., ""Cloning Considered Harmful" Considered Harmful," 13th Working Conference on Reverse Engineering (WCRE), pp. 19-28, Oct. 2006
↑ Brenda S. Baker. A Program for Identifying Duplicated Code. Computing Science and Statistics, 24:49–57, 1992.
↑ Ira D. Baxter, et al. Clone Detection Using Abstract Syntax Trees
↑ Visual Detection of Duplicated Code by Matthias Rieger, Stephane Ducasse.
↑ Yuan, Y. and Guo, Y. CMCD: Count Matrix Based Code Clone Detection, in 2011 18th Asia-Pacific Software Engineering Conference. IEEE, Dec. 2011, pp. 250–257.
↑ Chen, X., Wang, A. Y., & Tempero, E. D. (2014). A Replication and Reproduction of Code Clone Detection Studies. In ACSC (pp. 105-114).