Cuckoo search explained

In operations research, cuckoo search is an optimization algorithm developed by Xin-She Yang and Suash Debin 2009.[1] [2] It has been shown to be a special case of the well-known (μ + λ)-evolution strategy.[3] It was inspired by the obligate brood parasitism of some cuckoo species by laying their eggs in the nests of host birds of other species. Some host birds can engage direct conflict with the intruding cuckoos. For example, if a host bird discovers the eggs are not their own, it will either throw these alien eggs away or simply abandon its nest and build a new nest elsewhere. Some cuckoo species such as the New World brood-parasitic Tapera have evolved in such a way that female parasitic cuckoos are often very specialized in the mimicry in colors and pattern of the eggs of a few chosen host species.[4] Cuckoo search idealized such breeding behavior, and thus can be applied for various optimization problems.

Metaphor

Cuckoo search (CS) uses the following representations:

Each egg in a nest represents a solution, and a cuckoo egg represents a new solution. The aim is to use the new and potentially better solutions (cuckoos) to replace a not-so-good solution in the nests. In the simplest form, each nest has one egg. The algorithm can be extended to more complicated cases in which each nest has multiple eggs representing a set of solutions.

CS is based on three idealized rules:

  1. Each cuckoo lays one egg at a time, and dumps its egg in a randomly chosen nest;
  2. The best nests with high quality of eggs will carry over to the next generation;
  3. The number of available hosts nests is fixed, and the egg laid by a cuckoo is discovered by the host bird with a probability

pa\in(0,1)

. In this case, the host bird can throw the egg away/abandon the nest, and build a completely new nest.

In addition, Yang and Deb discovered that the random-walk style search is better performed by Lévy flights rather than simple random walk.

Algorithm

The pseudo-code can be summarized as:

Objective function:

f(x),x=(x1,x2,...,xd);

Generate an initial population of

n

host nests; While (t

Fi

[For maximization, <math>F_i \propto f(\mathbf{x}_i)</math> ]; Choose a nest among n (say, j) randomly; if (

Fi>Fj

), Replace j by the new solution; end if A fraction (

pa

) of the worse nests are abandoned and new ones are built; Keep the best solutions/nests; Rank the solutions/nests and find the current best; Pass the current best solutions to the next generation; end while

An important advantage of this algorithm is its simplicity. In fact, comparing with other population- or agent-based metaheuristic algorithms such as particle swarm optimization and harmony search, there is essentially only a single parameter

pa

in CS (apart from the population size

n

). Therefore, it is very easy to implement.

Random walks and the step size

An important issue is the applications of Lévy flights and random walks in the generic equation for generating new solutions

xt+1=xt+sEt,

where

Et

is drawn from a standard normal distribution with zero mean and unity standard deviation for random walks, or drawn from Lévy distribution for Lévy flights. Obviously, the random walks can also be linked with the similarity between a cuckoo's egg and the host's egg which can be tricky in implementation. Here the step size

s

determines how far a random walker can go for a fixed number of iterations. The generation of Lévy step size is often tricky, and a comparison of three algorithms (including Mantegna's[5]) was performed by Leccardi[6] who found an implementation of Chambers et al.'s approach[7] to be the most computationally efficient due to the low number of random numbers required.

If s is too large, then the new solution generated will be too far away from the old solution (or even jump outside of the bounds). Then, such a move is unlikely to be accepted. If s is too small, the change is too small to be significant, and consequently such search is not efficient. So a proper step size is important to maintain the search as efficient as possible.

As an example, for simple isotropic random walks, we know that the average distance

r

traveled in the d-dimension space is

r2=2dDt,

where

D=s2/2\tau

is the effective diffusion coefficient. Here

s

is the step size or distance traveled at each jump, and

\tau

is the time taken for each jump. The above equation implies that[8]
2=\taur2
td
s

.

For a typical length scale L of a dimension of interest, the local search is typically limited in a region of

r=L/10

. For

\tau=1

and t=100 to 1000, we have

s0.01L

for d=1, and

s0.001L

for d=10. Therefore, we can use s/L=0.001 to 0.01 for most problems. Though the exact derivation may require detailed analysis of the behaviour of Lévy flights.[9]

Algorithm and convergence analysis will be fruitful, because there are many open problems related to metaheuristics[10]

Theoretical analysis

As significant efforts, theoretical analyses are required to improve performances of CS-base algorithms:[11]

  1. Theoretical analysis on convergence of CS-based algorithms
  2. Providing the sufficient and necessary conditions for the control parameter settings
  3. Employing non-homogeneous search rules to enhance the classical CS algorithm

Improved Cuckoo Search Algorithms

Convergence of Cuckoo Search algorithm can be substantially improved by genetically replacing abandoned nests (instead of using the random replacements from the original method).[12] Modifications to the algorithm have also been made by additional interbreeding of best (high quality) nests [13] and this approach has been successfully applied to a range of industrial optimisation problems.[14] [15]

Notes and References

  1. Cuckoo search via Lévy flights. X.-S. Yang. S. Deb. December 2009. World Congress on Nature & Biologically Inspired Computing (NaBIC 2009). IEEE Publications. 210–214. 1003.1594v1 .
  2. Web site: Inderscience . Cuckoo designs spring . Alphagalileo.org . 27 May 2010 . 2010-05-27 . 2010-06-29 . https://web.archive.org/web/20100629063837/http://www.alphagalileo.org/ViewItem.aspx?ItemId=76985&CultureCode=en . dead .
  3. Camacho Villalón . C.L. . Stützle . T. . Dorigo . M. . Cuckoo Search ≡ (μ + λ)–Evolution Strategy . March 2021 . 2 July 2021.
  4. R. B. Payne, M. D. Sorenson, and K. Klitz, The Cuckoos, Oxford University Press, (2005).
  5. R. N. Mantegna, Fast, accurate algorithm for numerical simulation of Lévy stable stochastic processes, Physical Review E, Vol.49, 4677-4683 (1994).
  6. M. Leccardi, Comparison of three algorithms for Levy noise generation, Proceedings of fifth EUROMECH nonlinear dynamics conference (2005).
  7. Chambers . J. M. . Mallows . C. L. . Stuck . B. W. . 1976 . A method for simulating stable random variables . Journal of the American Statistical Association . 71 . 354 . 340–344 . 10.1080/01621459.1976.10480344.
  8. X.-S. Yang, Nature-Inspired Metaheuristic Algorithms, 2nd Edition, Luniver Press, (2010).
  9. M. Gutowski, Lévy flights as an underlying mechanism for global optimization algorithms, ArXiv Mathematical Physics e-Prints, June, (2001).
  10. X. S. Yang, Metaheuristic optimization: algorithm analysis and open problems, in: Experimental Algorithms (SEA2011), Eds (P. M. Pardalos and S. Rebennack), LNCS 6630, pp.21-32 (2011).
  11. Cheung. N. J.. Ding. X.. Shen. H.. 2016-01-21. A Nonhomogeneous Cuckoo Search Algorithm Based on Quantum Mechanism for Real Parameter Optimization. IEEE Transactions on Cybernetics. 47. 2. 391–402. 10.1109/TCYB.2016.2517140. 26812745. 7706150.
  12. de Oliveira. Victoria Y.M.. de Oliveira. Rodrigo M.S.. Affonso. Carolina M.. 2018-07-31. Cuckoo Search approach enhanced with genetic replacement of abandoned nests applied to optimal allocation of distributed generation units. IET Generation, Transmission & Distribution. 12. 13. 3353–3362. 10.1049/iet-gtd.2017.1992. 1751-8687. free.
  13. Walton. S.. Hassan. O.. Morgan. K.. Brown. M. R.. 2011-09-01. Modified cuckoo search: A new gradient free optimisation algorithm. Chaos, Solitons & Fractals. en. 44. 9. 710–718. 10.1016/j.chaos.2011.06.004. 2011CSF....44..710W . 0960-0779.
  14. 2016-04-01. A novel implementation of computational aerodynamic shape optimisation using Modified Cuckoo Search. Applied Mathematical Modelling. en. 40. 7–8. 4543–4559. 10.1016/j.apm.2015.11.023. 0307-904X. free. Naumann. D.S.. Evans. B.. Walton. S.. Hassan. O..
  15. Zhao. J.. Liu. S.. Zhou. M.. Guo. X.. Qi. L.. July 2018. Modified cuckoo search algorithm to solve economic power dispatch optimization problems. IEEE/CAA Journal of Automatica Sinica. 5. 4. 794–806. 10.1109/JAS.2018.7511138. 46935795. 2329-9274.