On the Choice of the Update Strength in Estimation-of-Distribution Algorithms and Ant Colony Optimization

Dirk Sudholt*, Carsten Witt

*Corresponding author for this work

Research output: Contribution to journalJournal articleResearchpeer-review

343 Downloads (Pure)

Abstract

Probabilistic model-building Genetic Algorithms (PMBGAs) are a class of metaheuristics that evolve probability distributions favoring optimal solutions in the underlying search space by repeatedly sampling from the distribution and updating it according to promising samples. We provide a rigorous runtime analysis concerning the update strength, a vital parameter in PMBGAs such as the step size 1 / K in the so-called compact Genetic Algorithm (cGA) and the evaporation factor ρ in ant colony optimizers (ACO). While a large update strength is desirable for exploitation, there is a general trade-off: too strong updates can lead to unstable behavior and possibly poor performance. We demonstrate this trade-off for the cGA and a simple ACO algorithm on the well-known OneMax function. More precisely, we obtain lower bounds on the expected runtime of Ω(Kn+nlogn) and Ω(n/ρ+nlogn), respectively, suggesting that the update strength should be limited to 1/K,ρ=O(1/(nlogn)). In fact, choosing 1/K,ρ∼1/(nlogn) both algorithms efficiently optimize OneMax in expected time Θ(nlog n). Our analyses provide new insights into the stochastic behavior of PMBGAs and propose new guidelines for setting the update strength in global optimization.

Original languageEnglish
JournalAlgorithmica
Volume81
Issue number4
Pages (from-to)1450–1489
ISSN0178-4617
DOIs
Publication statusPublished - 1 Jan 2018

Keywords

  • Ant colony optimization
  • Estimation-of-distribution algorithms
  • Genetic Algorithms
  • Probabilistic model-building Genetic Algorithms
  • Runtime analysis
  • Theory of randomized search heuristics

Fingerprint

Dive into the research topics of 'On the Choice of the Update Strength in Estimation-of-Distribution Algorithms and Ant Colony Optimization'. Together they form a unique fingerprint.

Cite this