Comma Selection Outperforms Plus Selection on OneMax with Randomly Planted Optima
April 19, 2023 ยท Declared Dead ยท ๐ Algorithmica
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Joost Jorritsma, Johannes Lengler, Dirk Sudholt
arXiv ID
2304.09712
Category
cs.NE: Neural & Evolutionary
Citations
15
Venue
Algorithmica
Last Checked
4 months ago
Abstract
It is an ongoing debate whether and how comma selection in evolutionary algorithms helps to escape local optima. We propose a new benchmark function to investigate the benefits of comma selection: OneMax with randomly planted local optima, generated by frozen noise. We show that comma selection (the $(1,ฮป)$ EA) is faster than plus selection (the $(1+ฮป)$ EA) on this benchmark, in a fixed-target scenario, and for offspring population sizes $ฮป$ for which both algorithms behave differently. For certain parameters, the $(1,ฮป)$ EA finds the target in $ฮ(n \ln n)$ evaluations, with high probability (w.h.p.), while the $(1+ฮป)$ EA) w.h.p. requires almost $ฮ((n\ln n)^2)$ evaluations. We further show that the advantage of comma selection is not arbitrarily large: w.h.p. comma selection outperforms plus selection at most by a factor of $O(n \ln n)$ for most reasonable parameter choices. We develop novel methods for analysing frozen noise and give powerful and general fixed-target results with tail bounds that are of independent interest.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ Neural & Evolutionary
๐ฎ
๐ฎ
The Ethereal
R.I.P.
๐ป
Ghosted
Deep Learning using Rectified Linear Units (ReLU)
R.I.P.
๐ป
Ghosted
Generative Adversarial Text to Image Synthesis
R.I.P.
๐ป
Ghosted
Regularized Evolution for Image Classifier Architecture Search
R.I.P.
๐ป
Ghosted
Temporal Ensembling for Semi-Supervised Learning
๐
๐
Old Age
Learning Structured Sparsity in Deep Neural Networks
Died the same way โ ๐ป Ghosted
R.I.P.
๐ป
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
๐ป
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
๐ป
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
๐ป
Ghosted