Mutation Strength Adaptation of the $(μ/μ_I, λ)$-ES for Large Population Sizes on the Sphere Function
August 19, 2024 · Declared Dead · + Add venue
"No code URL or promise found in abstract"
Evidence collected by the PWNC Scanner
Authors
Amir Omeradzic, Hans-Georg Beyer
arXiv ID
2408.09761
Category
cs.NE: Neural & Evolutionary
Citations
0
Last Checked
4 months ago
Abstract
The mutation strength adaptation properties of a multi-recombinative $(μ/μ_I, λ)$-ES are studied for isotropic mutations. To this end, standard implementations of cumulative step-size adaptation (CSA) and mutative self-adaptation ($σ$SA) are investigated experimentally and theoretically by assuming large population sizes ($μ$) in relation to the search space dimensionality ($N$). The adaptation is characterized in terms of the scale-invariant mutation strength on the sphere in relation to its maximum achievable value for positive progress. %The results show how the different $σ$-adaptation variants behave as $μ$ and $N$ are varied. Standard CSA-variants show notably different adaptation properties and progress rates on the sphere, becoming slower or faster as $μ$ or $N$ are varied. This is shown by investigating common choices for the cumulation and damping parameters. Standard $σ$SA-variants (with default learning parameter settings) can achieve faster adaptation and larger progress rates compared to the CSA. However, it is shown how self-adaptation affects the progress rate levels negatively. Furthermore, differences regarding the adaptation and stability of $σ$SA with log-normal and normal mutation sampling are elaborated.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
📜 Similar Papers
In the same crypt — Neural & Evolutionary
🔮
🔮
The Ethereal
R.I.P.
👻
Ghosted
Deep Learning using Rectified Linear Units (ReLU)
R.I.P.
👻
Ghosted
Generative Adversarial Text to Image Synthesis
R.I.P.
👻
Ghosted
Regularized Evolution for Image Classifier Architecture Search
R.I.P.
👻
Ghosted
Temporal Ensembling for Semi-Supervised Learning
🌅
🌅
Old Age
Learning Structured Sparsity in Deep Neural Networks
Died the same way — 👻 Ghosted
R.I.P.
👻
Ghosted
Federated Learning: Strategies for Improving Communication Efficiency
R.I.P.
👻
Ghosted
In-Datacenter Performance Analysis of a Tensor Processing Unit
R.I.P.
👻
Ghosted
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning
R.I.P.
👻
Ghosted