Using Covariance Matrix Adaptation Evolutionary Strategy to boost the search accuracy in hierarchic memetic computations

Many global optimization problems arising naturally in science and engineering exhibit some form of intrinsic ill-posedness, such as multimodality and insensitivity. Severe ill-posedness precludes the use of standard regularization techniques and necessitates more specialized approaches, usually com...

Full description

Bibliographic Details
Authors: Sawicki, J.; Los, M.; Smolka, M.; Alvarez-Aramberri, J.
Format: Article
Status:Published version
Publication date:2019
Country:España
Institution:Basque Center for Applied Mathematics (BCAM)
Repository:BIRD. BCAM's Institutional Repository Data
OAI Identifier:oai:bird.bcamath.org:20.500.11824/994
Online Access:http://hdl.handle.net/20.500.11824/994
http://dx.doi.org/10.1016/j.jocs.2019.04.005
Access Level:Open access
Keyword:inverse problems
multi-objective optimization methods
memetic algorithms
ill-posed problems
Description
Summary:Many global optimization problems arising naturally in science and engineering exhibit some form of intrinsic ill-posedness, such as multimodality and insensitivity. Severe ill-posedness precludes the use of standard regularization techniques and necessitates more specialized approaches, usually comprised of two separate stages - global phase, that determines the problem's modality and provides rough approximations of the solutions, and a local phase, which re fines these approximations. In this work, we attempt to improve one of the most efficient currently known approaches - Hierarchic Memetic Strategy (HMS) - by incorporating the Covariance Matrix Adaptation Evolutionary Strategy (CMA-ES) into its local phase. CMA-ES is a stochastic optimization algorithm that in some sense mimics the behavior of population-based evolutionary algorithms without explicitly evolving the population. This way, it avoids, to an extent, the associated cost of multiple evaluations of the objective function. We compare the performance of the HMS on relatively simple multimodal benchmark problems and on an engineering problem. To do so, we consider two con gurations: the CMA-ES and the standard SEA (Simple Evolutionary Algorithm). The results demonstrate that the HMS with CMA-ES in the local phase requires less objective function evaluations to provide the same accuracy, making this approach more efficient than the standard SEA.