White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Analyzing heuristic performance with response surface models: prediction, optimization and robustness

Ridge, E. and Kudenko, D. (2007) Analyzing heuristic performance with response surface models: prediction, optimization and robustness. In: Proceedings of the 9th Annual Genetic and Evolutionary Computation Conference. GECCO 2007, July 07 - 11, 2007, London, England. , pp. 150-157.

Full text not available from this repository.


This research uses a Design of Experiments (DOE) approach to build a predictive model of the performance of a combinatorial optimization heuristic over a range of heuristic tuning parameter settings and problem instance characteristics. The heuristic is Ant Colony System (ACS) for the Travelling Salesperson Problem. 10 heurstic tuning parameters and 2 problem characteristics are considered. Response Surface Models (RSM) of the solution quality and solution time predicted ACS performance on both new instances from a publicly available problem generator and new real-world instances from the TSPLIB benchmark library. A numerical optimisation of the RSMs is used to find the tuning parameter settings that yield optimal performance in terms of solution quality and solution time. This paper is the first use of desirability functions, a well-established technique in DOE, to simultaneously optimise these conflicting goals. Finally, overlay plots are used to examine the robustness of the performance of the optimised heuristic across a range of problem instance characteristics. These plots give predictions on the range of problem instances for which a given solutionquality can be expected within a given solution time.

Item Type: Proceedings Paper
Institution: The University of York
Academic Units: The University of York > Computer Science (York)
Depositing User: York RAE Import
Date Deposited: 08 Apr 2009 15:52
Last Modified: 08 Apr 2009 15:52
Published Version: http://dx.doi.org/10.1145/1276958.1276979
Status: Published
Identification Number: 10.1145/1276958.1276979
URI: http://eprints.whiterose.ac.uk/id/eprint/6170

Actions (repository staff only: login required)