Better GP benchmarks: community survey results and proposals
Name
10710_2012_Article_9177.pdf
Size
785.6 KB
Format
Adobe PDF
Checksum (MD5)
b06242c172599a1b82371f1dd589d0a9
Author(s) • • • • • • • •
McDermott, James
Castelli, Mauro
Manzoni, Luca
Kronberger, Gabriel
Jaśkowski, Wojciech
Luke, Sean
White, David R.
Goldman, Brian W.
O'Reilly, Una-May
Date Issued
December 2012
Journal
Genetic Programming and Evolvable Machines
Publisher
Springer US
Citation
White, David R. et al. “Better GP Benchmarks: Community Survey Results and Proposals.” Genetic Programming and Evolvable Machines 14.1 (2013): 3–29.
Version
Author's final manuscript
Abstract
We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a “blacklist” of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1007/s10710-012-9177-2