The 2025 ACM GECCO Impact Award: General Program Synthesis Benchmark Suite

Key Points

• The aim is to establish standardized benchmarks for the field of general program synthesis.
• Review of existing approaches to benchmarking in genetic programming.
• Identification of gaps in current benchmarking methods for general program synthesis.
• Development of a benchmark suite targeting the effectiveness of various synthesis techniques.
• No standardized benchmarks for general program synthesis have been established previously.
• Improved methodologies for benchmarking in specialized areas have highlighted the need for broader applications.
• This initiative aims to propel advancements in automated program generation for future applications.

Abstract