
Experimental studies are prevalent in Evolutionary Computation ( EC ), and concerns about the reproducibility and replicability of such studies have increased in recent times, reflecting similar concerns in other scientific fields. In this article, we discuss, within the context of EC, the different types of reproducibility and suggest a classification that refines the badge system of the Association of Computing Machinery ( ACM ) adopted by ACM Transactions on Evolutionary Learning and Optimization ( TELO ). We identify cultural and technical obstacles to reproducibility in the EC field. Finally, we provide guidelines and suggest tools that may help to overcome some of these reproducibility obstacles.
FOS: Computer and information sciences, Artificial Intelligence (cs.AI), TA, Computer Science - Artificial Intelligence, Optimization and Control (math.OC), FOS: Mathematics, Computer Science - Neural and Evolutionary Computing, Neural and Evolutionary Computing (cs.NE), Mathematics - Optimization and Control
FOS: Computer and information sciences, Artificial Intelligence (cs.AI), TA, Computer Science - Artificial Intelligence, Optimization and Control (math.OC), FOS: Mathematics, Computer Science - Neural and Evolutionary Computing, Neural and Evolutionary Computing (cs.NE), Mathematics - Optimization and Control
| citations This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 28 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
