README Steps to reproduce the experiments / figures from the paper. First we need to setup the environment. Download and unzip the repository.zip. Create a new directory called output (for storing all results). You should now have the following directory structure: /iohxplainer/ (with .py files) /experiments/ /experiments/cma_es_AAC-notebook.ipynb /experiments/de_AAC-notebook.ipynb /experiments/*.py files /output/ /de_final_processed_new.pkl /cma_final_processed_new.pkl /ela-features-cma.pkl /ela-features-de.pkl /pyproject.toml /README.md /poetry.lock Make sure you have Poetry 1.7.1 (or higher) and Python 3.10 installed. Run `poetry install` in the root directory. (OPTIONAL!!!) Run all Modular DE or Modular CMA configurations using the (de|cma_es)_run-configurations.py file (in the experiments folder), this writes a pkl file as result. This step takes a month on a supercomputer with 120 cores. The processed results of this step are already available as the pkl files in this repository. (OPTIONAL, ONLY RUN IF YOU RUN STEP 6) Pre-process the pickle files with poetry run python experiments/(de|cma_es)_process_pkl.py. Analyse the performance data of all configurations using IOH-Xplainer poetry run python experiments/(de/cma_es)_analyze.py (Expected runtime=24 hours) Compare the two frameworks using poetry run pythonexperiments/compare_de_cma.py. Writes the result as latex file (compare-new.tex). (Expected runtime=1 hour) Perform automated algorithm configuration experiment using experiments/(de|cma_es)_AAC-notebook.ipynb files. (Expected runtime = 2 hours per file)