# Evaluation of mergers ## Prerequisites The evaluation is expected to be running on a Unix-like system. We cannot guarantee that it works on windows. Complete the following steps: 1. Make sure both Java 8 and Java 11 are installed. 2. Fill in the paths to the Java executables in the `config.json`. 3. Make sure Python 3.6+ is installed. 4. Run `python3 -m pip install -r requirements.txt`. 5. Make sure Git is installed. 6. Make sure the following common utility commands are available: `time`, `timeout`, `diff`, `touch`, `mkdir`. ## Usage To run all mergers on `merge-scenarios`, simply run `python3 run.py`. See also `python3 run.py -h`. Some error messages may be shown when a merger fails on a merge scenario, which is the expected behavior. To summarize the results, run `python3 summarize.py`. See also `python3 summarize.py -h`. Note that IntelliMerge may not exit itself when it crashes, which will be reported as TIMEOUT instead of CRASHED.