The code to the preprint https://www.biorxiv.org/content/10.1101/2023.07.19.549677v1. Python was used for the model, performance assessment and data generation. R was used for scripting and data visualisation. All input data for the R scripts are separately provided, so that the data-intense and more intense computational steps do not have to be repeated. For the Python code, the folder finetuning_tasks has to be combined after decompression. It had to be split into four folders due to uploading problems. A tutorial on how to use GROVER as a foundation model can be found at: https://doi.org/10.5281/zenodo.8373159 The pretrained model can be found at: https://doi.org/10.5281/zenodo.8373117 The data for the tokenised genome are at: https://doi.org/10.5281/zenodo.8373053