Prototype implementation of tools for the Simulation System of the CTA Observatory. This is an intermediate development release with significant refactoring in the handling and reading of parameters from the DB. What's Changed Bump codecov/codecov-action from 3 to 4 by @dependabot in https://github.com/gammasim/simtools/pull/800 Add 2024, Feb 5 simtel version by @GernotMaier in https://github.com/gammasim/simtools/pull/803 Add CI for daily backups of the simulation model DB by @GernotMaier in https://github.com/gammasim/simtools/pull/805 Performance improvements by @GernotMaier in https://github.com/gammasim/simtools/pull/810 Failing linters by @GernotMaier in https://github.com/gammasim/simtools/pull/809 Add application to add a new parameter to the database from a json file by @GernotMaier in https://github.com/gammasim/simtools/pull/807 Fix failing raytracing unit test by @GernotMaier in https://github.com/gammasim/simtools/pull/819 Add pytest profiling to developer enviroment by @GernotMaier in https://github.com/gammasim/simtools/pull/815 fix environment name by @GernotMaier in https://github.com/gammasim/simtools/pull/821 Unit tests profiling by @GernotMaier in https://github.com/gammasim/simtools/pull/822 Unit vs units change in data metaschema by @GernotMaier in https://github.com/gammasim/simtools/pull/814 New simulation model by @GernotMaier in https://github.com/gammasim/simtools/pull/761 Address conda warning about pip by @GernotMaier in https://github.com/gammasim/simtools/pull/831 Re enable camera efficiency and ray tracing tests; files from test-data by @GernotMaier in https://github.com/gammasim/simtools/pull/827 Add pytest repeat to find dependencies between unit tests by @GernotMaier in https://github.com/gammasim/simtools/pull/833 Add -n auto options to pytest CI by @GernotMaier in https://github.com/gammasim/simtools/pull/832 Fixes broken container generation for new simulation model by @GernotMaier in https://github.com/gammasim/simtools/pull/826 Add application to import model parameters from simtel configuration file by @GernotMaier in https://github.com/gammasim/simtools/pull/824 Updated array elements naming and re-organisation of simulation model by @GernotMaier in https://github.com/gammasim/simtools/pull/830 Add readme hint for cloning of model_parameters repository by @GernotMaier in https://github.com/gammasim/simtools/pull/840 Allow to push packages for manual workflow by @GernotMaier in https://github.com/gammasim/simtools/pull/838 Improvements to model parameter schema validation by @GernotMaier in https://github.com/gammasim/simtools/pull/836 Add pip upgrade to prod docker file by @GernotMaier in https://github.com/gammasim/simtools/pull/841 Simplify file naming in names.py by @GernotMaier in https://github.com/gammasim/simtools/pull/835 Updates to get correct site and default values into DB by @GernotMaier in https://github.com/gammasim/simtools/pull/842 Update of to simtel / corsika package with date 240318 by @GernotMaier in https://github.com/gammasim/simtools/pull/844 Simplify application to add values to DB from json file; move to main application directory by @GernotMaier in https://github.com/gammasim/simtools/pull/843 Changes required for adding prod6 model to database by @GernotMaier in https://github.com/gammasim/simtools/pull/847 No need of test-data DB, as files are now in tests/resources by @GernotMaier in https://github.com/gammasim/simtools/pull/856 add Calibration by @tobiaskleiner in https://github.com/gammasim/simtools/pull/859 Add all files in a directory to database by @GernotMaier in https://github.com/gammasim/simtools/pull/854 fix boost-histogram by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/849 Add codespell to pre-commit and apply it to files by @GernotMaier in https://github.com/gammasim/simtools/pull/855 add illuminator to instrument by @tobiaskleiner in https://github.com/gammasim/simtools/pull/862 Remove python 3.9 and add 3.12 from CI workflow by @GernotMaier in https://github.com/gammasim/simtools/pull/860 Use astropy units in jsonschema validation by @GernotMaier in https://github.com/gammasim/simtools/pull/864 Add validation of parameter name to be consistent with file name for for model_parameter files by @GernotMaier in https://github.com/gammasim/simtools/pull/865 Address sluggish startup of tools - replace astropy.io.misc.yaml by plain yaml by @GernotMaier in https://github.com/gammasim/simtools/pull/813 Units with spaces by @GernotMaier in https://github.com/gammasim/simtools/pull/866 Fix url to unit test by @GernotMaier in https://github.com/gammasim/simtools/pull/867 Simple changes to accelerate integration tests. by @GernotMaier in https://github.com/gammasim/simtools/pull/868 allow to add to calibration_devices by @tobiaskleiner in https://github.com/gammasim/simtools/pull/870 drop sandboxes by @tobiaskleiner in https://github.com/gammasim/simtools/pull/872 Reduce number of calls to DB pass plus some maintenance in db_handler by @GernotMaier in https://github.com/gammasim/simtools/pull/869 Generate docker files for different corsika/sim_telarray versions by @GernotMaier in https://github.com/gammasim/simtools/pull/876 Add unix find to development docker by @GernotMaier in https://github.com/gammasim/simtools/pull/884 Allow model_version command line configuration of integration tests by @GernotMaier in https://github.com/gammasim/simtools/pull/878 Add an application to upload all files from a model parameter repo into a new data base by @GernotMaier in https://github.com/gammasim/simtools/pull/885 Bug fix: drop metadata collection after tests by @GernotMaier in https://github.com/gammasim/simtools/pull/888 update docker documentation by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/891 Re-enable docker images for arm64 architectures by @GernotMaier in https://github.com/gammasim/simtools/pull/877 Unify array elements in names.py and json schema by @GernotMaier in https://github.com/gammasim/simtools/pull/889 Name of simulation model database as configuration entry by @GernotMaier in https://github.com/gammasim/simtools/pull/893 Move model parameter schemas from gitlab into simtools by @GernotMaier in https://github.com/gammasim/simtools/pull/894 CI schema validation by @GernotMaier in https://github.com/gammasim/simtools/pull/897 remove if statement -> return testing all the output files in integra… by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/887 Housekeeping: pylint and location of schema files by @GernotMaier in https://github.com/gammasim/simtools/pull/898 Integrate and use model parameter schema to determine sim_telarray and CORSIKA parameters by @GernotMaier in https://github.com/gammasim/simtools/pull/895 python 311 in pyproject.tom by @GernotMaier in https://github.com/gammasim/simtools/pull/904 Add a simtools-simulate-prod integration test for the South site by @GernotMaier in https://github.com/gammasim/simtools/pull/883 Set schema paths using importlib by @GernotMaier in https://github.com/gammasim/simtools/pull/905 Documentation maintenance updates by @GernotMaier in https://github.com/gammasim/simtools/pull/900 More integration tests by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/906 Simulate prod test by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/875 Improve import efficiency for UnitsErrors by @GernotMaier in https://github.com/gammasim/simtools/pull/909 Separate plot_camera from camera module by @GernotMaier in https://github.com/gammasim/simtools/pull/907 Ci pylint fixes by @tobiaskleiner in https://github.com/gammasim/simtools/pull/914 Integrate light emission by @tobiaskleiner in https://github.com/gammasim/simtools/pull/802 Allow to trigger CI (especially tests) by hand. by @GernotMaier in https://github.com/gammasim/simtools/pull/920 Run pre-commit as CI by @GernotMaier in https://github.com/gammasim/simtools/pull/913 Add metaschema and tests for integration tests config files by @GernotMaier in https://github.com/gammasim/simtools/pull/922 Unit tests in random order to make sure that unit tests are independent of each other by @GernotMaier in https://github.com/gammasim/simtools/pull/921 Trigger rate module and application by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/801 Add telescope positions to database and improve ArrayModel by @GernotMaier in https://github.com/gammasim/simtools/pull/910 Add docker readme to general documentation by @GernotMaier in https://github.com/gammasim/simtools/pull/930 Trigger rate stacked files by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/935 Read site names from list of array elements by @GernotMaier in https://github.com/gammasim/simtools/pull/928 Read simulation model versions from DB by @GernotMaier in https://github.com/gammasim/simtools/pull/927 Add pre-commit hook to avoid large files updates by @GernotMaier in https://github.com/gammasim/simtools/pull/939 Step 1 of ruff integration: auto fixes by @GernotMaier in https://github.com/gammasim/simtools/pull/938 Step 2 of ruff integration: fix issues by @GernotMaier in https://github.com/gammasim/simtools/pull/941 Step 3 of ruff integration: add ruff to CI (plus cleanup of different linter stages) by @GernotMaier in https://github.com/gammasim/simtools/pull/943 Add a section on model parameters to the documentation by @GernotMaier in https://github.com/gammasim/simtools/pull/932 Documentation switch to markdown by @GernotMaier in https://github.com/gammasim/simtools/pull/940 Markdown badges by @GernotMaier in https://github.com/gammasim/simtools/pull/946 Add output_path to integration tests with file checks by @GernotMaier in https://github.com/gammasim/simtools/pull/948 Prod5 telescope positions by @GernotMaier in https://github.com/gammasim/simtools/pull/949 Add most recent simulation db name to env template by @GernotMaier in https://github.com/gammasim/simtools/pull/951 Replace ArrayLayout by ArrayModel for retrieving telescope positions in light emission package by @GernotMaier in https://github.com/gammasim/simtools/pull/950 Re-enable pylint in precommit by @GernotMaier in https://github.com/gammasim/simtools/pull/952 Extract telescope positions from DB by @GernotMaier in https://github.com/gammasim/simtools/pull/947 Disable fail fast for integration tests by @GernotMaier in https://github.com/gammasim/simtools/pull/954 First version of CTAO DPPS sonarqube workflow by @GernotMaier in https://github.com/gammasim/simtools/pull/957 Allow for local database connection by @GernotMaier in https://github.com/gammasim/simtools/pull/962 Remove obsolete ArrayLayout.remove_from_array_layout_name by @GernotMaier in https://github.com/gammasim/simtools/pull/960 Remove files in data/layout directory by @GernotMaier in https://github.com/gammasim/simtools/pull/959 Refactor light emission by @tobiaskleiner in https://github.com/gammasim/simtools/pull/958 Rename and move db-model parameters from db to main application directory by @GernotMaier in https://github.com/gammasim/simtools/pull/965 Add application to extract a layout using telescope positions stored in the DB by @GernotMaier in https://github.com/gammasim/simtools/pull/971 Run a local mongo DB instance by @GernotMaier in https://github.com/gammasim/simtools/pull/963 Database documentation by @GernotMaier in https://github.com/gammasim/simtools/pull/974 Removed (and checked) a TODO in simtel config writer; fixed one pylint report by @GernotMaier in https://github.com/gammasim/simtools/pull/973 Improved naming of simtel modules plus docstring ruff formatting. by @GernotMaier in https://github.com/gammasim/simtools/pull/976 Update simulation_software.md by @tobiaskleiner in https://github.com/gammasim/simtools/pull/979 Sonarqube fixes by @tobiaskleiner in https://github.com/gammasim/simtools/pull/969 remove old application from pyproject by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/980 Fix complexity issue in simtel_config_writer and add unit test by @GernotMaier in https://github.com/gammasim/simtools/pull/977 Improved naming of applications and get vs export by @GernotMaier in https://github.com/gammasim/simtools/pull/966 Add a small tool to inspect databases by @GernotMaier in https://github.com/gammasim/simtools/pull/967 improve docstring by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/988 Fix sonar-reported bug in validate_data by @GernotMaier in https://github.com/gammasim/simtools/pull/984 Improve position coordinate transformation and add json reader / writer by @GernotMaier in https://github.com/gammasim/simtools/pull/968 improve guidelines for testing by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/991 update ruff by @tobiaskleiner in https://github.com/gammasim/simtools/pull/995 Bump docker/build-push-action from 5 to 6 by @dependabot in https://github.com/gammasim/simtools/pull/994 refactor complex functions by @tobiaskleiner in https://github.com/gammasim/simtools/pull/975 Docstring applications commands by @tobiaskleiner in https://github.com/gammasim/simtools/pull/990 Parse function by @tobiaskleiner in https://github.com/gammasim/simtools/pull/996 Fix sonarq run warnings by @GernotMaier in https://github.com/gammasim/simtools/pull/997 adjust arguments legends_handler by @tobiaskleiner in https://github.com/gammasim/simtools/pull/998 update plot_pixel_layout by @tobiaskleiner in https://github.com/gammasim/simtools/pull/999 explicity include for coverage in sonar by @GernotMaier in https://github.com/gammasim/simtools/pull/1003 No coverage on tests, but still checking for issues. by @GernotMaier in https://github.com/gammasim/simtools/pull/1004 Allow hist file into trigger rate application by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/1000 update to 3.11 by @tobiaskleiner in https://github.com/gammasim/simtools/pull/1006 Step 1 of ruff fixes: autofixes by @GernotMaier in https://github.com/gammasim/simtools/pull/1008 Fix two sonar issues "Refactor this method to not always return the same value." by @GernotMaier in https://github.com/gammasim/simtools/pull/1020 Step 2 of ruff fixes: unsafe auto fixes by @GernotMaier in https://github.com/gammasim/simtools/pull/1009 Step 3 of fuff fixes: Fix D205 by @GernotMaier in https://github.com/gammasim/simtools/pull/1010 Step 4 of ruff fixes: Fix D401 by @GernotMaier in https://github.com/gammasim/simtools/pull/1011 Step 5 of ruff fixes: D404 - docstrings should not start with "This" by @GernotMaier in https://github.com/gammasim/simtools/pull/1012 Step 6 of ruff fixes: D100 no docstring in public module by @GernotMaier in https://github.com/gammasim/simtools/pull/1013 Step 7 of ruff fixes: D102 missing docstring in public method by @GernotMaier in https://github.com/gammasim/simtools/pull/1014 Step 8 of ruff fixes: D103 missing docstring in public function by @GernotMaier in https://github.com/gammasim/simtools/pull/1015 Step 9 of ruff fixes: check return statements by @GernotMaier in https://github.com/gammasim/simtools/pull/1016 Step 11 of ruff fixes: apply them to unit tests by @GernotMaier in https://github.com/gammasim/simtools/pull/1018 Step 10 of ruff fixes: ruff list comprehension by @GernotMaier in https://github.com/gammasim/simtools/pull/1017 adding docstrings by @tobiaskleiner in https://github.com/gammasim/simtools/pull/1002 Micro-fix: single line docstring by @GernotMaier in https://github.com/gammasim/simtools/pull/1024 Tidying documentation into sections by @GernotMaier in https://github.com/gammasim/simtools/pull/1019 Improvements to simulate for trigger rate by @VictorBarbosaMartins in https://github.com/gammasim/simtools/pull/1007 Consistent naming of simtel_path by @GernotMaier in https://github.com/gammasim/simtools/pull/1022 Sync sonar properties with python project template by @GernotMaier in https://github.com/gammasim/simtools/pull/1025 Improve simulation configuration for corsika and simtel simulations. by @GernotMaier in https://github.com/gammasim/simtools/pull/1026 Use quantity pairs in calculate_trigger_rate.py by @GernotMaier in https://github.com/gammasim/simtools/pull/1027 Exclude main from coverage by @GernotMaier in https://github.com/gammasim/simtools/pull/1028 Remove useless self-assignment in tests/unit_tests/simtel/test_simulator_light_emission.py by @GernotMaier in https://github.com/gammasim/simtools/pull/1030 Apply simplifications and fixes to command line configuration. by @GernotMaier in https://github.com/gammasim/simtools/pull/1029 Improve documentation on testing and continuous integration by @GernotMaier in https://github.com/gammasim/simtools/pull/1031 Add docstrings to conftests by @GernotMaier in https://github.com/gammasim/simtools/pull/1033 Improve user documentation by @GernotMaier in https://github.com/gammasim/simtools/pull/1035 Refactor simulation tools configuration by @GernotMaier in https://github.com/gammasim/simtools/pull/989 Review and improve job submission module by @GernotMaier in https://github.com/gammasim/simtools/pull/1034 Generalize primary particle definition using scikit-hep/particle/ by @GernotMaier in https://github.com/gammasim/simtools/pull/1037 Re-introduce writing of file lists to simulate_prod by @GernotMaier in https://github.com/gammasim/simtools/pull/1039 Address sonar simple issues by @GernotMaier in https://github.com/gammasim/simtools/pull/1038 Prefer conda over pip for installation of particle by @GernotMaier in https://github.com/gammasim/simtools/pull/1041 Fix bug in validating dimensionless values by @GernotMaier in https://github.com/gammasim/simtools/pull/1043 Fix link to database section by @GernotMaier in https://github.com/gammasim/simtools/pull/1044 Add unix find to production image by @GernotMaier in https://github.com/gammasim/simtools/pull/1045 Fix sonar issues by @tobiaskleiner in https://github.com/gammasim/simtools/pull/1042 Remaining sonar issues by @GernotMaier in https://github.com/gammasim/simtools/pull/1047 fixes sonar issues by @tobiaskleiner in https://github.com/gammasim/simtools/pull/1052 Minor bug fix to allow to run db_add_model_parameters_from_repository_to_db with SIMTOOLS_DB_SIMULATION_MODEL defined by @GernotMaier in https://github.com/gammasim/simtools/pull/1046 Fix in database documentation; improve upload from repository by @GernotMaier in https://github.com/gammasim/simtools/pull/1053 Add corsika DB parameter schema by @GernotMaier in https://github.com/gammasim/simtools/pull/1057 Full Changelog: https://github.com/gammasim/simtools/compare/v0.6.1...v0.7.0

Please cite this software using these metadata.