
ToMMY - web client and replication package This is the replication package for our study "What You Need is What You Get: Theory of Mind for an LLM-Based Code Comprehension Assistant", accepted at the NIER track of the International Conference on Software Maintenance and Evolution (ICSME), 2024. Files The package contains the following items: /analysis data: processed dataset clean-data.ipynb: data cleaning pipeline simulate-conversations.ipynb: light-weight evaluation of ToMMY user-study.ipynb: data analysis pipeline /screenshots: screenshots of the different screens encountered in the web client /task questions: quiz questions and answers for the code snippets snippets: code snippets and licenses design.ipynb: quiz question and answer creation pipeline design.json: config file detailing the tasks, models (agents), and participant groups /web api: backend of the web client client: frontend of the web client shared: type definitions shared between the backend/frontend The most noteworthy files are: /README.md: a description of the package, and an installation guide fo the web client /analysis/data: our dataset /analysis/simulate-conversations.ipynb: contains a Python implementation of ToMMY and the control approach /web/api/src/lib/agent.ts: contains a Javascript implementation of ToMMY and the control approach
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
