Downloads provided by UsageCounts
arXiv: 2304.10265
handle: 2117/416527 , 20.500.14243/499633
Natural language processing (NLP) techniques have been widely applied in the requirements engineering (RE) field to support tasks such as classification and ambiguity detection. Despite its empirical vocation, RE research has given limited attention to replication of NLP for RE studies. Replication is hampered by several factors, including the context specificity of the studies, the heterogeneity of the tasks involving NLP, the tasks’ inherent hairiness , and, in turn, the heterogeneous reporting structure. To address these issues, we propose a new artifact, referred to as ID-Card , whose goal is to provide a structured summary of research papers emphasizing replication-relevant information. We construct the ID-Card through a structured, iterative process based on design science. In this article: (i) we report on hands-on experiences of replication; (ii) we review the state-of-the-art and extract replication-relevant information: (iii) we identify, through focus groups, challenges across two typical dimensions of replication: data annotation and tool reconstruction; and (iv) we present the concept and structure of the ID-Card to mitigate the identified challenges. This study aims to create awareness of replication in NLP for RE. We propose an ID-Card that is intended to foster study replication but can also be used in other contexts, e.g., for educational purposes.
Employment, FOS: Computer and information sciences, Language processing techniques, replication, Programvaruteknik, Iterative methods, Requirement engineering, Annotation, Replication, Natural languages, Natural Language Processing (NLP), NLP, Computer Science - Software Engineering, tool reconstruction, Language processing, Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural, Requirements Engineering, Àrees temàtiques de la UPC::Informàtica::Enginyeria del software, 000, Natural language processing, Requirements Engineering (RE), Tool reconstruction, Requirements engineering, Software Engineering, ID cards, Natural language processing systems, 004, Software Engineering (cs.SE), annotation, ID card
Employment, FOS: Computer and information sciences, Language processing techniques, replication, Programvaruteknik, Iterative methods, Requirement engineering, Annotation, Replication, Natural languages, Natural Language Processing (NLP), NLP, Computer Science - Software Engineering, tool reconstruction, Language processing, Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural, Requirements Engineering, Àrees temàtiques de la UPC::Informàtica::Enginyeria del software, 000, Natural language processing, Requirements Engineering (RE), Tool reconstruction, Requirements engineering, Software Engineering, ID cards, Natural language processing systems, 004, Software Engineering (cs.SE), annotation, ID card
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 10 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
| views | 20 | |
| downloads | 6 |

Views provided by UsageCounts
Downloads provided by UsageCounts