
arXiv: 2108.02589
SummaryThis paper proposesTRANSMUT‐Sparkfor automating mutation testing of big data processing code within Spark programs. Apache Spark is an engine for big data analytics/processing that hides the inherent complexity of parallel big data programming. Nonetheless, programmers must cleverly combine Spark built‐in functions within programs and guide the engine to use the right data management strategies to exploit the computational resources required by big data processing and avoid substantial production losses. Many programming details in Spark data processing code are prone to false statements that must be correctly and automatically tested. This paper explores the application of mutation testing in Spark programs, a fault‐based testing technique that relies on fault simulation to evaluate and design test sets. The paper introducesTRANSMUT‐Sparkfor testing Spark programs by automating the most laborious steps of the process and fully executing the mutation testing process. The paper describes how theTRANSMUT‐Sparkautomates the mutant generation, test execution and adequacy analysis phases of mutation testing. It also discusses the results of experiments to validate the tool and argues its scope and limitations.
Software Engineering (cs.SE), FOS: Computer and information sciences, Mutation Testing, Computer Science - Software Engineering, TRANSMUT-SPARK, Apache Spark, Computer Science - Distributed, Parallel, and Cluster Computing, [INFO.INFO-DB] Computer Science [cs]/Databases [cs.DB], Distributed, Parallel, and Cluster Computing (cs.DC), Testing Tool
Software Engineering (cs.SE), FOS: Computer and information sciences, Mutation Testing, Computer Science - Software Engineering, TRANSMUT-SPARK, Apache Spark, Computer Science - Distributed, Parallel, and Cluster Computing, [INFO.INFO-DB] Computer Science [cs]/Databases [cs.DB], Distributed, Parallel, and Cluster Computing (cs.DC), Testing Tool
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 6 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
