
Abstract Video content distributors, codec developers and researchers in related fields often rely on subjective assessments to ensure that their video processing procedures result in satisfactory quality. The current 10 s recommendation for the length of test sequences in subjective video quality assessment, however, has recently been questioned. Not only do sequences of this length depart from modern cinematic shooting styles, the use of shorter sequences would also enable substantial efficiency improvements to the data collection process. Our previous work, using a double-stimulus methodology, indicated that shortening test sequences had a limited impact upon rating behaviour. Here, using a larger database and additional opinion score measures, we also explore the same effect within the popular single-stimulus approach. Two groups of viewers assessed reference and distorted videos ranging in length from 1.5 s to 10 s. Analyses confirmed our previous findings using the DSCQS paradigm, and were replicated when using a similar single-stimulus paradigm: while viewers' DMOS for 1.5 s videos was significantly lower than for 10 s, no significant variation was found between the groups of 10 s, 7 s and 5 s videos. Together with our previous research, these data lead us to recommend the use of 5 s, temporally-consistent video clips in quality assessment studies that employ either DSCQS or its single-stimulus variant. The extension of our recommendation to further methodologies is also discussed.
HEVC, Visual perception, Methodology, 610, Single stimulus continuous quality scale, Subjective testing, Reliability, Mean opinion scores, /dk/atira/pure/core/keywords/visual_perception; name=Visual Perception, /dk/atira/pure/core/keywords/cognitive_science, Video signal processing, /dk/atira/pure/core/keywords/visual_perception, name=Cognitive Science, /dk/atira/pure/core/keywords/cognitive_science; name=Cognitive Science, Test conditions, Video databases, Video coding, name=Visual Perception, Video sequences, Statistical reliability, Double stimulus continuous quality scale, Quality assessment
HEVC, Visual perception, Methodology, 610, Single stimulus continuous quality scale, Subjective testing, Reliability, Mean opinion scores, /dk/atira/pure/core/keywords/visual_perception; name=Visual Perception, /dk/atira/pure/core/keywords/cognitive_science, Video signal processing, /dk/atira/pure/core/keywords/visual_perception, name=Cognitive Science, /dk/atira/pure/core/keywords/cognitive_science; name=Cognitive Science, Test conditions, Video databases, Video coding, name=Visual Perception, Video sequences, Statistical reliability, Double stimulus continuous quality scale, Quality assessment
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 14 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Top 10% | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Top 10% | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Top 10% |
