Active sonar systems are used to detect underwater man-made objects of interest (targets) that are too quiet to be reliably detected with passive sonar. Performance of active sonar can be degraded by false alarms caused by echoes returned from geological seabed structures (clutter) in shallow regions. To reduce false alarms, a method of distinguishing target echoes from clutter echoes is required. Research has demonstrated that perceptual-based signal features similar to those employed in the human auditory system can be used to automatically discriminate between target and clutter echoes, thereby reducing the number of false alarms and improving sonar performance. An active sonar experiment on the Malta Plateau in the Mediterranean Sea was conducted during the Clutter07 sea trial and repeated during the Clutter09 sea trial. The dataset consists of more than 95 000 pulse-compressed echoes returned from two targets and many geological clutter objects. These echoes were processed using an automatic classifier that quantifies the timbre of each echo using a number of perceptual signal features. Using echoes from 2007, the aural classifier was trained to establish a boundary between targets and clutter in the feature space. Temporal robustness was then investigated by testing the classifier on echoes from the 2009 experiment.