The audio signal processing device of the present invention arranges objects in a virtual three-dimensional space and generates audio signals by performing, at a prescribed listening position, audio simulation to sounds generated from a prescribed sounding position. This invention is characterized in that the sound field space subject to audio simulation is structured by combining spatial objects and audio simulation is performed thereto. Here, “spatial object” shall mean the space (sound field space) for audio simulation which was simply modeled in order to simplify audio simulation, and is a virtual object provided with prescribed audio parameters. The sound field space is structured by combining these spatial objects.