JP7732938B2 - Target sound processing device, target sound processing method, and target sound processing program - Google Patents

Description

The present invention relates to a target sound processing device, a target sound processing method, and a target sound processing program.

The reverberation and sound insulation level are usually expressed numerically, making it difficult for the average person, who is unfamiliar with such numbers, to visualize how a sound will sound. For this reason, methods are used to calculate the reverberation and sound insulation performance of a building based on its design specifications, and then generate a sample sound by incorporating the predicted calculation results into the target sound, such as noise. For example, Patent Document 1 discloses a method for predicting the attenuation of environmental noise (target sound) for each propagation path into a sound receiving room, such as the direct transmission path through a partition wall, the roundabout propagation path from an opening, and the solid propagation path through a side wall, and then generating an evaluation sound (sample sound) by convolving the impulse response waveform calculated from the predicted attenuation with the source waveform of the environmental noise (Claim 1, etc.).

Japanese Patent Application Laid-Open No. 2003-156388 Patent No. 4307622 Patent No. 4234257

However, with the technology described in Patent Document 1, target sounds to be processed are collected in the location where the user wants to hear the sample sound, and then processed to generate the sample sound. However, since the technology does not have information about the location where the sound was collected, it is not possible to generate the sample sound based on the location information.

In order to solve the above problems, the target sound processing device according to the present invention comprises:
a storage unit that stores a target sound collected by a sound collection unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving unit that receives a listening location image, the listening location image being an image of a location different from the predetermined location, where a user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the target sound is listened to under a predetermined environment at the predetermined location;
a search unit that searches the storage unit for the predetermined location image similar to the received listening location image;
a target sound acquisition unit that acquires a target sound associated with the searched predetermined location image;
a first characteristic acquisition unit that acquires a first characteristic of the sound collection unit;
a processed target sound generation unit that acquires a first processing correction value for processing the target sound based on the first characteristic, and processes the target sound using the acquired first processing correction value to generate a processed target sound;
a preview sound generation unit that processes the generated processed target sound to generate the preview sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition unit that acquires a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating unit that obtains a second processing correction value for processing the sample sound based on the second characteristic, and processes the sample sound using the obtained second processing correction value to generate a processed sample sound;
an output control unit that controls the generated processed sample sound and outputs it from the output unit;
Equipped with.

In order to solve the above problems, the target sound processing method according to the present invention includes:
a storing step of storing a target sound collected by a sound collecting unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving step of receiving a listening location image of a location different from the predetermined location where a user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the user listens to the target sound under a predetermined environment at the predetermined location;
a searching step of searching a storage unit for an image of the predetermined location similar to the received image of the listening location;
a target sound acquisition step of acquiring a target sound associated with the searched predetermined location image;
a first characteristic acquisition step of acquiring a first characteristic of the sound collection unit;
a processed target sound generation step of acquiring a first processing correction value for processing the target sound based on the first characteristic, and processing the target sound using the acquired first processing correction value to generate a processed target sound;
a sample sound generating step of processing the generated processed target sound to generate the sample sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition step of acquiring a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating step of obtaining a second processing correction value for processing the sample sound based on the second characteristic, and processing the sample sound using the obtained second processing correction value to generate a processed sample sound;
an output control step of controlling the generated processed sample sound to output it from the output unit;
Includes:

Furthermore, in order to solve the above problem, the target sound processing program according to the present invention comprises:
a storing step of storing a target sound collected by a sound collecting unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving step of receiving a listening location image of a location different from the predetermined location where a user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the user listens to the target sound under a predetermined environment at the predetermined location;
a searching step of searching a storage unit for an image of the predetermined location similar to the received image of the listening location;
a target sound acquisition step of acquiring a target sound associated with the searched predetermined location image;
a first characteristic acquisition step of acquiring a first characteristic of the sound collection unit;
a processed target sound generation step of acquiring a first processing correction value for processing the target sound based on the first characteristic, and processing the target sound using the acquired first processing correction value to generate a processed target sound;
a sample sound generating step of processing the generated processed target sound to generate the sample sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition step of acquiring a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating step of obtaining a second processing correction value for processing the sample sound based on the second characteristic, and processing the sample sound using the obtained second processing correction value to generate a processed sample sound;
an output control step of controlling the generated processed sample sound to output it from the output unit;
to be executed by the computer.

According to the present invention, the target sound picked up to generate the sample sound is stored in association with information about the sound pickup location, allowing the sample sound to be generated based on the location information.

1 is a diagram for explaining an overview of a target sound processing system according to a preferred embodiment of the present invention; 1 is a sequence diagram for explaining an outline of the operation of a target sound processing system according to a preferred embodiment of the present invention; 1 is a diagram for explaining the configuration of a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention. FIG. 1 is a diagram showing an example of a microphone correction value table possessed by a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention; FIG. 2 is a diagram showing an example of a speaker correction value table held by a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention. FIG. 2 is a diagram showing an example of a target sound image table possessed by a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention. 1 is a diagram illustrating a hardware configuration of a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention. 1 is a flowchart illustrating a processing procedure of a target sound processing device included in a target sound processing system according to a preferred embodiment of the present invention. 10 is a flowchart illustrating a processing procedure of a mobile terminal included in the target sound processing system according to a preferred embodiment of the present invention. 10 is a graph showing frequency characteristics of collected sound data. 10 is a graph showing the microphone's pickup level and linearity. 10 is a graph showing frequency characteristics of sound reproduced through headphones. 1 is a graph showing the reproducible level and linearity of headphones. FIG. 1 is a diagram showing an outline of experimental conditions. 10 is a graph showing the difference in sound pressure level between rooms. 10 is a graph showing a sound pressure waveform on the conference room (sound source room) side. 10 is a graph showing octave band levels on the conference room (sound source room) side. 10 is a graph showing a sound pressure waveform on the office (sound receiving room) side. This is a graph showing the octave band levels on the office (receiving room) side.

The following describes in detail exemplary embodiments of the present invention, with reference to the drawings. However, the configurations, numerical values, processing flows, functional elements, etc. described in the following embodiments are merely examples, and are open to modification and alteration. The technical scope of the present invention is not intended to be limited to the following description.

A target sound processing system 100 as a preferred embodiment of the present invention will be described using Figures 1A to 5B. The target sound processing system 100 is used, for example, to evaluate how a target sound picked up at a specified location sounds after undergoing performance determined by architectural specifications, etc. Figure 1A is a diagram for explaining an overview of the target sound processing system 100 according to this embodiment.

The target sound processing system 100 is composed of a target sound processing device 110 and a mobile terminal 120. A sound collection unit 130 (microphone) and an output unit 140 (speaker) are connected to the mobile terminal 120 via a cable from outside the mobile terminal 120. The sound collection unit 130 and the output unit 140 may be connected to the mobile terminal 120 wirelessly, or the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120.

For example, a worker or user who owns the mobile terminal 120 uses the sound collection unit 130 (microphone) connected to the mobile terminal 120 to collect target sounds at a predetermined location. Here, target sounds include, but are not limited to, indoor and outdoor sounds. The predetermined location may be, for example, a planned construction site for a detached house or apartment complex, or an existing building, and is a location where stakeholders or potential buyers of the predetermined location want to know the sound environment of the predetermined location.

First, a person collecting target sound 131 at a predetermined location uses the sound collection unit 130 to collect the target sound 131 at the predetermined location and saves the collected target sound 131 on the mobile terminal 120. Then, the sound collection person (or the owner of the mobile terminal 120, etc.) transmits the target sound data saved on the mobile terminal 120 to the target sound processing device 110. The mobile terminal 120 and the target sound processing device 110 are connected wirelessly. The target sound processing device 110 may also be a cloud server installed on the cloud, etc.

In addition, when transmitting the collected target sound 131 to the target sound processing device 110, the mobile terminal 120 also transmits a predetermined location image 160 captured using imaging equipment such as a camera of the predetermined location where the target sound 131 was collected.

The target sound processing device 110 associates the received target sound 131 with the predetermined location image 160 and stores them. That is, the target sound processing device 110 associates the target sound 131 with the predetermined location image 160 and stores them based on, for example, GPS (Global Positioning System) position data of the predetermined location. In this way, the target sound processing device 110 stocks a pair (combination) of the target sound 131 and the predetermined location image 160, which is an image of the location where the target sound 131 was picked up, in a predetermined storage device or the like for future use.

Next, consider the case where, for example, a user listens to the target sound 131 in a predetermined environment at a location different from the above-mentioned predetermined location, and wishes to listen to a sample sound that reproduces absolute pitch, which is the sound that is actually heard. Here, the location different from the above-mentioned predetermined location is the location where the user wishes to listen to the sample sound (listening location). In this case, the user first captures an image of the listening location using the camera 150 of their own smartphone, and transmits the captured listening location image 151 to the target sound processing device 110.

The target sound processing device 110 searches for a predetermined location image similar to the received listening location image from among the stored predetermined location images. Then, if the target sound processing device 110 is able to find a predetermined location image 160 similar to the listening location image 151, it acquires the target sound 131 associated with this predetermined location image 160. Then, the target sound processing device 110 generates a listening sound or the like for the acquired target sound 131, for example, according to the following procedure.

That is, the target sound processing device 110 processes the target sound 131 collected at a predetermined location based on the acquired target sound data of the target sound 131, to generate an evaluation sound (processed preview sound 141). When transmitting the target sound data to the target sound processing device 110, the mobile terminal 120 preferably also transmits data regarding the characteristics of the sound collection unit 130 (microphone) and output unit 140 (speaker) connected to the mobile terminal 120, but this may also be transmitted in response to a request from the target sound processing device 110.

This is because the sound collection characteristics of the sound collection unit 130 cause some frequency components of the collected target sound 131 to be cut, and the output characteristics of the output unit 140 cause the output preview sound to have different frequency components from the sound that is actually heard. For this reason, the target sound processing system 100 processes the target sound 131 while taking into account the characteristics of the microphone and speaker to generate the preview sound (processed preview sound 141).

For example, built-in microphones and speakers built into mobile terminal 120 are smaller than external microphones and speakers, due to the need to keep the price of mobile terminal 120 down or to address space constraints within the housing of mobile terminal 120, and may have limited performance or certain functions removed. Also, even with external microphones and speakers, depending on the intended use and price, the functions that can be used may be limited to certain functions, certain performance may be restricted, or conversely, certain functions may be enhanced. For this reason, there are many microphones and speakers with a wide variety of functions and performance capabilities.

In this way, if microphones and speakers are used that are dedicated to picking up the target sound 131 and speakers that are dedicated to outputting the sample sound, there is no need to adjust for variations between microphones and speakers. However, if dedicated microphones and speakers must be used, the dedicated microphones must be transported to a designated location each time the target sound 131 is picked up, and when the sample sound is to be listened to, the dedicated speakers must be located, making it difficult to respond flexibly and quickly.

Therefore, in order to eliminate errors that depend on the characteristics of each device, the target sound processing system 100 generates absolute sounds (processed target sound, trial sound, processed trial sound 141) at each stage of processing the picked-up target sound 131, eliminating errors caused by the device, and by processing these absolute sounds, reproduces sounds that are no different from real sounds, allowing the listener (user) to experience them.

Therefore, in the target sound processing system 100, the characteristics of the sound collection unit 130 (microphone) and the characteristics of the output unit 140 (speaker) are transmitted to the target sound processing device 110 along with the target sound data of the collected target sound 131 and the predetermined location image 160. Alternatively, the characteristics of the sound collection unit 130 and the output unit 140 may be transmitted to the target sound processing device 110 separately from the target sound 131 and the predetermined location image 160. For example, they may be transmitted before or after the transmission of the target sound 131 and the predetermined location image 160. The target sound processing device 110 processes the acquired target sound data using a correction value according to the characteristics of the sound collection unit 130 that collected the sound, to generate a processed target sound. Next, the target sound processing device 110 generates a trial sound from the generated processed target sound that reproduces the sound that would actually be heard when the target sound 131 is listened to at a predetermined location under a predetermined environment.

Here, the specified environment includes, for example, buildings such as apartment buildings or detached houses that are scheduled to be constructed at the specified location where the target sound 131 was picked up, as well as the interiors of these buildings and outdoor areas such as balconies. Furthermore, the specified environment may include various factors that create the living environment of the building, such as the position and area of the building's walls, sound insulation performance (sound transmission loss), the position, area, and sound insulation performance (sound transmission loss) of windows installed in the building, the area and number of air intakes, sound insulation performance (normalized sound transmission loss), indoor surface area, and sound absorption performance (sound absorption capacity).

The target sound processing device 110 then recreates a specified environment (such as a building) in a virtual space, and generates a trial sound by predicting the acoustic effects in that specified environment using data on the picked-up target sound 131. The target sound processing device 110 processes the generated trial sound using a correction value according to the characteristics of the output unit 140 to generate a processed trial sound. By processing the trial sound using a correction value based on the characteristics of the output unit 140 in this way, it is possible to reliably reproduce the sound that is actually heard in the output unit 140 without using a dedicated speaker. Note that the trial sound may be regenerated based on the results of listening to the processed trial sound. By regenerating the trial sound in this way, trial sounds in various environments can be reproduced. Therefore, it is possible to simulate trial sounds in various environments by, for example, changing the window area or the grade of sound insulation performance.

With reference to Figure 1B, an overview of the operation of the target sound processing system 100 will be described. In step S101, the target sound 131 is collected by the sound collection unit 130. In step S103, the collected target sound 131 is transmitted from the sound collection unit 130 to the mobile terminal 120. The target sound 131 collected by the sound collection unit 130 is, for example, analog data.

Then, in step S105, a camera attached to the mobile terminal 120 is used to capture an image of the predetermined location where the target sound 131 was picked up, thereby acquiring a predetermined location image 160. In step S107, the mobile terminal 120 transmits target sound data obtained by digitally converting the captured target sound 131 and the predetermined location image data to the target sound processing device 110. Note that the predetermined location image 160 is already in the form of digital data, having been captured using a digital camera or the like. In step S109, the target sound processing device 110 stores the received target sound data and predetermined location image data.

In step S111, for example, the mobile terminal 120 transmits to the target sound processing device 110 a listening location image 151 obtained by capturing an image of the listening location, which is a location different from the predetermined location and where the user wants to listen to the listening sound, using the camera 150. In step S113, the target sound processing device 110 searches for a predetermined location image 160 that is similar to the received listening location image 151, and acquires the target sound 131 associated with the predetermined location image 160.

In step S115, the target sound processing device 110 processes the acquired target sound 131 in accordance with predetermined conditions to generate a processed preview sound. In step S117, the target sound processing device 110 transmits the generated processed preview sound to the mobile terminal 120 (output unit 140). In step S119, the output unit 140 outputs the received processed preview sound. Here, the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120. Furthermore, digital conversion of the target sound 131 may be performed in the target sound processing device 110.

<Configuration of target sound processing device 110>
The configuration of the target sound processing device 110 will be described with reference to Fig. 2. The target sound processing device 110 has a storage unit 211, an image receiving unit 212, a search unit 213, a target sound acquisition unit 214, a first characteristic acquisition unit 215, and a processed target sound generation unit 216. The target sound processing device 110 further has a preview sound generation unit 217, a second characteristic acquisition unit 218, a processed preview sound generation unit 219, and an output control unit 220.

The storage unit 211 associates and stores target sound 131 collected by the sound collection unit 130 at a predetermined location with a predetermined location image 160 captured of the predetermined location. The target sound 131 is collected, for example, by a microphone (sound collection unit 130). The predetermined location image 160 is captured by a camera or the like. The camera may be one built into a mobile terminal 120 such as a smartphone or tablet terminal, or a standalone camera. The captured predetermined location image 160 is saved as digital data in the camera's internal storage or external storage.

The predetermined location image 160 may also be an image captured according to a predetermined imaging method. That is, when capturing an image of a predetermined location using a camera, imaging conditions such as the distance from a sound source or subject present at the predetermined location, exposure time (shutter speed), angle of view, and exposure are consistent. By consistent imaging conditions in this way, it is possible to shorten the search time by the search unit 213 (described below) and improve search accuracy.

Furthermore, images can be taken under consistent imaging conditions, such as the height of the camera lens from the ground and the angle of sunlight incidence. However, there may be cases where it is not possible to uniform imaging conditions due to various constraints, and in such cases, images can be taken under imaging conditions that are close to the specified imaging conditions.

The image receiving unit 212 receives a listening location image 151 captured at a location different from the predetermined location where the user wishes to listen to a sample sound that reproduces absolute pitch, which is the sound that would actually be heard when listening to the target sound 131 in a predetermined environment at the predetermined location. The listening location image 151 is captured using, for example, a camera 150.

Furthermore, the listening location image 151 may be an image captured according to a predetermined imaging method, similar to the above-mentioned predetermined location image 160. In this way, by using the same imaging method for the listening location image 151 and the predetermined location image 160, it is possible to shorten the time required to search for a predetermined location image 160 that is similar to the received listening location image 151 and improve the search accuracy.

The search unit 213 searches the storage unit 211 for a predetermined location image 160 that is similar to the received listening location image 151. The search unit 213 searches the storage unit 211 for a predetermined location image 160 that is similar to the listening location image 151, for example, based on the degree of match between the listening location image 151 and the predetermined location image 160. The search unit 213 may, for example, extract feature points from both images and search for a predetermined location image 160 that is similar to the listening location image 151 based on the number of matching feature points among the extracted feature points.

The search unit 213 may also input the predetermined location image 160, which is an image of the predetermined location, into artificial intelligence (AI) for machine learning. When the machine learning by the AI is complete, the search unit 213 generates a trained predetermined location image model. The search unit 213 may also store the generated trained predetermined location image model in a specified storage device, etc. In this case, the stored trained predetermined location image model may be updated each time a new learning image is acquired, machine learning is performed, and a trained predetermined location image model is generated.

Machine learning using artificial intelligence is performed using known algorithms. In machine learning, the loss function specifies weights and uses the inverse of the number of events. Furthermore, the search unit 213 inflates the number of images of a given location that the artificial intelligence learns in order to improve the accuracy of the machine learning using artificial intelligence and generate a more accurate model for similar image search. The search unit 213 obtains inflated data, for example, by flipping left and right. Furthermore, the search unit 213 may use transfer learning to improve the accuracy of the machine learning using artificial intelligence. Here, transfer learning is a method that aims to improve model performance by reusing a trained model using a different dataset for a different problem and performing partial learning. This method is particularly promising for improving inference performance and reducing learning time when there is insufficient training data.

The target sound acquisition unit 214 acquires the target sound 131 associated with the searched predetermined location image 160. Since the storage unit 211 stores combinations of target sounds 131 and predetermined location images 160, the target sound acquisition unit 214 acquires the target sound 131 associated with the searched predetermined location image 160 based on it.

The first characteristic acquisition unit 215 acquires the first characteristic of the sound collection unit 130. The first characteristic of the sound collection unit 130 is the various conditions when the target sound 131 is collected, and includes, for example, mechanical characteristics such as the frequency characteristics of the sound collection unit 130 (microphone), characteristics of the software built into the sound collection unit 130, and environmental characteristics such as the temperature, humidity, wind direction, and wind volume of a specified location, but is not limited to these.

The processed target sound generation unit 216 acquires a first processing correction value for processing the target sound 131 based on the first characteristic, and processes the target sound 131 using the acquired first processing correction value to generate the processed target sound. The processed target sound generation unit 216 acquires, for example, the first processing correction value stored in internal storage or external storage. The first processing correction value is a correction value for processing the target sound 131 in accordance with the acquired first characteristic.

The processed target sound generation unit 216 then processes the target sound 131 (target sound data) using the acquired first processing correction value to generate the processed target sound. The processed target sound generation unit 216 processes the target sound data, for example, by canceling specific frequency components, to generate the processed target sound.

The preview sound generation unit 217 processes the generated processed target sound to generate a preview sound that reproduces the absolute sound that will actually be heard when the target sound 131 is listened to in a predetermined environment at a location different from the predetermined location. Here, the predetermined environment is, for example, a building such as an apartment building or detached house that is scheduled to be constructed at the predetermined location where the target sound 131 is picked up, and includes the interior of these buildings and outdoor areas such as balconies. Furthermore, the predetermined environment may include various factors that realize the living environment of the building, such as the position and area of the building's walls, sound insulation performance (sound transmission loss), the position, area, and sound insulation performance (sound transmission loss) of windows installed in the building, the area and number of air intakes, sound insulation performance (normalized sound transmission loss), the surface area of the room, sound absorption performance (sound absorption capacity), and sound reflection from surrounding buildings.

The sample sounds generated include, for example, (1) indoor noise caused by external noise, (2) spatial sound insulation performance (noise propagating from adjacent rooms), (3) noise propagating from inside and outside the building to the site boundary, (4) indoor quieting performance caused by air conditioning equipment, (5) floor impact sound insulation performance (floor impact sound), and (6) indoor reverberation time (sound reverberation).

Specifically, (1) refers to how a noise from an external noise source, such as a train, sounds indoors. (2) refers to how a noise from a TV or meeting sounds in a neighboring room. (3) refers to how noise sources such as equipment and machinery on the building premises (inside or outside the building) and operational noise sound to the property boundary or neighbors. (4) refers to how the quietness of a room changes or how the sound of an air conditioning unit, such as an air conditioner or total heat exchanger, sounds indoors. (5) refers to how sounds such as jumping or running from a room on an upper floor sound in a room on a lower floor. (6) refers to how voices and sounds from audio equipment resonate and sound in a room during a meeting, lecture, or other such occasion.

The second characteristic acquisition unit 218 acquires the second characteristic of the output unit 140 for outputting the generated preview sound. The second characteristic is the output condition of the output unit 140 (speaker) for outputting the generated preview sound, and includes, for example, the mechanical characteristics of the output unit 140, the characteristics of the software incorporated in the output unit 140, and the environmental characteristics of the output location, but is not limited to these.

The processed sample sound generation unit 219 acquires a second processing correction value for processing the sample sound based on the second characteristic, and processes the sample sound using the acquired second processing correction value to generate a processed sample sound.

When a sample sound is output from the output unit 140, the reproducibility of the sample sound depends on the characteristics of the output unit 140. Therefore, even if the same sample sound data is played back, if it is output from multiple output units 140 with different characteristics, the listener may hear it differently. When this occurs, additional construction may be required after the building or other structure is actually constructed. Therefore, in order to reproduce the sound that will actually be heard in advance, the generated sample sound is processed according to the output characteristics of the output unit 140. A processing correction value (second processing correction value) is used to process the sample sound.

The second processing correction value is determined after outputting a reference experimental sound from each output unit 140 (speaker) and checking the output characteristics, such as the frequency characteristics, of each output unit 140. The processed sample sound generation unit 219 then processes the sample sound using the second processing correction value determined as described above, and generates a processed sample sound that has been processed in accordance with the characteristics of the output unit 140.

The output control unit 220 controls the generated processed preview sound 141 and outputs it from the output unit 140. For example, the output control unit 220 transmits the generated processed preview sound 141 to the mobile terminal 120, and outputs the processed preview sound 141 from the output unit 140. The output control unit 220 may also transmit the generated processed preview sound 141 directly to the output unit 140, thereby outputting the processed preview sound 141 from the output unit 140.

<Configuration of mobile terminal 120>
Next, the configuration of the mobile terminal 120 will be described with reference to Fig. 2. The mobile terminal 120 has an acquisition unit 221, a transmission unit 222, a reception unit 223, and an output control unit 224. Note that the sound collection unit 130 and the output unit 140 may be built into the mobile terminal 120.

The acquisition unit 221 acquires the target sound 131 collected by the sound collection unit 130 (microphone) at a predetermined location. Here, the target sound 131 includes at least one of indoor sound and outdoor sound. The data of the acquired target sound 131 is analog data, but if the sound collection unit 130 has an AD converter, for example, the analog data of the collected target sound 131 may be converted to digital data in the sound collection unit 130. Furthermore, if the sound collection unit 130 does not have an AD converter, the analog data may be converted to digital data using an AD converter provided in the mobile terminal 120. Furthermore, if neither the sound collection unit 130 nor the mobile terminal 120 has an AD converter, the analog data of the collected target sound 131 may be converted to digital data in an AD converter provided in the target sound processing device 110.

The transmission unit 222 transmits the acquired data of the target sound 131 to the target sound processing device 110. The data of the target sound 131 transmitted to the target sound processing device 110 may be analog data or digital data.

The receiving unit 223 receives the processed sample sound 141 transmitted from the target sound processing device 110. The data of the received processed sample sound 141 is digital data.

The output control unit 224 controls the received processed sample sound 141 to output it from the output unit 140. The output control unit 224 converts the received digital data of the processed sample sound 141 into analog data and sends it to the output unit 140, and controls the output unit 140 to play the analog data of the processed sample sound 141. As described above, the processed target sound may also be sent directly from the output control unit 220 of the target sound processing device 110 to the output unit 140 for output.

Next, referring to Figure 3A, an example of the microphone correction value table 301 possessed by the target sound processing device 110 will be described. The microphone correction value table 301 stores characteristics 312 and correction values 313 in association with a microphone ID (Identifier) 311. The microphone ID 311 is an identifier for identifying a microphone capable of collecting the target sound 131. The characteristics 312 indicate the characteristics of the microphone, and include frequency characteristics and the sound collection level. The correction values 313 include a frequency correction value and a level correction value. The processed target sound generation unit 216 of the target sound processing device 110 then references the microphone correction value table 301, extracts a correction value according to the characteristics of the microphone (sound collection unit 130), and processes the received target sound 131.

With reference to Figure 3B, an example of the speaker correction value table 302 possessed by the target sound processing device 110 will be described. The speaker correction value table 302 stores characteristics 322 and correction values 323 in association with speaker IDs 321. The speaker IDs 321 are identifiers for identifying speakers capable of outputting the processed sample sound 141 transmitted from the target sound processing device 110. The characteristics 322 indicate the characteristics of the speaker, and include frequency characteristics and possible output levels. The correction values 323 include frequency correction values and level correction values. The processed sample sound generation unit 219 of the target sound processing device 110 then references the speaker correction value table 302, extracts correction values according to the characteristics of the speaker (output unit 140), and processes the generated sample sound.

An example of a target sound image table 303 held by the target sound processing device 110 will be described with reference to Figure 3C. The target sound image table 303 stores an image 332, a location 333, and sound collection/imaging conditions 334 in association with a target sound ID 331. The target sound ID 331 is an identifier for identifying each target sound 131 collected by the sound collection unit 130. The image 332 is an image stored in association with the collected target sound 131, and is an image of the location where the target sound 131 was collected. The location 333 is coordinate data indicating the location where the target sound 131 was collected, and multiple target sounds 131 and images may correspond to one location. The sound collection/imaging conditions 334 are the sound collection conditions when the target sound 131 was collected and the imaging conditions when an image of the sound collection location was captured, and include the distance from the subject, exposure time, weather, temperature, etc.

The hardware configuration of the target sound processing device 110 will be described with reference to Figure 4. The CPU (Central Processing Unit) 410 is a processor for arithmetic and control, and by executing programs, realizes each functional configuration of the target sound processing device 110 in Figure 2. The CPU 410 has multiple processors and may execute different programs, modules, tasks, threads, etc. in parallel. The ROM (Read Only Memory) 420 stores fixed data such as initial data and programs, as well as other programs. The network interface 430 communicates with other devices via a network. The CPU 410 is not limited to one, and may be multiple CPUs, or may include a GPU (Graphics Processing Unit) for image processing. Furthermore, it is desirable that the network interface 430 has a CPU independent of the VPU 410, and writes and reads transmitted and received data to and from an area of the RAM (Random Access Memory) 440. It is also desirable to provide a DMAC (Direct Memory Access Controller) (not shown) that transfers data between the RAM 440 and the storage 450. Furthermore, the CPU 410 recognizes that data has been received or transferred to the RAM 440 and processes the data. The CPU 410 also prepares the processing results in the RAM 440, and leaves subsequent transmission or transfer to the network interface 430 or the DMAC.

RAM 440 is a random access memory used by CPU 410 as a work area for temporary storage. RAM 440 has a storage area reserved for storing data necessary to implement this embodiment. Target sound data 441 is data on target sound picked up at a specified location using the sound pickup unit 130, and is digitally converted data. Microphone correction value 442 is a correction value used to calibrate microphone sensitivity (the difference between the actual sound and the picked-up sound), which depends on the sound pickup unit 130 (microphone) used to pick up target sound 131.

The speaker correction value 443 is a correction value used to eliminate speaker-specific acoustic characteristics (differences between the generated sample sound and the reproduced sample sound) that depend on the output unit 140 (speaker) that reproduces the generated processed sample sound. The processed target sound data 444 is sound data obtained by processing the collected target sound 131 using the first processing correction value.

Trial sound data 445 is data on the trial sound obtained by processing the processed target sound, which reproduces the sound that would actually be heard when target sound 131 is listened to in a specified location under a specified environment. Processed trial sound data 446 is trial sound that has been processed using the second processing correction value based on the output conditions of output unit 140 for outputting the generated trial sound. Image data 447 is data on an image captured of the location where target sound 131 was picked up.

Transmitted/received data 448 is data transmitted and received via the network interface 430. RAM 440 also has an application execution area 449 for executing various application modules.

Storage 450 stores databases, various parameters, and the following data or programs required to implement this embodiment. Storage 450 stores a microphone correction value table 301, a speaker correction value table 302, and a target sound image table 303. The microphone correction value table 301 is a table that manages the relationship between microphone ID 311 and correction value 313, etc., shown in Figure 3A. The speaker correction value table 302 is a table that manages the relationship between speaker ID 321 and correction value 323, etc., shown in Figure 3B. The target sound image table 303 is a table that manages the relationship between target sound ID 331 and image 332, etc., shown in Figure 3C.

Storage 450 further stores an image reception module 451, a search module 452, a target sound acquisition module 453, a first characteristic acquisition module 454, a processed target sound generation module 455, a preview sound generation module 456, a second characteristic acquisition module 457, a processed target sound generation module 458, and an output control module 459.

The image reception module 451 is a module that captures an image of a location different from the predetermined location where a sample sound that reproduces absolute sound, which is the sound that is actually heard when the target sound 131 is listened to in a predetermined environment at the predetermined location, and receives a listening location image 151. The search module 452 is a module that searches the storage unit 211 for a predetermined location image 160 that is similar to the received listening location image 151. The target sound acquisition module 453 is a module that acquires the target sound 131 associated with the searched predetermined location image 160.

The first characteristic acquisition module 454 is a module that acquires the first characteristic of the sound pickup unit 130. The processed target sound generation module 455 is a module that acquires a first processing correction value for processing the target sound 131 based on the first characteristic, and processes the target sound 131 using the acquired first processing correction value to generate a processed target sound. The preview sound generation module 456 is a module that processes the generated processed target sound to generate a preview sound.

The second characteristic acquisition module 457 is a module that acquires the second characteristic of the output unit 140 for outputting the generated preview sound. The processed target sound generation module 458 is a module that acquires a second processing correction value for processing the preview sound based on the second characteristic, and processes the preview sound using the acquired second processing correction value to generate a processed preview sound. The output control module 459 is a module that controls the generated processed preview sound and outputs it from the output unit 140.

These modules 451 to 459 are loaded into the application execution area 449 of the RAM 440 by the CPU 410 and executed. The control program 470 is a program for controlling the entire target sound processing device 110.

The input/output interface 460 interfaces input/output data with input/output devices. A display unit 461 and an operation unit 462 are connected to the input/output interface 460. A storage medium 464 may also be connected to the input/output interface 460. A speaker 463 serving as an audio output unit, a microphone (not shown) serving as an audio input unit, or a GPS position determination unit may also be connected. Note that the RAM 440 and storage 450 shown in Figure 4 do not include programs or data related to the general-purpose functions of the target sound processing device 110 or other feasible functions.

Next, the processing procedure of the target sound processing device 110 will be described with reference to the flowchart shown in Figure 5A. This flowchart is executed by the CPU 410 in Figure 4 using the RAM 440, and realizes the various functional components of the target sound processing device 110 in Figure 2.

In step S501, the storage unit 211 associates and stores the target sound 131 picked up at a predetermined location with a predetermined location image capturing the predetermined location where the target sound 131 was picked up. In step S503, the image receiving unit 212 receives a listening location image 151 capturing an image of a location where the sample sound was listened to, which is a location different from the predetermined location where the target sound 131 was picked up.

In step S505, the search unit 213 searches the storage unit 211 for a predetermined location image similar to the received listening location image 151. The search method is, for example, based on the degree of match between the predetermined location image 160 and the listening location image 151. In step S507, the search unit 213 determines whether a predetermined location image 160 similar to the listening location image 151 has been found. If it is determined that a search has not been found (NO in step S507), the target sound processing device 110 terminates processing. If it is determined that a search has been found (YES in step S507), the target sound processing device 110 proceeds to the next step.

In step S509, the target sound acquisition unit 214 acquires the target sound 131 associated with the searched predetermined location image 160. In step S511, the first characteristic acquisition unit 215 acquires the first characteristic of the sound collection unit 130. In step S513, the processed target sound generation unit 216 acquires a first processing correction value for processing the target sound 131 based on the acquired first characteristic, and processes the target sound 131 using the acquired first processing correction value to generate the processed target sound.

In step S515, the preview sound generation unit 217 processes the generated processed target sound to generate a preview sound that reproduces the absolute pitch, which is the sound that would actually be heard when the target sound 131 is listened to in a location different from the specified location and under a specified environment. In step S517, the second characteristic acquisition unit 218 acquires the second characteristic of the output unit 140 for outputting the generated preview sound. In step S519, the processed preview sound generation unit 219 acquires a second processing correction value for processing the preview sound based on the acquired second characteristic, and processes the preview sound using the acquired second processing correction value to generate the processed preview sound. In step S521, the generated processed preview sound is controlled and output from the output unit 140.

Next, the processing procedure of the mobile terminal 120 will be described with reference to the flowchart shown in Figure 5B. This flowchart is executed by a CPU (not shown) using RAM (not shown), and realizes each functional configuration of the mobile terminal 120 shown in Figure 2.

In step S531, the mobile terminal 120 acquires the target sound 131 collected by the sound collection unit 130. Here, the mobile terminal 120 may digitally convert the acquired target sound 131. In step S533, the mobile terminal 120 transmits data of the acquired target sound 131 to the target sound processing device 110. In step S535, the mobile terminal 120 receives the processed sample sound 141 from the target sound processing device 110. The received processed sample sound 141 is output from the output unit 140.

In this embodiment, the target sound and a predetermined location image are stored in association with each other, so by capturing an image of a new location, a sample sound can be generated without having to record the sound at the new location. In other words, there is no need to carry a dedicated sound recording microphone to the new location to record the sound, making it easy to use.

[Example]
Next, embodiments of the present invention will be described with reference to Figures 6 to 15. It should be noted that the scope of the present invention is not limited to the following embodiments.

The target sound processing device 110 of the target sound processing system 100 generates test sounds for the six items (a) to (f) shown in Table 1. These are: (a) indoor noise caused by external noise, (b) spatial shielding performance (noise propagating from adjacent rooms), (c) noise propagating from inside and outside the building to the site boundary, (d) indoor noise caused by spatial equipment, (e) floor impact sound insulation performance (floor impact sound), and (f) indoor reverberation time (sound reverberation).

Specific examples of each of the six categories include (a) traffic noise (road traffic noise, railway noise, etc.), (b) airborne noise such as conversations in conference rooms and hotel television sounds, (c) outdoor equipment and machinery, indoor equipment and machinery, (d) indoor air conditioning equipment, (e) floor impact noise (heavy floor impact noise, light floor impact noise), and (f) conversations in conference rooms and classroom lectures. Calculations for each category utilize technologies described in, for example, Patent Documents 1 to 3.

The target frequencies for each of the six items are: (a) 50Hz to 5,000Hz band, (b) 100Hz to 5,000Hz band, (c) and (d) 50Hz to 5,000Hz band, (e) heavy floor impact sound: 50Hz to 630Hz band, light floor impact sound: 50Hz to 5,000Hz band, and (f) 100Hz to 5,000Hz band.

To generate the preview sound, in steps (a) to (d), a volume reduction filter is generated and the sound source data (the picked-up target sound data) is filtered to generate the preview sound.

In (e), the floor impact sound level is calculated from the impact force of standard impact sources (tires, balls, tapping) according to JIS standards, and sound source data closest to the calculated conditions is extracted from floor impact sounds from standard impact sources recorded under various conditions such as slab thickness, floor finish structure, and finished ceiling. A filter is then generated that reduces the volume by the difference between this floor impact sound level and the calculated value, and a sample sound is generated. Note that heavy floor impact sound is evaluated in the 50Hz to 630Hz band, so frequencies outside of this range are not filtered and are not played back.

In (f), a test sound is generated by convolving a dry source sound, such as a reading recorded in an anechoic chamber, with an impulse response predicted by acoustic simulation or the like, or an actual measured value of the impulse response.

Next, the microphones (sound pickup unit 130 or sound pickup device) and headphones (output unit 140 or speaker) used each have their own unique acoustic characteristics. Therefore, in order to faithfully reproduce the generated sample sound, these acoustic characteristics must be corrected, and the picked-up sound source (target sound 131) and the generated sample sound are corrected based on a correction value calculated in advance. The correction value for the acoustic characteristics of the equipment used can be calculated using the following method.

<<How to correct the acoustic characteristics of a microphone>>
<Microphone frequency characteristics>
A method for correcting the acoustic characteristics of a microphone (sound pickup unit 130) will be described using an example in which a tablet device is used as the mobile terminal 120. First, experimentally confirm that the microphone can pick up the sound of the frequency to be evaluated. In an anechoic chamber, pink noise (noise) is generated from a speaker (sound source), and a precision sound level meter is placed 1 m away to pick up the sound. Figure 6 shows the 1/3 octave band levels of the picked-up sound data.

The microphone attached to the tablet device and the precision sound level meter generally match in the target frequency range of 50 Hz to 5,000 Hz. On the other hand, the microphone built into the tablet device shows level differences at low frequencies below 80 Hz. When capturing problematic low-frequency sounds such as heavy floor impact noise and equipment noise, it is preferable to use an external microphone.

<Microphone pickup level and linearity>
When listening to the test sound, the sound pressure level to be picked up is assumed to be 30 dB to 80 dB, taking into consideration the user's hearing impairment and the level of noise that requires noise control measures when using the system. In addition, the frequency characteristics of the microphone used will change linearly depending on the sound pressure level to be picked up. Therefore, the linearity of the sound pick-up level and frequency characteristics of the microphone to be used will be experimentally confirmed.

Pink noise was recorded at a volume between 30 dB and 80 dB using the tablet's built-in microphone and a precision sound level meter. The recorded sound was analyzed in 1/3 octave bands to examine the correspondence between the tablet's built-in microphone and the precision sound level meter. Figure 7 shows the results for the 1,000 Hz band as a representative example.

If the precision sound level meter value is taken as the true value, when using the tablet device's built-in microphone, the change is roughly linear from 30 dB to 80 dB. Because the change is linear within the sound pressure level range expected for system use, correction can be made using a fixed correction value for each frequency band.

After confirming that the target microphone can be used with the target sound processing system 100, the 1/3 octave band level difference between the precision sound level meter and the target microphone is used as a correction value (first processing correction value) to ensure accurate sound pickup.

<<How to correct the acoustic characteristics of headphones>>
<Headphone frequency characteristics>
Many headphones are tuned according to purpose and preference, and to faithfully reproduce the generated sample sound, the frequency characteristics of each headphone must be canceled. Therefore, in an anechoic chamber, headphones were attached to a dummy head, and pink noise (sound source) was played via a tablet device. Figure 8 shows the 1/3 octave band levels of the pink noise and the sound reproduced by the headphones. Compared to the pink noise, which has a flat frequency response, the sound reproduced by the headphones used varies by frequency, with sounds in the 400 Hz to 1,000 Hz band being particularly emphasized.

<Headphone playback level and linearity>
Pink noise is reproduced through headphones at various levels to examine the reproducible level and linearity of the headphones. Figure 9 shows the 1/3 octave band level of a 1,000 Hz band as a typical example.

Sounds can be reproduced through headphones in the range of 20dB to 80dB, and change linearly in response to changes in the pink noise level at 5dB intervals. Similar results were obtained in other frequency bands. Because reproduction up to 20dB is possible, when considering the sound insulation of a space, for example, the spatial sound insulation performance of up to Dr-55 can be expressed as a listening test sound for a sound source generated at 75dB in the sound source room. Here, Dr is the rating of the difference in sound pressure level between rooms, and the higher the Dr value, the higher the sound insulation performance of the space and the less airborne sound is transmitted.

After confirming that the target headphones can be used with the target sound processing system 100, the 1/3 octave band level difference between the pink noise (sound source) and the sound reproduced by the headphones is used as a correction value (second processing correction value) to cancel out the acoustic characteristics unique to the headphones so that the generated trial sound can be faithfully reproduced.

<<Verification example of system accuracy in an actual building>>
<Verification Overview>
Using an office room, the accuracy of the predicted calculations regarding spatial sound insulation performance by the target sound processing device 110, the sample sound, and the processed sample sound were verified. An outline of the measurement room is shown in FIG.

The partition wall between the conference room and the office is a dry double wall (sound insulation performance TL _D -40). The corridor door between the conference room and the office is a standard steel double door without an airtight seal. The conference room was used as the sound source room, and target sounds (pink noise or a male reading) were played from the speaker. The played target sounds were each picked up by the target sound processing device 110 (using the built-in microphone of a tablet device), and the picked-up target sound was used as sound source data. To verify sound pickup accuracy, sound was also picked up using a precision sound level meter (NA-28 manufactured by RION Corporation). A dummy head was installed in the sound receiving room to pick up the sound propagating from the conference room. The difference in sound pressure level between the rooms was also measured according to JIS A1418:2000, "Method for measuring the airborne sound insulation performance of buildings."

<Prediction calculation accuracy>
To confirm the accuracy of the prediction calculations performed by the target sound processing system 100, the predicted values of the sound pressure level differences between rooms were compared with the actual measured values. Figure 11 shows the comparison results for octave band levels. The predicted values roughly correspond to the actual measured values in the 125 Hz to 4,000 Hz bands, and the sound pressure level differences between rooms were predicted with high accuracy.

Because sound pickup accuracy affects the accuracy of generating the sample sound, we compared the sound pickup data from the target sound processing system 100 (tablet's built-in microphone) with the sound pickup data from a precision sound level meter. Figure 12 shows the sound pressure waveform from the precision sound level meter and the sound pressure waveform (processed target sound) picked up by the target sound processing system 100 (tablet's built-in microphone), and Figure 13 shows the octave band levels of each sound pressure waveform.

The shape and amplitude of the sound pressure waveforms picked up by the target sound processing system 100 (tablet's built-in microphone) are the same as those picked up by a precision sound level meter for both pink noise and a male reading aloud. At the octave band level, the error is a maximum of about 1 dB, meaning that the sound is picked up with the same accuracy as a standard sound level meter.

<Preview sound accuracy>
A correction process was performed to cancel the acoustic characteristics specific to headphones on the sound pressure waveform of the sample sound, which was obtained by taking into account the predicted calculation results for the sound pickup data of the target sound processing system 100, and a processed sample sound was generated.

Figure 14 shows the sound pressure waveform of the test sound, the sound pressure waveform of the processed test sound (sound played back through headphones), and the sound pressure waveform (actual measured values) picked up using a dummy head in the sound receiving room office, and Figure 15 shows the octave band levels of each. Note that while Figure 15 shows the background noise in the sound receiving room, this was excluded from the evaluation when playing back a male reading, as it is affected by background noise in the sound receiving room above the 1,000 Hz band.

The processed sample sound (sound played through headphones) has roughly the same shape and amplitude as the sample sound and the actual measured sound pressure waveform, and the octave band levels are also roughly the same.

The preview sound generated by the system's target sound processing device 110 can be played back correctly through headphones, and the processed preview sound reproduces the actual sound.

The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above-described embodiments and can be modified as appropriate. The configuration and details of the present invention can be modified in various ways that are understandable to those skilled in the art and are within the scope of the present invention. Furthermore, outer containers and packaging boxes that combine the separate features included in each embodiment in any way are also included in the scope of the present invention.

The present invention may be applied to a system consisting of multiple devices or to a single device. Furthermore, the present invention may also be applied when an information processing program that realizes the functions of the embodiments is supplied to a system or device and executed by a built-in processor. Therefore, the technical scope of the present invention also includes a program installed on a computer to realize the functions of the present invention, a medium storing the program, a World Wide Web (WWW) server from which the program is downloaded, and a processor that executes the program. In particular, the technical scope of the present invention also includes a non-transitory computer-readable medium storing a program that causes a computer to execute at least the processing steps included in the above-described embodiments.

Claims (9)

a storage unit that stores a target sound collected by a sound collection unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving unit that receives a listening location image, the listening location image being an image of a location different from the predetermined location, where a user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the target sound is listened to under a predetermined environment at the predetermined location;
a search unit that searches the storage unit for the predetermined location image similar to the received listening location image;
a target sound acquisition unit that acquires a target sound associated with the searched predetermined location image;
a first characteristic acquisition unit that acquires a first characteristic of the sound collection unit;
a processed target sound generation unit that acquires a first processing correction value for processing the target sound based on the first characteristic, and processes the target sound using the acquired first processing correction value to generate a processed target sound;
a sample sound generation unit that processes the generated processed target sound to generate the sample sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition unit that acquires a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating unit that obtains a second processing correction value for processing the sample sound based on the second characteristic, and processes the sample sound using the obtained second processing correction value to generate a processed sample sound;
an output control unit that controls the generated processed sample sound and outputs it from the output unit;
A target sound processing device comprising: A model generation unit that generates a learned predetermined location image model by training an artificial intelligence to learn the predetermined location image,
The target sound processing device according to claim 1 , wherein the search unit searches the storage unit for the predetermined location image similar to the listening location image by using the learned predetermined location image model. The target sound processing device described in claim 1 or 2, wherein the search unit searches the storage unit for a predetermined location image similar to the listening location image based on the degree of similarity between the listening location image and the predetermined location image. The target sound processing device described in any one of claims 1 to 3, wherein the processed sample sound includes at least one of indoor noise caused by external noise, noise propagating from an adjacent room, noise propagating from inside or outside the building to the site boundary, indoor noise caused by air conditioning equipment, floor impact sound insulation performance, and indoor reverberation time. The target sound processing device described in claim 2, wherein the model generation unit generates the trained predetermined location image model using left-right inversion as padding data. The target sound processing device described in claim 2, wherein the model generation unit generates the trained predetermined location image model using transfer learning. The target sound processing device described in any one of claims 1 to 6, wherein the listening location image is an image captured according to a predetermined imaging method. a storing step of storing a target sound collected by a sound collecting unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving step of receiving a listening location image of a location different from the predetermined location where the user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the target sound is listened to in a predetermined environment at the predetermined location;
a searching step of searching a storage unit for an image of the predetermined location similar to the received image of the listening location;
a target sound acquisition step of acquiring a target sound associated with the searched predetermined location image;
a first characteristic acquisition step of acquiring a first characteristic of the sound collection unit;
a processed target sound generation step of acquiring a first processing correction value for processing the target sound based on the first characteristic, and processing the target sound using the acquired first processing correction value to generate a processed target sound;
a sample sound generating step of processing the generated processed target sound to generate the sample sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition step of acquiring a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating step of acquiring second processing correction values for processing the sample sound based on the second characteristic, and processing the sample sound using the acquired second processing correction values to generate a processed sample sound;
an output control step of controlling the generated processed sample sound to output it from the output unit;
A target sound processing method including: a storing step of storing a target sound collected by a sound collecting unit at a predetermined location and a predetermined location image obtained by capturing the predetermined location in association with each other;
an image receiving step of receiving a listening location image of a location different from the predetermined location where the user wishes to listen to a listening sound that reproduces absolute sound, which is a sound that is actually heard when the target sound is listened to in a predetermined environment at the predetermined location;
a searching step of searching a storage unit for an image of the predetermined location similar to the received image of the listening location;
a target sound acquisition step of acquiring a target sound associated with the searched predetermined location image;
a first characteristic acquisition step of acquiring a first characteristic of the sound collection unit;
a processed target sound generation step of acquiring a first processing correction value for processing the target sound based on the first characteristic, and processing the target sound using the acquired first processing correction value to generate a processed target sound;
a sample sound generating step of processing the generated processed target sound to generate the sample sound that reproduces an absolute sound that is a sound that is actually heard when the target sound is listened to in a predetermined environment at a location different from the predetermined location;
a second characteristic acquisition step of acquiring a second characteristic of an output unit for outputting the generated sample sound;
a processed sample sound generating step of acquiring second processing correction values for processing the sample sound based on the second characteristic, and processing the sample sound using the acquired second processing correction values to generate a processed sample sound;
an output control step of controlling the generated processed sample sound to output it from the output unit;
A target sound processing program that causes a computer to execute the above.