JP7188545B2 - Out-of-head localization system and out-of-head localization method - Google Patents

Description

The present invention relates to an out-of-head localization processing system and out-of-head localization processing method.

Patent Literature 1 discloses a system for controlling sound image localization when listening to audio through earphones or headphones while viewing an image on a display device. The system of Patent Document 1 uses a filter that convolves an impulse response obtained by transforming a transfer function from a speaker to both ears into a time domain. Further, an adder circuit is provided for each of the left and right outputs of the earphone or headphone. The adding circuit adds the audio signals from the digital filters.
An audio signal from the adder circuit is converted into an analog signal by a DAC (Digital to Analog Converter). The converted audio signal is supplied to the transducer through an amplifier circuit. Furthermore, in Patent Document 1, the localization position of the sound image is controlled according to the movement distance and rotation of the display or the listener's head.

By the way, as a sound image localization technique, there is an out-of-head localization technique in which a sound image is localized outside the listener's head using headphones. In the out-of-head localization technology, the sound image is localized out of the head by canceling the characteristics from the headphones to the ears and giving the four characteristics (spatial sound transfer characteristics) from the stereo speakers to the ears.

In out-of-head localization reproduction, for example, a measurement signal (impulse sound, etc.) emitted from a two-channel (hereinafter referred to as ch) speaker is placed in the ear of the listener (hereinafter referred to as a microphone). to record. This allows the characteristics from the speaker to the microphone (
Also referred to as spatial acoustic transfer characteristics, spatial acoustic transfer function, head-related transfer function HRTF, etc.), and based on the spatial acoustic transfer characteristics obtained by collecting the measured signals, a processing unit generates a filter. The out-of-head localization processing device convolves the filter with the 2ch audio signal.

Furthermore, in order to generate a filter that cancels the characteristics from the headphones to the ear, the characteristics from the headphones to the ear to the eardrum (also called the external auditory canal transfer function ECTF, external auditory canal transfer characteristics) are measured with a microphone placed in the listener's own ear. do.

JP 2010-147529 A

When performing out-of-head localization processing, it is preferable to measure the characteristics with a microphone placed in the listener's own ear. However, it is difficult to properly place the microphone in the listener's own ear. Furthermore, the measurement location for measuring the spatial sound transfer characteristics from the speaker to the microphone is also limited. On the other hand, when characteristics other than those of the listener are used, there is a possibility that out-of-head localization processing cannot be appropriately performed. In particular, since the shape of the ear canal differs from person to person or from ear to ear, it may not be possible to perform appropriate processing when using a filter that corresponds to another person's ear canal transfer characteristics.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an out-of-head localization processing apparatus, a processing method, and a program capable of performing appropriate processing.

The out-of-head localization processing system according to the present embodiment includes a measuring device for measuring transfer characteristics using a microphone attached to the ear of the user, and a filter corresponding to the transfer characteristics before the user sits on the seat. and a server for transmitting a filter corresponding to the transfer characteristic to the out-of-head localization processing apparatus based on the identification information of the user. is.

The out-of-head localization processing method according to this embodiment comprises the steps of measuring transmission characteristics using a microphone worn on the user's ear before the user boards a vehicle, and a step of transmitting a filter corresponding to the transfer characteristics to an out-of-head localization processing device installed in the vehicle; and outputting the out-of-head localization-processed reproduction signal from headphones or earphones to the user corresponding to the identification information.

The filter generation device according to the present embodiment includes an ear canal transfer characteristic acquisition unit that acquires the ear canal transfer characteristic from the headphone or earphone worn by the user to the microphone, and a first characteristic corresponding to the spatial sound transfer characteristic from the speaker to the microphone. Data and the second characteristic data corresponding to the ear canal transfer characteristics are set as one set, and by referring to a database storing a plurality of sets, the frequency characteristics in the first frequency band of the ear canal transfer characteristics of the user are obtained. a first selection unit that selects a first set based on, a first acquisition unit that acquires second characteristic data included in the first set selected by the first selection unit; A second selection unit that selects a second set based on frequency characteristics in a second frequency band of the ear canal transfer characteristics of the user by referring to the database, and selected by the second selection unit a second acquisition unit that acquires second characteristic data included in the second set; a third acquisition unit that acquires preset data set in advance; and the second acquisition unit of the first set. a filter generation unit that generates a filter corresponding to the spatial sound transfer characteristic of the user based on the characteristic data, the second characteristic data of the second set, and the preset data. .

The filter generation method according to the present embodiment includes the step of acquiring the ear canal transfer characteristic from the headphone or earphone worn by the user to the microphone, the first characteristic data corresponding to the spatial sound transfer characteristic from the speaker to the microphone, and By referring to a database that stores a plurality of sets of second characteristic data corresponding to the ear canal transfer characteristic as one set, based on the frequency characteristic in the first frequency band of the ear canal transfer characteristic of the user, the first selecting one set; obtaining second characteristic data included in the first set; and referring to the database to determine the frequency in the second frequency band of the user's ear canal transfer characteristic. selecting a second set based on the characteristics; obtaining second characteristic data included in the second set; obtaining preset data; generating a filter according to the spatial sound transfer characteristics of the user based on the set of second characteristic data, the second set of second characteristic data, and the preset data. It is a filter thing.

An object of the present invention is to provide an out-of-head localization processing system, a filter generation device, a method, and a program capable of performing appropriate processing.

1 is a block diagram showing an out-of-head localization processing apparatus according to this embodiment; FIG. It is a schematic diagram which shows the measuring apparatus for measuring an external auditory canal transfer characteristic. It is a figure which shows the whole structure of a system. It is a figure which shows the structure of a server terminal. 1 is a diagram showing a boarding seat and a seat terminal installed in an aircraft; FIG. It is a flowchart which shows the process in a measuring device. 4 is a flowchart showing processing in a server terminal; 2 is a block diagram showing the configuration of a filter generation device according to a second embodiment; FIG. 4 is a table showing first and second characteristic data stored in a database; FIG. 2 is a diagram for explaining direct sound and reflected sound in a collected sound signal; FIG. FIG. 11 is a block diagram showing the configuration of a processing device according to a third embodiment; FIG. FIG. 10 is a diagram for explaining convolution processing and volume adjustment in a 5.1 ch reproduction signal; FIG. 10 is a diagram showing filters before and after applying an LPF in example 1 of the fourth embodiment; FIG. FIG. 20 is a diagram showing a filter to which a reverberation component is added in Example 2 of Embodiment 4;

An outline of out-of-head localization processing according to the present embodiment will be described. The out-of-head localization processing according to this embodiment uses the spatial sound transfer characteristics and the ear canal transfer characteristics to perform the out-of-head localization processing. Spatial sound transfer characteristics are transfer characteristics from a sound source such as a speaker to the ear canal. The ear canal transfer characteristic is the transfer characteristic from the speaker unit of the headphone or earphone to the eardrum.
In this embodiment, out-of-head localization processing can be performed using a filter corresponding to the spatial sound transfer characteristics measured without wearing headphones or earphones. Furthermore, using a filter according to the ear canal transfer characteristics measured while wearing headphones or earphones,
Out-of-head localization processing can be performed.

The out-of-head localization processing according to this embodiment is executed by a user terminal such as a personal computer, a smart phone, or a tablet PC. Furthermore, the user terminal that performs out-of-head localization processing is
It may be a playback device mounted on a vehicle such as an aircraft, a train (railway vehicle), a ship, or a bus. In this case, the passenger in the passenger seat of the vehicle performs out-of-head localized listening. A user terminal is an information processing device having processing means such as a processor, storage means such as a memory and a hard disk, display means such as a liquid crystal monitor, and input means such as a touch panel, buttons, keyboard, and mouse. A user terminal may have a communication function for transmitting and receiving data. Furthermore, output means (output unit) having headphones or earphones are connected to the user terminal. Although an example using headphones will be described below, earphones may be used instead of headphones.
Embodiment 1.
(Out-of-head stereotactic processing device)
FIG. 1 shows an out-of-head localization processing device 100, which is an example of a sound field reproducing device according to the present embodiment. FIG. 1 is a block diagram of an out-of-head localization processing apparatus 100. As shown in FIG. The out-of-head localization processing device 100 reproduces a sound field for the user U wearing the headphones 43 . Therefore, the out-of-head localization processing apparatus 100 performs out-of-head localization processing on the Lch and Rch stereo input signals XL and XR. The Lch and Rch stereo input signals XL and XR are analog audio reproduction signals output from a CD (Compact Disc) player or the like, or digital audio data such as mp3 (MPEG Audio Layer-3). Note that the audio reproduction signal or digital audio data will be collectively referred to as a reproduction signal. That is, Lch and Rch stereo input signal XL
, and XR are reproduction signals.

It should be noted that the out-of-head localization processing apparatus 100 is not limited to a physically single apparatus, and a part of the processing may be performed by a different apparatus. For example, part of the processing may be performed by a smart phone or the like, and the rest of the processing may be performed by a DSP (Digital Signal Processor) built in the headphones 43 or the like.

The out-of-head localization processing device 100 includes an out-of-head localization processing unit 10, a filter unit 41, a filter unit 42,
and headphones 43 are provided. The out-of-head localization processing unit 10, filter unit 41, and filter unit 42 can be specifically realized by a processor or the like.

The out-of-head localization processing unit 10 includes convolution calculation units 11 to 12, 21 to 22, and adders 24, 2
5. The convolution calculation units 11 to 12 and 21 to 22 perform convolution processing using spatial acoustic transfer characteristics. Stereo input signals XL and XR from a CD player or the like are input to the out-of-head localization processing unit 10 . Spatial sound transfer characteristics are set in the out-of-head localization processing unit 10 . The out-of-head localization processing unit 10 convolves a spatial acoustic transfer characteristic filter (hereinafter, also referred to as a spatial acoustic filter) with stereo input signals XL and XR of each channel. The spatial sound transfer characteristic may be a head-related transfer function HRTF measured from the head or pinna of the person to be measured, or may be a head-related transfer function of a dummy head or a third person.

A set of four spatial sound transfer characteristics Hls, Hlo, Hro, and Hrs is defined as a spatial sound transfer function. The data used for convolution in the convolution calculation units 11, 12, 21, and 22 serve as spatial acoustic filters. A spatial acoustic filter is generated by cutting out the spatial acoustic transfer characteristics Hls, Hlo, Hro, and Hrs with a predetermined filter length.

Spatial sound transfer characteristics Hls, Hlo, Hro, and Hrs are obtained in advance by impulse response measurement or the like. For example, the user U wears microphones on the left and right ears, respectively. Left and right speakers placed in front of the user U output impulse sounds for impulse response measurement. Then, a measurement signal such as an impulse sound output from the speaker is picked up by a microphone. Spatial sound transfer characteristic Hl
s, Hlo, Hro, Hrs are obtained. Spatial sound transfer characteristics Hls between the left speaker and the left microphone, Spatial sound transfer characteristics Hlo between the left speaker and the right microphone, Spatial sound transfer characteristics Hro between the right speaker and the left microphone, Right speaker and the right microphone The spatial sound transfer characteristic Hrs between is measured.

Then, the convolution calculation unit 11 convolves the Lch stereo input signal XL with a spatial acoustic filter corresponding to the spatial acoustic transfer characteristic Hls. The convolution calculation unit 11 outputs the convolution calculation data to the adder 24 . The convolution calculation unit 21 converts the Rch stereo input signal XR
A spatial acoustic filter corresponding to the spatial acoustic transfer characteristic Hro is convoluted with respect to . The convolution calculation unit 21 outputs the convolution calculation data to the adder 24 . The adder 24 adds the two pieces of convolution operation data and outputs the result to the filter section 41 .

The convolution calculation unit 12 calculates the spatial sound transfer characteristic Hl for the Lch stereo input signal XL.
Convolve the spatial acoustic filter according to o. The convolution calculation unit 12 outputs the convolution calculation data to the adder 25 . The convolution calculation unit 22 convolves a spatial acoustic filter corresponding to the spatial acoustic transfer characteristic Hrs with respect to the Rch stereo input signal XR. The convolution calculation unit 22 outputs the convolution calculation data to the adder 25 . The adder 25 adds the two pieces of convolution operation data and outputs the result to the filter section 42 .

Inverse filters Linv and Rinv for canceling headphone characteristics (characteristics between the reproduction unit of the headphones and the microphone) are set in the filter units 41 and 42 . Then, an inverse filter Linv,
Convolve Rinv. In the filter unit 41, the Lch signal from the adder 24 is convoluted with an inverse filter Linv of headphone characteristics on the Lch side. Similarly, filter section 42 includes adder 2
The Rch signal from 5 is convolved with an inverse filter Rinv of headphone characteristics on the Rch side. The inverse filters Linv and Rinv cancel the characteristics from the headphone unit to the microphone when the headphones 43 are worn. The microphone can be placed anywhere between the ear canal entrance and the eardrum.

Filter section 41 outputs processed Lch signal YL to left unit 43L of headphone 43 . The filter section 42 outputs the processed Rch signal YR to the right unit 43R of the headphone 43 . A user U wears headphones 43 . Headphones 43 are L
A ch signal YL and an Rch signal YR (hereinafter, the Lch signal YL and the Rch signal are collectively referred to as a stereo signal) are output to the user U. Thereby, a sound image localized outside the head of the user U can be reproduced.

In this way, the out-of-head localization processing apparatus 100 uses the spatial sound transfer characteristics Hls, Hlo, Hro,
Out-of-head localization processing is performed using a spatial acoustic filter corresponding to Hrs and inverse filters Linv and Rinv of headphone characteristics. In the following description, spatial sound transfer characteristics Hls, H
Spatial acoustic filter corresponding to lo, Hro, Hrs and inverse filter Lin for headphone characteristics
v and Rinv are collectively used as an out-of-head localization processing filter. In the case of a 2ch stereo reproduction signal, the out-of-head localization filter is composed of four spatial acoustic filters and two inverse filters. Then, the out-of-head localization processing apparatus 100 performs out-of-head localization processing by performing convolution processing on the stereo reproduction signal using a total of six out-of-head localization filters. The out-of-head localization filter is preferably based on user U's individual measurements. For example, an out-of-head localization filter is set based on a sound signal picked up by a microphone attached to the user's U ear. In order to reduce the memory capacity, the filters may be calculated and combined into four filters.

Thus, the spatial acoustic filter and the inverse headphone characteristic filter are filters for audio signals. By convolving these filters with the reproduced signals (stereo input signals XL and XR), the out-of-head localization processing apparatus 100 executes out-of-head localization processing. In other words, the out-of-head localization processing device 100 serves as a reproduction device that reproduces a sound field in which a sound image is localized out-of-head.
(measuring device)
Next, a measuring device for measuring transfer characteristics will be described with reference to FIG. FIG. 2 is a diagram schematically showing the measurement configuration of the measurement device 200. As shown in FIG. Note that the measuring device 200 may be a common device with the out-of-head localization processing device 100 shown in FIG. Alternatively, part or all of the measurement device 200 may be a device different from the out-of-head localization processing device 100 .

As shown in FIG. 2, the measuring device 200 includes a stereo speaker 5, a stereo microphone 2,
It has a headphone 43 and a processing device 201 . A stereo speaker 5 is installed in the measurement environment. The measurement environment may be a room in the person to be measured 1's home, an audio system store, a showroom, or the like. Also, the measurement environment may be installed in various facilities used when boarding a vehicle, such as airports, stations, harbors, and bus terminals.

In this embodiment, the processing device 201 of the measuring device 200 performs arithmetic processing for appropriately generating an out-of-head localization filter according to the measurement result. The processing device 201 includes a measurement signal generation section 211 , a collected sound signal acquisition section 212 and a filter generation section 213 . The processing device 201 is a personal computer (PC), tablet terminal, smart phone, or the like, and includes a memory and a CPU. The memory stores processing programs, various parameters, measurement data, and the like. The CPU executes a processing program stored in memory. By executing the processing program by the CPU, the measurement signal generation unit 211 and the collected sound signal acquisition unit 2
12, each process of the filter generator 213 is executed.

The measurement signal generator 211 generates a measurement signal for measuring ear canal transfer characteristics or spatial sound transfer characteristics. The measurement signal is, for example, an impulse signal or a TSP (Time Stroke
hed pulse) signal and the like. Here, using an impulse sound as the measurement signal,
A measurement device 200 is performing an impulse response measurement.

When measuring the spatial sound transfer characteristics Hls, Hlo, Hro, and Hrs, the measurement device 200 performs measurement using the stereo speakers 5 . That is, the person 1 to be measured does not wear the headphones 43 but only the stereo microphone 2 . Then, a measurement signal is output from the stereo speaker 5 and the measurement signal is picked up by the stereo microphone 2 . Spatial sound transfer characteristics Hls, Hlo, H
Headphones 43 are not used when measuring ro, Hrs.

When measuring the ear canal transfer characteristics, the measurement device 200 performs measurement using the headphones 43 . That is, the subject 1 wears the stereo microphone 2 and the headphones 43 . and,
A measurement signal is output from the headphone 43, and the stereo microphone 2 picks up the measurement signal. Stereo speakers 5 are not used when measuring ear canal transfer characteristics.

First, spatial sound transfer characteristics Hls, Hlo, Hro, Hrs (hereinafter simply transfer characteristics Hls
, Hlo, Hro, and Hrs) and generating a spatial acoustic filter. The stereo speaker 5 has a left speaker 5L and a right speaker 5R. For example, a left speaker 5L and a right speaker 5R are installed in front of the person 1 to be measured. The left speaker 5L and the right speaker 5R output measurement signals for impulse response measurement. In the following description of the present embodiment, the number of speakers serving as sound sources is two (stereo speakers), but the number of sound sources used for measurement is not limited to two, and may be one or more. That is, the present embodiment can be similarly applied in a so-called multi-channel environment such as 1ch monaural, 5.1ch, 7.1ch, and the like.

The stereo microphone 2 has a left microphone 2L and a right microphone 2R. Left mic 2L
is installed on the subject's 1 left ear 9L, and the right microphone 2R is installed on the subject's 1 right ear 9R. Specifically, it is preferable to install the microphones 2L and 2R at positions from the entrance of the ear canal of the left ear 9L and the right ear 9R to the eardrum. The microphones 2L and 2R pick up the measurement signal output from the stereo speaker 5 to acquire the picked-up sound signal. The microphones 2L and 2R output picked-up sound signals to the processing device 201. FIG. The person 1 to be measured may be a person or a dummy head. i.e.
In this embodiment, the person to be measured 1 is a concept including not only a person but also a dummy head.

The left microphone 2 L and the right microphone 2 R of the stereo microphone 2 each pick up the measurement signal and output the picked-up sound signal to the processing device 201 . The collected sound signal acquisition unit 212 receives the left microphone 2L, the right microphone 2R,
Acquire the collected sound signal. The collected sound signal acquisition unit 212 may include an A/D converter that A/D converts the collected sound signals from the microphones 2L and 2R. Acquired sound signal acquisition unit 212
may synchronously add signals obtained by multiple measurements.

When the left speaker 5L outputs the impulse sound, the collected sound signal acquisition unit 212 acquires a collected sound signal corresponding to the transfer characteristic Hls and a collected sound signal corresponding to the transfer characteristic Hlo. after that,
By outputting the impulse sound from the right speaker 5R, the collected sound signal acquisition unit 212 acquires the transfer characteristic H
A picked-up sound signal corresponding to rs and a picked-up sound signal corresponding to the transfer characteristic Hro are obtained. The order of the measurement by the left speaker 5L and the measurement by the right speaker 5R may be reversed.

As described above, the impulse sounds output by the left and right speakers 5L and 5R are transferred to the microphones 2L and 2
Measuring with R measures the impulse response. The processing device 201 stores the picked-up sound signal acquired based on the impulse response measurement in a memory or the like. As a result, the transfer characteristic Hls between the left speaker 5L and the left microphone 2L, the transfer characteristic Hlo between the left speaker 5L and the right microphone 2R, the transfer characteristic Hro between the right speaker 5R and the left microphone 2L, the right speaker A transfer characteristic Hrs between 5R and the right microphone 2R is measured. That is, the measurement signal output from the left speaker 5L is picked up by the left microphone 2L to obtain the transfer characteristic Hls. The transfer characteristic Hlo is acquired by the right microphone 2R picking up the measurement signal output from the left speaker 5L. The measurement signal output from the right speaker 5R is picked up by the left microphone 2L to obtain the transfer characteristic Hro. The transfer characteristic Hrs is acquired by the right microphone 2R picking up the measurement signal output from the right speaker 5R.

Then, the filter generation unit 213 generates filters according to the transfer characteristics Hls, Hlo, Hro, Hrs from the left and right speakers 5L, 5R to the left and right microphones 2L, 2R based on the collected sound signals. The filter generator 213 cuts out the transfer characteristics Hls, Hlo, Hro, and Hrs with a predetermined filter length and performs predetermined arithmetic processing. By doing so, the processing device 201 generates a spatial acoustic filter used in the convolution operation of the out-of-head localization processing device 100 .

Next, the measurement of the ear canal transfer characteristics and the generation of the inverse filters Linv and Rinv will be described. The subject 1 wears the headphones 43 with the microphones 2L and 2R attached to the left and right ears 9L and 9R. That is, the subject 1 wears the headphones 43 over the left and right microphones 2L and 2R. The left microphone 2L and the right microphone 2R are configured so as not to interfere with the headphone 43. FIG. That is, the left microphone 2L and the right microphone 2R are connected to the left ear 9L and the right ear 9R.
The person to be measured 1 can wear the headphones 43 while the headphones 43 are arranged at appropriate positions.

The measurement signal generated by the measurement signal generator 211 is output from the left unit 43L and the right unit 43R of the headphone 43, respectively. The left microphone 2L picks up sound output from the left unit 43L of the headphone 43 . The right microphone 2R is connected to the right unit 43 of the headphone 43.
Sound output from R is collected.

In this way, the microphones 2L and 2R pick up the measurement signal output from the headphone 43 and detect the picked-up sound signal. The collected sound signal acquisition unit 212 acquires the collected sound signals from the microphones 2L and 2R. It should be noted that the measurement of the ear canal transfer characteristics and the spatial sound transfer characteristics may be performed using another processing device 201 and at another location. Therefore, it is possible to measure the ear canal transfer characteristics even in a place other than the measurement environment where the stereo speakers 5 are provided.

The processing device 201 stores the picked-up sound signal based on the impulse response measurement in a memory or the like. As a result, the transfer characteristic between the left unit 43L and the left microphone 2L (that is, the ear canal transfer characteristic ECTFL of the left ear 9L) and the transfer characteristic between the right unit 43R and the right microphone 2R (that is, the Ear canal transfer characteristics (ECTFR) are obtained. The processing device 201 has a memory or the like for storing measurement data.

The processing device 201 applies an inverse filter L
Calculate inv and Rinv respectively. For example, the processing device 201 calculates frequency-amplitude characteristics and frequency-phase characteristics of the ear canal transfer characteristics by discrete Fourier transform, discrete cosine transform, or the like. Then, the processing device 201 obtains the inverse characteristic of the frequency-amplitude characteristic. Note that the processing device 201 may correct the frequency amplitude characteristic or its inverse characteristic for each frequency band. The processing unit 201 calculates a time signal using the inverse characteristic and the phase characteristic by inverse discrete Fourier transform or the like. The processing device 201 calculates an inverse filter by cutting out the time signal with a predetermined filter length. As described above, the inverse filter is a filter that cancels the headphone characteristics (the characteristics between the headphone playback unit and the microphone). In addition, since a well-known method can be used for the calculation method of the inverse filter, detailed description thereof will be omitted.

The processing unit 201 stores filters according to the spatial sound transfer characteristics Hls, Hlo, Hro, Hrs and left and right inverse filters Linv, Rinv. If the processing device 201 and the out-of-head localization processing device 100 are different devices, the processing device 201 transmits the filter and the inverse filter to the out-of-head localization processing device 100 . Note that the connection between the headphones 43 or the stereo speakers 5 and the processing device 201 may be a wireless connection using Bluetooth (registered trademark) or the like.

Here, an out-of-head localization filter suitable for the user U can be generated by measuring the user U who performs out-of-head localization processing listening with the measurement device 200 . That is, with the user U as the person to be measured 1, the measurement apparatus 200 performs spatial acoustic transfer characteristics and ear canal transfer characteristics to generate an out-of-head localization filter (hereinafter simply referred to as a filter) unique to the user U. can be done.
(System configuration)
Next, a system configuration for filter generation and out-of-head localization processing will be described with reference to FIG. FIG. 3 is a diagram schematically showing the overall configuration of the system. A system 1000 includes a measuring device 200 and a server terminal 600 . Referring to FIG. 3, a system 1000 for performing out-of-head localization for occupants of aircraft 500 is shown. In other words, user U shown in FIG. 1 becomes a passenger on aircraft 500 . Here, the filter can be set for each passenger by storing the filter and the identification information of the passenger in association with each other. Therefore, out-of-head localization processing can be performed using a different filter for each passenger.

The measuring device 200 is similar to the measuring device 200 shown in FIG. Here, the measuring device 2
00 is installed at the airport. For example, the measuring device 200 may be installed in an airline lounge or the like. When the lounge is used as the measurement environment, stereo speakers 5, headphones 43, processing device 201, and the like are installed in the lounge. In addition, the lounge has
A desk or the like for installing the measuring device 200 may be provided. The processing device 201 may have the out-of-head localization processing function of the out-of-head localization processing device 100 shown in FIG.

The measuring device 200 is provided with input means 221 , display means 222 , communication means 223 and an antenna 224 . The input means 221 includes a keyboard, mouse, touch panel, etc., and receives input from the passenger or operator. Alternatively, when accepting voice input, the input means 221 has a microphone and a voice recognition function. display means 222
has a monitor, etc., and displays an input screen and a measurement screen.

The passenger operates the input means 221 while checking the input screen displayed on the display means 222 to input identification information for identifying the passenger. The identification information is unique information given to each passenger. For example, a membership number (member ID) of a mileage club of an airline company of aircraft 500 boarded by a passenger can be used as identification information. In this case, the input means 221 may be a card scanner or the like for scanning a mileage card. The input unit 221 may be a device that reads identification information displayed on the screen of the smartphone or identification information stored in an IC chip built into the smartphone.

As described in FIG. 2, the measurement device 200 makes measurements and generates filters. Here, the headphones 43 are of the same type as the headphones carried on the aircraft 500 . Headphones 43 are loaned from airlines. Alternatively, the passenger can purchase the headphones 43 . Alternatively, a plurality of headphones 43 may be prepared and passengers may carry the headphones 43 used for measurement into the cabin. When the model of the headphones 43 differs for each flight, it is preferable to prepare the headphones 43 of each model in the measurement environment.

Measuring device 200 transmits the generated filter to server terminal 600 . Measuring device 200
transmits the filter to the server terminal 600 in association with the identification information. Accordingly, server terminal 600 receives the identification information of the passenger and the filter. The server terminal 600 may be placed inside the aircraft or outside the aircraft.

For example, the communication means 223 has a modulation circuit or the like that modulates data of filters and identification information. Data modulated by communication means 223 is transmitted from antenna 224 . Antenna 601 of server terminal 600 receives data transmitted from antenna 224 .

FIG. 4 is a diagram schematically showing the server terminal 600. As shown in FIG. The receiving means 602 includes a demodulation circuit or the like for demodulating the received data. Server terminal 600 sets a filter to seat terminal 511 in aircraft 500 according to the identification information.

Aircraft 500 includes multiple passenger seats and multiple seat terminals 511 . in short,
In the aircraft 500, a seat terminal 511 is provided for each passenger seat. FIG. 5 shows an example of a passenger seat and a seat terminal 511. As shown in FIG. In FIG. 5 , a user U (passenger) who is a passenger is sitting in a passenger seat 521 . A user U is wearing headphones 43 . The headphones 43 worn by the user U in the cabin are of the same model as the headphones 43 used for the measurement.

The seat terminal 511 is installed, for example, under the passenger seat 521 or on an armrest. Here, a seat terminal 511 is installed for each passenger seat 521 . A headphone 43 is connected to an earphone jack (not shown) provided on the seat terminal 511 . seat terminal 51
1 corresponds to the out-of-head localization processing apparatus 100 shown in FIG.

A seat terminal 511 is installed for each passenger seat 521 . That is, the plurality of boarding seats 521 and the plurality of seat terminals 511 are associated one-to-one. The server terminal 600 is connected to the passenger seat 5
21 and the terminal number of the seat terminal 511 are associated and stored. seat terminal 5
The terminal number 11 is unique information such as the IP address of the seat terminal 511, for example. Furthermore, in aircraft 500, a boarding seat 521 is designated for each passenger. In other words, the server terminal 600 associates and stores the identification information of the passenger and the boarding seat.

For example, airlines manage passenger identification information, flight numbers, seat numbers, and terminal numbers. Therefore, the server terminal 600 can specify the aircraft and the boarding seat of the passenger by referring to the identification information. The server terminal 600 then transmits the filter to the seat terminal 511 corresponding to the specified boarding seat 521 .

In this way, the measuring device 200 transmits the filter to the server terminal 600 in association with the identification information for identifying the passenger. Then, the server terminal 600 refers to the identification information and transmits the filter to the seat terminal 511 of the passenger's boarding seat 521 . This allows system 1000 to set an appropriate filter for each passenger.

Next, processing in the measuring device 200 will be described using FIG. FIG. 6 is a flowchart showing processing in the measuring device 200. As shown in FIG. First, the ID (identification information) of the passenger is input to the processing device 201 by the operation of the passenger (user U) (S1). Processing device 2
01 stores identification information. Then, the processing device 201 confirms the passenger's flight number and seat number corresponding to the identification information (S2). For example, the processing device 201 may use the server terminal 60
Check the flight number and seat number by referring to the information in 0. If the processing device 201 cannot confirm the flight number or seat number (NO in S2), it displays an error message (S3
),finish. That is, since the processing device 201 cannot specify the flight number and seat number corresponding to the passenger identification information, the processing ends after displaying an error message.

If the processing device 201 can confirm the flight number or seat number (YES in S2), the measuring device 200 measures the spatial sound transfer characteristics and the ear canal transfer characteristics (S4). The order of measuring the spatial sound transfer characteristics and the ear canal transfer characteristics is not particularly limited. Then, the processing device 201 generates a filter based on the measurement result (S5). Here, the processing unit 201 includes four spatial acoustic filters and left and right inverse filters Linv, Rin
Save the out-of-head localization filter containing v.

Next, using the filter generated in S5, the out-of-head localization processing device 100 causes the user U to listen to the reproduced signal after out-of-head localization processing (S6). That is, the user U wears the headphones 43 and performs out-of-head localization listening. As a result, a sound field in which the sound image is localized outside the head can be reproduced. Here, the out-of-head localization processing device 100 may be the same device as the processing device 201 that performed the measurement in S4 and the filter generation in S5, or may be a separate device. If the processing device 201 and the out-of-head localization processing device 100 are physically separate devices, the processing device 201 transmits the filter to the out-of-head localization processing device 100 wirelessly or by wire.

Then, the processing device 201 or the out-of-head localization processing device 100 determines whether or not to adopt this sound field (S7). The processing device 201 or the out-of-head localization processing device 100 determines whether or not to adopt this sound field according to user input. For example, the display means 222 displays on the monitor a message and a selection button for confirming whether or not the auditioned sound field is acceptable. Alternatively, the processing unit 201 may ask for a voice message.

By operating the input means 221, the user U can select whether or not to adopt the sound field that has been auditioned. That is, the user U specifies whether the sound field is appropriate or not according to the listening result of the out-of-head localization listening. If the user U feels uncomfortable with the sound field subjected to out-of-head localization processing, he or she makes an input so as not to adopt this sound field. If the out-of-head localization-reproduced sound field is the desired sound field, the user U makes an input to adopt this sound field. The user U selects (for example, clicks or taps) a button for adopting or not adopting the sound field (filter) according to the auditory sense of the sound field. Then, based on the user input, the processing device 201 determines whether or not to adopt the sound field.

When it is determined that this sound field is not adopted (NO in S7). The processing device 201 determines whether or not there is a request for remeasurement (S8). The processing device 201 or the out-of-head localization processing device 100 determines whether or not there is a request for re-measurement according to user input. For example, the display means 222
Display a remeasurement button, an end button, etc. on the monitor. Alternatively, the processing device 201
An inquiry about remeasurement may be made by a voice message.

The user U selects the remeasurement button when performing remeasurement. The user U selects the end button when not re-measuring. Upon receiving the user input, the processing device 201 determines whether or not to perform re-measurement based on the user input. Of course, input/output using a voice message may be used.

If it is determined in S8 that there is no remeasurement request (NO in S8), the processing device 201 ends the process. If it is determined in S8 that there is a remeasurement request (YES in S8)
, and returns to S4 for re-measurement. Then, based on the re-measurement result, the measuring device 200 generates a filter (S5). Then, the out-of-head localization processing apparatus 100 uses the filter obtained by the remeasurement to perform trial listening again. (S6).

In S7, when the processing device 201 determines to adopt this sound field (YES in S7
), and accepts the payment of the fee by the user U (S9). Here, the fee is not limited to payment by credit card or cash, but payment by points such as airline miles (mileage) may be used. Then, the processing device 201 transmits personal data including the filter and identification information to the server terminal 600 (S10). This ends the processing.

Next, processing in server terminal 600 will be described using FIG. FIG. 7 is a flow chart showing processing in the server terminal 600. As shown in FIG. First, the server terminal 600
It is determined whether or not the passenger's ID (identification information) has been received (S11). Here, it is determined whether or not the server terminal 600 has received the identification information input in S1 of FIG. If the server terminal 600 has not received the identification information (NO in S11),
Repeat the process until received.

When the server terminal 600 receives the identification information (YES in S11), it searches for the flight number, seat number, and seat terminal number corresponding to the identification information, and transmits them to the processing device 201 (S1
2). The server terminal 600 identifies the flight number, seat number, and seat terminal number of the passenger of the identification information by referring to flight information managed by the airline company. Note that the processing device 201 performs the determination in S2 of FIG. 6 based on the flight number and seat number transmitted in S12.

Next, the server terminal 600 determines whether or not the notice of intention to pay has been received (S13).
Here, server terminal 600 determines whether or not payment has been made in S9 of FIG. If the server terminal 600 has not received the notice of intention to pay the fee (N in S13
O), wait until receiving notification of intention to pay;

When the server terminal 600 receives the notice of intention to pay the fee (YES in S13), it executes the payment process (S14). Then, the server terminal 600 determines whether or not the payment has been completed (S15). If the payment has not been completed (NO in S15), the server terminal 600
), and an error message is displayed on the display means 222 (S16). That is, the server terminal 6
00 transmits an error message to the processing device 201 when the point balance is insufficient. As a result, the display means 222 of the processing device 201 displays the error message to the user U.
display for

If the payment has been completed (YES in S15), the server terminal 600 receives personal data (S17). That is, the server terminal 600 receives the personal data transmitted by the processing device 201 in S10 of FIG. Personal data includes identification information and filters. Then, server terminal 600 refers to the identification information and transfers the filter to seat terminal 511 . in short,
The filter is transmitted to the seat terminal 511 of the boarding seat corresponding to the identification information (S18). As a result, a filter corresponding to the passenger is set in the seat terminal 511. FIG.

When the passenger turns on the out-of-head localization processing function after boarding the aircraft, the seat terminal 511 performs out-of-head localization processing using a filter. In other words, the seat terminal 511 functions as the out-of-head localization processing device 100 in FIG. As a result, the headphone 43 outputs the reproduction signal subjected to the out-of-head localization processing to the passenger. Thus, the spatial sound transfer characteristics measured with respect to the occupant,
And, using a filter according to the ear canal transfer characteristics, the passenger can perform out-of-head stereotactic listening. By doing so, out-of-head localization listening can be performed using an appropriate filter.

Therefore, the passenger can relax and listen to the reproduced signal while sitting on the passenger seat 521, so that the passenger can spend a long time comfortably. Since the identification information and the filter are linked, the passenger can enjoy out-of-head stereophonic listening in the same way even after connecting flights. Furthermore, after flight arrival, the generated filter can be associated with the identification information and stored in the server terminal 600 . By doing so, it is possible to omit part or all of the measurement of the passengers in the next and subsequent flights. In addition, the use of remaining miles can be encouraged.

Furthermore, out-of-head localization processing can be performed in the entertainment system on board the aircraft. Therefore, the passenger can hear not only the reproduction signal of music but also the reproduction signal of movies and games out of head.

In summary, the system 1000 according to the first embodiment includes the measuring device 200, the seat terminal 511, and the server terminal 600. The measuring device 200 measures transfer characteristics using a microphone attached to the user's ear before the user U gets on the vehicle. The seat terminal 511 is an out-of-head localization processing device that is installed in a vehicle and performs out-of-head localization processing using a filter according to transfer characteristics. The server terminal transmits a filter according to the transfer characteristics to the seat terminal 511 based on the user's identification information. As a result, the out-of-head localization process can be appropriately performed for the passenger (user U).

In the above description, an example of out-of-head localization listening performed by an aircraft passenger was described.
Vehicles boarded by passengers are not limited to aircraft. The headphone 43 may output a reproduced signal subjected to out-of-head localization processing to passengers on trains, buses, ships, etc., as described above. In the case of trains, buses, ships, etc., the measuring device 200 may be installed in stations, bus terminals, port waiting rooms, and the like. Furthermore, the ride may be an amusement park attraction or the like. In this case, the out-of-head localization processing device 100 may be installed in a vehicle that is not limited to a vehicle that actually moves, but a vehicle that stays in place.

It is sufficient that the terminal serving as the out-of-head localization processing device is associated with the identification information of the passenger. Then, each passenger wears headphones or earphones in the passenger seat. A playback device is installed for each passenger seat, and the playback device performs out-of-head localization processing using a filter suitable for the passenger. Of course, it is not necessary to perform out-of-head localization processing for some passengers.
Furthermore, a common reproduced signal may be used for a plurality of passengers. In this case, the apparatus for reproducing the reproduced signal is common, and the processing using the out-of-head localization filter may be performed for each passenger. Moreover, the headphones or earphones are not limited to those installed in the measurement environment, and may be those brought by the user U.
Embodiment 2.
(Generation of spatial acoustic filter)
Also, in the first embodiment, the measurement apparatus 200 measures both the spatial sound transfer characteristic and the ear canal transfer characteristic, but there are cases where part of the measurement cannot be performed. Due to limitations in the measurement environment, etc., the spatial sound transfer characteristic Hls
, Hlo, Hro, Hrs, and the left and right ear canal transfer characteristics ECTFL, ECTFR may not all be measured. In particular, in the measurement of spatial sound transfer characteristics, it is necessary to install one or more speakers at positions distant from the user U. Therefore, it may not be possible to provide a wide and quiet measurement environment at an airport or the like.

On the other hand, the ear canal transfer characteristics are measured while wearing headphones. For this reason, measurement of ear canal transfer characteristics does not require a large and quiet environment as much as measurement of spatial sound transfer characteristics. Therefore, it is preferable that all of the out-of-head localization filters can be obtained by only measuring the ear canal transfer characteristics of the passenger. In other words, it is desired to generate a spatial acoustic filter suitable for a passenger without measuring spatial acoustic transfer characteristics using a speaker. The method for generating a spatial acoustic filter suitable for passengers from the measurement results of the ear canal transfer characteristics is described below.
explain.

A filter generation device that generates a spatial acoustic filter based on the measurement results of the ear canal transfer characteristics ECTFL and ECTFR will be described with reference to FIG. FIG. 8 shows the filter generation device 9
00 is a block diagram showing the configuration of FIG. It should be noted that the filter generation device 900 is the processing device 201
It may be the same device as , or it may be a different device. Furthermore, filter generation device 900 is not limited to a physically single device. For example, the filter generator 90
0 and the processing device 201 are different devices, the processing device 201 may perform part of the processing described later. Also, the database 901 may be stored in different devices, or may be distributed and stored in a plurality of devices.

The filter generation device 900 includes a database 901, a first selection unit 902, a first acquisition unit 903, a second selection unit 904, a second acquisition unit 905, a third acquisition unit 906,
First adjuster 907 , first combiner 908 , second adjuster 911 , and second combiner 9
12 , a generation unit 920 , and an ear canal transfer characteristic acquisition unit 930 .

The ear canal transfer characteristic acquisition unit 930 acquires the measurement result of the user's U ear canal transfer characteristic. note that. When the filter generation device 900 is a device different from the processing device 201, the ear canal transfer characteristics of the user U are transmitted to the ear canal transfer characteristics acquisition unit 930 by wired communication or wireless communication.

A database 901 stores characteristic data for a plurality of persons. That is, the spatial sound transfer characteristics and the ear canal transfer characteristics are measured in advance for a plurality of persons 1 to be measured. The database 901 stores data of spatial sound transfer characteristics and ear canal transfer characteristics based on measurement results for a plurality of people as characteristic data. Specifically, the database 901
stores a plurality of sets of data, with first characteristic data and second characteristic data as one set. For example, the ear canal transfer characteristics are measured in advance for N subjects 1 (N is an integer equal to or greater than 2). Therefore, the database 901 stores N sets of characteristic data for the left ear and N sets of characteristic data for the right ear.

The first characteristic data is data corresponding to spatial sound transfer characteristics from a speaker, which is a sound source, to a microphone. The first characteristic data is, for example, frequency characteristics of spatial sound transfer characteristics.
Specifically, the first characteristic data includes amplitude characteristics in the frequency domain. Of course, the first
The characteristic data of may include power characteristics instead of amplitude characteristics. Moreover, it is preferable that the first characteristic data have the frequency amplitude characteristic of the direct sound portion of the spatial sound transfer characteristic. The first characteristic data may comprise time domain signals. For example, the time domain signals are sound signals picked up by the microphones 2L and 2R of the measuring device 200. FIG. Alternatively, the time-domain signal may be a signal obtained by extracting the sound signals picked up by the microphones 2L and 2R with a predetermined filter length.

The second characteristic data is data corresponding to the ear canal transfer characteristic. The second characteristic data are
For example, it is the frequency characteristic of the ear canal transfer characteristic. Specifically, the second characteristic data includes amplitude characteristics in the frequency domain. Of course, the second characteristic data may have power characteristics instead of amplitude characteristics. Furthermore, the second characteristic data may have phase characteristics in the frequency domain. The second characteristic data may comprise time domain signals. For example, the time domain signals are sound signals picked up by the microphones 2L and 2R of the measuring device 200 . Alternatively, the time-domain signal may be a signal obtained by extracting the sound signals picked up by the microphones 2L and 2R with a predetermined filter length.

The processing device 201, the filter generation device 900, or the like applies discrete Fourier transform, discrete cosine transform, or the like to the collected sound signal in the time domain, thereby obtaining the frequency amplitude characteristics and the like. Further, the frequency-amplitude characteristic may be obtained by performing discrete Fourier transform, discrete cosine transform, or the like on a filter obtained by cutting out the picked-up sound signal with a predetermined filter length. Alternatively, the database 901 stores time-domain picked-up signals and filters as the first characteristic data and the second characteristic data, and fast Fourier transform (
FFT) or the like may be performed to obtain the frequency-amplitude characteristic.

The first and second characteristic data stored in database 901 will be described with reference to FIG. Spatial sound transfer characteristics Hls, Hlo for the first person (first set) subject 1
, Hro and Hrs as first characteristic data Hls_DB1 and Hlo_
Let DB1, Hro_DB1, and Hrs_DB1. The N-th person is also referred to as the first characteristic data Hls_DBN, Hlo_DBN, Hro_DBN, Hrs_DBN, etc., respectively. First characteristic data Hls_DB1 to Hls for N persons stored in database 901
_DBN are collectively referred to as first characteristic data Hls_DB. Similarly, first characteristic data Hlo_DB1 to Hlo_DBN, Hro_DB1 to Hro_DBN, Hrs_DB1
~Hrs_DBN, similarly, the data for N persons are put together to obtain the first characteristic data H
They are referred to as lo_DB, Hro_DB, and Hrs_DB.

For the first person to be measured 1, the data on the ear canal transfer characteristics ECTFL and ECTFR are assumed to be second characteristic data ECTFL_DB1 and ECTFR_DB1, respectively. Data on the ear canal transfer characteristics ECTFL and ECTFR for the person 1 to be measured such as the N-th person are also sent to the second
characteristic data ECTFL_DBN, ECTFR_DBN, and the like. In addition, the second characteristic data ECTFL_DB1 to ECTFL_DBN for N persons stored in the database 901
are collectively referred to as second characteristic data ECTFL_DB. Second characteristic data E for N people
CTFR_DB1 to ECTFR_DBN are put together to form second characteristic data ECTFR_DB
called.

The database 901 stores the first characteristic data Hls_
DB1, Hro_DB1, and second characteristic data ECTFL_DB1 are stored as one set. Similarly, the database 901 stores the first characteristic data Hls_DBN, Hro_DBN and the second characteristic data ECTFL_DBN regarding the left ear of the N-th subject 1 as 1
Store as a set. The database 901 also stores first characteristic data Hlo_DB1 and Hrs_DB1 related to the right ear of the first subject 1, and second characteristic data ECTFR_
Store DB1 as one set. The database 901 stores first characteristic data Hlo_DBN, Hrs_DBN and second characteristic data ECTF regarding the right ear of the N-th person 1 to be measured.
and R_DBN are stored as one set.

A set therefore comprises at least three frequency-amplitude characteristics. The database 901 stores different ear characteristic data for the same subject 1 as different sets. Of course, the number of first characteristic data included in one set changes according to the number of speaker channels. Also, the database 901 may store the first and second characteristic data in association with the identification information.

Further, first characteristic data Hls_DB, Hlo_DB, Hro_DB, Hrs_DB
preferably have two types of frequency-amplitude characteristics. For example, the first characteristic data Hls_DB1 preferably has frequency amplitude characteristics of the direct sound portion and frequency amplitude characteristics of the direct sound portion and the reflected sound portion. The frequency-amplitude characteristics of the direct sound portion and the reflected sound portion can be obtained by performing FFT on the collected sound signal in the time domain including the direct sound and the reflected sound. The frequency-amplitude characteristics of the direct sound portion can be obtained by performing FFT on the collected sound signal in the time domain that contains only the direct sound and does not contain the reflected sound. The direct sound is the sound that reaches the ear (microphone) directly from the sound source (speaker), and the reflected sound is the sound that reaches the ear after being reflected from the sound source by a wall or the like. Reflected sound reaches the microphone after the direct sound. Other first characteristic data Hlo
The same applies to _DB1, Hro_DB1, Hrs_DB1, and the like.

For example, as shown in FIG. 10, a case where 0 to 4095 samples of sound signals are collected in the measurement of spatial sound transfer characteristics will be described. In this case, the frequency amplitude characteristics of the direct sound and the reflected sound can be obtained by Fourier transforming the entire collected sound signal of 0 to 4095 samples. 0-40
A direct sound signal of 0 to X (X is an integer of 1 or more) samples from the 95 samples of the collected sound signal (Fig. 10
) is cut out, and the cut-out direct sound signal is Fourier-transformed to obtain the frequency-amplitude characteristics of the direct sound.

Thus, in the database 901, the first characteristic data Hls_DB1 preferably includes the frequency-amplitude characteristic of the direct sound and the frequency-amplitude characteristics of the direct sound and the reflected sound. Similarly, the first characteristic data Hlo_DB1, Hro_DB1, Hrs_DB
1 preferably includes the frequency-amplitude characteristics of the direct sound portion and the frequency-amplitude characteristics of the direct and reflected sound portions, respectively. Of course, the same applies to the 2nd to Nth persons.

The measuring device 200 shown in FIG. 2 measures the external auditory canal transfer characteristics ECTFL and ECTFR for a user U who performs out-of-head stereotactic listening. A measurement result for the user U is input to the ear canal transfer characteristic acquisition unit 930 . Hereinafter, the ear canal transfer characteristics E measured for the user U who is a passenger
CTFL and ECTFR are defined as ear canal transfer characteristics ECTFL_U and ear canal transfer characteristics ECTFR_U.
and

The filter generation device 900 performs filter generation processing on the ear canal transfer characteristic ECTFL_U. As a result, the filter generation device 900 generates filters related to the spatial acoustic transfer characteristics Hls and Hro for the left ear of the user U (hereinafter referred to as filters F_Hls_U and F_Hro_
U) respectively. That is, the filter generation device 900 generates two filters F_Hls_U and F_Hro_U based on the ear canal transfer characteristic ECTFL_U.
to generate At this time, the filter generation device 900 may refer to only the set relating to the left ears of the plurality of subjects 1, or may refer to the set relating to both ears.

Similarly, the filter generation device 900 performs filter generation processing on the ear canal transfer characteristic ECTFR_U. As a result, the filter generation device 900 generates filters related to the spatial acoustic transfer characteristics Hlo and Hrs for the right ear of the user U (hereinafter referred to as filters F_Hlo_U, F_
Hrs_U) respectively. That is, the filter generating device 900 generates two filters F_Hlo_U and F_Hrs_U based on the ear canal transfer characteristic ECTFR_U. At this time, the filter generation device 900 may refer to only the set related to the right ear of the plurality of subjects 1, or may refer to the set related to both ears.

Note that the processing of filters F_Hls_U and F_Hro_U and the processing of filters F_Hlo_U and
The processing of F_Hrs_U is similar. Therefore, in the following description, the ear canal transfer characteristic ECTF
Processing for generating filters F_Hls_U and F_Hro_U based on L_U will be described.

The first selection unit 902 refers to the database 901 to select the ear canal transfer characteristics ECT.
Based on FL_U, select the first set. For example, the first selection unit 902 compares the frequency amplitude characteristic of the ear canal transfer characteristic ECTFL_U with the second characteristic data ECTFL_DB in a first frequency band (eg, 1 kHz to 4 kHz). Specifically, the first selection unit 902 calculates a correlation value between each of the second characteristic data ECTFL_DB1 to ECTFL_DBN and the ear canal transfer characteristic ECTFL_U. First selection section 902 obtains the correlation value of the frequency-amplitude characteristic in the first frequency band. And the first selection unit 9
02 selects a set including the second characteristic data ECTFL_DBk (k is an arbitrary integer from 1 to N) having the largest correlation value. The set selected by the first selection unit 902 is referred to as the first set.

A first acquisition unit 903 acquires first characteristic data Hls_DBk and Hro_DBk included in the first set from the database 901 . First acquisition section 903 outputs the frequency amplitude characteristics of the direct sound portion to first synthesizing section 908 , and outputs the frequency amplitude characteristics of the direct sound and reflected sound portions to first adjustment section 907 .

A second selection unit 904 refers to the database 901 to select the ear canal transfer characteristics ECT.
Select the second set based on FL_U. For example, the second selection unit 904 selects the ear canal transfer characteristic ECTFL_U in the second frequency band (eg, 4 kHz to 15 kHz).
is compared with the second characteristic data ECTFL_DB. Second selection unit 90
4 calculates a correlation value between each of the second characteristics ECTFL_DB1 to ECTFL_DB1 and the ear canal transfer characteristic ECTFL_U. Second selection section 904 obtains the correlation value of the frequency-amplitude characteristic in the second frequency band. Then, second selection section 904 selects a set including second characteristic data ECTFL_DBm (m is an integer equal to or greater than 1 and equal to or less than N) having the largest correlation value. The set selected by the second selection unit 904 is referred to as the second set.

A second acquisition unit 905 acquires the first characteristic data Hls_DBm and Hro_DBm included in the second set from the database 901 . The second acquisition unit 905 outputs the frequency amplitude characteristics of the direct sound portion to the first synthesizing unit 908 and outputs the frequency amplitude characteristics of the direct sound and reflected sound portions to the first adjustment unit 907 .

A first adjustment unit 907 obtains gain values for adjusting the amplitude levels of the first characteristic data Hls_DBk, Hro_DBk and the first characteristic data Hls_DBm, Hro_DBm. For example, in the frequency band for adjustment (200 Hz to 1 kHz), the first adjuster 907 obtains a gain value that makes the amplitude level equal between the first characteristic data Hls_DBk and the first characteristic data Hls_DBm. By multiplying one or both of the first characteristic data by a gain value, the amplitude level of the first characteristic data can be increased or decreased. Specifically, so that the sum of discrete amplitudes in the adjustment frequency band is equal,
The amplitude level is adjusted by multiplying the amplitude characteristic by the gain value (coefficient).

Specifically, in the adjustment frequency band, when the amplitude level of the first characteristic data Hls_DBk is higher than the amplitude level of the first characteristic data Hls_DBm, the first adjusting section 907
obtains a gain value for lowering the amplitude level of the first characteristic data Hls_DBk. Alternatively, the amplitude level of the first characteristic data Hls_DBk is the first characteristic data Hls_DB
m amplitude level, the first adjustment unit 907 adjusts the first characteristic data Hls_DB
Find a gain value to increase the amplitude level of m. Of course, the first adjusting section 907 may calculate two gain values so that both amplitude levels are within a predetermined range. In this case, each of the first characteristic data Hls_DBm and the first characteristic data Hls_DBk is multiplied by the gain value. Note that the first adjustment unit 907 uses the first characteristic data Hls_DBk
, Hro_DBk may have a common gain value, or different gain values may be obtained for each.

As described above, the first characteristic data are based on the results of measurements performed on a plurality of subjects 1 . In each measurement, the loudspeaker volume and microphone sensitivity are not always the same. Furthermore, the measurement environment may differ, or different speakers and microphones may be used. Therefore, the first adjuster 907 may select different sets of first
Adjust the amplitude level of the characteristic data. For example, the first adjuster 907 calculates a gain value for adjusting the balance between the two frequency amplitude characteristics. This allows the first
The amplitude level balance of the characteristic data can be adjusted. Here, the gain value is calculated for the frequency amplitude characteristics of the direct sound and the reflected sound.

First adjusting section 907 then outputs a gain value for adjusting the amplitude level to first synthesizing section 908 . The first synthesizing unit 908 multiplies the first characteristic data by the gain value to perform level adjustment, and then combines the first characteristic data Hls_DBk and the first characteristic data Hls_DB.
Composite with m. The first synthesizing unit 908 multiplies the first characteristic data by the gain value, adjusts the level, and then combines the first characteristic data Hro_DBk and the first characteristic data Hro_DBm.
Synthesize with

Here, the first synthesizing unit 908 synthesizes the direct sound. That is, the first characteristic data Hls_DBk, Hro_DBk and the first characteristic data Hls_DBm, Hro_
DBm is the frequency amplitude characteristic of the direct sound. The first synthesizing unit 908 replaces the amplitude value of the first characteristic data Hls_DBm in the first frequency band (1 kHz to 4 kHz) with the amplitude value of the first characteristic data Hls_DBk. First synthesizing section 908 converts the amplitude value of first characteristic data Hro_DBm in the first frequency band into first characteristic data Hro_DB
Replace with the amplitude value of k. First synthesizing section 908 outputs the frequency-amplitude characteristic after replacement to second adjusting section 911 as first synthesized data Hls_com1 and Hro_com1.

In the first synthesized data Hls_com1 and Hro_com1, the amplitude values of the first frequency band are based on the first characteristic data Hls_DBk and Hro_DBk, and the amplitude values of other than the first frequency band are the second Characteristic data Hls_DBm, Hro_DBm
It is based on Alternatively, the first combined data Hls_com1, Hro_c
In om1, the amplitude value of the second frequency band is the first characteristic data Hls_DBm, Hr
o_DBm, and amplitude values other than the second frequency band are based on the first characteristic data Hl
It may be based on s_DBk and Hro_DBk. First combiner 908
are the first characteristic data Hls_DBm, Hro_DBm and the first characteristic data Hls_DB
The frequency-amplitude characteristics may be synthesized while balancing k and Hro_DBk, that is, so that the level of the adjustment frequency band is included in a predetermined range.

The third acquisition unit 906 refers to the database 901 and obtains preset first characteristic data Hls_DBps, Hro_DBps (hereinafter referred to as preset data Hls_DBps,
Hro_DBps). Preset data Hls_DBps, Hro_D
Bps is a representative one-person (1
set).

Here, the preset data Hls_DBps and Hro_DBps are preferably the first characteristic data of the subject 1 in which the left and right phase characteristics and amplitude levels are balanced. That is, the preset data Hls_DBps, Hlo_DBps, Hro_DBps,
Hrs_DBps is the first characteristic data of the same subject 1 . Furthermore, it is preferable that the first characteristic data having no large dip in the frequency amplitude characteristic of 1 kHz or less is set as the preset data. In addition, the four spatial acoustic transfer characteristics Hls at 100 kHz, H
In lo, Hro, and Hrs, it is preferable to use the first characteristic data of the person to be measured 1 having uniform frequency amplitude characteristics of 100 kHz or less as the preset data. The preset data is set in advance by a system administrator or the like.

Furthermore, multiple sets of preset data candidates are prepared, and the ear canal transfer characteristic ECTFL
One set of preset data may be selected based on _U. In this case, one set having the second characteristic data having the highest correlation value with the ear canal transfer characteristic ECTFL_U may be selected from among the multiple sets as preset data candidates.

The third acquisition unit 906 acquires the preset data Hls_DBps and Hro_DBps and outputs them to the second synthesis unit 912 and the second adjustment unit 911 . Preset data Hl
s_DBps and Hro_DBps are frequency amplitude characteristics of the direct sound portion, but may be frequency amplitude characteristics of the direct sound and reflected sound portions.

First combined data Hls_com1, Hro_com1 and first preset data Hl
Gain values for adjusting the amplitude levels of s_DBps and Hro_DBps are calculated. Similar to the first adjustment unit 907, the second adjustment unit 911 adjusts the adjustment frequency band (200 Hz to 1
kHz), the first combined data Hls_com1 and the preset data Hls_DB
The second adjuster 911 obtains a gain value that makes the amplitude level equal to ps.
Then, the amplitude level is adjusted by multiplying at least one of the first synthesized data and the first preset data by the gain value. The second adjuster 911 adjusts the first adjuster 907
Since the same processing as is performed, the description is omitted.

Second adjusting section 911 outputs the gain value to second synthesizing section 912 . Second synthesizing unit 91
2 is the first combined data Hls_com1 after performing level adjustment using the gain value;
Synthesize with preset data Hls_DBps. After performing level adjustment using the gain value, the second combining unit 912 combines the first combined data Hro_com1 and the preset data H
ro_DBps. As a result, the second combined data Hro_com2, Hro
_com2 is generated.

A second synthesizing unit 912 synthesizes the direct sound. That is, the first combined data Hls_co
m1, Hro_com1 and preset data Hls_DBps, Hro_DBps are
It is the frequency amplitude characteristic of the direct sound. The second synthesizing unit 912 replaces the amplitude value of the first synthesized data Hls_com1 in the third frequency band (lowest frequency to 1 kHz) with the amplitude value of the preset data Hls_DBps. The second combining unit 912 replaces the amplitude value of the first combined data Hro_com1 in the third frequency band (lowest frequency to 1 kHz) with the amplitude value of the preset data Hro_DBps. The lowest frequency is the lowest frequency in frequency characteristics obtained by FFT, and is 1 Hz, for example.

In the second synthesized data Hls_com2, Hro_com2, the third frequency band (
(minimum frequency to 1 kHz) are preset data Hls_DBps, Hro_DB
It is based on ps. Second synthetic data Hls_com2, Hro_com2
, the amplitude value of the first frequency band (1 kHz to 4 kHz) is the first characteristic data Hl
It is based on s_DBk and Hro_DBk. Second synthetic data Hls_co
In m2 and Hro_com2, the amplitude values of the second frequency band (4 kHz to 15 kHz) are based on the second characteristic data Hls_DBm and Hro_DBm. The amplitude value of the fourth frequency band (15 kHz to highest frequency) other than the first frequency band, the second frequency band, and the third frequency band is the second characteristic data Hls_DBm, Hro_D
Bm, but preset data Hls_DBps, Hro_
It may be based on DBps. The highest frequency is the highest frequency in frequency characteristics obtained by FFT. Here, if the FFT frame size is frame_size, the highest frequency is (FS/frame_size)*(frame_size/2-
1). Also, the amplitude level in each frequency band is adjusted by the first adjusting section 90
7 or the gain value obtained by the second adjustment unit 911 . Therefore, it is possible to appropriately synthesize frequency-amplitude characteristics.

The second synthesizer 912 outputs the second synthesized data Hls_com2 and Hro_com2 to the generator 920 . The generation unit 920 generates the second combined data Hls_com2, Hro_c
Based on om2, generate filters F_Hls_U, F_Hro_U. For example, the generating unit 920 performs an inverse Fourier transform on the second combined data Hls_com2 and Hro_com2, respectively, to obtain the second combined data Hls_com2_Time in the time domain.
, Hro_com2_Time. It should be noted that the phase characteristics used in the inverse Fourier transform may be those of the second set, but may also be those of the preset data.

Thereby, the generator 920 can obtain the direct sound portion of the filters F_Hls_U and F_Hro_U. Then, the generation unit 920 generates the second synthesized data Hls_com2_
Preset data Hls_DBps is combined with Time. In addition, the generating unit 920 generates the second
The reflected sound portion of the preset data Hro_DBps is synthesized with the synthesized data Hro_com2_Time of the above. For example, the direct sound portion (i.e., 0-X samples) of filters F_Hls_U, F_Hro_U is the second synthesized data Hls_com2_Time, Hro_c
om2_Time. The reflected sound portion ((X+1) to 4095 samples) is the reflected sound portion ((X+1)
~ 4095 samples). Note that the filters F_Hls_U,
The reflected sound portion of F_Hro_U is the preset data Hls_DBps, Hro_DBps
but may be of the second set. As for the preset data, it is preferable that the database 901 stores the first characteristic data in the time domain in advance.

Through the above processing, the filter generation device 900 generates the filters F_Hls_U, F_Hro
_U can be generated. Further, through similar processing, the filter generation device 900
Generate filters F_Hlo_U, F_Hrs_U. As a result, even if the user U can only measure the ear canal transfer characteristic, the filter F_Hls_U suitable for the user U
, F_Hlo_U, F_Hro_U, F_Hrs_U can be generated.

Note that the values of the upper limit frequency and lower limit frequency of the first to third frequency bands, the number of signal samples, the highest frequency, and the lowest frequency in the above description are exemplary values, and are not particularly limited. Also, the processing order of the first synthesizing unit 908 and the second synthesizing unit 912 is not particularly limited. For example, the first set of first characteristic data may be synthesized after the preset data and the second set of first characteristic data are synthesized. Alternatively, the preset data, the second set of first characteristic data, and the first set of first characteristic data may be combined together. Also, power values may be used instead of amplitude values in the frequency domain.

In the second embodiment, users who perform out-of-head localized listening are not limited to passengers in vehicles such as airplanes. In other words, the process of the second embodiment can be applied to a user terminal such as a smart phone or a tablet terminal owned by the user, when the out-of-head localization process is performed. Therefore, no identification information is required.

In summary, the filter generation device 900 according to Embodiment 2 includes an ear canal transfer characteristic acquisition unit 930, a first selection unit 902, a first acquisition unit 903, a second selection unit 904, a second acquisition unit 905 , a third acquisition unit 906 , and a generation unit 920 . The ear canal transfer characteristic acquisition unit 930 acquires the ear canal transfer characteristic from the headphone or earphone worn by the user to the microphone. A first selection unit 902 selects the first characteristic data corresponding to the spatial sound transfer characteristic from the speaker to the microphone and the second characteristic data corresponding to the ear canal transfer characteristic.
By referring to the database 901 that stores a plurality of sets as sets, the first set is selected based on the frequency characteristics in the first frequency band of the ear canal transfer characteristics of the user. A first acquisition unit 903 acquires second characteristic data included in the first set selected by the first selection unit. The second selection unit 904 refers to the database 901 to
A second set is selected based on frequency characteristics in a second frequency band of the user's ear canal transfer characteristics. A second acquisition unit 905 acquires second characteristic data included in the second set selected by the second selection unit 903 . A third selection unit 906 acquires preset data set in advance. Based on the first set of second characteristic data, the second set of second characteristic data, and the preset data, the generation unit 920 generates a filter according to the spatial sound transfer characteristic of the user. This makes it possible to generate a filter capable of performing appropriate processing.
Embodiment 3.
In the third embodiment, out-of-head localization processing is performed using a 5.1ch reproduced signal. 5.
In the case of 1ch, there are 6 speakers. That is, a center speaker (front speaker), a right front speaker, a left front speaker, a right rear speaker, a left rear speaker, and a bass subwoofer speaker are arranged in the measurement environment of the measurement apparatus 200 . Therefore, a center speaker, a left rear speaker, a right rear speaker, and a subwoofer speaker are added to the measurement apparatus 200 shown in FIG. A center speaker is arranged in front of the person 1 to be measured. The center speaker is arranged, for example, between the left front speaker and the right front speaker.

Let Hls and Hlo be the spatial sound transfer characteristics from the left front speaker to the left ear and the right ear, as in the first embodiment. Spatial sound transfer characteristics from the right front speaker to the left and right ears are
Let Hro and Hrs be the same as in the first embodiment. Let CHl and CHr be the spatial sound transfer characteristics from the center speaker to the left and right ears. Let SHls and SHlo be the spatial sound transfer characteristics from the left rear speaker to the left and right ears. Let SHro and SHrs be the spatial sound transfer characteristics from the right rear speaker to the left and right ears. Let SWHl and SWHr be the spatial sound transfer characteristics from the subwoofer speaker for bass output to the left and right ears.

Therefore, the spatial acoustic transfer characteristics Hls, Hlo, CHl, CHr, Hro, Hrs, SHls
, SHlo, SHro, SHrs, SWHl, and SWHr are used to perform the convolution operation. Spatial Acoustic Transfer Hls, Hlo, CHl, CHr
, Hro, Hrs, SHls, SHlo, SHro, SHrs, SWHl, SWHr corresponding to F_Hls, F_Hlo, F_CHl, F_CHr, F_Hro, F
_Hrs, F_SHls, F_SHlo, F_SHro, F_SHrs, F_SWHl,
F_SWHr.

FIG. 11 is a block diagram showing the configuration of a processing device 700 according to this embodiment. The processing device 700 corresponds to the processing device 201 shown in FIG. 2 and generates a filter.
Further, the processing device 700 performs out-of-head localization processing as shown in FIG. Here, the processing unit 700 includes 12 filters F_Hls, F_Hlo, F_CHl, F_C
Hr, F_Hro, F_Hrs, F_SHls, F_SHlo, F_SHro, F_SH
rs, F_SWHl, and F_SWHr are used to perform convolution operation processing. Of course, as in the system of Embodiment 1, the device that generates the filter and the device that performs the out-of-head localization processing may be different devices. Filter generating means 70
3, convolution means 704, reproduction means 705, transmission/reception means 706, memory 707, center channel dereverberation means 708, and center channel volume varying means 709. Further, the processing device 700 is connected with dialogue volume control means 711 .

Measuring means 702 measures spatial sound transfer characteristics. The measurement means 702 performs impulse measurement for each of the six speakers. Specifically, the measurement signal generator 2 shown in FIG.
Like 11, an impulse sound is output to each speaker. Furthermore, the measurement means 702 acquires sound signals from the microphones 2L and 2R, like the sound signal acquisition unit 212 .

Similar to the filter generation unit 213, the filter generation unit 703 generates a filter based on the collected sound signal. Here, 12 filters are generated because the measurements are made with 6 loudspeakers and 2 microphones. Memory 707 stores 12 filters. Note that the transmitting/receiving means 706 may transmit the filter to the server terminal 600 shown in FIG. 3, for example. This will store the filter in the database.

When reproducing a 5.1ch reproduction signal, the user U can individually adjust the dialogue volume. In other words, only the volume of the center speaker that outputs the audio signal of the dialogue can be adjusted independently. The dialogue volume control means 711 receives an input from the user U and controls the dialogue volume (the volume of the center channel). For example, the dialogue volume control means 711 displays buttons and levers for volume adjustment. Then, the user U raises or lowers the dialogue volume according to the out-of-head localization listening result. Dialogue volume control means 7
11 outputs a volume signal indicating the dialogue volume to the center channel volume varying means 709 . The center channel volume varying means 709 has a variable amplifier and varies the amplification factor according to the input. For the volume signal, for example, a numerical value of Vol indicating the magnitude of the volume or an amplification factor of the volume may be used.

Center channel dereverberation means 708 performs processing for deleting center channel reverberation based on the volume signal. Here, the center channel dereverberation unit 708 performs windowing on the center channel filters F_CHl and F_CHr. The filter after windowing is F_WCHl
, F_WCHr.

For example, when the sound volume of the center channel is equal to or higher than the threshold, the center channel dereverberation unit 708 performs windowing using a window function that zeroes the data in the latter half of the filters F_CHl and F_CHr. By doing so, noise can be reduced and natural sound can be obtained. Further, the center channel dereverberation means 708 may use a window function that is constant until a predetermined time and gradually decreases after the predetermined time. Filter F_WCHl, F_W after windowing
By using CHr, it is possible to suppress the reverberation of the dialogue portion. Also, if the sound volume is less than the threshold, windowing may not be performed, but for the sake of convenience, it is assumed that windowing is performed using a rectangular window.

Furthermore, the window function may be changed according to the speech volume. It is possible to use a window function such that the length of the window increases as the volume of the dialogue increases. Alternatively, it is possible to use a window function in which the length of the window becomes shorter as the speech volume increases.

A sound source file 701 stores a 5.1ch reproduction signal. The 5.1ch reproduced signal is input to convolution means 704 . Convolution means 704 performs convolution arithmetic processing on the six reproduced signals using 12 filters.

The convolution means 704 includes filters F_Hls, F_Hlo, F_WCHl, F_WCH
r, F_Hro, F_Hrs, F_SHls, F_SHlo, F_SHro, F_SHr
A convolution operation is performed using s, F_SWHl, and F_SWHr. FIG. 12 shows the 5.1ch
FIG. 10 is a diagram for explaining the convolution operation and dialogue volume adjustment in the case of the reproduction signal of .

Let L(t) be the reproduction signal of the left front channel, C(t) be the reproduction signal of the center channel, and R(t) be the reproduction signal of the right front channel. Let SL(t) be the reproduced signal of the left rear channel, SR(t) be the reproduced signal of the right rear channel, and LFE(t) be the reproduced signal of the subwoofer channel. Then, each reproduced signal is convoluted with a corresponding filter. For example, the reproduction signal C(t
) are convoluted with filters F_WCHl and F_WCHr, respectively.

Adder 24 then adds filters F_Hls, F_WCHl, F_Hro, F_SHl
The six convolved signals with s, F_SHro, and F_SWHl are summed to generate summed signal HRl(t). The adder 24 outputs the addition signal HRl(t) to the filter section 41 (see FIG. 1). Adder 25 adds filters F_Hlo, F_WCHr, F_Hrs,
The convolved signals with F_SHlo, F_SHrs, and F_SWHr are added to generate summed signal HRr(t). The adder 25 passes the addition signal HRr(t) to the filter section 42
(See FIG. 1). The reproducing means 705 convolves the summed signals HRl(t) and HRr(t) with the inverse filters Linv and Rinv, respectively. Then, the added signals HRl(t) and HRr(t) convoluted with the inverse filters are output from the headphone 43 .

Here, convoluted signals obtained by convoluting the filters F_WCH1 and F_WCHr are input to the adders 24 and 25 via the variable amplifier 721 . The dialogue volume control means 711 changes the amplitude amplification factor of the variable amplifier 721 according to the input volume. This will
The speech volume by the center channel can be adjusted according to user U's preference. Therefore,
Out-of-head localization processing can be performed more appropriately.
Embodiment 4.
In Embodiment 4, the out-of-head localization processing apparatus 100 performs processing to make the user more relaxed in out-of-head localization listening. For example, the out-of-head localization processing device 100 compresses the dynamic range of the filter or changes the method of supplying the reproduced signal, thereby
(Back-Ground Music).
Example 1.
In example 1, the filter is generated by compressing the high frequency band of the filter. Specifically, the filter generator applies a low-pass filter (LPF) to each of the measured spatial acoustic transfer characteristics. For example, an LPF with a cutoff frequency of 2 kHz
is shown in FIG. FIG. 13 shows the sound pressure levels before and after applying the LPF to the filter F_Hls. By performing the out-of-head localization process using the LPF-applied filter, the user U can be more relaxed.
Example 2.
In Example 2, the filter generation device adds a reverberation component obtained by changing the amplitude of the direct sound in each filter. Specifically, the filter generation device cuts out the direct sound signal with the measured transfer characteristics, and adds a signal obtained by changing the amplitude of the direct sound signal as a reverberation component after the direct sound signal to generate the filter. there is FIG. 14 shows the filter F_Hls after adding the reverberation component to the collected sound signal shown in FIG. In FIG. 10, seven reverberation components D1-D7 are added. Each reverberation component is a separate adjustment of the amplitude of the direct sound signal. Note that the number of reverberation components to be added is not particularly limited.
By performing out-of-head localization processing using such a filter, the user U can be more relaxed.

A part or all of the above processes may be executed by a computer program. The programs described above may be stored on various types of non-transitory computer-readable media (non-t
stored using a random computer readable medium) and delivered to a computer. Non-transitory computer readable media include various types of tangible storage media.
including. Examples of non-transitory computer-readable media include magnetic recording media (eg, flexible discs, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical discs), CD-ROMs (Read Only Memory), CD-Rs, CD-R/W,
Semiconductor memory (e.g., mask ROM, PROM (Programmable ROM)
, EPROM (Erasable PROM), Flash ROM, RAM (Rando
m Access Memory)). Programs may also be stored on various types of transitory computer readable media.
e medium) to the computer. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable media can deliver the program to the computer via wired channels, such as wires and optical fibers, or wireless channels.

The invention made by the present inventor has been specifically described above based on the embodiments, but the present invention is not limited to the above embodiments, and various modifications can be made without departing from the scope of the invention. Needless to say.

U User 1 Subject 10 Out-of-Head Localization Processor 11 Convolution Calculator 12 Convolution Calculator 21 Convolution Calculator 22 Convolution Calculator 24 Adder 25 Adder 41 Filter 42 Filter 43 Headphone 200 Measurement Device 201 Processing Device 211 Measurement Signal generation unit 212 Collected sound signal acquisition unit 213 Filter generation unit 511 Seat terminal 521 Boarding seat

Claims (5)

A measuring device that measures transfer characteristics using a microphone attached to the ear of the user before the user sits on the seat;
an out-of-head localization processing device that performs out-of-head localization processing using a filter according to the transfer characteristics;
an out-of-head localization processing system, comprising: a server that transmits a filter corresponding to the transfer characteristics to the out-of-head localization processing device based on the identification information of the user. a plurality of seats and a plurality of out-of-head stereotactic processing devices are installed in association with each other;
2. The out-of-head localization processing system according to claim 1, wherein the server identifies the seat of the user by referring to the identification information, and transmits the filter to the out-of-head localization processing device corresponding to the identified seat. . 3. The out-of-head localization processing system according to claim 1, wherein payment by the user is accepted after the user performs trial listening. measuring the ear canal transfer characteristics from the headphones or earphones worn by the user to the microphone;
By referring to a database that stores a plurality of sets of first characteristic data corresponding to spatial sound transfer characteristics from a speaker to the microphone and second characteristic data corresponding to the ear canal transfer characteristics as one set. 4. The out-of-head localization processing system according to any one of claims 1 to 3, wherein a filter corresponding to said spatial sound transfer characteristics of said user is acquired based on said ear canal transfer characteristics of said user. before the user is seated in the seat, using a microphone worn in the user's ear to perform a transfer characteristic;
a step of transmitting a filter corresponding to the transfer characteristic to an out-of-head localization processing device installed in the seat based on the identification information of the user;
a step in which the out-of-head localization processing device performs out-of-head localization processing on the reproduced signal using the filter;
and outputting the reproduced signal after the out-of-head localization processing from headphones or earphones to the user corresponding to the identification information.

Images