JP6880893B2 - Sound signal processing device - Google Patents

Description

The present invention relates to a sound signal processing device.

Patent Document 1 describes a vehicle voice input / output control device (hereinafter referred to as "control device") that assists conversation in a vehicle interior having three rows of seats. The control device receives an audio signal according to the utterance (voice) of the user in the first row seat from the microphone arranged for the first row seat. Then, the control device outputs an audio signal to a speaker selected from a plurality of speakers provided for each seat.

JP-A-2007-208828

The control device described in Patent Document 1 may output the voice of a speaker from a plurality of speakers in different seat rows in a vehicle compartment having three or more rows of seats. In this case, depending on the seat, a situation may occur in which appropriate conversation assistance cannot be performed.

The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a technique capable of appropriately assisting conversation in any seat in a vehicle having three or more rows of seats.

One aspect of the sound signal processing device according to the present invention is to the first speaker arranged for the third seat located between the first seat and the second seat located in front of or behind the first seat. The first sound is sent to the first output unit that outputs the first sound signal corresponding to the output signal of the microphone arranged for the first seat and the second speaker arranged for the second seat. It is characterized by including a second output unit that outputs a second sound signal corresponding to the signal at a timing later than the output timing of the first sound signal.
Further, one aspect of the sound signal processing device according to the present invention is a first seat arranged with respect to a third seat located between the first seat and the second seat located in front of or behind the first seat. A first output unit that outputs a first sound signal corresponding to the output signal of a microphone arranged for the first seat to a speaker, and a sound output from the first speaker according to the first sound signal. The second sound signal corresponding to the first sound signal is output to the second speaker so that the volume of the sound is lower than the volume of the sound output from the second speaker arranged with respect to the second seat. It is characterized by including a second output unit to be used.

It is a figure which showed the conversation assist system 1 including the sound signal processing apparatus 3 which concerns on 1st Embodiment of this invention. It is a figure which showed an example of the sound signal processing apparatus 3. It is a flowchart for demonstrating the operation of the conversation assist system 1. It is a figure which showed the sound signal processing apparatus 3A which concerns on 2nd Embodiment of this invention.

Hereinafter, embodiments according to the present invention will be described with reference to the drawings. In the drawings, the dimensions and scale of each part are appropriately different from the actual ones. Moreover, the embodiment described below is a preferable specific example of the present invention. For this reason, the present embodiment is provided with various technically preferable limitations. However, the scope of the present invention is not limited to these forms unless it is stated in the following description that the present invention is particularly limited.

<First Embodiment>
FIG. 1 is a diagram showing a conversation assist system 1 including a sound signal processing device 3 according to the first embodiment of the present invention. The conversation assist system 1 is used in a vehicle 100 such as an automobile.
In the passenger compartment 100a of the vehicle 100, seats 51 to 56 forming three rows of seats, a front right door 71, a front left door 72, a rear right door 73, and a rear left door 74 are arranged.

Seats 51 and 52 are seats in the first row. The seat 51 is a driver's seat. Seat 52 is a passenger seat. Seats 53 and 54 are seats in the second row. Seats 55 and 56 are seats in the third row. Seats 51-56 face in a common direction. In each of the seats 51-56, for example, cloth or leather is used as the material. Each of the seats 51 to 56 has a sound absorbing property.

Seats 51 and 52 are examples of the first seat. Seats 55 and 56 are examples of second seats located behind the first seat. Seats 53 and 54 are examples of third seats located between the first and second seats.

The conversation assist system 1 includes microphones 11 to 12, speakers 21 to 26, and a sound signal processing device 3.

The microphone 11 is arranged with respect to the seats 51 and 52. In the present embodiment, the microphone 11 is arranged in a portion (ceiling portion) of the ceiling of the vehicle interior 100a facing the area between the seats 51 and 52. The microphone 11 collects the voice of the user sitting in the seat 51 and the voice of the user sitting in the seat 52, and outputs an output signal M1 corresponding to the collected voice. The position of the microphone 11 can be changed as appropriate as long as it is arranged with respect to the seats 51 and 52.

The microphone 12 collects the voices of the respective users of the seats 53 to 56, and outputs an output signal M2 corresponding to the collected voices. In the present embodiment, the microphone 12 is arranged in a portion (ceiling portion) of the ceiling of the vehicle interior 100a facing the area surrounded by the seats 53 to 56. The position of the microphone 12 may be closer to the seats 53 and 54 or closer to the seats 55 and 56. Further, the microphone 12 may be a directional microphone. For example, howling can be improved by setting the directivity direction of the microphone 12 to a direction in which a speaker does not exist.

The speaker 21 is arranged with respect to the seat 51, and the speaker 22 is arranged with respect to the seat 52. In the present embodiment, the speaker 21 is arranged on the front right door 71, and the speaker 22 is arranged on the front left door 72. The position of the speaker 21 can be appropriately changed as long as it is arranged with respect to the seat 51. The position of the speaker 22 can be appropriately changed as long as it is arranged with respect to the seat 52.

The speaker 23 is arranged with respect to the seat 53, and the speaker 24 is arranged with respect to the seat 54. Each of the speakers 23 and 24 is an example of the first speaker. In the present embodiment, the speaker 23 is arranged at the rear right door 73, and the speaker 24 is arranged at the rear left door 74. The position of the speaker 23 is preferably in front of the position of the user sitting on the seat 53, but can be changed as appropriate if it is arranged with respect to the seat 53. The position of the speaker 24 is preferably in front of the position of the user sitting on the seat 54, but can be changed as appropriate if it is arranged with respect to the seat 54.

The speaker 25 is arranged with respect to the seat 55, and the speaker 26 is arranged with respect to the seat 56. Each of the speakers 25 and 26 is an example of a second speaker. In the present embodiment, the speaker 25 is arranged behind the rear right door 73, and the speaker 26 is arranged behind the rear left door 74. The position of the speaker 25 can be changed as appropriate as long as it is arranged with respect to the seat 55. The position of the speaker 26 can be appropriately changed as long as it is arranged with respect to the seat 56.

The sound signal processing device 3 receives the output signal M1 of the microphone 11 and the output signal M2 of the microphone 12 and controls the speakers 21 to 26.
FIG. 2 is a diagram showing an example of the sound signal processing device 3. The sound signal processing device 3 includes a storage unit 8 and a processing unit 9. The storage unit 8 is a computer-readable recording medium. The storage unit 8 stores a program that controls the sound signal processing device 3. The processing unit 9 is a computer such as a CPU (Central Processing Unit). The processing unit 9 realizes the first output unit 91, the second output unit 92, and the third output unit 93 by reading and executing the program stored in the storage unit 8.

The first output unit 91 generates the first sound signal S1 corresponding to the output signal M1 of the microphone 11 corresponding to the seats 51 and 52 in the first row. For example, the first output unit 91 amplifies the output signal M1 to generate the first sound signal S1. The first output unit 91 outputs the first sound signal S1 to the speakers 23 and 24 corresponding to the seats in the second row. The speakers 23 and 24 output the sound corresponding to the first sound signal S1.

The second output unit 92 outputs the second sound signal S2 corresponding to the first sound signal S1 to the speakers 25 and 26 corresponding to the seats in the third row at a timing later than the output timing of the first sound signal S1. To do. The speakers 25 and 26 output a sound corresponding to the second sound signal S2. Further, the volume of the sound output from the speakers 23 and 24 in response to the first sound signal S1 is lower than the volume of the sound output from the speakers 25 and 26 in response to the second sound signal S2. The 2 output unit 92 outputs the second sound signal S2 to the speakers 25 and 26. The second output unit 92 includes an amplification unit 92a and a delay unit 92b.

The amplification unit 92a amplifies the first sound signal S1 to generate the second sound signal S2. For example, the amplification unit 92a amplifies the first sound signal S1 so that the sound corresponding to the second sound signal S2 has a relationship of 3 to 8 dB (decibel) with respect to the sound corresponding to the first sound signal S1. To do. The amplification degree with respect to the first sound signal S1 is not limited to 3 to 8 dB and can be changed as appropriate.

The delay unit 92b delays the second sound signal S2 for a predetermined time, and outputs the delayed second sound signal S2 to the speakers 25 and 26. The predetermined time is, for example, 1 to 2 msec (milliseconds). The predetermined time is not limited to 1 to 2 msec, and the preceding sound effect (speakers 23 and 24 in which the sound output from the speakers 25 and 26 outputs the sound earlier in time is given to the user in the second row seats. It suffices as long as it is the time to generate the effect) that makes you feel that it is output from.

The third output unit 93 uses the output signal M2 of the microphone 12 corresponding to the seats 55 and 56 in the third row to correspond to the speaker 21 corresponding to the seat 51 in the first row and the seat 52 in the first row. It controls the speaker 22. The third output unit 93 includes an amplification unit 93a and a reverse phase signal generation unit 93b.

The amplification unit 93a amplifies the output signal M2 to generate the third sound signal S3. The amplification unit 93a outputs the third sound signal S3 to the speaker 21 and the anti-phase signal generation unit 93b. The anti-phase signal generation unit 93b generates a fourth sound signal S4 having a phase opposite to that of the third sound signal S3. The reverse phase signal generation unit 93b outputs the fourth sound signal S4 to the speaker 22.
The speaker 21 and the speaker 22 emit sounds having opposite phases to each other, so that when the respective sounds reach the microphone 11, they cancel each other out and are canceled. Therefore, howling is less likely to occur.

Next, the operation will be described. FIG. 3 is a flowchart for explaining the operation of the conversation assist system 1.
When the first output unit 91 receives the output signal M1 of the microphone 11, the first output unit 91 amplifies the output signal M1 and generates the first sound signal S1 (step S1). Subsequently, the first output unit 91 outputs the first sound signal S1 to the second output unit 92 and the speakers 23 and 24 (step S2). When each of the speakers 23 and 24 receives the first sound signal S1, it outputs a sound corresponding to the first sound signal S1 (step S3).

On the other hand, in the second output unit 92, when the amplification unit 92a receives the first sound signal S1, it amplifies the first sound signal S1 and generates the second sound signal S2 (step S4). Subsequently, the amplification unit 92a outputs the second sound signal S2 to the delay unit 92b. When the delay unit 92b receives the second sound signal S2, the delay unit 92b delays the second sound signal S2 for a predetermined time (step S5), and outputs the delayed second sound signal S2 to the speakers 25 and 26 (step S6). .. When each of the speakers 25 and 26 receives the delayed second sound signal S2, each of the speakers 25 and 26 outputs a sound corresponding to the second sound signal S2 (step S7).

According to the present embodiment, the user of the second row seat uses the preceding sound effect to hear the voice of the user of the first row seat output from the speakers 25 and 26 corresponding to the third row seat. It can be felt as the voice output from the speakers 23 and 24 corresponding to the seats in the second row. Therefore, it is possible to suppress the discomfort that the user of the second row seat feels when he / she feels that the voice of the user of the first row seat is being heard from the speakers 25 and 26 corresponding to the third row seat. It becomes possible to do.

Further, the volume of the sound output from the speakers 23 and 24 corresponding to the seats in the second row is lower than the volume of the sound output from the speakers 25 and 26 corresponding to the seats in the third row. Therefore, howling is less likely to occur between the microphone 11 corresponding to the seats in the first row and the speakers 23 and 24 corresponding to the seats in the second row. Further, since the voice of the user in the first row seat is output from each of the speakers 23 to 26, the user in the second row seat even if the volume of the sound output from the speakers 23 and 24 is low. Can hear the voice of the user in the first row of seats through the speaker included in the conversation assist system 1.

<Second Embodiment>
FIG. 4 is a diagram showing a sound signal processing device 3A according to a second embodiment of the present invention. The sound signal processing device 3A differs from the sound signal processing device 3 in that it has a reception unit 10a, a noise sound detection microphone 10b, and a control unit 94.

The reception unit 10a is, for example, an operation button or a touch panel, and receives an operation by the user.
The reception unit 10 has, for example, the first information that neither the user of the seat 53 nor the user of the seat 54 is present, and the second information that there is either the user of the seat 53 or the user of the seat 54. And accept. When the reception unit 10 receives the first information, it outputs the first information to the control unit 94, and when it receives the second information, it outputs the second information to the control unit 94.
Further, the reception unit 10 has, for example, the third information that neither the user of the seat 55 nor the user of the seat 56 is present, and the third information that there is either the user of the seat 55 or the user of the seat 56. 4 Information and is accepted. When the reception unit 10 receives the third information, it outputs the third information to the control unit 94, and when it receives the fourth information, it outputs the fourth information to the control unit 94.

The noise sound detection microphone 10b is arranged in the passenger compartment 100a and detects noise noise (for example, road noise and engine noise) in the passenger compartment 100a. The noise noise in the passenger compartment 100a is not limited to road noise and engine noise. The noise sound detection microphone 10b outputs the noise sound detection result to the control unit 94.

The control unit 94 is an example of the first control unit and the second control unit. For example, the control unit 94 controls whether or not to prohibit the output of the first sound signal S1 to the speakers 23 and 24 depending on the presence or absence of the user of the seat 53 and the user of the seat 54. Further, the control unit 94 controls whether or not to prohibit the output of the first sound signal S1 to the speakers 23 and 24 according to the noise sound in the vehicle interior 100a.

The control unit 94 includes switches 94a and 94b and an output control unit 94c.
The switch 94a is provided between the first output unit 91 and the speakers 23 and 24. The switch 94b is provided between the first output unit 91 and the second output unit 92.

When the output control unit 94c receives the first information (the first information indicating that neither the user of the seat 53 nor the user of the seat 54 is present) from the reception unit 10a, the output control unit 94c turns off the switch 94a and the first sound signal S1. Is prohibited from being output to the speakers 23 and 24. Therefore, it is possible to suppress the output of less necessary sound from the speaker 23 and the speaker 24 in a situation where neither the user of the seat 53 nor the user of the seat 54 is present.

Further, when the output control unit 94c receives the second information (the second information indicating that either the user of the seat 53 or the user of the seat 54 is present) from the reception unit 10a, the output control unit 94c turns on the switch 94a to make the first information. The output of the sound signal S1 to the speakers 23 and 24 is allowed, and the switch 94b is turned on to allow the output of the first sound signal S1 to the second output unit 92. Therefore, the users of the seats 53 and 54 in the second row output the voices of the users of the seats 51 and 52 in the first row output from the speakers 25 and 26 from the speakers 23 and 24 by the preceding sound effect. You can feel it.

When the output control unit 94c receives the third information (third information indicating that neither the user of the seat 55 nor the user of the seat 56 is present) in the situation where the first information is received from the reception unit 10a, the output control unit 94c switches the switch 94b. It is turned off to prohibit the output of the first sound signal S1 to the speakers 25 and 26. Therefore, it is possible to suppress the output of less necessary sound from the speakers 23 to 26 corresponding to the seats 53 to 56 in a situation where none of the users of the seats 53 to 56 are present.

When the output control unit 94c receives the third information in the situation where the second information is received from the reception unit 10a, the output control unit 94c keeps the switches 94a and 94b turned on. The output control unit 94c may turn off the switch 94b when it receives the third information.

When the output control unit 94c receives the fourth information (the fourth information indicating that either the user of the seat 55 or the user of the seat 56 is present) from the reception unit 10a, the output control unit 94c turns on the switch 94b. Therefore, the users of the seats 55 and 56 in the third row can hear the voices of the users of the seats 51 and 52 in the first row output from the speakers 25 and 26.

Further, when the output control unit 94c receives the detection result of the noise sound from the noise sound detection microphone 10b, the output control unit 94c determines whether or not the noise sound is equal to or more than the threshold value. When the noise sound is less than the threshold value, that is, when the vehicle interior 100a is quiet and the need for conversation assist executed by the sound signal processing device 3 is low, the output control unit 94c turns off the switches 94a and 94b.

<Modification example>
Each of the above embodiments can be modified in various ways. A specific mode of modification is illustrated below. Two or more embodiments arbitrarily selected from the following examples can be appropriately merged as long as they do not conflict with each other.

<Modification example 1>
Each embodiment was a system for transmitting the voice of the user of the first row seat to the users of the second and third row seats (first row priority system), but the use of the third row seat. Each embodiment may be modified so as to be a system (third row priority system) for transmitting the voice of a person to the users of the seats in the first and second rows.
For example, the microphone 11 and the microphone 12 are turned upside down, and the speakers 21 and 22 and the speakers 25 and 26 are turned upside down. In this case, the seats 55 and 56 are examples of the first seat, and the seats 51 and 52 are examples of the second seat located in front of the first seat.

<Modification 2>
Seats may be located in front of at least one of seats 51 and 52. A seat may be arranged between the seat 51 and the seat 53. A seat may be arranged between the seat 52 and the seat 54. A seat may be arranged between the seat 53 and the seat 55. A seat may be arranged between the seat 54 and the seat 56. Seats may be located behind at least one of the seats 55 and 56. The number of seats included in one seat row (for example, the seats in the first row) can be changed as appropriate.

<Modification example 3>
In FIG. 2 or FIG. 4, the delay portion 92b may be located in the front stage of the amplification unit 92a instead of the rear stage of the amplification unit 92a.

<Modification example 4>
In FIG. 2 or FIG. 4, an anti-phase signal generation unit similar to the anti-phase signal generation unit 93b may be provided in front of any one of the speakers 23 and 24. Further, in FIG. 2 or FIG. 4, a reverse phase signal generation unit similar to the reverse phase signal generation unit 93b may be provided in front of any one of the speakers 25 and 26.

<Modification 5>
When the noise sound is equal to or larger than the threshold value, the output control unit 94c may increase the amplification degree of the amplification unit 92a as the noise sound becomes louder. Further, the output control unit 94a may stop the operation of the first output unit 91 instead of turning off both the switches 94a and 94b.

<Modification 6>
Either the reception unit 10a or the noise sound detection microphone 10b may be omitted.

<Modification 7>
When pressure sensors are arranged in the seats 53 and 54 and the output of the pressure sensor shows a pressure equal to or higher than a specific value (for example, when the user sits in the seat 53 or 54), the output control unit 94c sends the second information. May behave in the same way as when it was received. Further, when the output of the pressure sensor indicates a pressure less than a specific value (for example, when the user is not sitting in any of the seats 53 and 54), the output control unit 94c receives the first information. It may operate in the same manner.

Further, when the pressure sensors are arranged in the seats 55 and 56 and the output of the pressure sensors shows a pressure equal to or higher than a specific value (for example, when the user sits in the seats 55 or 56), the output control unit 94c has this. The output of the pressure sensor may be used instead of the fourth information. Further, when the output of the pressure sensor shows a pressure less than a specific value (for example, when the user is not sitting in any of the seats 55 and 56), the output control unit 94c outputs the output of the pressure sensor. 3 It may be used instead of the information.

<Modification 8>
All or part of the elements realized by the processing unit 9 reading and executing the program may be realized by hardware by an electronic circuit such as FPGA (field programmable gate array) or ASIC (Application Specific IC). ..

<Aspects grasped from at least one of each embodiment and each modification>
The following aspects are grasped from at least one of each of the above-described embodiments and modifications.
One aspect of the sound signal processing device according to the present invention is to the first speaker arranged for the third seat located between the first seat and the second seat located in front of or behind the first seat. The first sound is sent to the first output unit that outputs the first sound signal corresponding to the output signal of the microphone arranged for the first seat and the second speaker arranged for the second seat. It is characterized by including a second output unit that outputs a second sound signal corresponding to the signal at a timing later than the output timing of the first sound signal.
According to this aspect, the user of the third seat between the first seat and the second seat arranges the sound corresponding to the output signal of the microphone arranged for the first seat with respect to the third seat. After listening from the first speaker, the second speaker arranged for the second seat will be heard. For this reason, the user of the third seat feels that the sound heard from the second speaker is also heard from the first speaker due to the preceding sound effect, and the user of the third seat may not feel a sense of discomfort. It will be possible. Therefore, it is possible to suppress the occurrence of a situation in which conversation cannot be assisted in a vehicle having three or more rows of seats.

In one aspect of the sound signal processing device described above, it is desirable that the volume of the sound indicated by the first sound signal is lower than the volume of the sound indicated by the second sound signal.
According to this aspect, howling can be suppressed as compared with the case where the first speaker outputs sound at a louder volume than that of the second speaker.

In one aspect of the sound signal processing device described above, it is desirable that the first seat, the second seat, and the third seat are arranged in the passenger compartment, and the second seat is located behind the first seat.
According to this aspect, the user of the third seat can also hear the voice of the user of the front first seat heard from the rear second speaker from the first speaker corresponding to the third seat due to the preceding sound effect. It is possible to make it feel as if it is heard and make it difficult to feel a sense of discomfort.

Another aspect of the sound signal processing device according to the present invention is a first speaker arranged with respect to a third seat located between the first seat and the second seat located in front of or behind the first seat. The first output unit that outputs the first sound signal corresponding to the output signal of the microphone arranged for the first seat, and the sound output from the first speaker according to the first sound signal. A second sound signal corresponding to the first sound signal is output to the second speaker so that the volume is lower than the volume of the sound output from the second speaker arranged for the second seat. It is characterized by including a second output unit.
According to this aspect, howling is less likely to occur between the microphone and the first speaker as compared with the case where the first speaker outputs sound at a louder volume than that of the second speaker. Therefore, it is possible to suppress the occurrence of a situation in which conversation cannot be assisted in a vehicle having three or more rows of seats.

In one aspect of the sound signal processing device described above, a first control unit that controls whether or not to prohibit the output of the first sound signal to the first speaker according to the presence or absence of a user of the third seat. It is desirable to include.
According to this aspect, for example, when there is no user in the third seat, it is possible to suppress the output of sound from the first speaker to the user in the third seat, which is less necessary.

In one aspect of the sound signal processing device described above, the first seat, the second seat, and the third seat are arranged in the passenger compartment, and the first sound signal is described in accordance with the noise sound in the passenger compartment. It is desirable to include a second control unit that controls whether or not output to the first speaker is prohibited.
According to this aspect, for example, when the noise noise in the passenger compartment is small and the voice of the user in the first seat can be heard by the user in the third seat without using a microphone and a speaker, the necessity is low. It becomes possible to suppress the output of sound from the first speaker to the user of the third seat.

11, 12 ... Microphone, 21-26 ... Speaker, 3 ... Sound signal processing device, 8 ... Storage unit, 9 ... Processing unit, 91 ... First output unit, 92 ... Second output unit, 92a ... Amplification unit, 92b ... Delay section, 93 ... Third output section, 93a ... Amplification section, 93b ... Reverse phase signal generation section.

Claims (3)

To the first speaker arranged for the third seat located between the first seat and the second seat located in front of or behind the first seat, the microphone arranged for the first seat. The first output unit that outputs the first sound signal according to the output signal, and
A second output unit that outputs a second sound signal corresponding to the first sound signal to the second speaker arranged with respect to the second seat at a timing later than the output timing of the first sound signal. only including,
The first seat, the second seat, the third seat, and the microphone are arranged in the passenger compartment of the vehicle.
The vehicle has a side with a door and
The first speaker and the second speaker are arranged on the side portion, and the first speaker and the second speaker are arranged on the side portion.
A sound signal processing device characterized in that the volume of sound indicated by the first sound signal is lower than the volume of sound indicated by the second sound signal. Depending on whether the user of the third seat in claim 1, characterized in that it comprises a first control unit that controls whether to prohibit the output to the first speaker of the first sound signal The sound signal processing device described. The first seat, the second seat, and the third seat are arranged in the passenger compartment.
The first or second claim, wherein the second control unit that controls whether or not the output of the first sound signal to the first speaker is prohibited according to the noise sound in the vehicle interior is included. Sound signal processing device.

Images