JP5870819B2 - Voice control device, voice control method, and voice control program - Google Patents

Description

  The present invention relates to a voice control device capable of adjusting voice, a voice control method, and a voice control program.

  2. Description of the Related Art Conventionally, a voice control device that is used in a conference and can adjust voice is known. For example, the electronic conference terminal device (voice receiving device) described in Patent Literature 1 receives data transmitted from devices used by other participants. The electronic conference terminal device changes the sound quality, sound, and volume of the audio data included in the data, and outputs it from a speaker or the like. The electronic conference terminal device determines the sound quality, sound, and volume of the sound data based on the data indicating the transmission source of the sound data and the information when the user of the electronic conference terminal intentionally wants to change the sound quality, sound, and volume. It is changing.

JP-A-8-125761

  In the conventional electronic conference terminal device, only the participant using the electronic conference terminal device can change the sound quality and the like, and can distinguish the voice of the speaker. Here, among the participants of the conference, there may be a participant who uses a device of a different type from the electronic conference terminal device. In this case, a participant who uses a device of a different type from the electronic conference terminal device cannot change the sound quality or the like. For this reason, there is a problem that it is difficult for a participant who uses a device of a different type from the electronic conference terminal device to distinguish the voice of the speaker.

  An object of the present invention is to provide a voice control device, a voice control method, and a voice control program capable of easily distinguishing a voice of a speaker regardless of the type of device used by a conference participant. is there.

The voice control device according to the first aspect of the present invention includes a voice acquisition unit that acquires voices transmitted from a plurality of devices, and a frequency that acquires the frequency of the voice for each of the devices acquired by the voice acquisition unit. A change that determines to change the frequency of the sound when the difference between the frequency of the maximum sound pressure in the frequency for each device acquired by the acquisition means and the frequency acquisition means is within a preset first range. When the determination means and the change determination means determine that the sound frequency is to be changed, the sound frequencies of the plurality of devices are set apart from each other so that the sound frequencies of the plurality of devices are separated from each other. The frequency changing means for changing the frequency of at least one of the voices, and the frequency changing means among the plurality of devices based on a preset condition. Device selection means for selecting the device to be transmitted as the frequency-changed sound that is the sound whose wave number has been changed, and first sound for transmitting the frequency-changed sound to the device selected by the device selection means Transmission means and second voice transmission means for transmitting the voice before the frequency is changed by the frequency changing means to a device other than the device selected by the device selection means.

  In this case, the frequency of the sound of at least one device is changed so that the frequencies of the sounds transmitted from the plurality of devices are separated from each other. Since the audio frequencies are separated from each other, it is easier to distinguish the voices of the participants in the conference using each device than when the audio frequencies overlap. Then, the frequency-changed sound whose frequency has been changed is transmitted to the device selected by the device selection means. For this reason, the device selected by the device selection means can receive the frequency-changed sound and output it from a speaker or the like. Therefore, even if the device selected by the device selection means does not perform the process of changing the audio frequency, the user can easily distinguish the voice of the speaker of the conference. As described above, the voice control device can easily distinguish the voice of the speaker regardless of the type of the device selected by the device selection means.

  In the voice control device, the plurality of devices include a device that transmits and receives a conference image, and receives the image among the plurality of devices from which the voice is acquired by the voice acquisition unit. The device includes a specifying unit that specifies the device, and the device selecting unit transmits the frequency-changed sound to the device other than the device that is specified as receiving the image by the specifying unit. You may select as an apparatus. Since a user who uses a device receiving an image for a conference is performing a conference while viewing the image, it is easy to distinguish the voice of the speaker by not only listening to the sound but also checking the image. On the other hand, since the user of the apparatus that has not received the image data of the conference cannot see the image, it is difficult to distinguish the voice of the speaker as compared with the user who is having the conference while viewing the image. Since the frequency-changed voice can be transmitted to the device used by the user who is difficult to distinguish the voice of the speaker, the user who cannot easily distinguish the voice of the speaker can easily distinguish the voice of the speaker. Moreover, the voice which has not changed the frequency can be transmitted to the user who can easily distinguish the voice of the speaker. Therefore, the user who is viewing the image can hold the conference while listening to the sound whose frequency is not changed.

  The voice control device includes a connection type detection unit that detects a connection type with the plurality of devices, and the device selection unit determines the frequency-changed voice according to the connection type detected by the connection type detection unit. You may select the said apparatus used as the object which transmits. The connection type is related to the type of device used by each user. For this reason, by selecting a device that is a target for transmitting the frequency-changed sound according to the connection type, for example, the frequency-changed sound can be transmitted to a type of device that is difficult to distinguish the voice of the speaker. Therefore, the user can easily distinguish the voice of the speaker. In addition, it is possible to transmit a voice whose frequency is not changed to a device of a type that can easily distinguish a voice of a speaker. Therefore, the user can hold the conference while listening to the voice whose frequency is not changed.

In the voice control system, the change determination means, the difference between the frequency of the maximum sound pressure in the frequency of the device each obtained by the frequency acquisition means, when within said first range, and, for each of the devices When the maximum sound pressure at the frequency is larger than a predetermined sound pressure value set in advance, it may be determined that the frequency of the sound is changed. In this case, if the voice of the speaker is not included in the acquired voice, the maximum sound pressure is equal to or lower than a predetermined sound pressure value. Therefore, it is possible to prevent the frequency from being changed even though the voice of the speaker is not included in the acquired voice. Thus, when the voice of the speaker is not included and there is no need to change the frequency, the frequency changing process is not executed. Therefore, the processing load is reduced. In addition, the voice that does not include the voice of the speaker may contain only noise. However, since the frequency is not changed in the case of noise-only speech, it is possible to prevent the frequency of the noise-only speech from being changed and causing the user to feel uncomfortable.

  In the voice control device, the frequency changing unit may change the frequency of at least one of the voices of the plurality of devices to a frequency within a preset second range when changing the frequency of the voice. Good. In this case, the frequency change range can be within the second range. For this reason, for example, if the second range is limited to the frequency range of the human voice, it is possible to prevent the voice from being changed to a voice having a frequency higher or lower than the frequency range of the human voice. Therefore, when the frequency-changed sound is output from the speaker, the user can easily recognize a human voice. For this reason, it becomes easier to distinguish the voice of the speaker.

The voice control method according to the second aspect of the present invention is a voice control method executed in a voice control device that processes voice, a voice acquisition step of acquiring voices transmitted from a plurality of devices, and the voice A frequency acquisition step for acquiring the frequency of the sound for each device acquired by the acquisition step, and a frequency difference of the maximum sound pressure in the frequency for each device acquired by the frequency acquisition step is set in advance. When it is determined to change the frequency of the audio when within the range, and the change determining step determines to change the frequency of the audio, the frequency of the audio of the plurality of devices is determined. A frequency for changing the frequency of at least one of the sounds of the plurality of devices so as to be separated from each other And a device selection for selecting, from among the plurality of devices, the device to be a target for transmitting the frequency-changed sound, which is the sound whose frequency has been changed by the frequency changing step, based on a preset condition. A first voice transmission step for transmitting the frequency-changed voice to the device selected by the device selection step, and a frequency other than the device selected by the device selection step by the frequency change step. A second voice transmission step of transmitting the voice before the change is made. In this case, it is possible to easily distinguish the voice of the speaker regardless of the type of the device selected in the device selection step.

A voice control program according to a third aspect of the present invention is a voice control program executed in a voice control device that processes voice, and the voice transmitted from a plurality of devices is transmitted to a controller of the voice control device. A sound acquisition step to acquire; a frequency acquisition step to acquire the frequency of the sound for each device acquired by the sound acquisition step; and a frequency of the maximum sound pressure at the frequency for each device acquired by the frequency acquisition step. If the difference is within a preset first range, the change determination step for determining to change the frequency of the sound, and the change determination step determines that the frequency of the sound is to be changed. Among the sounds of the plurality of devices, the frequencies of the sounds of the plurality of devices are separated from each other. A frequency changing step for changing the frequency of at least one of the voices, and a frequency-changed voice that is the voice whose frequency has been changed by the frequency changing step among the plurality of devices based on a preset condition. A device selection step for selecting the device to be processed, a first voice transmission step for transmitting the frequency-changed voice to the device selected by the device selection step, and the device selected by the device selection step. And a second voice transmitting step for transmitting the voice before the frequency is changed by the frequency changing step. In this case, it is possible to easily distinguish the voice of the speaker regardless of the type of the device selected in the device selection step.

1 is a configuration diagram of a conference system 1. FIG. 3 is a block diagram showing an electrical configuration of the voice control device 11. FIG. It is a figure which shows the frequency characteristic of the state in which the voice of a speaker is not contained in the audio | voices 601 and 602. FIG. It is a figure which shows the frequency characteristic of the state in which the voice of the speaker was included in the audio | voices 601 and 602. FIG. It is a figure which shows the frequency characteristic of the state in which the frequency of the audio | voices 601 and 602 shown in FIG. 4 was changed. It is a figure which shows the frequency characteristic of the state in which the voice of the speaker was included in the audio | voices 603,604,605. It is a figure which shows the frequency characteristic of the state in which the frequency of the audio | voices 603,604,605 shown in FIG. 6 was changed. It is a flowchart of a main process. It is a flowchart of an audio | voice transmission process. 7 is a data configuration diagram of a connection type data table 95. FIG.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. An overview of the conference system 1 according to the first embodiment will be described with reference to FIG. The conference system 1 performs a remote conference (hereinafter referred to as “voice conference”) using at least voice between different sites (first site 10, second site 20, third site 30, and fourth site 40). It is. The conference system 1 includes voice control devices 11 and 12, personal computers (hereinafter referred to as PCs) 13 and 21, mobile phones 14 and 31, and a fixed phone 41. When an audio conference is performed, audio is transmitted and received as an analog signal or a digital signal, and processing is performed. In the following description, audio represented by an analog signal or a digital signal is collectively referred to as “audio data”.

  The voice control devices 11 and 12, the PC 13, and the mobile phone 14 are installed at the first base 10. The voice control device 12 is daisy chain connected to the voice control device 11 by a communication cable. Daisy chain connection is a connection method for connecting devices in a daisy chain. Therefore, it is possible to increase the number of voice control devices by further daisy chaining voice control devices other than the voice control devices 11 and 12. The voice control device 11 can transmit and receive voice data to and from the voice control device 12. The PC 13 and the mobile phone 14 are connected to the voice control device 11 by a communication cable.

  The PC 21 is installed at the second site 20. The PC 21 is connected to the PC 13 at the first site 10 via the Internet network 22. The PC 13 can transmit / receive image data, audio data, and the like to / from the PC 21 at the second site 20 via the Internet network 22. The voice control device 11 can transmit / receive voice data and the like to / from the PC 21 via the PC 13 and the Internet network 22.

  The mobile phone 31 is installed at the third base 30. The mobile phone 31 is connected to the mobile phone 14 at the first site 10 via a mobile phone network 32 (for example, a PSTN network). The voice control device 11 can transmit / receive voice data and the like to / from the mobile phone 31 via the mobile phone 14 and the mobile phone network 32. The fixed telephone 41 is installed at the fourth base 40. The fixed telephone 41 is connected to the voice control device 11 at the first site 10 via a fixed telephone network 42 (for example, a PSTN network). The voice control device 11 can transmit and receive voice data and the like to and from the fixed telephone 41 via the fixed telephone network 42.

  In the present embodiment, the voice control devices 11 and 12, the PC 21, the mobile phone 31, and the fixed phone 41 at the first to fourth sites 10, 20, 30, and 40 have their surrounding voices (voices of users participating in the conference). Etc.). Voice data collected by the voice control devices 11 and 12, the PC 21, the mobile phone 31, and the fixed phone 41 is collected in the voice control device 11 at the first site 10. The collected voice data is processed by the CPU 110 of the voice control device 11, and then transmitted to the speaker 114, the voice control device 12, the PC 21, the mobile phone 31, and the fixed phone 41 of the voice control device 11, It is output (reproduced) from the speaker of each device. As a result, the audio conference is performed at the first to fourth sites 10, 20, 30, and 40.

  The PC 13 includes a camera 131, and the PC 21 includes a camera 211. The PC 13 and the PC 21 capture images during the meeting of the respective bases 10 and 20, and transmit / receive image data to / from each other. The PCs 13 and 21 display the received images on a display provided on the PCs 13 and 21. Thus, a user who performs a voice conference using the PC 21 can perform a voice conference while confirming the conference image. Note that a user who performs a voice conference using the voice control device 11 cannot confirm the conference image when only the voice control device 11 is used. However, by looking at the display of the PC 13, the audio conference can be performed while confirming the conference image.

  With reference to FIG. 2, the electrical configuration of the voice control device 11 will be described. The electrical configuration of the voice control device 12 is the same as that of the voice control device 11. The voice control device 11 includes a CPU 110 that controls the voice control device 11. CPU 110 is electrically connected to ROM 111, RAM 112, flash memory 113, speaker 114, microphone 115, communication interface (hereinafter referred to as communication I / F) 116, input unit 117, and output unit 118.

  The ROM 111 stores a boot program, BIOS, OS, and the like. The RAM 112 stores temporary data. The flash memory 113 stores a control program for the CPU 110. The communication I / F 116 is an interface for communicating with other devices (voice control device 12, PC 21, mobile phone 31, fixed phone 41). The voice control device 11 includes a plurality of communication I / Fs 116 to communicate with the voice control device 12, the PC 21, the mobile phone 31, and the fixed phone 41. The input unit 117 is a button for the user to input various instructions to the voice control device 11. The output unit 118 is a liquid crystal display for notifying the user of information. The speaker 114 outputs (reproduces) sound based on the sound data transmitted from the CPU 110. The microphone 115 collects sound. The collected voice data is input to the CPU 110. Note that a D / A converter for converting a digital signal into an analog signal is provided in order to output sound from the speaker 114 based on the sound data transmitted from the CPU 110, but the illustration is omitted. In addition, an A / D converter that converts an analog signal into a digital signal is provided in order to input sound data collected from the microphone 115 to the CPU 110, but the illustration is omitted.

  With reference to FIGS. 3-7, the frequency of the audio | voice based on the audio | voice data acquired in the audio | voice control apparatus 11 and the change of a frequency are demonstrated. In the following description, the devices (voice control devices 11, 12, PC 21, mobile phone 31, fixed phone 41) that collect and output voices for the users of the respective bases 10, 20, 30, 40 to hold a conference. When any one is not specified or generically referred to, it is simply referred to as “conference device”. 3 and 4 show the frequency characteristics of the two voices 601 and 602 when the voice data collected by the two conference apparatuses are simultaneously acquired by the voice control apparatus 11. 3 and 4, the horizontal axis represents frequency (Hz), and the vertical axis represents sound pressure level (dB). When the voice of the speaker is not included in the voice, as shown in FIG. 3, the frequency characteristics of the voices 601 and 602 are equal to or lower than a predetermined sound pressure value. The predetermined sound pressure value is a reference value for determining whether the voice acquired in S13 (described later) is ambient noise or a voice of a speaker. In the present embodiment, as an example, It is set to 60 dB. In FIG. 3, since the voice of the speaker is not included, the voices 601 and 602 have noise levels.

  When the voices of the speakers are included in the voices 601 and 602, as shown in FIG. 4, the frequency characteristics of the voices 601 and 602 indicate peaks (waveforms) corresponding to the frequency and sound pressure level of the voices of the speakers. It becomes larger than the predetermined sound pressure value. The difference in frequency between the voice 601 and the voice 602 represents the difference in the frequency of the voice of the speaker. The difference in the sound pressure level is based on the loudness of the speaker who has collected the sound and the difference in the amplification factor.

  In general, the closer the frequency, the more similar the voice of the speaker output from the speaker. For this reason, in an audio conference, it becomes difficult to distinguish the voices of speakers from a plurality of conference apparatuses. Therefore, in this embodiment, when the frequency of the maximum sound pressure (frequency with the highest sound pressure level) is within the first range, the frequencies of the voices 601 and 602 are changed (S28 in FIG. 9, described later). The first range is set to a range in which it is difficult to distinguish a speaker's voice when a plurality of sounds fall within the first range, and is assumed to be 200 Hz as an example in the present embodiment.

  When changing the frequency, the CPU 110 changes the frequency to a frequency within a preset second range. At this time, the CPU 110 changes the frequency of each sound so as to be separated within the second range (see S28 in FIG. 9). In the present embodiment, as an example, the second range is a range of 400 Hz to 3000 Hz. Generally, the frequency of voice that can be transmitted through the fixed telephone network 42 is about 300 Hz to 3400 Hz that covers the frequency range of human voice. The second range (400 Hz to 3000 Hz) is within the frequency of voice that can be transmitted through the fixed telephone network 42 (within 300 Hz to 3400 Hz), and is a frequency that can be recognized as a human voice. The second range is not limited to the case of the present embodiment, and may be another frequency range.

  For example, when two frequencies of the voices 601 and 602 shown in FIG. 4 are changed, as shown in FIG. 5, one voice 601 is changed to the lower limit “400 Hz” of the second range, and the other voice 602 is changed to the second frequency. The upper limit of the range is changed to “3000 Hz”. Thereby, the frequencies of the two voices 601 and 602 are separated from each other, and the two voices 601 and 602 are easily distinguished. The sound 601 before the change (see FIG. 4) is closer to the lower limit “400 Hz” than the sound 602. For this reason, the voice 601 is set to the lower limit of the second range (see FIG. 5). The voice 602 before the change (see FIG. 4) is closer to the upper limit “3000 Hz” than the voice 602. For this reason, the voice 602 is set to the upper limit of the second range (see FIG. 5). The frequency change process is performed by a known frequency change method.

  Further, for example, among the voices 603, 604, and 605 shown in FIG. 6, the voices 603 and 604 are within the first range, and the voices 604 and 605 are also within the first range. For this reason, the CPU 110 changes the frequency of each sound so as to be separated (see S28 in FIG. 9). When the frequencies of the three voices 603, 604, and 605 are changed, for example, as shown in FIG. 7, the voices 603, 604, and 605 are changed so as to have substantially equal intervals within the second range. In the example shown in FIG. 6, the frequency of the maximum sound pressure of the voice 603 is changed to 400 Hz, the frequency of the voice 604 is changed to 1700 Hz, and the frequency of the maximum sound pressure of the voice 605 is changed to 3000 Hz.

  Of the voices 603, 604, and 605 before the change (see FIG. 6), the voice 603 has the lowest frequency, and the voice 605 has the highest frequency. For this reason, the voice 603 is set to the lower limit “400 Hz” of the second range, and the voice 605 is set to the upper limit “3000 Hz” of the second range (see FIG. 7). The voice 604 (see FIG. 6) having a frequency between the voice 603 and the voice 605 is set to an intermediate frequency “1700 Hz” in the second range (see FIG. 7). Note that the method for determining the frequency of the voice after the change is an example. A method for determining the frequency to be set is stored in the flash memory 113 in advance. In the following description, the sound whose frequency has been changed is referred to as “frequency-changed sound”.

  With reference to FIG. 8, the main process which CPU110 of the audio | voice control apparatus 11 performs is demonstrated. The main process is a process of acquiring voice data collected by each conference device, performing various processes, and then transmitting the data to each conference device in order to perform a voice conference. When the power is turned on, the CPU 110 reads the main process program from the flash memory 113 and starts the main process. In the following description, the case where the CPU 110 acquires (receives) audio data is the case where the audio control device 12, the PC 21, the mobile phone 31, and the landline phone 41 collect and transmit audio data, Including a case where an audio signal of sound collected by the microphone 115 of the audio control device 11 is acquired. The CPU 110 transmits audio data when transmitting audio data to the audio control device 12, the PC 21, the mobile phone 31, and the fixed phone 41, and when transmitting audio data to the speaker 114 of the audio control device 11. Including the case of transmission.

  In the main process, first, it is determined whether or not a voice conference start instruction has been input (S11). The user operates the input unit 117 to input a voice conference start instruction. When the instruction for starting the audio conference is not input (S11: NO), the process of S11 is repeated. When an instruction to start an audio conference is input (S11: YES), a conference device that receives image data is identified (S12). In S <b> 12, a signal for searching for a conference device receiving the conference image data is transmitted from the CPU 110 to each conference device. Then, the response signal obtained from the PC 21 specifies that the PC 21 is a conference apparatus that is receiving image data. Information on the identified conference device is stored in the RAM 112. The voice control devices 11 and 12, the mobile phone 31, and the landline phone 41 are conference devices that have not received image data.

  Next, it is determined whether or not the audio data of the conference device has been acquired (received) (S13). Note that voice data collected by the voice control device 12, the PC 21, the mobile phone 31, and the fixed phone 41 is transmitted to the voice control device 11 every predetermined time and acquired by the CPU 110. In addition, the voice data collected by the microphone 115 of the voice control device 11 is always acquired by the CPU 110. The acquired voice data is stored in the RAM 112. If audio data has not been acquired (S13: NO), the process of S17 described later is executed. When voice data is acquired (S13: YES), one conference device is selected from a plurality of conference devices (voice control devices 11, 12, PC 21, mobile phone 31, and landline phone 41) that perform a voice conference. (S14). Next, a voice transmission process is performed (S15).

  The voice transmission process will be described with reference to FIG. First, it is determined whether or not voice data of a plurality of conference devices has been acquired in S13 (S21). That is, it is determined whether or not there are a plurality of voice inputs at the same time. For example, it is assumed that the voices acquired in S13 are voices 601 and 602 shown in FIG. In this case, it is determined that a plurality of conference apparatus voices have been acquired (S21: YES), the preset conditions stored in the flash memory 113 are referred to, and the conference apparatus selected in S14 receives the frequency-changed voice. It is determined whether or not the conference device is a transmission target (S22).

  In the present embodiment, it is assumed that the preset condition is the presence / absence of reception of conference image data. Since users of conference devices other than the conference device receiving the conference image data cannot see the images, it is difficult to distinguish the voice of the speaker compared to the users who are meeting while viewing the images. . For this reason, in this embodiment, it is determined that a conference device other than the conference device receiving the conference image data is a conference device that is a target for transmitting the frequency-changed sound. That is, the conference apparatus that is the target of transmitting the frequency-changed voice is selected by the process of S22.

  In the present embodiment, it is specified in S12 that the PC 21 is a conference device that is receiving image data. On the other hand, the voice control devices 11 and 12, the mobile phone 31, and the fixed phone 41 are not specified as conference devices that receive image data because they do not receive image data. For this reason, for example, when the conference apparatus selected in S14 is the fixed telephone 41, it is determined that the conference apparatus is a target for transmitting the frequency-changed voice (S22: YES), and the frequency is determined in the process of S28 described later. It is determined whether or not a modified voice has already been created (S23). When the frequency change voice has been created (S23: YES), S29 (described later) is executed. That is, the frequency-changed voice already created in S28 (described later) is transmitted to the selected conference apparatus.

  When the frequency change voice is not created (S23: NO), the frequency of the voice for each conference device acquired in S13 is acquired (S24). In S24, for example, the audio for each conference device acquired in S13 is Fourier transformed, and the frequency characteristics are acquired. Voices 601 and 602 shown in FIG. 4 and the like are frequency characteristics after Fourier transform.

  Next, the frequency of the maximum sound pressure in the frequency for each conference device acquired in S24 is acquired for each conference device (S25). For example, the maximum sound pressure frequency “1250 Hz” of the sound 601 and the maximum sound pressure frequency “1340 Hz” of the sound 602 shown in FIG. 4 are acquired (S25).

  Next, it is determined whether or not the plurality of maximum sound pressures at the frequency for each conference device acquired in S24 is greater than a predetermined sound pressure value (60 dB) set in advance (S26). For example, voices 601 and 602 shown in FIG. 4 are larger than a predetermined sound pressure value. For this reason, it is determined that the maximum sound pressure at the frequency for each conference device is larger than the predetermined sound pressure value (S26: YES), and the frequency of the maximum sound pressure acquired at S25 is greater than the predetermined sound pressure value at S26. It is determined whether or not the determined frequency of the maximum sound pressure is within the first range (in this embodiment, within the range of 200 Hz) (S27).

  For example, the frequency of the maximum sound pressure of the voices 601 and 602 (see FIG. 4) acquired in S25 is “1250 Hz” and “1340 Hz”. The difference in frequency between these maximum sound pressures is 90 Hz. For this reason, it is determined that it is within the first range (S27: YES), and the frequency of the audio of the plurality of conference devices is changed so that the frequency of the maximum sound pressure for each of the plurality of conference devices is separated from each other. (S28). By the process of S28, the frequencies of the voices 601 and 602 shown in FIG. 4 are changed as shown in FIG. Note that the frequency-changed sound whose frequency has been changed is stored in the RAM 112.

  Next, the frequency-change voice data changed in S28 is transmitted to the conference device selected in S22 (S29). Thereby, for example, the data of the frequency change voice is received by the fixed telephone 41 and is output from the speaker of the fixed telephone 41. For example, when the voices 603, 604, and 605 shown in FIG. 6 are acquired in S13, the frequency is changed as shown in FIG. 7 (S28) and transmitted (S29).

  Next, the voice transmission process is terminated. Next, returning to the main process, it is determined whether or not audio data has been transmitted to all the conference apparatuses in S29 and S30 (S16). In other words, it is determined whether all conference devices have been selected in S14. If there is a conference device to which no audio data is transmitted (S16: NO), the process returns to S14, and another conference device is selected.

  For example, when the PC 21 is selected in S14, since the PC 21 has received image data, it is determined that the PC 21 is not a target conference device that transmits frequency-changed audio (S22: NO). Next, the audio data acquired in S13 is transmitted to the conference device selected in S14 (S30). That is, voices 601 and 602 (see FIG. 4) whose frequencies are not changed are transmitted to the PC 21. The PC 21 receives audio data and outputs it from the speaker of the PC 21. Next, the voice transmission process is terminated.

  Further, for example, when the voice of one conference apparatus is acquired in S13, it is determined that the voices of a plurality of conference apparatuses are not acquired in S21 (S21: NO), and the voice data whose frequency is not changed is determined. Is transmitted (S30). In this case, since the voice data includes only the voice of one conference device, the voices of a plurality of speakers do not overlap, and the voices of the speakers can be easily distinguished without changing the frequency. .

  Also, for example, if it is determined in S26 that the maximum sound pressure at the frequency for each conference device is not greater than a predetermined sound pressure value (S26: NO), audio data whose frequency has not been changed is transmitted. (S30). In this case, since the voice data includes only noise-only voice or only one voice that exceeds the predetermined sound pressure value, the voices of a plurality of speakers do not overlap. This is because the voice of the speaker can be easily distinguished without changing the frequency.

  In S27, among the maximum sound pressure frequencies acquired in S25, the maximum sound pressure frequencies determined to be larger than the predetermined sound pressure value in S26 are within the first range (in this embodiment, 200 Hz). If not (within range) (S27: NO), audio data whose frequency has not been changed is transmitted (S30). In this case, since the frequencies of the voices of the plurality of speakers are separated from each other by the first range or more, the voices of the plurality of speakers who have spoken at the same time can be distinguished.

  In the process of S16, when it is determined in S29 and S30 that audio data has been transmitted to all the conference apparatuses (S16: YES). It is determined whether or not the voice conference is terminated (S17). If it is determined that the audio conference has not ended (S17: NO), the process returns to S13, and the audio conference is continued. When the user inputs an instruction to end the audio conference via the input unit 117, it is determined that the audio conference is ended (S17: YES), and the main process is ended.

  As described above, the processing in this embodiment is executed. In the present embodiment, the audio frequency is changed so that the audio frequencies transmitted from a plurality of conference apparatuses are separated from each other (S28, FIG. 5, and FIG. 7). Since the voice frequencies are separated from each other, it is easier to distinguish the voice of the speaker as compared to the case where the voice frequencies overlap (see FIGS. 4 and 6). Then, the frequency-changed voice whose frequency has been changed is transmitted to the conference device selected in S22 (S29). For this reason, even if the destination conference apparatus does not perform the process of changing the audio frequency, the user can easily distinguish the voice of the speaker. In this way, the voice control device 11 (CPU 110) can make it easier for the user to distinguish the voice of the speaker regardless of the type of conference device.

  In addition, in S22, the conference device (speech control device 11, 12, mobile phone 31, and fixed phone 41) other than the conference device (PC 21) receiving the image data is a target for transmitting the frequency-changed voice. The device is selected (S22: YES). Then, the frequency change sound is transmitted (S29). As described above, since the user of the conference device that has not received the conference image data cannot see the image, the voice of the speaker is distinguished from the user who holds the conference while viewing the image. hard. In the present embodiment, since the frequency-changed voice can be transmitted to the conference device used by the user who is difficult to distinguish the voice of the speaker, the user (voice control devices 11, 12,. The user of the mobile phone 31 and the fixed phone 41) can easily distinguish the voice of the speaker. Further, not only listening to voice but also images can be seen, and voice that does not change the frequency can be transmitted to a user who easily distinguishes the voice of the speaker (user using PC 21) (S22: NO, S30). Therefore, the user who is viewing the image can hold the conference while listening to the sound whose frequency is not changed.

  In the present embodiment, when a plurality of maximum sound pressures at a frequency for each conference device are larger than a predetermined sound pressure value (S26: YES), and when the frequency of the maximum sound pressure is within the first range (S27). : YES), it is determined to change the frequency, and the frequency of the sound is changed (S29). If the voice of the speaker is not included in the voice acquired in S13, the maximum sound pressure is equal to or lower than a predetermined sound pressure value. In this case, the audio frequency is not changed. Therefore, the frequency is prevented from being changed even though the voice of the speaker is not included in the voice acquired in S13. Thus, when the voice of the speaker is not included and there is no need to change the frequency, the frequency changing process is not executed. Thus, the processing load on the CPU 110 is reduced. In addition, the voice that does not include the voice of the speaker may include only noise, such as voices 601 and 602 shown in FIG. However, since the frequency is not changed in the case of voice with noise only (S26: NO, S30), it is possible to prevent the frequency of the voice with noise only from being changed and giving the user a sense of incongruity.

In the present embodiment, the range in which the audio frequency is changed is limited to the second range. In the present embodiment, the second range is limited to the frequency range of human voice. Therefore, when the CPU 11 0 changes the frequency at S28, higher than the frequency range of the human voice, or can be prevented from being changed to the sound of low frequencies. Therefore, when the frequency change sound is transmitted (S30) and is output from the speaker, the user can easily recognize the voice of the speaker. For this reason, it becomes easier for the user to distinguish the voice of the speaker.

  In the present embodiment, the CPU 110 that performs the process of S13 corresponds to the “voice acquisition unit” of the present invention, and the CPU 110 that performs the process of S24 corresponds to the “frequency acquisition unit” of the present invention. The CPU 110 that performs the processes of S26 and S27 corresponds to the “change determination unit” of the present invention, and the CPU 110 that performs the process of S22 corresponds to the “device selection unit” of the present invention. The CPU 110 that performs the process of S29 corresponds to the “first voice transmission unit” of the present invention, and the CPU 110 that performs the process of S30 corresponds to the “second voice transmission unit” of the present invention. The CPU 110 that performs the process of S12 corresponds to the “specifying means” of the present invention.

  The process of S13 corresponds to the “voice acquisition step” of the present invention, and the process of S24 corresponds to the “frequency acquisition step” of the present invention. The processing of S26 and S27 corresponds to the “change determination step” of the present invention, and the processing of S22 corresponds to the “device selection step” of the present invention. The process of S29 corresponds to the “first voice transmission step” of the present invention, and the process of S30 corresponds to the “second voice transmission step” of the present invention.

  In addition, this invention is not limited to said embodiment, A various change is possible. For example, the frequency of the frequency-changed voice whose frequency has been changed in S28 is not limited to the voices 601 and 602 shown in FIG. 5 and the voices 603, 604, and 605 shown in FIG. For example, at least one frequency of the voice 601 and the voice 602 may be changed. Moreover, you may change at least 1 frequency among audio | voice 603,604,605. In this case, since the number of voices whose frequency is changed is reduced, it is possible to easily distinguish the voice of the speaker while reducing the processing load of the CPU 110. Further, when changing the frequency of the sound whose maximum sound pressure frequency is within the first range (for example, the sounds 601 and 602 shown in FIG. 4 or the sounds 603, 604 and 605 shown in FIG. 6), the frequencies separated from each other. The frequency after the change is not particularly limited as long as it is (for example, a frequency separated by 200 Hz or more).

  Further, the sound before the frequency change is transmitted to the PC 21 that has acquired the image data (S22: NO, S30), and the sound control devices 11 and 12 that have not acquired the image data have the frequency Although the change voice has been transmitted (S22: YES, S29), it is not limited to this. For example, since the PC 13 exists at the first site 10, the users of the voice control devices 11 and 12 at the first site 10 can also view images using the PC 13. Therefore, the audio before the frequency is changed may be transmitted to the conference device (voice control devices 11 and 12) used by the user at the base where the image can be seen.

  Further, when the plurality of maximum sound pressures at the frequency for each conference device are larger than a predetermined sound pressure value set in advance (S26: YES), and when the frequency of the maximum sound pressure is within the first range (S27). : YES), it is determined that the frequency is to be changed, and the audio frequency has been changed (S29), but the present invention is not limited to this. For example, when the frequency of the maximum sound pressure is within the first range without performing the process of S26 (S27: YES), the audio frequency may be changed (S29).

  Further, the maximum sound pressure may not be a frequency having the highest sound pressure level at a certain temporary sound pressure level. For example, the CPU 110 may acquire the maximum sound pressure several times (for example, 10 times) within a predetermined time (for example, 1 second), and set the average value of the acquired maximum sound pressure as the maximum sound pressure.

  Further, a conference device that acquires conference image data is identified (S12), and a conference device other than the conference device that is identified as acquiring a conference image transmits frequency-changed audio. (S22: YES), but the present invention is not limited to this. For example, the CPU 110 of the voice control device 11 may detect the type of connection with the conference device, and select a conference device that is a target for transmitting the frequency-changed voice according to the detected connection type. Hereinafter, the second embodiment which is this modification will be described in detail.

  The connection type data table 95 will be described with reference to FIG. The connection type data table 95 is stored in the flash memory 113 of the voice control device 11. As shown in FIG. 10, in the connection type data table 95, the connection type and the change information are associated with each other. The connection type is the Internet network 22, the mobile phone network 32, the fixed phone network 42, daisy chain connection, or the like. Note that the voice control device 11 itself is also included in the connection type. The change information is a flag indicating a case where the frequency is changed and a case where the frequency is not changed. The connection type “Internet network 22” is associated with the change information “0 (does not change the frequency)”, and the connection types “mobile phone network 32” “fixed phone network 42” “daisy chain connection” “voice control device 11”. Change information “1 (change frequency)” is associated with “self”.

  Processing in the second embodiment will be described with reference to FIGS. In the second embodiment, only the processes of S12 of FIG. 8 and S22 of FIG. 9 are different from those of the first embodiment. Therefore, only this point will be described in detail, and description of other processes will be omitted. In S12 in the second embodiment, the type of connection with the conference device is detected (S12). In S12, for example, a connection type is detected by detecting which of the communication jacks (not shown) included in the communication I / F 116 included in the voice control device 11 is communicating. Is detected. For example, if the CPU 110 communicates with the PC 21 via a LAN (Local Area Network) jack (not shown) included in the voice control device 11, it is detected that the connection type is the Internet network 22.

  Further, if the CPU 110 is communicating with the mobile phone 31 via a USB (Universal Serial Bus) jack (not shown) provided in the voice control device 11, it is detected that the connection type is the mobile phone network 32. . Further, if the CPU 110 is communicating with the fixed telephone 41 via a modular jack (not shown) provided in the voice control device 11, it is detected that the connection type is the fixed telephone network 42. Further, if the CPU 110 is communicating with the voice control device 12 via a daisy chain connection jack (not shown) provided in the voice control device 11, it is detected that the connection type is daisy chain connection. The detected connection type is stored in the RAM 112.

  In S22, the connection type data table 95, which is a preset condition stored in the flash memory 113, is referred to, and whether or not the conference device selected in S14 is a conference device that is a target for transmitting frequency-changed audio. Is determined (S22). For example, it is assumed that the conference device selected in S14 is the PC 21. The PC 21 is detected as the connection type “Internet network 22” in S12. For this reason, the connection type data table 95 is referred to, and the change information “0 (does not change the frequency)” corresponding to the connection type “Internet network 22” is specified. In this case, it is determined that the conference device is not the target for transmitting the frequency-changed voice (S22: NO), and the voice before the frequency is changed is sent to the PC 21 (S30).

  Similarly, when the conference device selected in S14 is the fixed telephone 41, the connection type data table 95 is referred to, and the change information “1 (changes frequency)” corresponding to the connection type “fixed telephone network 42”. Is identified. In this case, it is determined that the conference device is a target for transmitting the frequency-changed voice (S22: YES), and the frequency-changed voice is transmitted to the fixed telephone 41 (S29). As described above, in S22, the conference device that is the target of transmitting the frequency-changed voice is selected according to the connection type detected in S12.

  As described above, the processing in the second embodiment is executed. The connection type is related to the type of conference device used by each user. For this reason, by selecting the conference device that is the target of transmitting the frequency-changed voice according to the connection type, the frequency-changed voice can be transmitted to a type of conference device in which it is difficult to distinguish the voice of the speaker. For example, if the connection type is “fixed telephone network 42”, the conference device used by the fourth base 40 is the fixed telephone 41. Since the fixed telephone 41 cannot confirm other users by an image, or the fixed telephone network 42 communicated by analog signals may not be able to hear a clear voice due to signal deterioration, the voice of the speaker It is a type of conference device that is difficult to distinguish. For this reason, the connection type data table 95 is associated with the change information “1 (change frequency)”. Therefore, the frequency change voice can be transmitted to the fixed telephone 41 (S22: YES, S29), and the user using the fixed telephone 41 can easily distinguish the voice of the speaker. In addition, a voice that does not change the frequency can be transmitted to a conference apparatus of a type that can easily distinguish the voice of the speaker (for example, the PC 21 that can see an image) (S22: NO, S30). Therefore, the user who uses PC21 which is a kind of conference apparatus with which it is easy to distinguish the voice of the speaker can hold the conference while listening to the voice whose frequency is not changed.

1 Conference system 11, 12 Voice control device 14, 31 Mobile phone 31 Mobile phone 41 Fixed phone 95 Connection type data table 110 CPU
601 602 603 604 605 Audio

Claims (7)

Audio acquisition means for acquiring audio transmitted from a plurality of devices;
Frequency acquisition means for acquiring the frequency of the sound for each of the devices acquired by the sound acquisition means;
A change determination means for determining that the frequency of the sound is to be changed when the difference in frequency of the maximum sound pressure in the frequency for each device acquired by the frequency acquisition means is within a preset first range;
When it is determined by the change determining means that the frequency of the sound is to be changed, at least one of the sounds of the plurality of devices is in a state of being separated from each other. Frequency changing means for changing the frequency of the sound;
A device selection unit that selects, from among the plurality of devices, the device that is the target of transmitting the frequency-changed voice, which is the voice whose frequency has been changed by the frequency changing unit, based on a preset condition;
First voice transmission means for transmitting the frequency-changed voice to the device selected by the device selection means;
A voice control apparatus comprising: a second voice transmission means for sending the voice before the frequency is changed by the frequency changing means to a device other than the device selected by the device selection means. The plurality of devices includes a device that transmits and receives a conference image,
Among the plurality of devices from which the sound is acquired by the sound acquisition unit, a specifying unit that specifies the device that is receiving the image,
The device selection unit selects the device other than the device identified as receiving the image by the identifying unit as the device to be the target of transmitting the frequency-changed sound. Item 2. The voice control device according to Item 1. A connection type detection means for detecting a connection type with the plurality of devices;
The voice control according to claim 1, wherein the device selection unit selects the device to be the target of transmitting the frequency-changed voice according to the connection type detected by the connection type detection unit. apparatus. The change determination means, the difference between the frequency of the maximum sound pressure in the frequency of the device each obtained by the frequency acquisition means, when within said first range, and the maximum sound pressure in the frequency of each of the devices 4. The voice control device according to claim 1, wherein when it is greater than a predetermined sound pressure value set in advance, it is determined that the frequency of the voice is changed. 5.   2. The frequency changing means, when changing the frequency of at least one of the voices of the plurality of devices, changes the frequency to a frequency within a preset second range. 5. The voice control device according to any one of 4 to 4. A voice control method executed in a voice control device that processes voice,
An audio acquisition step of acquiring audio transmitted from a plurality of devices;
A frequency acquisition step of acquiring the frequency of the audio for each of the devices acquired by the audio acquisition step;
A change determination step for determining that the frequency of the sound is to be changed when the difference in frequency of the maximum sound pressure in the frequency for each device acquired by the frequency acquisition step is within a preset first range;
If it is determined in the change determination step that the frequency of the sound is changed, at least one of the sounds of the plurality of devices is set so that the sound frequencies of the plurality of devices are separated from each other. A frequency changing step for changing the frequency of the voice;
A device selection step of selecting the device to be a target for transmitting the frequency-changed voice, which is the voice whose frequency has been changed by the frequency changing step, among the plurality of devices based on a preset condition;
A first voice transmission step of transmitting the frequency-changed voice to the device selected by the device selection step;
A voice control method comprising: a second voice transmission step of sending the voice before the frequency is changed by the frequency changing step to a device other than the device selected by the device selection step. A voice control program executed in a voice control device that processes voice,
In the controller of the voice control device,
An audio acquisition step of acquiring the audio transmitted from a plurality of devices;
A frequency acquisition step of acquiring the frequency of the audio for each of the devices acquired by the audio acquisition step;
A change determination step for determining that the frequency of the sound is to be changed when the difference in frequency of the maximum sound pressure in the frequency for each device acquired by the frequency acquisition step is within a preset first range;
If it is determined in the change determination step that the frequency of the sound is changed, at least one of the sounds of the plurality of devices is set so that the sound frequencies of the plurality of devices are separated from each other. A frequency changing step for changing the frequency of the voice;
A device selection step of selecting the device to be a target for transmitting the frequency-changed voice, which is the voice whose frequency has been changed by the frequency changing step, among the plurality of devices based on a preset condition;
A first voice transmission step of transmitting the frequency-changed voice to the device selected by the device selection step;
An audio control program that causes a device other than the device selected in the device selection step to execute a second audio transmission step of transmitting the audio before the frequency is changed in the frequency change step.

Images