JP7390582B2 - Call system, control method and program - Google Patents

Description

The present disclosure generally relates to a telephone call system, a control method, and a program. More specifically, the present disclosure relates to a telephone call system that outputs audio, a control method, and a program.

Patent Document 1 discloses an entrance handset (intercom device) installed at the entrance to call residents and talk to them, and a room main unit (intercom device) installed in the house to respond to calls from the entrance handset. An intercom system comprising a terminal) and a terminal are described.

The entrance handset includes a camera for capturing an image of a visitor, a microphone array, a handset CODEC, a phase difference detection section, a direction of arrival estimation section, and a video signal processing section. The microphone array includes multiple microphones. The handset CODEC converts multiple channels of audio signals collected and output by the microphone array into digital signals. The phase difference detection section detects the phase difference of the audio signals from the digital audio signals of multiple channels transmitted from the entrance slave unit to the main unit in the room. The direction of arrival estimation unit estimates the direction of arrival of the audio based on the detected phase difference information. The video signal processing unit pans and tilts the video displayed on the monitor based on the estimation result of the direction of arrival estimation unit.

Japanese Patent Application Publication No. 2016-189570

A speaker who makes a telephone call has a desire to suppress the output of sounds (voices) that he or she does not want to be leaked to the outside during a telephone conversation. In Patent Document 1, since the direction of arrival of sound is estimated, it is possible to suppress and output sounds from directions other than the estimated direction. However, the speaker cannot confirm that sounds (voices) that he or she does not want to be leaked to the outside are not being output at the other end of the call.

The present disclosure has been made in view of the above problems, and aims to provide a telephone call system, a control method, and a program that allow a speaker to know the status of the sound (voice) being output at the other end of the call.

A telephone call system according to one aspect of the present disclosure includes a sound acquisition section, an output section, and a notification section. The sound acquisition unit acquires a sound including at least a speaker's voice. The output unit outputs the acquired sound to a device operated by a person on the other end of the call. The notification unit notifies the speaker of confirmation information related to the acquired sound. The confirmation information includes an acquisition range that is a range regarding information on at least one of the presence or absence of the sound, sound pressure, and volume. The notification unit superimposes the acquisition range on an image representing a floor plan of the space in which the speaker is present, displays the acquired range on a display unit, and notifies the speaker.

A control method according to one aspect of the present disclosure includes a sound acquisition step, an output step, and a notification step. The sound obtaining step obtains sound including at least the speaker's voice. The output step outputs the acquired sound to a device operated by the person on the other end of the call. The notification step notifies the speaker of confirmation information related to the acquired sound. The confirmation information includes an acquisition range that is a range regarding information on at least one of the presence or absence of the sound, sound pressure, and volume. In the notification step, the acquisition range is superimposed on an image representing a floor plan of the space in which the speaker is present and displayed on a display unit, and the speaker is notified.

A program according to one aspect of the present disclosure is a program for causing a computer to execute the control method.

According to the present disclosure, the speaker can know the status of the sound (voice) being output at the destination of the call.

FIG. 1 is a diagram illustrating the configuration of an information terminal as a telephone call system according to an embodiment. FIG. 2 is a diagram illustrating the configuration of an intercom system including the above information terminal. FIG. 3 is a diagram illustrating the operation of the above information terminal. FIG. 4 is a diagram illustrating an example of an image related to confirmation information displayed on the display unit of the information terminal according to Modification 1. FIG. 5 is a diagram illustrating the configuration of an information terminal according to modification 2. FIG. 6 is a diagram illustrating an example of an image related to confirmation information displayed on the display unit of the above information terminal.

The embodiments and modified examples described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modified examples. Even other than the following embodiments and modifications, various changes can be made according to the design etc. as long as they do not deviate from the technical idea of the present disclosure.

(Embodiment)
Hereinafter, an intercom system 2 including an information terminal 10 as a telephone call system 1 according to the present embodiment will be explained using FIGS. 1 to 3.

(1) Overview The telephone call system 1 according to the present embodiment will be described below.

The telephone call system 1 according to this embodiment is applied to an intercom system 2, as shown in FIG. The intercom system 2 is applied, for example, to a housing complex 5 such as an apartment building. The intercom system 2 according to this embodiment includes an information terminal 10 as the call system 1. In this embodiment, the intercom system 2 includes a plurality of (two in FIG. 2) information terminals 10. The intercom system 2 further includes a lobby intercom 20, a control device 30, and a plurality of (two in FIG. 2) door phones 40. The intercom system 2 is configured so that each of the plurality of information terminals 10 and the lobby intercom 20 communicate with each other via the control device 30. Furthermore, in the intercom system 2, the plurality of information terminals 10 and the plurality of doorphones 40 correspond one-to-one. Note that the intercom system 2 according to this embodiment may be applied to a detached house in addition to the apartment complex 5. Alternatively, the intercom system 2 may be applied to offices, stores, schools, non-residential facilities such as nursing care facilities, and the like.

Each of the plurality of information terminals 10 is, for example, a dwelling unit terminal (master device) provided in each of the plurality of dwelling units E2 included in the apartment complex 5. Each information terminal 10 is provided, for example, at the inner entrance of each dwelling unit E2. Each information terminal 10 is connected to the control device 30 via a second main line 62, a branch line 63, and a branch 50. Each information terminal 10 is configured to communicate (for example, make a phone call, transmit a control signal, etc.) with the lobby intercom 20 via the control device 30. Further, each information terminal 10 is connected to a corresponding door phone 40 via a connection line 64. Each information terminal 10 is configured to communicate (for example, make a call, send a control signal, etc.) with a corresponding door intercom 40.

The lobby intercom 20 is provided, for example, at a common entrance (lobby) E1 of the housing complex 5. Lobby intercom 20 is connected to control device 30 via first trunk line 61 . The lobby intercom 20 is configured to communicate (eg, make phone calls, transmit video signals, etc.) with each information terminal 10 via the control device 30. The lobby intercom 20 is attached to the wall of the common entrance E1, for example. When the lobby intercom 20 transmits a video signal to the information terminal 10, the information terminal 10 can display a video (image).

The control device 30 is provided, for example, in a management room E3 of the housing complex 5. The control device 30 is connected to the lobby intercom 20 via a first trunk line 61 and to each information terminal 10 via a second trunk line 62. That is, the control device 30 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

Each of the plurality of door phones 40 is provided, for example, at the outer entrance of each housing unit E2 of the housing complex 5. Each door phone 40 is connected to the corresponding information terminal 10 via a connection line 64. Each door phone 40 is configured to communicate (eg, make a phone call, transmit a video signal, etc.) with the corresponding information terminal 10.

In this embodiment, the first trunk line 61, the second trunk line 62, the branch line 63, and the connection line 64 are all twisted pair wires. That is, although the first main line 61, the second main line 62, the branch line 63, and the connecting line 64 are actually composed of two electric wires, they are represented by one line in the drawing. At least one of the first trunk line 61, the second trunk line 62, the branch line 63, and the connection line 64 may be an electric wire other than the twisted pair wire.

The information terminal 10 according to this embodiment includes a sound acquisition section 13, a transmission section 184 (output section), and a notification section 186. The sound acquisition unit 13 acquires sounds including at least the speaker's voice. The sending unit 184 outputs the sound acquired by the sound acquiring unit 13 to a device operated by the person on the other end of the call. The notification unit 186 notifies the speaker of confirmation information related to the sound acquired by the sound acquisition unit 13. Here, the speaker is, for example, a resident of dwelling unit E2. The person to be called is, for example, a visitor to the housing complex 5, but may be a person who calls each housing unit E2 from the lobby intercom 20, or may be a resident of each housing unit E2 who has returned home from outside. .

In the information terminal 10 (call system 1) according to this embodiment, the speaker is notified of confirmation information related to the sound acquired by the sound acquisition unit 13. Therefore, the speaker can know in what state the sound acquired by the information terminal 10 is being output to the device operated by the person on the other end of the call. For example, the speaker can know whether or not a sound that is originally not desired to leak outside is being output.

(2) Configuration (2-1) Information Terminal As shown in FIG. , a storage section 17 and a control section 18.

The information terminal 10 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the control unit 18 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The first communication unit 11 is a communication interface for communicating with (the communication unit 21 of) the lobby intercom 20. The first communication unit 11 is connected to the control device 30 via a second main line 62, a branch line 63, and a branch 50. The first communication unit 11 transmits an audio signal, a control signal, etc. to the lobby intercom 20 via the control device 30. Further, the first communication unit 11 receives audio signals, video signals, etc. from the lobby intercom 20 via the control device 30.

The second communication unit 12 is a communication interface for communicating with the door phone 40. The second communication unit 12 is connected to the door phone 40 via a connection line 64. The second communication unit 12 transmits audio signals, control signals, etc. to the door phone 40, and receives audio signals, video signals, etc. from the door phone 40.

The sound acquisition unit 13 acquires sounds including at least the speaker's voice, and outputs sound information related to the acquired sounds to the control unit 18. The sound acquisition section 13 has a plurality of microphones. Each of the plurality of microphones is a directional microphone. In this embodiment, the sound acquisition unit 13 includes two microphones (a first microphone 131 and a second microphone 132), as shown in FIG. The first microphone 131 and the second microphone 132 have different directivities in at least one of the horizontal direction (left-right direction) and the vertical direction (up-down direction). The first microphone 131 and the second microphone 132 are arranged side by side along the left-right direction. The first microphone 131 and the second microphone 132 acquire surrounding sounds, including the voice (sound) of a speaker located in front of the information terminal 10, and convert the acquired sounds into analog sound signals (sound information). and outputs it to the control section 18.

The operation unit 14 is configured to receive operations from a user (for example, a resident of each dwelling unit E2, etc.). The operation unit 14 has at least a call button. The call button is a button for starting communication with the lobby intercom 20 or the door phone 40 (call with a visitor, etc.) in response to a call from the lobby intercom 20 or the door phone 40. In other words, if the call button is pressed while the first communication unit 11 is receiving a call signal for calling a resident, a voice call is possible between the lobby intercom 20 or door phone 40 and the information terminal 10. .

The output unit 15 is, for example, a speaker. When the information terminal 10 is in a state where it can communicate with the lobby intercom 20, the output unit 15 outputs sounds (including the voices of visitors, etc.) based on the sound data transmitted from the lobby intercom 20.

The display unit 16 is, for example, a liquid crystal display. The display unit 16 is configured to display images. Furthermore, the display unit 16 is configured to display confirmation information related to the sound acquired by the sound acquisition unit 13 to the speaker. The confirmation information includes, for example, at least one of information on whether or not sound was acquired during the call (presence or absence of sound), the sound pressure of the acquired sound, and the volume. Note that in this embodiment, the confirmation information includes the presence or absence of sound, the sound pressure of the acquired sound, and the volume. The display unit 16 displays the presence or absence of sound, the sound pressure of the acquired sound, and the volume. In addition, when the information terminal 10 is equipped with a touch panel display, the touch panel display may serve as the display section 16 and the operation section 14.

The storage unit 17 is composed of a readable and writable memory. The storage unit 17 is, for example, a flash memory. The storage unit 17 stores, for example, confirmation information.

As shown in FIG. 1, the control unit 18 includes a voice processing unit 181, a direction estimation unit 182, a direction control unit 183, a sending unit 184, a processing unit 185, and a notification unit 186.

The audio processing unit 181 acquires the analog sound signal output by the sound acquisition unit 13. The audio processing unit 181 converts the acquired analog sound signal into a digital sound signal. Furthermore, the audio processing unit 181 is configured to perform predetermined filtering processing and the like on the sound signal acquired from the sound acquisition unit 13. The audio processing unit 181 includes, for example, a plurality of echo cancellers (a first echo canceller and a second echo canceller). The first echo canceller suppresses or removes echoes from the sound signal output from the first microphone 131. The second echo canceller suppresses or removes echoes from the sound signal output from the second microphone.

The direction estimation unit 182 estimates the direction of the person who makes the sound based on the sound information related to the sound acquired by the sound acquisition unit 13. Specifically, the direction estimation unit 182 estimates the direction of the person who is speaking based on the phase difference between the first signal and the second signal.

The direction control unit 183 controls the sound acquisition direction by the sound acquisition unit 13 based on the estimation result of the direction estimation unit 182. Specifically, the direction control unit 183 adjusts the gain of the sound input from the first microphone 131 and the gain of the sound input from the second microphone 132 based on the estimation result of the direction estimation unit 182. It is configured as follows. More specifically, the direction control unit 183 performs various calculations on the audio signals input from each of the first microphone 131 and the second microphone 132, thereby converting the audio signal into an audio signal with increased sensitivity in a desired direction. Convert. This improves the S/N ratio in the desired direction. For example, when the direction estimation unit 182 estimates that the speaker is on the right side, the direction control unit 183 sets the gain of the sound input from the first microphone 131 to 1, and the gain of the sound input from the second microphone 132. Set to 0. In this case, the direction control unit 183 will output only the sound input from the first microphone 131. In other words, the control unit 18 controls the sound acquisition direction by the sound acquisition unit 13 by causing the direction control unit 183 to change the gain of the sound input from each microphone based on the estimation result of the direction estimation unit 182. Can be done.

The direction control unit 183 includes, for example, a noise suppressor. The direction control unit 183 suppresses or removes noise from a sound signal including two gain-adjusted signals.

The sending unit 184 outputs the sound data (sound information) related to the sound acquired by the sound acquiring unit 13 to a device operated by the person on the other end of the call. Specifically, the transmission unit 184 transmits the sound signal whose noise has been suppressed or removed by the direction control unit 183 to the communication target device via the first communication unit 11 or the second communication unit 12. . For example, when the information terminal 10 is communicating with the lobby intercom 20, the sending unit 184 transmits a sound signal (hereinafter simply referred to as “sound signal”) whose noise has been suppressed or removed by the direction control unit 183. ) is transmitted to the lobby intercom 20 via the first communication unit 11.

The processing unit 185 generates confirmation information to be notified to the speaker. The processing unit 185 acquires the presence or absence of sound, volume, and sound pressure based on the sound signal. The processing unit 185 generates confirmation information including the presence or absence of sound, volume, and sound pressure. In short, the processing unit 185 generates confirmation information based on the sound obtained by performing predetermined processing on the sound acquired by the sound acquisition unit 13. Here, the predetermined process is a process of removing unnecessary sounds from the sound acquired by the sound acquisition unit 13 as output sounds output by the device at the destination of the call, such as suppressing or removing echoes, and processing related to noise suppression or removal. Therefore, the confirmation information includes information regarding the sound obtained by performing predetermined sound-related processing on the sound acquired by the sound acquisition unit 13. That is, the confirmation information is information related to the sound acquired by the information terminal 10 and different from the sound (in other words, information that is not the sound itself acquired by the information terminal 10).

The notification unit 186 notifies the speaker of confirmation information related to the sound acquired by the sound acquisition unit 13. For example, the notification unit 186 notifies the speaker of confirmation information during a call between the speaker and the person on the other end. More specifically, during the call, the notification unit 186 controls the display unit 16 so that the display unit 16 displays the presence or absence of sound, volume, and sound pressure included in the confirmation information generated by the processing unit 185. At this time, the display unit 16 displays the presence or absence of sound, volume, and sound pressure included in the confirmation information. Thereby, the notification unit 186 can notify the speaker of the confirmation information.

(2-2) Lobby Intercom As shown in FIG. 2, the lobby intercom 20 includes a communication section 21, a control section 22, a sound acquisition section 23, a communication section 24, a display section 25, an operation section 26, It includes a storage section 27 and an imaging section 28.

The lobby intercom 20 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the control unit 22 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The communication unit 21 is a communication interface for communicating with (the first communication unit 11 of) the information terminal 10. The communication unit 21 is connected to (the communication unit 31 of) the control device 30 via the first main line 61. The communication unit 21 transmits audio signals, video signals, etc. to the information terminal 10 via the control device 30. Furthermore, the communication unit 21 receives audio signals, control signals, etc. from the information terminal 10 via the control device 30. Here, the communication signal from the lobby intercom 20 includes information for identifying the information terminal 10 (for example, address information, etc.). Therefore, only the information terminal 10 to which address information that matches the address information included in this communication signal is assigned can receive the communication signal.

The control unit 22 is configured to control the communication unit 21, the sound acquisition unit 23, the communication unit 24, the imaging unit 28, and the like.

The sound acquisition section 23 has a microphone. The microphone acquires surrounding sounds including voices (sounds) of visitors and the like located in front of the lobby intercom 20 , converts the acquired sounds into analog sound signals, and outputs the analog sound signals to the control unit 22 .

The communication unit 24 includes a speaker and a microphone, and is configured to be able to communicate with the information terminal 10 .

The display unit 25 is, for example, a liquid crystal display. The display unit 25 is configured to display the video imaged by the imaging unit 28. Furthermore, the display unit 25 is configured to display messages to visitors and the like. The message is, for example, a message for encouraging a visitor or the like to speak. The display unit 25 displays a message such as "Please talk", for example. In this case, a similar voice message may be output (noticed) from the speaker of the communication unit 24 or a speaker provided separately from the speaker of the communication unit 24. Further, the display section 25 and a speaker may be used together. In addition, when the intercom system 2 is equipped with a touch panel display, the touch panel display may serve as the display section 25 and the operation section 26.

The operation unit 26 is configured to accept operations from a user (for example, a visitor to the housing complex 5, a resident, etc.). The operation unit 26 is, for example, an input interface including a plurality of pushbutton switches, a touch panel, and the like.

The storage unit 27 is composed of a readable and writable memory. The storage unit 27 is, for example, a flash memory. The storage unit 27 stores, for example, video data of a video (image) captured by the imaging unit 28.

The imaging unit 28 is a camera that has an image sensor and captures an image of a subject (user). In this embodiment, the imaging area (field of view) of the imaging unit 28 is set in front of the intercom system 2. In this embodiment, the imaging unit 28 is a camera that captures moving images. Furthermore, in this embodiment, the imaging unit 28 is a camera that captures color images. Note that the imaging unit 28 may be a camera that captures still images (a still camera), or may be a camera that captures monochrome images.

The image sensor is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 28 forms an image of light from the subject on an imaging surface (light receiving surface) of an image sensor using an optical system such as a lens, and converts the light from the subject into an electrical signal using the image sensor. The imaging section 28 then outputs the output signal of the imaging device to the control section 22 as a video signal.

(2-3) Control Device The control device 30 includes a communication section 31, a control section 32, and a storage section 33, as shown in FIG.

The control device 30 includes, for example, a microcomputer having a processor and a memory. The microcomputer functions as the control unit 32 by the processor executing the program stored in the memory. Although the program executed by the processor is pre-recorded in the memory of the microcomputer here, it may also be provided recorded on a non-temporary recording medium such as a memory card, or provided via a telecommunications line such as the Internet. may be done.

The communication unit 31 includes a communication interface for communicating with each information terminal 10 and the lobby intercom 20. The communication unit 31 is connected to the lobby intercom 20 via a first trunk line 61 and to each information terminal 10 via a second trunk line 62. That is, the communication unit 31 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

The control unit 32 is configured to control the communication unit 31.

The storage unit 33 is composed of a readable and writable memory. The storage unit 33 is, for example, a flash memory. The storage unit 33 stores, for example, a correspondence table representing the correspondence between the room number assigned to each dwelling unit E2 and the address information assigned to each information terminal 10. That is, in the control device 30, the control unit 32 refers to the correspondence table, creates a signal in which the room number included in the signal from the lobby intercom 20 is replaced with the address information of the corresponding information terminal 10, and converts this signal into The information is transmitted from the communication unit 31 to each information terminal 10. In each information terminal 10, if the address information included in the signal received by the first communication unit 11 matches the address information stored in the storage unit 17, the control unit 18 controls the Get the information that is displayed. In addition, in each information terminal 10, if the address information included in the signal received by the first communication unit 11 does not match the address information stored in the storage unit 17, the control unit 18 controls the discard the information that is

(2-4) Doorphone Each doorphone 40 is connected to the corresponding information terminal 10 via a connection line 64, as shown in FIG. The door phone 40 transmits audio signals, video signals, etc. to the information terminal 10. Further, the door phone 40 receives audio signals, control signals, etc. from the information terminal 10.

(3) Operation Here, the operation of the information terminal 10 as the telephone call system 1 will be explained using FIG. 3.

The sound acquisition unit 13 acquires the speaker's voice (step S1). Specifically, each of the first microphone 131 and the second microphone 132 included in the sound acquisition unit 13 acquires surrounding sounds including the voice (sound) of the speaker, and converts the acquired sounds into analog sound signals. and outputs it to the control section 18.

The direction estimation unit 182 estimates the direction of the speaker who makes the sound based on the sound information related to the sound acquired by the sound acquisition unit 13 (step S2). The direction control unit 183 controls the sound acquisition direction by the sound acquisition unit 13 based on the estimation result of the direction estimation unit 182 (step S3). At this time, the sound acquired by the sound acquisition unit 13 is subjected to predetermined sound-related processing. Specifically, as a predetermined process, the sound acquired by the sound acquisition unit 13 is subjected to a process of removing a sound that is unnecessary as an output sound output from the device at the destination of the call. More specifically, in the information terminal 10, echo suppression or removal and noise suppression or removal are performed on the sound acquired by the sound acquisition unit 13.

The processing unit 185 performs a confirmation process (step S4). Specifically, the processing unit 185 generates confirmation information including the presence or absence of sound, volume, and sound pressure based on the sound signal that has been subjected to predetermined sound processing.

The sending unit 184 outputs a sound signal that has been subjected to predetermined sound processing to a device operated by the person on the other end of the call (step S5). For example, when the information terminal 10 is communicating with the lobby intercom 20 , the transmitter 184 transmits a sound signal whose noise has been suppressed or removed by the direction controller 183 to the lobby intercom 20 .

The notification unit 186 notifies the speaker of confirmation information during the conversation between the speaker and the person on the other end of the call (step S6). Specifically, during the call, the notification unit 186 controls the display unit 16 so that the display unit 16 displays the presence or absence of sound, volume, and sound pressure included in the confirmation information generated by the processing unit 185.

(4) Advantages As explained above, the information terminal 10 of this embodiment acquires the sound including at least the voice of the speaker, and outputs the acquired sound to the lobby intercom 20 or door phone 40 operated by the person on the other end of the call. do. The information terminal 10 notifies the speaker of information regarding the presence or absence of the acquired sound, volume, and sound pressure as confirmation information related to the acquired sound.

Thereby, a speaker using the information terminal 10 can know in what state the sound acquired by the information terminal 10 is being output from the lobby intercom 20 or the door phone 40.

(5) Modification Examples Modification examples are listed below. Note that the modified examples described below can be applied in combination with the above embodiment as appropriate.

(5-1) Modification example 1
In the above embodiment, the confirmation information includes at least one of the presence or absence of sound, volume, and sound pressure, but is not limited to this configuration.

The confirmation information may include information regarding an acquisition range in which the sound acquisition unit 13 acquires sounds. In this case, the notification unit 186 superimposes the acquisition range on the image related to the location of the speaker and displays it on the display unit 16 to notify the speaker.

For example, as shown in FIG. 4, the notification unit 186 superimposes and displays a confirmation image G2 in which an acquisition range is superimposed on an image related to the location of the speaker, on a video G1 captured by the lobby intercom 20. The display unit 16 is controlled to. The confirmation image G2 is an image in which a polar diagram G22 is superimposed as an image of the acquisition range on a floor plan G21 of the space where the information terminal 10 is installed as an image related to the place where the speaker is. An object G23 included in the confirmation image G2 represents the information terminal 10. A polar diagram G22 represents a sound acquisition range centered on an object G23 representing the information terminal 10.

Note that the image related to the location of the speaker is not limited to the floor plan G21. The image related to the location of the speaker may be an image captured by a camera. In other words, the image related to the location of the speaker may be any image that allows the space in which the information terminal 10 is installed to be recognized.

Furthermore, the image in the acquisition range is not limited to a polar diagram. The image of the acquisition range may be any image that allows the recognition of the voice acquisition range.

(5-2) Modification example 2
In the embodiment described above, the information terminal 10 may use a sound identification function to determine whether or not the acquired sound includes a sound other than that of the speaker.

For example, the processing unit 185 of this modification includes a determination unit 191 and a confirmation processing unit 192, as shown in FIG.

The determining unit 191 determines whether the sound acquired by the sound acquiring unit 13 includes a sound different from the speaker's voice (non-speaker sound). For example, when determining that the sound acquired by the sound acquisition unit 13 includes a human voice, the determination unit 191 determines that the voice of the person is the speaker's voice, and determines that the sound acquired by the sound acquisition unit 13 It is determined whether or not a sound other than the voice of the speaker is included.

Note that the determining unit 191 may use the estimation result of the direction estimating unit 182 to determine whether there is a speaker in the dwelling unit E2. In this case, if the sound signal includes a human voice and the estimation result of the direction estimation unit 182 indicates that the person who is emitting the voice is in front, the discrimination unit 191 determines that the person's voice is the speaker's voice. Then, it is determined whether the sound acquired by the sound acquisition unit 13 includes a sound other than the voice of the speaker.

The confirmation processing unit 192 generates confirmation information to be notified to the speaker according to the determination result of the determination unit 191. Specifically, when the determination unit 191 determines that the sound acquired by the sound acquisition unit 13 includes a sound other than the voice of the speaker, the confirmation processing unit 192 determines whether the sound acquired by the sound acquisition unit 13 includes a sound other than the voice of the speaker. Information regarding at least one of the type of non-speaker sound and the source of the non-speaker sound is generated.

For example, if the sound acquired by the sound acquisition unit 13 includes a sound with a higher frequency or lower frequency than the frequency of the speaker's voice, the confirmation processing unit 192 selects high frequency (or low frequency) as the type of sound external to the speaker. ) is generated. Confirmation information including information indicating that the sound of ) is included is generated. If the sound acquired by the sound acquisition unit 13 includes the voice of an animal (for example, a dog) or the sound of a television set in the space, the confirmation processing unit 192 determines whether the sound source (for example, a dog) is the source of the sound other than the speaker. , television)). The information representing the sound source is, for example, information related to an icon representing the sound source.

If the confirmation information includes information related to a dog icon and information related to a television icon as information representing the sound source, the notification unit 186 displays the source of the sound other than the speaker in the image captured by the lobby intercom 20. As such information G3, a dog icon G31 and a television icon G32 are displayed in a superimposed manner on the display unit 16 (see FIG. 6).

(5-3) Modification example 3
In the above embodiment, the processing unit 185 may classify the volume and sound pressure included in the confirmation information into levels according to their strength. At this time, the notification unit 186 may display the volume and sound pressure according to the result of the level classification. For example, the notification unit 186 changes the display color depending on the intensity of the volume and sound pressure. More specifically, the processing unit 185 classifies each of the volume and sound pressure included in the confirmation information into one of three intensity levels (“large,” “medium,” and “low”). The notification unit 186 displays the volume (or sound pressure) in red on the display unit 16 when the level of the volume (or sound pressure) is “loud”. The notification unit 186 causes the display unit 16 to display the volume (or sound pressure) in yellow when the volume (or sound pressure) level is “medium”. The notification unit 186 displays the volume (or sound pressure) in blue on the display unit 16 when the level of the volume (or sound pressure) is “low”.

Further, the confirmation information may be displayed as a heat map that represents the level of confirmation information using color shading or the like. For example, as mentioned above, if each of the volume and sound pressure included in the confirmation information is divided into one of the three intensity levels (“loud”, “medium”, “low”), the level As the display color changes from "small" to "large", the display color changes from light to dark or from dark to light.

Note that this modification may be applied to modification 1. In this case, the processing unit 185 divides the acquisition range into a plurality of ranges based on the intensity (level) of the acquired sound. The notification unit 186 causes the display unit 16 to display each divided range in a different color.

(5-4) Modification example 4
In the above embodiment, the notification unit 186 is configured to notify the speaker of confirmation information during a call between the speaker and the person on the other end of the phone call, but the notification unit 186 is not limited to this configuration.

The notification unit 186 may notify the speaker of the confirmation information when a call is not being made. In this case, the sound acquisition unit 13 acquires the sound including at least the speaker's voice during the call. The processing unit 185 generates confirmation information based on the sound acquired by the sound acquisition unit 13 and subjected to predetermined sound-related processing on the sound controlled by the direction control unit 183, and stores it in the storage unit 17. do. The notification unit 186 notifies the confirmation information stored in the storage unit 17 when the operation unit 14 receives a predetermined operation after the call ends.

(5-5) Modification example 5
In the embodiment described above, the telephone call system 1 (information terminal 10) may have a test mode in which the speaker notifies confirmation information in a state where there is no call from the lobby intercom 20 or the door phone 40.

When the test mode is set, the sound acquisition unit 13 acquires a sound including at least the voice of the speaker by an operation of the operator (speaker) in a state where there is no call from the lobby intercom 20 or the door phone 40. In other words, when the test mode is set, the sound acquisition unit 13 acquires the sound that includes at least the speaker's voice when a call is not being made with the lobby intercom 20 or the door phone 40.

The audio processing unit 181 converts the analog sound signal output by the sound acquisition unit 13 into a digital sound signal when the test mode is set and no call is being made. At this time, the audio processing unit 181 performs a predetermined filtering process (echo cancellation process) etc. on the sound signal acquired from the sound acquisition unit 13.

The direction estimation unit 182 estimates the direction of the person making the sound based on the sound information related to the sound acquired by the sound acquisition unit 13 when the test mode is set and no call is being made. Specifically, as described in the first embodiment, the direction estimation unit 182 estimates the direction of the person making the sound based on the phase difference between the first signal and the second signal.

The direction control unit 183 controls the sound acquisition direction by the sound acquisition unit 13 based on the estimation result of the direction estimation unit 182 when the test mode is set and no call is being made. Specifically, the direction control unit 183 is as described in the first embodiment. Based on the estimation results of the direction estimation unit 182, the gain of the sound input from the first microphone 131 and the gain of the sound input from the second microphone 132 are adjusted. Further, in the test mode, the direction control unit 183 suppresses or removes noise from the sound signal including the two gain-adjusted signals.

The sending unit 184 does not function in the test mode. In other words, the sending unit 184 does not output the sound signal whose noise has been suppressed or removed by the direction control unit 183.

The processing unit 185 generates confirmation information to notify the speaker when the test mode is set and no call is being made. As described in the first embodiment, the processing unit 185 generates confirmation information based on the sound obtained by performing predetermined processing on the sound acquired by the sound acquisition unit 13.

The notification unit 186 notifies the user of information related to the sound acquired by the information terminal 10 and different from the sound as confirmation information when the test mode is set and no call is being made. .

As a result, when the test mode is set, the information terminal 10 can receive confirmation information, which is information related to sound including the voice of the operator (speaker) of the information terminal 10, even when a call is not being made. can be notified to the speaker. Therefore, when a call is received through the lobby intercom 20 or the door phone 40, the speaker can know in what state the sound acquired by the information terminal 10 is being output at the called destination (call destination).

(5-6) Modification example 6
Modifications are listed below.

In the embodiment described above, the sound acquisition unit 13 has a configuration including a plurality of microphones, but is not limited to this configuration. The sound acquisition unit 13 may have one microphone.

In the above embodiment, the information terminal 10 was described as an example of the telephone call system 1, but the telephone call system 1 is not limited to the information terminal 10. The call system 1 may be a lobby intercom 20 or a door phone 40. If a management room base unit is provided, the telephone call system 1 may be the management room base unit.

In the above embodiment, the notification unit 186 may notify the speaker of the confirmation information by voice or the like.

(Other variations)
The above embodiment is only one of various embodiments of the present disclosure. The embodiments described above can be modified in various ways depending on the design, etc., as long as the objective of the present disclosure can be achieved. Further, functions similar to those of the telephone call system 1 may be realized by a control method, a computer program, a non-temporary recording medium on which a program is recorded, or the like. A method for controlling the telephone call system 1 according to one embodiment includes a sound acquisition step, an output step, and a notification step. Sound acquisition steps. Obtaining sound that includes at least the speaker's voice. In the output step, the acquired sound is output to a device operated by the person on the other end of the call (eg, lobby intercom 20, door phone 40). The notification step notifies the speaker of confirmation information related to the acquired sound. A program according to one aspect is a program for causing a computer system to function as the above-described telephone call system 1 or a control method for the telephone call system 1.

The main body that executes the telephone call system 1 or the control method for the telephone call system 1 in the present disclosure includes a computer system. A computer system has a processor and memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as the main body for executing the telephone call system 1 or the control method for the telephone call system 1 according to the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, or may be provided over a telecommunications line. Further, the program may be provided by being recorded on a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system. A processor of a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The plurality of electronic circuits may be integrated into one chip, or may be provided in a distributed manner over a plurality of chips. A plurality of chips may be integrated into one device, or may be distributed and provided in a plurality of devices.

(summary)
As described above, the telephone call system (1) of the first aspect includes a sound acquisition section (13), an output section (sending section 184), and a notification section (186). The sound acquisition unit (13) acquires sounds including at least the speaker's voice. The output unit outputs the acquired sound to a device operated by the person on the other end of the call (eg, lobby intercom 20, door phone 40). The notification unit (186) notifies the speaker of confirmation information related to the acquired sound.

According to this configuration, the speaker can know the status of the sound (voice) being output at the destination of the call.

In the telephone call system (1) of the second aspect, in the first aspect, the confirmation information includes information on at least one of the presence or absence of sound, sound pressure, and volume.

According to this configuration, the speaker can know information on at least one of the presence or absence of sound, sound pressure, and volume as the status of the sound (voice) being output at the destination of the call.

In the telephone call system (1) of the third aspect, in the first or second aspect, the confirmation information includes information regarding the acquisition range in which the sound acquisition unit (13) acquires the sound.

According to this configuration, the speaker can know the sound acquisition range as the status of the sound (voice) being output at the destination of the call.

In the telephone call system (1) of the fourth aspect, in the third aspect, the notification unit (186) causes the display unit (16) to display the acquired range superimposed on the image related to the location of the speaker. , notify the speaker.

According to this configuration, since the acquisition range is displayed superimposed on the image related to the speaker's location, the speaker can know the sound acquisition range in association with the image related to the speaker's location.

In the telephone call system (1) of the fifth aspect, in any one of the first to fourth aspects, the notification section (186) divides the information regarding the sound included in the confirmation information into levels and displays the information on the display section (16). Display and notify the speaker.

According to this configuration, the speaker can know the level of the sound-related information included in the confirmation information.

In the telephone call system (1) of the sixth aspect, in any one of the first to fifth aspects, the confirmation information includes the type of non-speaker sound that is different from the voice included in the sound and the non-speaker sound. includes information regarding at least one of the sound sources.

According to this configuration, it is possible to know at least one of the type and the source of the sound other than the speaker's voice as the state of the sound (voice) being output at the destination of the call.

The telephone call system (1) of the seventh aspect further includes a determination unit (191) in the sixth aspect. The determining unit (191) determines whether the sound acquired by the sound acquiring unit (13) includes a sound other than the speaker.

According to this configuration, it is possible to determine whether there is a sound other than the speaker's voice.

In the telephone call system (1) of the eighth aspect, in any of the first to seventh aspects, the confirmation information is obtained after predetermined processing is performed on the sound acquired by the sound acquisition unit (13). Contains information about sounds.

According to this configuration, the speaker can know how the sound after predetermined processing is output at the other end of the call.

In the telephone call system (1) of the ninth aspect, in the eighth aspect, the predetermined processing is unnecessary for the sound acquired by the sound acquisition unit (13) as an output sound output by the device at the destination of the call. Includes processing to remove certain sounds.

According to this configuration, for example, the speaker can know how the sound after noise cancellation is being output at the other party.

In the telephone call system (1) of the tenth aspect, in any one of the first to ninth aspects, the sound acquisition unit (13) acquires sound during a conversation between the speaker and the person on the other end. The notification unit (186) notifies the speaker of confirmation information during the call.

According to this configuration, the speaker can know in real time how the sound acquired by the information terminal is being output at the other party.

In the telephone call system (1) of the eleventh aspect, in any one of the first to ninth aspects, the sound acquisition unit (13) is configured such that when a conversation is being made between the speaker and the person on the other end of the conversation, to get the sound. The notification unit (186) notifies the speaker of confirmation information when a call is not being made.

According to this configuration, the speaker can know how the sound acquired by the information terminal is being output at the other end of the conversation, for example, after the conversation. Therefore, countermeasures can be taken for subsequent calls.

The telephone call system (1) of the twelfth aspect has a test mode in any one of the first to eleventh aspects. When the test mode is set, the sound acquisition unit (13) acquires the sound when no call is being made. The notification unit (186) notifies the speaker of information related to the sound and different from the sound as confirmation information when the test mode is set and a call is not being made.

According to this configuration, in the test mode, it is possible to know in advance in a pseudo manner how the sound acquired by the information terminal is being output at the other end of the conversation.

The control method of the thirteenth aspect includes a sound acquisition step, an output step, and a notification step. The sound obtaining step obtains sound including at least the speaker's voice. In the output step, the acquired sound is output to a device operated by the person on the other end of the call (eg, lobby intercom 20, door phone 40). The notification step notifies the speaker of confirmation information related to the acquired sound.

According to this control method, the speaker can know the status of the sound (voice) being output at the destination of the call.

The program according to the fourteenth aspect is a program for causing a computer to execute the control method according to the thirteenth aspect.

According to this program, the speaker can know the status of the sound (voice) being output at the other end of the call.

1 Call system 10 Information terminal 13 Sound acquisition section 16 Display section 184 Sending section 186 Notification section 191 Discrimination section

Claims (11)

a sound acquisition unit that acquires sound including at least the speaker's voice;
an output unit that outputs the acquired sound to a device operated by the person on the other end of the call;
a notification unit that notifies the speaker of confirmation information related to the acquired sound;
The confirmation information includes an acquisition range that is a range regarding information on at least one of the presence or absence of the sound, sound pressure, and volume,
The notification unit superimposes the acquisition range on an image representing a floor plan of the space in which the speaker is present, displays the acquired range on a display unit, and notifies the speaker.
call system. The notification unit divides the information regarding the sound included in the confirmation information into levels, displays the classified information on a display unit, and notifies the speaker.
The telephone call system according to claim 1. The confirmation information includes information regarding at least one of the type of non-speaker sound that is a sound different from the voice included in the sound and the source of the non-speaker sound.
A telephone call system according to claim 1 or 2. further comprising a determination unit that determines whether the sound acquired by the sound acquisition unit includes a sound other than the speaker;
The telephone call system according to claim 3. The confirmation information includes information regarding the sound after predetermined processing is performed on the sound acquired by the sound acquisition unit.
The telephone call system according to any one of claims 1 to 4. The predetermined process includes a process of removing, from the sound acquired by the sound acquisition unit, a sound that is unnecessary as an output sound output by the device at the destination of the call.
The telephone call system according to claim 5. The sound acquisition unit acquires the sound during a call between the speaker and the person on the other end,
The notification unit notifies the speaker of the confirmation information during the call,
A telephone call system according to any one of claims 1 to 6. The sound acquisition unit acquires the sound when a call is being made between the speaker and the person on the other end,
The notification unit notifies the speaker of the confirmation information when the call is not being made.
A telephone call system according to any one of claims 1 to 6. Has a test mode,
The sound acquisition unit acquires the sound when no call is being made when the test mode is set;
The notification unit notifies the speaker of information related to the sound and different from the sound as the confirmation information when the test mode is set and a call is not being made.
A telephone call system according to any one of claims 1 to 8. a sound obtaining step of obtaining sound including at least the speaker's voice;
an output step of outputting the acquired sound to a device operated by the person on the other end of the call;
a notification step of notifying the speaker of confirmation information related to the acquired sound;
The confirmation information includes an acquisition range that is a range regarding information on at least one of the presence or absence of the sound, sound pressure, and volume,
In the notification step, the acquisition range is superimposed on an image representing a floor plan of the space where the speaker is present and displayed on a display unit, and the speaker is notified.
Control method. A program for causing a computer to execute the control method according to claim 10.

Images