JP7656853B2 - Information terminal and intercom system - Google Patents

Description

The present disclosure generally relates to an information terminal and an intercom system , and more particularly to an information terminal and an intercom system configured to be able to make and receive calls.

Conventionally, intercom systems have been known for use in apartment complexes and the like (see, for example, Patent Document 1).

The intercom system in Patent Document 1 includes a lobby intercom installed at the common entrance of an apartment building, an intercom master unit installed in each dwelling unit, and a door phone slave unit installed outside each dwelling unit (at the entrance).

In this type of intercom system, a visitor calls the intercom master unit using the lobby intercom. In response to this call, the resident of the residence performs a specified operation on the intercom master unit, which starts a conversation between the lobby intercom and the intercom master unit. Similarly, when the intercom master unit is called using the doorphone slave, the resident of the residence performs a specified operation on the intercom master unit in response to the call, which starts a conversation between the doorphone slave and the intercom master unit.

JP 2004-64249 A

Incidentally, intercom master units (information terminals) are often configured to allow hands-free calling. In such cases, there is a demand for the ability to make calls even from a location far away from the intercom master unit.

The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide an information terminal and an intercom system that enable clear conversation depending on the user's location.

An information terminal according to an aspect of the present disclosure is an information terminal that operates as an intercom device. The information terminal includes a sound acquisition unit, a voice processing unit, a voice recognition unit, and a control processing unit. The sound acquisition unit acquires a sound including a user's voice. The voice processing unit performs a voice adjustment process on the sound acquired by the sound acquisition unit, with an estimation target being at least one of the distance and direction of the user relative to the information terminal as a predetermined condition. The voice recognition unit performs a voice recognition process on the sound processed by the voice processing unit. The control processing unit performs control based on a result of the voice recognition process on the sound processed by the voice processing unit. The voice processing unit estimates the estimation target when a predetermined keyword is included in the voice uttered by the user. The voice processing unit performs the voice adjustment process on at least one of receiving and uttering according to the estimation result. When the predetermined keyword is included in the voice uttered by the user, the voice recognition unit sets the state to a call start state, and after the call start state, determines whether or not the sound processed by the voice processing unit includes a control word other than the predetermined keyword. When the voice recognition unit determines that the sound processed by the voice processing unit includes the control word, the control processing unit performs control in accordance with the control word. The control word includes a word corresponding to control of unlocking a door.

The intercom system according to one aspect of the present disclosure includes the information terminal and an intercom entrance device that communicates with the information terminal.

According to this disclosure, clear calls can be made depending on the user's location.

FIG. 1 is a block diagram illustrating the configuration of an information terminal according to an embodiment. FIG. 2 is a diagram for explaining the system configuration of an intercom system including the above information terminal. FIG. 3 is a diagram for explaining the operation of the information terminal. 4A and 4B are diagrams showing an example of a display mode of an image displayed on the information terminal of the above embodiment when the user is close to the information terminal of the above embodiment and when the user is far from the information terminal of the above embodiment; FIG. 5 is a block diagram illustrating the configuration of an information terminal according to the first modification.

The embodiments and modifications described below are merely examples of the present disclosure, and the present disclosure is not limited to the embodiments and modifications. Various modifications other than the embodiments and modifications below are possible depending on the design, etc., as long as they do not deviate from the technical ideas of the present disclosure.

(Embodiment)
Hereinafter, an intercom system 1 including an information terminal 10 that operates as an intercom device according to this embodiment will be described with reference to FIGS. 1 to 4B.

(1) Overview Hereinafter, an information terminal 10 according to the present embodiment will be described.

The information terminal 10 according to this embodiment is applied to an intercom system 1 as shown in FIG. 2. The intercom system 1 is applied to, for example, an apartment building or other collective housing 5. The intercom system 1 according to this embodiment includes an information terminal 10. In this embodiment, the intercom system 1 includes a plurality of information terminals 10 (two in FIG. 2), each of which operates as an intercom device. The intercom system 1 further includes a lobby intercom 20 (intercom entrance device), a control device 30, and a plurality of entrance sub-units 40 (intercom entrance device). In the intercom system 1, each of the plurality of information terminals 10 and the lobby intercom 20 are configured to communicate with each other via the control device 30. In the intercom system 1, the plurality of information terminals 10 and the plurality of entrance sub-units 40 correspond one-to-one to each other. The intercom system 1 according to this embodiment may be applied to a detached house in addition to the collective housing 5. Alternatively, the intercom system 1 may be applied to non-residential facilities such as offices, stores, schools, or nursing homes.

Each of the multiple information terminals 10 is, for example, a dwelling unit terminal (intercom master unit) provided in each of the multiple dwelling units E2 included in the apartment building 5. Each information terminal 10 is provided, for example, at the inner entrance of each dwelling unit E2. Each information terminal 10 is connected to the control device 30 via the second trunk line 62, the branch line 63, and the splitter 50. Each information terminal 10 is configured to communicate (for example, make calls and send control signals, etc.) with the lobby intercom 20 via the control device 30. Furthermore, each information terminal 10 is connected to the corresponding entrance unit 40 via a connection line 64. Each information terminal 10 is configured to communicate (for example, make calls and send control signals, etc.) with the corresponding entrance unit 40.

The lobby intercom 20 is provided, for example, at the shared entrance (lobby) E1 of the apartment building 5. The lobby intercom 20 is connected to the control device 30 via a first trunk line 61. The lobby intercom 20 is configured to communicate (for example, make calls and transmit video signals, etc.) with each information terminal 10 via the control device 30. The lobby intercom 20 is attached, for example, to the wall of the shared entrance E1. The lobby intercom 20 transmits a video signal to the information terminal 10, which enables the information terminal 10 to display a video (image).

The control device 30 is provided, for example, in the management room E3 of the apartment building 5. The control device 30 is connected to the lobby intercom 20 via a first trunk line 61, and is connected to each information terminal 10 via a second trunk line 62. In other words, the control device 30 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

Each of the multiple entrance sub-units 40 is provided, for example, at the outer entrance of dwelling unit E2 of apartment building 5. Each entrance sub-unit 40 is connected to a corresponding information terminal 10 via a connection line 64. Each entrance sub-unit 40 is configured to communicate (for example, make calls, transmit video signals, etc.) with the corresponding information terminal 10.

In this embodiment, the first trunk 61, the second trunk 62, the branch 63, and the connection 64 are all twisted pair wires. In other words, in reality, the first trunk 61, the second trunk 62, the branch 63, and the connection 64 are each composed of two electric wires, but are shown as a single line in the drawings. At least one of the first trunk 61, the second trunk 62, the branch 63, and the connection 64 may be an electric wire other than a twisted pair wire.

The information terminal 10 according to this embodiment performs a voice adjustment process for at least one of receiving and speaking based on at least one of the distance and direction of the user relative to the information terminal 10. Here, the user is, for example, a resident of the dwelling unit E2. The received voice includes the user's voice received by the information terminal 10. The spoken voice includes the voice output by the information terminal 10 to the user. The sender of the voice output to the user is, for example, a visitor to the apartment building 5, but it may be anyone who calls the user of each dwelling unit E2 from the lobby intercom 20 or the entrance unit 40, or it may be a resident of each dwelling unit E2 who has returned home from outside (a user different from the user to be called), etc.

In the information terminal 10 according to this embodiment, sound adjustment processing is performed for at least one of receiving and speaking based on at least one of the distance and direction of the user relative to the information terminal 10. Therefore, the information terminal 10 can output an appropriate sound to the device with which it is communicating (lobby intercom 20, entrance unit 40) or to the user. For example, when a user answers a call from the lobby intercom 20 while in a location away from the information terminal 10, even if the sound received by the information terminal 10 from the user is low, it can be adjusted to an appropriate volume and output to the lobby intercom 20.

(2) Configuration (2-1) Information Terminal As shown in FIG. 1, the information terminal 10 includes a first communication unit 11, a second communication unit 12, a sound acquisition unit 13, an operation unit 14, an output unit 15, a display unit 16, a memory unit 17, and a control unit 18.

The information terminal 10 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 18. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may also be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

The first communication unit 11 is a communication interface for communicating with the lobby intercom 20 (its communication unit 21). The first communication unit 11 is connected to the control device 30 via the second main line 62, the branch line 63, and the splitter 50. The first communication unit 11 transmits audio signals, control signals, etc. to the lobby intercom 20 via the control device 30. Furthermore, the first communication unit 11 receives audio signals, video signals, etc. from the lobby intercom 20 via the control device 30.

The second communication unit 12 is a communication interface for communicating with the front door sub-unit 40. The second communication unit 12 is connected to the front door sub-unit 40 via a connection line 64. The second communication unit 12 transmits audio signals, control signals, etc. to the front door sub-unit 40, and receives audio signals, video signals, etc. from the front door sub-unit 40.

The sound acquisition unit 13 acquires sounds including at least the user's voice, and outputs sound information related to the acquired sounds to the control unit 18. The sound acquisition unit 13 has a plurality of microphones. Each of the plurality of microphones is a directional microphone. In this embodiment, the sound acquisition unit 13 has two microphones (a first microphone 131 and a second microphone 132) as shown in FIG. 1. The first microphone 131 and the second microphone 132 have directionality in at least one of the horizontal direction (left-right direction) and the vertical direction (up-down direction). The first microphone 131 and the second microphone 132 are arranged side by side along the left-right direction. The first microphone 131 and the second microphone 132 acquire surrounding sounds including the voice (sound) of a user located in front of the information terminal 10, convert the acquired sounds into analog sound signals (sound information), and output them to the control unit 18.

The operation unit 14 is configured to accept operations by a user (e.g., a resident of each dwelling unit E2, etc.). The operation unit 14 has at least a call button. The call button is a button for starting communication (a call with a visitor, etc.) with the lobby intercom 20 or the front door unit 40 in response to a call from the lobby intercom 20 or the front door unit 40. In other words, when the call button is pressed while the first communication unit 11 is receiving a call signal to call a resident, a voice call becomes possible between the lobby intercom 20 or the front door unit 40 and the information terminal 10.

The output unit 15 is, for example, a speaker. When the information terminal 10 is in a state where it can communicate with the lobby intercom 20, the output unit 15 outputs sound (including the voice of a visitor, etc.) based on sound data transmitted from the lobby intercom 20. When the information terminal 10 is in a state where it can communicate with the front door unit 40, the output unit 15 outputs sound (including the voice of a visitor, etc.) based on sound data transmitted from the front door unit 40.

The display unit 16 is, for example, a liquid crystal display. The display unit 16 is configured to display images. When the information terminal 10 is in a state where it can make a call (communicate) with the lobby intercom 20, the display unit 16 displays an image captured by the lobby intercom 20, which is the communication target. When the information terminal 10 is in a state where it can make a call (communicate) with the front door intercom 40, the display unit 16 displays an image captured by the front door intercom 40, which is the communication target. Note that, when the information terminal 10 is equipped with a touch panel display, the touch panel display may serve as both the display unit 16 and the operation unit 14.

The storage unit 17 is composed of a readable and writable memory. The storage unit 17 is, for example, a flash memory. The storage unit 17 stores, for example, reference information that serves as a standard for estimating the distance between the information terminal 10 and the user. The reference information includes, for example, an input level that represents the strength of a signal when a voice uttered by a user from a fixed position is input to the information terminal 10. The unit for expressing the input level is, for example, [dBspl] or [dBm].

As shown in FIG. 1, the control unit 18 has a voice processing unit 181, a voice recognition unit 182, a control processing unit 183, a display processing unit 184, and a transmission unit 185.

The audio processing unit 181 performs audio adjustment processing on the sound acquired by the sound acquisition unit 13 in accordance with predetermined conditions. Here, the predetermined conditions include at least one of the distance and direction of the user relative to the information terminal 10. In this embodiment, the predetermined conditions include both the distance and direction of the user relative to the information terminal 10. Below, a specific example of the audio adjustment processing performed by the audio processing unit 181 is described.

The audio processing unit 181 acquires the analog sound signal output by the sound acquisition unit 13. The audio processing unit 181 converts the acquired analog sound signal into a digital sound signal. The audio processing unit 181 is also configured to perform a predetermined filtering process or the like on the sound signal acquired from the sound acquisition unit 13. The audio processing unit 181 includes, for example, multiple echo cancellers (a first echo canceller, a second echo canceller). The first echo canceller suppresses or removes echo from the sound signal output from the first microphone 131. The second echo canceller suppresses or removes echo from the sound signal output from the second microphone.

When the sound acquired by the sound acquisition unit 13 includes a predetermined keyword uttered by the user, the sound processing unit 181 estimates the distance and direction of the user relative to the information terminal 10. That is, the sound processing unit 181 is triggered by the sound acquisition unit 13 acquiring a predetermined keyword as a voice uttered by the user, and executes acquisition (estimation) of information (distance, direction) as a predetermined condition.

The sound processing unit 181 estimates the direction of the person making the sound based on the sound information related to the sound acquired by the sound acquisition unit 13. Specifically, the sound processing unit 181 estimates the direction of the person making the sound based on the phase difference between the first signal and the second signal. Here, the first signal is a digital sound signal corresponding to the analog sound signal output from the first microphone 131. The second signal is a digital sound signal corresponding to the analog sound signal output from the second microphone 132.

The sound processing unit 181 controls the direction of sound acquisition by the sound acquisition unit 13 based on the estimation result for the direction. Specifically, the sound processing unit 181 performs various calculations on the sound signals input from each of the first microphone 131 and the second microphone 132 to convert them into sound signals with increased sensitivity in the desired direction. This improves the S/N ratio in the desired direction. In other words, the control unit 18 can control the direction of sound acquisition by the sound acquisition unit 13 based on the sound input from each microphone, based on the estimation result of the sound processing unit 181.

The audio processing unit 181 includes, for example, a noise suppressor. The audio processing unit 181 suppresses or removes noise from the sound signal that includes the two gain-adjusted signals.

The voice processing unit 181 estimates the distance to the user using the reference information stored in the storage unit 17. The voice processing unit 181 measures the signal level (intensity) of the sound signal (sound information) related to the sound acquired by the sound acquisition unit 13. For example, the voice processing unit 181 calculates the average value per unit time of the signal level of the sound signal related to the sound acquired by the sound acquisition unit 13 as a measurement of the signal level (intensity). If the signal level of the sound signal is equal to or higher than the input level included in the reference information, the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is close. If the signal level of the signal (digital sound signal) related to the sound acquired by the sound acquisition unit 13 is lower than the input level included in the reference information, the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is far. In short, the distance includes a result estimated based on the sound acquired by the sound acquisition unit 13. In other words, the distance includes a result estimated based on the sound acquired by the sound acquisition unit 13. In addition, the input level included in the reference information may differ for each user.

When the audio processing unit 181 estimates that the distance between the information terminal 10 and the user is short, it reduces the gain at which sound is input so that the volume of the user's voice decreases. For example, the audio processing unit 181 changes the setting so that the gain at which sound is input decreases.

When the audio processing unit 181 estimates that the distance between the information terminal 10 and the user is far, it increases the gain at which sound is input so that the volume of the user's voice increases. For example, the audio processing unit 181 changes the settings so that the gain at which sound is input increases.

The audio processing unit 181 changes the settings so that the signal level of the sound acquired by the sound acquisition unit 13 is the same as the input level included in the reference information.

The voice recognition unit 182 performs voice recognition processing on the sound processed by the voice processing unit 181. By performing voice recognition processing, the voice recognition unit 182 determines whether or not the sound processed by the voice processing unit 181 contains a predetermined keyword. If the voice recognition unit 182 determines that the sound processed by the voice processing unit 181 contains a predetermined keyword, it instructs the voice processing unit 181 to estimate the distance and direction of the user relative to the information terminal 10.

When the voice recognition unit 182 determines that the sound processed by the voice processing unit 181 contains a predetermined keyword, it controls the information terminal 10 to start communication (a call) with the intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target.

The voice recognition unit 182 determines whether the sound processed by the voice processing unit 181 contains keywords (control words) related to control in the intercom system 1.

The control processing unit 183 performs processing related to control in the intercom system 1 according to the result of the above-mentioned judgment by the voice recognition unit 182. Specifically, when the voice recognition unit 182 judges that the sound processed by the voice processing unit 181 contains a control word, the control processing unit 183 performs processing according to the control word contained in the sound processed by the voice processing unit 181.

For example, while the information terminal 10 is communicating with the lobby intercom 20, the information terminal 10 receives a voice from the user that includes the control word "open the door." In this case, the voice recognition unit 182 determines that the voice processed by the voice processing unit 181 includes the control word "open the door." The control processing unit 183 controls the unlocking of the door for entering from the shared entrance E1.

Furthermore, the control processing unit 183 controls the unlocking of the door when the operation unit 14 receives a predetermined operation from the user.

The display processing unit 184 performs processing to display on the display unit 16 an image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target. More specifically, the display processing unit 184 changes the display mode of the image displayed by the display unit 16 according to predetermined conditions.

Specifically, when the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is short, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device (lobby intercom 20, entrance unit 40) without changing the magnification. When the voice processing unit 181 estimates that the distance between the information terminal 10 and the user is long, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device at a higher magnification, for example, to enlarge and display the visitor's face.

In addition, when the voice processing unit 181 estimates that the user is present in the direction of the first microphone 131 with respect to the information terminal 10, the display processing unit 184 controls the display unit 16 so that the visitor's face is displayed in the direction in which the user is estimated to be present, that is, on the first microphone 131 side, rather than the center of the screen of the display unit 16. When the voice processing unit 181 estimates that the user is present in the direction of the second microphone 132 with respect to the information terminal 10, the display processing unit 184 may control the display unit 16 so that the visitor's face is displayed on the second microphone 132 side, rather than the center of the screen of the display unit 16.

The sending unit 185 outputs sound data (sound information) related to the sound acquired by the sound acquisition unit 13 to a device operated by the person at the other end of the call. Specifically, the sending unit 185 transmits a sound signal from which noise has been suppressed or removed by the voice processing unit 181 to the intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target via the first communication unit 11 or the second communication unit 12. For example, when the information terminal 10 is communicating with the lobby intercom 20, the sending unit 185 transmits a sound signal from which noise has been suppressed or removed by the voice processing unit 181 to the lobby intercom 20 via the first communication unit 11.

(2-2) Lobby Intercom The lobby intercom 20 includes a communication unit 21, a control unit 22, a call unit 23, a display unit 24, an operation unit 25, a memory unit 26, and an imaging unit 27, as shown in FIG.

The lobby intercom 20 has, for example, a microcomputer having a processor and memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 22. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but it may also be provided by being recorded on a non-transitory recording medium such as a memory card, or it may be provided via a telecommunications line such as the Internet.

The communication unit 21 is a communication interface for communicating with the information terminal 10 (the first communication unit 11 of the information terminal 10). The communication unit 21 is connected to the control device 30 (the communication unit 31 of the control device 30) via the first trunk line 61. The communication unit 21 transmits audio signals, video signals, etc. to the information terminal 10 via the control device 30. Furthermore, the communication unit 21 receives audio signals, control signals, etc. from the information terminal 10 via the control device 30. Here, the communication signal from the lobby intercom 20 contains information (e.g., address information, etc.) for identifying the information terminal 10. Therefore, only information terminals 10 that are assigned address information that matches the address information contained in this communication signal can receive the communication signal.

The control unit 22 is configured to control the communication unit 21, the call unit 23, and the imaging unit 27, etc.

The communication unit 23 includes a speaker and a microphone, and is configured to enable communication with the information terminal 10.

The display unit 24 is, for example, a liquid crystal display. The display unit 24 is configured to display an image captured by the imaging unit 27. The display unit 24 is also configured to display a message to a visitor, etc. The message is, for example, a message to encourage the visitor, etc. to speak. The display unit 24 displays a message such as "Please speak." In this case, a similar voice message may be output (announced) from the speaker of the call unit 23 or a speaker provided separately from the speaker of the call unit 23. The display unit 24 and the speaker may also be used together. Note that, if the information terminal 10 is equipped with a touch panel display, the touch panel display may serve as both the display unit 24 and the operation unit 25.

The operation unit 25 is configured to accept operations from a user (e.g., a visitor to the apartment complex 5, a resident, etc.). The operation unit 25 is, for example, an input interface having multiple push button switches, a touch panel, etc.

The storage unit 26 is composed of a readable and writable memory. The storage unit 26 is, for example, a flash memory. The storage unit 26 stores, for example, video data of a video (image) captured by the imaging unit 27.

The imaging unit 27 has an imaging element and is a camera for capturing an image of a subject (user). In this embodiment, the imaging area (field of view) of the imaging unit 27 is set in front of the information terminal 10. In this embodiment, the imaging unit 27 is a camera that captures moving images. Furthermore, in this embodiment, the imaging unit 27 is a camera that captures color images. Note that the imaging unit 27 may be a camera that captures still images (still camera) or a camera that captures monochrome images.

The imaging element is, for example, a two-dimensional image sensor such as a CCD (Charge Coupled Devices) image sensor or a CMOS (Complementary Metal-Oxide Semiconductor) image sensor. The imaging unit 27 forms an image of light from the subject on the imaging surface (light-receiving surface) of the imaging element using an optical system such as a lens, and converts the light from the subject into an electrical signal in the imaging element. The imaging unit 27 then outputs the output signal of the imaging element to the control unit 22 as a video signal.

(2-3) Control Device As shown in FIG. 2, the control device 30 includes a communication unit 31, a control unit 32, and a storage unit 33.

The control device 30 has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 32. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may also be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

The communication unit 31 includes a communication interface for communicating with each information terminal 10 and the lobby intercom 20. The communication unit 31 is connected to the lobby intercom 20 via a first trunk line 61, and is connected to each information terminal 10 via a second trunk line 62. In other words, the communication unit 31 is configured to relay communication between each information terminal 10 and the lobby intercom 20.

The control unit 32 is configured to control the communication unit 31.

The storage unit 33 is composed of a readable and writable memory. The storage unit 33 is, for example, a flash memory. The storage unit 33 stores, for example, a correspondence table showing the correspondence between the room number assigned to each dwelling unit E2 and the address information assigned to each information terminal 10. That is, in the control device 30, the control unit 32 refers to the correspondence table to create a signal in which the room number included in the signal from the lobby intercom 20 is replaced with the address information of the corresponding information terminal 10, and causes the communication unit 31 to transmit this signal to each information terminal 10. Then, in each information terminal 10, the control unit 18 acquires the information included in the signal when the address information included in the signal received by the first communication unit 11 matches the address information stored in the storage unit 17. Also, in each information terminal 10, the control unit 18 discards the information included in the signal when the address information included in the signal received by the first communication unit 11 does not match the address information stored in the storage unit 17.

2, each of the front door slave units 40 is connected to a corresponding information terminal 10 via a connection line 64. The front door slave unit 40 transmits audio signals, video signals, etc. to the information terminal 10. Furthermore, the front door slave unit 40 receives audio signals, control signals, etc. from the information terminal 10.

(3) Operation Here, the operation of the information terminal 10 will be described with reference to FIG.

The voice recognition unit 182 uses the sound information related to the sound acquired by the sound acquisition unit 13 to determine whether the sound acquired by the sound acquisition unit 13 contains a predetermined keyword uttered by the user (step S1).

If the voice recognition unit 182 determines that the sound acquired by the sound acquisition unit 13 does not contain a predetermined keyword ("No" in step S1), the process repeats this determination.

When the voice recognition unit 182 determines that the sound acquired by the sound acquisition unit 13 includes a predetermined keyword ("Yes" in step S1), the voice processing unit 181 estimates the direction of the user relative to the information terminal 10 (step S2). Specifically, the voice processing unit 181 estimates the direction of the person making the sound based on the phase difference between the first signal and the second signal.

The audio processing unit 181 measures the signal level (intensity) of the sound signal (sound information) related to the sound acquired by the sound acquisition unit 13 (step S3). The audio processing unit 181 determines whether the signal level of the sound signal is equal to or higher than the input level included in the reference information (step S4).

When it is determined that the signal level of the sound signal is equal to or higher than the input level included in the reference information ("Yes" in step S4), the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is close, and performs the first sound processing (step S5). Specifically, when the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is close, it reduces the gain at which the sound is input so that the volume of the user's voice is reduced. At this time, the sending unit 185 transmits the sound signal, which has been adjusted to reduce the volume, to the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target.

Furthermore, the display processing unit 184 performs a first display process (step S6). Specifically, when the voice processing unit 181 estimates that the information terminal 10 is close to the user, the display processing unit 184 controls the display unit 16 to display the image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) without changing the magnification. At this time, the display unit 16 displays an image G10 captured of a visitor U1 who has made a call operation on the lobby intercom 20 without changing the magnification of the image G10 (see FIG. 4A).

When it is determined that the signal level of the sound signal is not equal to or greater than the input level included in the reference information, i.e., that the signal level is less than the input level ("No" in step S4), the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is far, and performs the second sound processing (step S7). Specifically, when the sound processing unit 181 estimates that the distance between the information terminal 10 and the user is far, it increases the gain at which sound is input so that the volume of the user's voice increases. At this time, the sending unit 185 transmits the sound signal, which has been adjusted to increase the volume, to the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target.

Furthermore, the display processing unit 184 performs a second display process (step S8). Specifically, when the audio processing unit 181 estimates that the distance between the information terminal 10 and the user is far, the display processing unit 184 controls the display unit 16 to increase the magnification of the image captured by the intercom entrance device, for example, to enlarge and display the visitor's face. At this time, the display unit 16 enlarges and displays the face of visitor U1 contained in image G10 captured of visitor U1 who made a call operation on the lobby intercom 20 (see FIG. 4B).

The voice recognition unit 182 performs voice recognition processing on the sound processed by the voice processing unit 181 (step S9). Specifically, the voice recognition unit 182 determines whether or not the sound processed by the voice processing unit 181 includes a keyword (control word) related to control in the intercom system 1.

The control processing unit 183 judges whether or not control is necessary in the intercom system 1 (step S10). Specifically, the control processing unit 183 judges whether or not control is necessary based on the judgment result of the voice recognition unit 182. The control processing unit 183 judges that control is necessary when it judges that the sound processed by the voice processing unit 181 contains a control word. The control processing unit 183 judges that control is not necessary when it judges that the sound processed by the voice processing unit 181 does not contain a control word.

If it is determined that control is necessary ("Yes" in step S10), the control processing unit 183 performs processing according to the control word contained in the sound processed by the audio processing unit 181.

If it is determined that control is not necessary ("No" in step S10), the control processing unit 183 does not execute step S11.

After the predetermined keyword is detected, if communication is in progress between the information terminal 10 and the intercom entrance device that is the communication target, the information terminal 10 executes the processes from step S5 to step S11.

(4) Advantages As described above, the information terminal 10 of the present embodiment is an information terminal that operates as an intercom device. The information terminal 10 performs a sound adjustment process for receiving a call, which is a sound (voice) acquired by the sound acquisition unit 13, based on at least one of the distance and the direction of the user relative to the information terminal 10.

More specifically, the information terminal 10 includes a sound acquisition unit 13, a voice processing unit 181, and a control processing unit 183. The sound acquisition unit 13 acquires sound including the user's voice. The voice processing unit 181 performs a voice adjustment process on the sound acquired by the sound acquisition unit 13, using at least one of the distance and the direction as a predetermined condition.

With this configuration, audio adjustment processing is performed using at least one of the distance and direction of the user relative to the information terminal 10, so the volume of the audio output from the intercom entrance device (lobby intercom 20, entrance unit 40) with which communication is to be made can be made appropriate. For example, even if the user is far away from the information terminal 10, the audio can be adjusted to make the visitor feel as if the audio is coming from nearby. Therefore, the information terminal 10 can make clear calls according to the user's position.

The information terminal 10 further includes a display unit 16 and a display processing unit 184. The display unit 16 displays an image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) with which communication is to be performed. The display processing unit 184 causes the display unit 16 to display the image. The display processing unit 184 changes the display mode of the image displayed by the display unit 16 according to a predetermined condition.

For example, if the user is far away from the information terminal 10, the displayed image is enlarged. This allows the user to easily confirm who the visitor is, regardless of the user's location.

(5) Modifications The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved.

Below, we will list some variations of the above embodiment. The variations described below can be applied in appropriate combinations.

(5-1) Modification 1
In the above embodiment, the information terminal 10 is configured to estimate the distance and direction of the user relative to the information terminal 10 based on the acquired sound, but the present invention is not limited to this configuration.

The distance and direction of the user relative to the information terminal 10 may be estimated based on information other than the sound information related to the acquired sound. For example, the information terminal 10 may estimate the distance and direction of the user relative to the information terminal 10 based on the detection results of the human detection unit 19 (see FIG. 5) that detects the presence or absence of a person (user) in the dwelling unit E2.

The following will focus on the differences from the embodiment. Note that the same components as those in the embodiment will be given the same reference numerals as in the embodiment, and their explanation will be omitted as appropriate.

As shown in FIG. 5, the information terminal 10A of this modified example includes a first communication unit 11, a second communication unit 12, a sound acquisition unit 13, an operation unit 14, an output unit 15, a display unit 16, a memory unit 17, a control unit 18A, and a human detection unit 19.

The information terminal 10A has, for example, a microcomputer having a processor and a memory. The processor executes a program stored in the memory, causing the microcomputer to function as the control unit 18A. The program executed by the processor is pre-recorded in the memory of the microcomputer here, but may also be provided by being recorded on a non-transitory recording medium such as a memory card, or may be provided via a telecommunications line such as the Internet.

The human detection unit 19 is, for example, a human sensor. The human detection unit 19 outputs microwaves such as infrared rays and receives the reflected waves reflected by an object.

As shown in FIG. 5, the control unit 18A has a voice processing unit 181A, a voice recognition unit 182, a control processing unit 183, a display processing unit 184, a transmission unit 185, and a detection processing unit 186.

When the voice recognition unit 182 determines that the sound (voice) acquired by the sound acquisition unit contains a predetermined keyword, the detection processing unit 186 estimates the distance and direction of the user relative to the information terminal 10 based on the detection result of the human detection unit 19. Specifically, the detection processing unit 186 estimates the direction in which the microwaves are output as the direction of the user relative to the information terminal 10. The detection processing unit 186 calculates (estimates) the distance to the object (user) from which the microwaves are reflected based on the phase difference between the phase of the output microwaves and the phase of the received reflected wave. If the calculated distance is equal to or less than a predetermined reference value, the detection processing unit 186 determines that the user is close to the information terminal 10. If the calculated distance is greater than a predetermined reference value, the detection processing unit 186 determines that the user is far from the information terminal 10. In short, the distance includes a result estimated based on the result detected by the human detection unit 19 that detects people. In other words, the distance includes a result estimated based on the result detected by the human detection unit 19, which detects people.

The audio processing unit 181A performs audio adjustment processing on the sound acquired by the sound acquisition unit 13 according to predetermined conditions (the distance and direction of the user relative to the information terminal 10).

The audio processing unit 181A acquires the analog sound signal output by the sound acquisition unit 13 and converts it into a digital sound signal. The audio processing unit 181A performs a predetermined filtering process or the like on the sound signal acquired from the sound acquisition unit 13 to suppress or remove echoes from the sound signal.

The sound processing unit 181A controls the direction of sound acquisition by the sound acquisition unit 13 based on the estimation result of the direction detection processing unit 186. Specifically, the sound processing unit 181A adjusts the sound input from the first microphone 131 and the sound input from the second microphone 132 based on the estimation result.

The audio processing unit 181A includes, for example, a noise suppressor. The audio processing unit 181 suppresses or removes noise from a sound signal that includes two gain-adjusted signals.

The audio processing unit 181 adjusts the volume of the sound output to the intercom entrance device (lobby intercom 20, entrance unit 40) with which it is communicating, based on the estimation result (determination result) of the detection processing unit 186 for the distance. For example, if the detection processing unit 186 determines that the distance between the information terminal 10 and the user is short, it reduces the gain at which the sound is input so that the volume of the user's voice becomes lower. If the detection processing unit 186 determines that the distance between the information terminal 10 and the user is long, it reduces the gain at which the sound is input so that the volume of the user's voice becomes higher.

As a result, the information terminal 10A of this modified example can conduct clear calls according to the user's position, even when using the detection results of the human detection unit 19.

In this modified example, the information terminal 10A is configured to include a human detection unit 19, but is not limited to this. The human detection unit 19 is not a required component of the information terminal 10A.

The human detection unit 19 is configured as a human sensor, but is not limited to this. The human detection unit 19 may be a Local Positioning System (LPS) that detects the position of a person in the dwelling unit E2. In other words, the human detection unit 19 may be configured to detect (estimate) the distance and direction of a person (user) in the dwelling unit E2 relative to the information terminal 10.

(5-2) Modification 2
In the above embodiment, the predetermined condition includes both the distance and the direction of the user with respect to the information terminal 10, but is not limited to this.

The predetermined condition may be configured to include either the distance or the direction of the user relative to the information terminal 10. In other words, the predetermined condition may be configured to include at least one of the distance or the direction of the user relative to the information terminal 10. In other words, the audio processing unit 181 may be configured to perform audio adjustment processing based on at least one of the distance or the direction of the user relative to the information terminal 10.

(5-3) Modification 3
In the above embodiment, the voice processing unit 181 is configured to adjust the voice of the sound (user's voice) acquired by the sound acquisition unit 13, i.e., the received call, based on the distance and direction of the user relative to the information terminal 10, but this configuration is not limited to this.

When outputting audio (visitor audio) based on an audio signal received from the intercom entrance device (lobby intercom 20, entrance unit 40), the audio processing unit 181 may adjust the audio based on at least one of the distance and direction of the user relative to the information terminal 10.

For example, the audio processing unit 181 determines whether the user is far from the information terminal based on the signal level (intensity) of the sound signal (sound information) related to the sound acquired by the sound acquisition unit 13. If the audio processing unit 181 determines that the user is far from the information terminal 10, it adjusts the audio to increase the volume of the visitor's voice. If the audio processing unit 181 determines that the user is close to the information terminal 10, it adjusts the audio to maintain or lower the volume of the visitor's voice. This allows the volume heard by the user to be an appropriate volume.

In short, the audio processing unit 181 may be configured to perform audio adjustment processing for at least one of receiving and speaking based on at least one of the distance and direction of the user relative to the information terminal. For example, by performing audio adjustment processing for speaking, the volume of the sound output from the output unit 15 of the information terminal 10 can be adjusted to a volume that is easy for the user to hear depending on the user's position. Also, by performing audio adjustment processing for both receiving and speaking, the volume of the sound output from the intercom entrance device (lobby intercom 20, entrance unit 40) can be adjusted to an appropriate volume, and the volume of the sound output from the output unit 15 of the information terminal 10 can be adjusted to a volume that is easy for the user to hear depending on the user's position.

(5-4) Modification 4
In the above embodiment, the information terminal 10 is configured to adjust the sound (adjust the volume) based on the distance and direction of the user from the information terminal 10, but the present invention is not limited to this configuration.

The intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target with the information terminal 10 may adjust the volume. In this case, the information terminal 10 transmits the estimation results of the user's distance and direction from the information terminal 10 to the intercom entrance device. The intercom entrance device adjusts the volume of the user's voice output from the intercom entrance device based on the estimation results.

(5-5) Modification 5
In the above embodiment, the voice processing unit 181 is configured to acquire (estimate) information (distance, direction) as a predetermined condition when the sound acquisition unit 13 acquires a predetermined keyword as a voice uttered by the user as a trigger. However, the present invention is not limited to this configuration.

It is not essential for the sound acquisition unit 13 to acquire a specified keyword as a condition for starting to acquire (estimate) information (distance, direction) as a specified condition. When the first communication unit 11 or the second communication unit 12 receives a control signal related to a call from the intercom entrance device (lobby intercom 20, entrance handset 40), the sound processing unit 181 may acquire (estimate) information (distance, direction) as a specified condition.

(5-6) Modification 6
In the above embodiment, the voice processing unit 181 may repeatedly estimate the distance and direction of the user relative to the information terminal 10 until communication between the information terminal and the intercom entrance device (lobby intercom 20, entrance unit 40) is terminated.

(5-7) Modification 7
In the above embodiment, the sound acquisition unit 13 is configured to have two microphones (the first microphone 131 and the second microphone 132), but is not limited to this configuration.

The sound acquisition unit 13 may be configured to have one microphone or three or more microphones. A configuration in which the sound acquisition unit 13 has one microphone is effective when estimating the distance of the user from the information terminal 10 as a predetermined condition. Furthermore, when the sound acquisition unit 13 has three or more microphones, the distance and direction of the user from the information terminal 10 can be estimated with greater accuracy.

(5-8) Modification 8
In the above embodiment, the voice recognition unit 182 is not an essential component of the information terminal 10. The voice recognition unit 182 may be provided in a terminal (e.g., a server) different from the information terminal 10. In this case, the information terminal 10 transmits sound information related to the sound acquired by the sound acquisition unit 13 to the server. The server detects a predetermined keyword and a control word by a voice recognition process. Specifically, the server determines whether the sound acquired by the sound acquisition unit 13 includes a predetermined keyword and whether the sound acquired by the sound acquisition unit 13 includes a control word based on the sound information.

Alternatively, the voice recognition unit 182 may detect the specified keywords, and the server may detect the control words.

(5-9) Modification 9
In the above embodiment, the information terminal 10 is configured as a dwelling terminal (intercom master unit), but is not limited to this configuration.

The information terminal 10 may be any terminal that is configured to be able to communicate with the intercom entrance device (lobby intercom 20, entrance handset 40), and may be, for example, a tablet terminal or a smartphone.

(5-10) Modification 10
The functions relating to the sound adjustment process provided in the information terminal 10 of the above embodiment (sound acquisition unit 13, sound processing unit 181) may be applied to an intercom entrance device (lobby intercom 20, entrance unit 40).

Similarly, the functions related to the audio adjustment processing provided in the information terminal 10A of the first modification (sound acquisition unit 13, human detection unit 19, audio processing unit 181A, detection processing unit 186) may be applied to the intercom entrance device (lobby intercom 20, entrance unit 40).

(5-11) Modification 11
The voice processing unit 181 provided in the information terminal 10 in the above embodiment may be configured to perform processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance sub-unit 40) that is the communication target from being processed in the voice recognition processing.

For example, when the sound output by the output unit 15 (speaker) is input to the sound acquisition unit 13, the sound processing unit 181 provided in the information terminal 10 may suppress or remove echoes from the sound using an echo canceller. That is, when the sound output by the output unit 15 is input to the sound acquisition unit 13, the sound processing unit 181 may attenuate the sound using an echo canceller. Since the sound processing unit 181 performs an attenuation process (attenuation process) on the sound output by the output unit 15, the voice recognition process performed by the voice recognition unit 182 on the sound is suppressed. That is, by the sound processing unit 181 performing an attenuation process on the sound output by the output unit 15, the sound can be excluded from being processed in the voice recognition process.

Alternatively, the voice processing unit 181 may determine whether or not voice is being output from the output unit 15, and if it determines that voice is being output from the output unit 15, control the voice recognition unit 182 to inhibit voice recognition processing by the voice recognition unit 182. By performing processing to control the voice recognition unit 182 to inhibit voice recognition processing by the voice recognition unit 182, the voice processing unit 181 can exclude the voice output by the output unit 15 from being processed in the voice recognition processing.

For example, when the information terminal 10 is communicating with the lobby intercom 20, the voice transmitted from the lobby intercom 20 may be input to at least one of the first microphone 131 and the second microphone 132, and a voice recognition process may be performed. In this case, if the voice transmitted from the lobby intercom 20 contains a control word for unlocking the door for entering from the common entrance E1, the control processing unit 183 controls the unlocking of the door for entering from the common entrance E1 based on the result of the voice recognition process. In other words, the door to the common entrance E1 may be unlocked by a third party (e.g., a visitor) regardless of the intention of the user of the dwelling unit E2.

The information terminal 10 of the 11th modification thus includes a sound acquisition unit 13, a voice processing unit 181, and a control processing unit 183. The sound acquisition unit 13 acquires sound including the user's voice. The voice processing unit 181 performs voice adjustment processing on the sound acquired by the sound acquisition unit 13. The control processing unit 183 performs control based on the results of voice recognition processing on the sound processed by the voice processing unit 181. The voice processing unit 181 is configured to perform processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target from being processed in the voice recognition processing.

With this configuration, the voice processing unit 181 performs processing to exclude voice received from the intercom entrance device, which is the communication target, from being processed in the voice recognition process, thereby reducing the possibility that the door will be opened by a third party.

In addition, in the 11th modified example, it is not essential that the sound acquisition unit 13 has multiple microphones (first microphone 131, second microphone 132). The sound acquisition unit 13 may have a configuration having one microphone. If the sound acquisition unit 13 has one microphone, it is not essential that the audio processing unit 181 estimates the distance and direction of the user. The audio processing unit 181 may be configured to at least suppress or remove echoes from the sound signal acquired by the sound acquisition unit 13 (one microphone) as an audio adjustment process.

The processing method of the information terminal 10 according to the modified example 11 is a processing method used in an information terminal that operates as an intercom device. The processing method includes a sound acquisition step, a voice processing step, and a control processing step. The sound acquisition step acquires sound including the user's voice. The voice processing step performs a voice adjustment process on the sound acquired in the sound acquisition step. The control processing step performs control based on the result of the voice recognition process on the sound processed in the voice processing step. The voice processing step performs a process to exclude the voice received from the intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target from the processing target in the voice recognition process. The program according to one aspect is a program for causing a computer system to function as the information terminal 10 according to the modified example 11 or the processing method of the information terminal 10 according to the modified example 11.

Also, variant 11 may be applied to the information terminal 10A of variant 1. In this case, the voice processing unit 181A of the information terminal 10A is configured to perform processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target from being processed in the voice recognition process.

(Other Modifications)
The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. In addition, the same function as the information terminal 10 may be embodied in a processing method, a computer program, or a non-transitory recording medium on which a program is recorded. The processing method of the information terminal 10 according to one aspect is a processing method used in an information terminal that operates as an intercom device. The processing method includes processing steps. The processing steps perform a voice adjustment process for at least one of receiving and speaking based on at least one of the distance and direction of the user relative to the information terminal 10. Here, the processing steps correspond to steps S5 and S7 shown in FIG. 3. The program according to one aspect is a program for causing a computer system to function as the above-mentioned information terminal 10 or the processing method of the information terminal 10.

The information terminal 10 or the processing method of the information terminal 10 in the present disclosure includes a computer system. The computer system has a processor and a memory as hardware. The processor executes a program recorded in the memory of the computer system, thereby realizing the function of the information terminal 10 or the processing method of the information terminal 10 in the present disclosure. The program may be pre-recorded in the memory of the computer system, or may be provided through an electric communication line. The program may also be recorded and provided in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuits such as IC or LSI here are called by different names depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the LSI is manufactured, or a logic device that allows reconfiguration of the connection relationships within the LSI or reconfiguration of the circuit partitions within the LSI, can also be used as a processor. The multiple electronic circuits may be integrated into one chip, or may be distributed across multiple chips. The multiple chips may be integrated into one device, or may be distributed across multiple devices.

In addition, it is not essential for the information terminal 10 that multiple functions are concentrated in one housing, and the components of the information terminal 10 may be distributed across multiple housings. Furthermore, at least some of the functions of the information terminal 10, for example, some of the functions of the information terminal 10, may be realized by the cloud (cloud computing) or the like.

(summary)
As described above, the information terminal (10, 10A) of the first aspect is an information terminal that operates as an intercom device. The information terminal (10, 10A) performs a sound adjustment process for at least one of receiving and speaking, based on at least one of the distance and the direction of the user relative to the information terminal (10, 10A).

This configuration allows clear calls to be made depending on the user's location.

The information terminal (10, 10A) of the second aspect is the first aspect and includes a sound acquisition unit (13), a voice processing unit (181, 181A), and a control processing unit (183). The sound acquisition unit (13) acquires sound including the user's voice. The voice processing unit (181) performs a voice adjustment process on the sound acquired by the sound acquisition unit (13) using at least one of the distance and the direction as a predetermined condition. The control processing unit (183) performs control based on the result of a voice recognition process on the sound processed by the voice processing unit (181).

This configuration allows clear calls to be made according to the user's location, and allows control to be performed according to the voice uttered by the user.

In the information terminal (10, 10A) of the third aspect, in the second aspect, the predetermined condition includes the distance of the user from the information terminal (10). The audio processing unit (181, 181A) changes the volume of the user's voice acquired by the sound acquisition unit (13) depending on the distance.

This configuration allows an appropriate volume to be set according to the user's distance from the information terminal (10, 10A).

In the information terminal (10, 10A) of the fourth aspect, in the second or third aspect, the distance includes a result estimated based on the sound acquired by the sound acquisition unit (13).

With this configuration, clear conversations can be made based on the results estimated from the sounds acquired by the sound acquisition unit (13).

In the information terminal (10, 10A) of the fifth aspect, in the second or third aspect, the distance includes a result estimated based on the result detected by a human detection unit (19) that detects a person.

With this configuration, clear conversations can be made based on the results estimated from the results detected by the human detection unit (19).

In the sixth aspect of the information terminal (10, 10A), in any of the second to fifth aspects, the voice processing unit (181) executes the acquisition of information as a predetermined condition, triggered by the sound acquisition unit (13) acquiring a predetermined keyword as a voice uttered by the user.

With this configuration, it is possible to set the timing for acquiring information as a specified condition.

The information terminal (10, 10A) of the seventh aspect is any one of the second to sixth aspects, and further includes a voice recognition unit (182). The voice recognition unit (182) performs voice recognition processing on the sound processed by the voice processing unit (181).

This configuration allows speech recognition to be performed on the voice uttered by the user. Specifically, the speech recognition unit (182) of the information terminal (10, 10A) performs speech recognition on the sound processed by the speech processing unit (181), allowing for more appropriate speech recognition.

The information terminal (10, 10A) of the eighth aspect further includes a display unit (16) and a display processing unit (184) in any of the second to seventh aspects. The display unit (16) displays an image captured by the intercom entrance device (lobby intercom 20, entrance slave unit 40) that is the communication target. The display processing unit (184) causes the display unit (16) to display the image. The display processing unit (184) changes the display mode of the image displayed by the display unit (16) according to a predetermined condition.

With this configuration, the user can easily check who the visitor is, regardless of the user's location.

In the ninth aspect of the information terminal (10, 10A), in any of the second to eighth aspects, the voice processing unit (181, 181A) performs processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance handset 40) that is the communication target from being processed in the voice recognition process.

This configuration reduces the possibility of the door being unlocked by a third party.

The intercom system (1) of the tenth aspect includes an information terminal (10, 10A) of any one of the first to ninth aspects, and an intercom entrance device (lobby intercom 20, entrance handset 40) that communicates with the information terminal (10, 10A).

This configuration allows clear calls to be made depending on the user's location.

The processing method of the eleventh aspect is a processing method used in an information terminal (10, 10A) that operates as an intercom device. The processing method includes a processing step. The processing step performs a sound adjustment process for at least one of receiving and speaking based on at least one of the distance and direction of the user relative to the information terminal (10, 10A).

This processing method allows for clear calls depending on the user's location.

The program of the twelfth aspect is a program for causing a computer to execute the processing method of the eleventh aspect.

This program allows users to make clear calls based on their location.

The information terminal (10, 10A) of the thirteenth aspect includes a sound acquisition unit (13), a voice processing unit (181, 181A), and a control processing unit (183). The sound acquisition unit (13) acquires sound including the user's voice. The voice processing unit (181) performs a voice adjustment process on the sound acquired by the sound acquisition unit (13). The control processing unit (183) performs control based on the result of a voice recognition process on the sound processed by the voice processing unit (181). The voice processing unit (181) is configured to perform a process that excludes the voice received from the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target from the processing target of the voice recognition process.

With this configuration, the voice processing unit (181, 181A) performs processing to exclude voice received from the intercom entrance device, which is the communication target, from being processed in the voice recognition process, thereby reducing the possibility that the door will be opened by a third party.

The intercom system (1) of the 14th aspect includes the information terminal (10, 10A) of the 13th aspect and an intercom entrance device (lobby intercom 20, entrance handset 40) that communicates with the information terminal (10, 10A).

This configuration reduces the possibility of the door being unlocked by a third party.

The processing method of the fifteenth aspect is a processing method used in an information terminal that operates as an intercom device. The processing method includes a sound acquisition step, a voice processing step, and a control processing step. The sound acquisition step acquires sound including the user's voice. The voice processing step performs a voice adjustment process on the sound acquired in the sound acquisition step. The control processing step performs control based on the results of voice recognition processing on the sound processed in the voice processing step. The voice processing step performs processing to exclude voice received from the intercom entrance device (lobby intercom 20, entrance unit 40) that is the communication target from being processed in the voice recognition processing.

This method of processing reduces the chances of the door being unlocked by a third party.

The program of the sixteenth aspect is a program for causing a computer to execute the processing method of the fifteenth aspect.

This method of processing reduces the chances of the door being unlocked by a third party.

1 Intercom system 10, 10A Information terminal 13 Sound acquisition unit 16 Display unit 19 Human detection unit 20 Lobby intercom (intercom entrance device)
40 Entrance intercom unit (entrance intercom device)
181, 181A Voice processing unit 182 Voice recognition unit 183 Control processing unit 184 Display processing unit

Claims (8)

An information terminal that operates as an intercom device,
A sound acquisition unit that acquires a sound including a user's voice;
a sound processing unit that performs sound adjustment processing on the sound acquired by the sound acquisition unit, using at least one of a distance and a direction of the user relative to the information terminal as a predetermined condition to be estimated;
a voice recognition unit that performs voice recognition processing on the sound processed by the voice processing unit;
a control processing unit that performs control based on a result of the voice recognition processing for the sound processed by the voice processing unit,
The audio processing unit includes:
When a predetermined keyword is included in the voice uttered by the user , the estimation target is estimated;
According to the estimation result, the voice adjustment process is performed for at least one of the speech reception and the speech generation.
the voice recognition unit sets a call start state when the voice uttered by the user includes the predetermined keyword, and after setting the call start state, determines whether or not a control word different from the predetermined keyword is included in the sound processed by the voice processing unit;
when the voice recognition unit determines that the sound processed by the voice processing unit includes the control word, the control processing unit performs control according to the control word;
The control word includes a word corresponding to the control of unlocking a door.
Information terminal. the predetermined condition includes the distance of the user to the information terminal,
The voice processing unit changes a volume of the voice of the user acquired by the sound acquisition unit according to the distance.
2. An information terminal according to claim 1. The distance includes a result estimated based on the sound acquired by the sound acquisition unit.
3. An information terminal according to claim 1 or 2. The distance includes a result estimated based on a result detected by a human detection unit that detects a person.
3. An information terminal according to claim 1 or 2. the voice processing unit executes estimation of information as the predetermined condition, triggered by the sound acquisition unit acquiring the predetermined keyword;
An information terminal according to any one of claims 1 to 4. a display unit that displays an image captured by the intercom entrance device that is the communication target;
A display processing unit for displaying the image on the display unit,
the display processing unit changes a display mode of the image displayed by the display unit in accordance with the predetermined condition.
An information terminal according to any one of claims 1 to 5. The voice processing unit performs a process of excluding a voice received from an intercom entrance device that is a communication target from a processing target of the voice recognition process.
An information terminal according to any one of claims 1 to 6. An information terminal according to any one of claims 1 to 7;
and an intercom entrance device that communicates with the information terminal.
Intercom system.

Images