JP7678454B2 - Judgment system, judgment method, and program - Google Patents

Description

The present disclosure generally relates to a judgment system, a judgment method, and a program, and more specifically, the present disclosure relates to a judgment system, a judgment method, and a program for acquiring images.

Patent document 1 describes an intercom system that includes a common entrance slave unit, a residential master unit, and a facial recognition server. The facial recognition server described in patent document 1 performs facial recognition by comparing an image captured by a camera in the common entrance slave unit with a facial image registered in the facial recognition server.

JP 2019-140617 A

The facial images registered in the facial recognition server are images that have been registered in advance by, for example, an administrator. Therefore, when a resident wants to register a new facial image in the facial recognition server, for example when there is a change in the family structure of a resident of an apartment complex, the resident must ask the administrator to register the facial image. Furthermore, allowing residents to register facial images could potentially reduce security.

The present disclosure has been made in consideration of the above-mentioned reasons, and aims to provide a judgment system, judgment method, and program that improves convenience when registering an authentication image while suppressing a decrease in security.

A judgment system according to an aspect of the present disclosure includes an acquisition unit, a registration judgment unit, a registration unit, and an image quality judgment unit . The acquisition unit acquires an image to be used as an authentication image of an intercom system. The registration judgment unit judges whether or not to register the image acquired by the acquisition unit as the authentication image. The registration unit registers the image judged by the registration judgment unit to be registered as the authentication image as the authentication image. The image quality judgment unit judges whether or not the image satisfies a predetermined image quality standard for the authentication image. When the image quality judgment unit judges that the image satisfies the predetermined image quality standard and the image is acquired by the acquisition unit via a trunk line of the intercom system, the registration judgment unit judges that the image is to be registered as the authentication image. The registration judgment unit judges whether or not to register the image as the authentication image by judging whether or not the image judged by the image quality judgment unit to satisfy the predetermined image quality standard has passed through the trunk line.

A judgment method according to one aspect of the present disclosure includes an acquisition step, a registration judgment step, a registration step, and an image quality judgment step . In the acquisition step, an image to be used as an authentication image of an intercom system is acquired. In the registration judgment step, it is judged whether or not the image acquired in the acquisition step is to be registered as the authentication image. In the registration step, the image judged to be registered as the authentication image in the registration judgment step is registered as the authentication image. In the image quality judgment step, it is judged whether or not the image satisfies a predetermined image quality standard for the authentication image. In the registration judgment step, when it is judged in the image quality judgment step that the image satisfies the predetermined image quality standard and the image is acquired in the acquisition step via a trunk line of the intercom system, the image is registered as the authentication image. In the registration judgment step, it is judged whether or not the image judged to satisfy the predetermined image quality standard in the image quality judgment step has passed through the trunk line, thereby judging whether or not the image is to be registered as the authentication image.

A program according to one aspect of the present disclosure is a program for causing one or more processors to execute the determination method.

The judgment system, judgment method, and program according to the above aspects of the present disclosure can improve the convenience of registering an authentication image while suppressing a decrease in security.

FIG. 1 is a schematic diagram showing the overall configuration of a determination system according to an embodiment. FIG. 2 is a sequence diagram showing the operation of the determination system. FIG. 3 is a flowchart showing the operation of the determination device. FIG. 4 is a flowchart showing the operation of the determination device according to the modified example. FIG. 5 is a schematic diagram showing the overall configuration of a determination system according to a first modified example. FIG. 6 is a block diagram showing a main part of the above-mentioned determination system. FIG. 7 is a schematic diagram showing the selection screen of the above embodiment. FIG. 8 is a block diagram showing a main part of a determination system according to the second modified example. FIG. 9 is a block diagram showing a main part of a determination system according to the third modified example.

Below, preferred embodiments of the present disclosure will be described in detail with reference to the drawings. In the embodiments described below, common elements are given the same reference numerals, and duplicated descriptions of the common elements will be omitted. The following embodiment is merely one of various embodiments of the present disclosure. Various modifications of the embodiment can be made depending on the design, etc., as long as the object of the present disclosure can be achieved. Each figure described in this disclosure is a schematic diagram, and the respective ratios of size and thickness of each component in each figure do not necessarily reflect the actual dimensional ratios.

(1) Overview First, an overview of a determination system 1 according to this embodiment will be described with reference to FIG.

As shown in FIG. 1, the judgment system 1 is a system that cooperates with an intercom system 2 that is installed in a facility 20 such as an apartment building. The judgment system 1 includes an acquisition unit 31, a registration judgment unit 32, and a registration unit 34.

The acquisition unit 31 acquires an image to be used as an authentication image for the intercom system 2. In this disclosure, "image" means image data and may include still images and moving images. In this embodiment, it is assumed that the image acquired by the acquisition unit 31 is a still image. The acquisition unit 31 in this embodiment is configured to be able to acquire images from the intercom master unit 26 installed in each dwelling unit 22 of the facility 20 via the main line L1 of the intercom system 2.

The registration determination unit 32 performs a registration determination to determine whether or not to register the image acquired by the acquisition unit 31 as an authentication image. More specifically, when the image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the image acquired by the acquisition unit 31 is to be registered as an authentication image.

The registration unit 34 registers the image that is determined by the registration determination unit 32 to be registered as an authentication image in the database 5 as an authentication image. In the present disclosure, "registering an image as an authentication image" may include registering the image itself, registering an image after image processing, and registering features of a person (face) included in the image. "Image processing" may include a process of deleting the background from an image that includes a person and a background, a process of changing the size of a person included in the image, a process of changing the brightness of the image, and a process of extracting the face of a person included in the image. In this embodiment, the registration unit 34 registers the image itself acquired by the acquisition unit 31 in the database 5 as an authentication image. In this embodiment, a person appearing in the authentication image registered in the database 5 is treated as a person permitted to enter the facility 20 (inside the door 23 described later).

According to the judgment system 1 of this embodiment, when a resident of the facility 20 experiences a change in family composition, for example, the resident can register a new image as an authentication image by transmitting the new image to the acquisition unit 31 via the main line L1 of the intercom system 2. Therefore, the resident of the facility 20 does not need to request the manager of the facility 20 to register the new image as an authentication image. In other words, the judgment system 1 of this embodiment has the advantage of improving the convenience of the intercom system 2.

The registration judgment unit 32 of the judgment system 1 judges that the image acquired by the acquisition unit 31 via the main line L1 of the intercom system 2 should be registered as an authentication image. The image acquired by the acquisition unit 31 via the main line L1 of the intercom system 2 of the facility 20 is registered in the database as an authentication image, which has the advantage of preventing a decrease in security.

(2) Details Hereinafter, the details of the determination system 1 according to this embodiment will be described with reference to FIGS.

(2.1) Configuration of the Intercom System First, the configuration of the intercom system 2 will be described with reference to FIG.

As described above, the intercom system 2 is installed in the facility 20. Here, the "facility" in this disclosure includes residential facilities used for residential purposes, as well as non-residential facilities such as stores (tenants), offices, welfare facilities, educational facilities, hospitals, and factories. Non-residential facilities also include restaurants, amusement parks, hotels, inns, kindergartens, nurseries, and community centers. In other words, the facility 20 may be a residential facility such as an apartment building, or a non-residential facility such as an office building. Furthermore, the facility 20 also includes facilities in which residential facilities and non-residential facilities are mixed, for example, with stores on the lower floors and residences on the upper floors. As shown in FIG. 1, in this embodiment, it is assumed that the facility 20 is an apartment building (such as an apartment) including multiple residences 22. In the following description, each of the multiple residences 22 may be referred to as a "residence 22".

As shown in FIG. 1, the intercom system 2 includes a door 23, a control device 24, a lobby intercom 25, an intercom master unit 26, and an intercom handset 27. The door 23, the control device 24, and the lobby intercom 25 are installed in the lobby 21. The intercom master unit 26 and the intercom handset 27 are installed in each dwelling unit 22.

The door 23 of the lobby 21 leads to the inside of the facility 20. The door 23 is communicatively connected to the lobby intercom 25 and can be controlled by the lobby intercom 25. In this disclosure, "communicative" means that information can be exchanged directly or indirectly via a network or a repeater, using an appropriate communication method such as wired or wireless communication. In the intercom system 2 of this embodiment, the lobby intercom 25 can control the opening/closing or locking/unlocking of the door 23 of the lobby 21. In other words, if the door 23 is an automatic door, the lobby intercom 25 can control the door 23 to open, even though the door 23 is closed by default.

The control device 24 is communicatively connected to the lobby intercom 25, the intercom master units 26 of each dwelling unit 22, and the judgment device 3 (described later) of the judgment system 1. The control device 24 relays communication between the lobby intercom 25, the intercom master units 26 of each dwelling unit 22, and the judgment device 3.

The lobby intercom 25 is installed in the lobby 21 and is a terminal provided outside the door 23. The lobby intercom 25 is communicatively connected to the door 23 and the control device 24. The lobby intercom 25 of this embodiment is communicatively connected to a database 5 in which authentication images are registered, for example, via an external network NT1.

The lobby intercom 25 has an imaging unit 251. The imaging unit 251 is equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge-Coupled Device) image sensor.

The imaging unit 251 captures an image of a visitor who is about to open the door 23 and generates an image. More specifically, the imaging unit 251 in this embodiment captures an image of a visitor who performs a predetermined operation on the lobby intercom 25 and generates an image. In this disclosure, "visitor" includes not only customers, delivery persons, and construction workers of the facility 20, but also people who approach the door 23 leading to the inside of the facility 20. In other words, visitors include residents of the facility 20, managers and workers of the facility 20, etc. The lobby intercom 25 may be configured to automatically capture an image of a visitor who enters the lobby 21 from outside the facility 20 using the imaging unit 251.

In this embodiment, the lobby intercom 25 captures an image of a visitor with the imaging unit 251, and then performs facial recognition using the facial image contained in the generated image to determine whether or not the visitor is authorized to enter the facility 20. In facial recognition, the lobby intercom 25 first performs a facial detection process to detect the human facial portion of the image and extracts a facial image that is an image of the human facial portion. Then, when a facial image is extracted from the image, the lobby intercom 25 compares (matches) the extracted facial image with multiple authentication images (template data) that are preregistered in the database 5.

The lobby intercom 25 allows the visitor to enter the facility 20 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. In other words, the lobby intercom 25 opens (unlocks) the door 23 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. On the other hand, the lobby intercom 25 does not allow the visitor to enter the facility 20 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value. In other words, the lobby intercom 25 does not open (unlock) the door 23 if any of the multiple authentication images has a similarity to the extracted facial image that is equal to or greater than a threshold value.

The intercom master unit 26 (information terminal) is installed in the indoor space of each dwelling unit 22. The intercom master unit 26 is communicatively connected to the intercom slave unit 27. The intercom master unit 26 is communicatively connected to the control device 24 via the main line L1 of the intercom system 2. The intercom master unit 26 of this embodiment is communicatively connected to the server 4 described below via the network NT1. Furthermore, the intercom master unit 26 of this embodiment is configured to be communicatively connected to an information terminal (other information terminal) such as a smartphone 6 carried by a resident of the dwelling unit 22 via a route different from the main line L1, for example, wireless communication. The information terminal carried by the resident with which the intercom master unit 26 can communicate may be an information terminal such as a personal computer, a tablet, or a digital camera.

In this embodiment, it is assumed that the intercom master unit 26 is an information terminal that is pre-installed in the indoor space of the dwelling unit 22. However, the intercom master unit 26 may also be an information terminal such as a personal computer, smartphone, or tablet that is owned by a resident of the dwelling unit 22, as long as it is capable of communicating with the control device 24 via the main line L1 of the intercom system 2.

When the intercom master unit 26 of this embodiment receives an image to be used as an authentication image for the intercom system 2 from the smartphone 6, it transmits the image to the server 4. The server 4 performs a picture quality judgment, which will be described later, on the image transmitted by the intercom master unit 26.

The intercom master unit 26 receives result information regarding the result of the image quality judgment from the server 4 and checks the information. If the result information indicates that the image meets a predetermined image quality standard, the intercom master unit 26 transmits the image to the judgment device 3 via the trunk line L1. Here, the intercom master unit 26 of this embodiment transmits source information indicating that the image will be transmitted via the trunk line L1 in association with the image to be transmitted. The "source information" may include, for example, information indicating that the source of the image is the intercom master unit 26.

On the other hand, if the result information indicates that the image does not meet the specified image quality standard, the intercom master unit 26 does not transmit the image that was the subject of the image quality judgment to the judgment device 3. If the result information indicates that the image does not meet the specified image quality standard, the intercom master unit 26 outputs information regarding the result of the image quality judgment to the smartphone 6. Having received the information indicating that the image does not meet the specified image quality standard, the smartphone 6 is notified that the image does not meet the specified image quality standard. The notification from the smartphone 6 lets the resident know that the image has been determined to not meet the specified image quality standard.

The intercom handset 27 is communicably connected to the intercom master 26, and is, for example, a front door handset installed outside the front door of each dwelling unit 22. In other words, the intercom master 26 and the intercom handset 27 are configured to be able to communicate with each other (including making calls). Furthermore, in this embodiment, the intercom handset 27 has an imaging unit 271, and an image of a visitor captured by the imaging unit 271 of the intercom handset 27 can be displayed on the intercom master 26.

As described above, the lobby intercom 25 and the intercom master unit 26 are communicatively connected to the control device 24. Therefore, the lobby intercom 25 and the intercom master unit 26 are capable of communication (including phone calls) via the control device 24. Furthermore, the lobby intercom 25 and the intercom master unit 26 of this embodiment are configured to be capable of communication with the judgment device 3 of the judgment system 1 via the control device 24.

(2.2) Configuration of the Determination System Next, the configuration of the determination system 1 of this embodiment will be described with reference to FIG.

As shown in FIG. 1, the judgment system 1 includes a judgment device 3 and a server 4. The judgment device 3 and the server 4 are configured to be able to communicate with each other via a network NT1.

(2.2.1) Server Configuration Next, the configuration of the server 4 will be described with reference to FIG.

The server 4 in this embodiment is installed, for example, outside the facility 20. Note that the server 4 may also be installed, for example, inside the facility 20. The server 4 is configured to be able to communicate with the intercom master unit 26 and the smartphones 6 carried by the residents of the dwelling units 22 via the network NT1. The server 4 is configured, for example, to request those who wish to access the server 4 to transmit registration information and a password, etc., so that only the residents of the facility 20 can transmit images to the server 4.

The server 4 is mainly composed of a computer system having one or more processors and one or more memories. In the server 4, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the image quality determination unit 41 and the output unit 42 in the server 4. The program may be pre-recorded in the memory, may be provided via a telecommunications line such as the Internet, or may be recorded on a non-transitory recording medium such as a memory card and provided.

The image quality judgment unit 41 performs image quality judgment to judge whether an image to be used as an authentication image for the intercom system 2 satisfies a predetermined image quality standard for an authentication image. More specifically, the image quality judgment unit 41 in this embodiment judges whether an image to be used as an authentication image for the intercom system 2 received from the intercom master unit 26 satisfies a predetermined image quality standard for an authentication image. The "predetermined image quality standard" in this disclosure is a standard for whether an image to be used as an authentication image for the intercom system 2 is suitable as an authentication image. For example, the "predetermined image quality standard" may include standards such as whether the resolution (number of pixels) and image size are within a predetermined range, whether the image contains a person's face, whether there is only one person in the image, and whether the image is not blurred.

The image quality judgment unit 41 of this embodiment judges whether or not an image satisfies a predetermined image quality standard before the acquisition unit 31 of the judgment device 3 acquires an image to be used as an authentication image for the intercom system 2. Therefore, for example, there is an advantage in that the processing load of the judgment device 3 can be reduced by preventing the acquisition unit 31 of the judgment device 3 from acquiring an image that is not suitable as an authentication image.

After the image quality judgment unit 41 judges the image quality of an image to be used as an authentication image for the intercom system 2, the output unit 42 outputs information related to the judgment result of the image quality judgment unit 41. In this embodiment, the output unit 42 associates result information indicating the result of the image quality judgment with the image that was the subject of the image quality judgment, and transmits (outputs) the image and result information to the intercom master unit 26. By the output unit 42 outputting information indicating the result of the image quality judgment, the intercom master unit 26 can notify the resident of the result of the image quality judgment via a display unit or speaker of the intercom master unit 26, for example. The result of the image quality judgment may also be notified via a display unit or speaker of an information terminal owned by the resident, such as a smartphone 6.

(2.2.2) Configuration of the Determination Device Next, the configuration of the determination device 3 will be described with reference to FIG.

The judgment device 3 in this embodiment is installed in the lobby 21 of the facility 20. Note that the judgment device 3 may be installed, for example, in a management room in the facility 20, or may be installed outside the facility 20.

The judgment device 3 mainly comprises a computer system having one or more processors and one or more memories. In the judgment device 3, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the acquisition unit 31, the registration judgment unit 32, the output unit 33, and the registration unit 34 in the judgment device 3. The program may be pre-recorded in the memory, may be provided via a telecommunications line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

As described above, the acquisition unit 31 acquires an image to be used as an authentication image for the intercom system 2. The acquisition unit 31 of this embodiment is configured to be able to acquire an image from the intercom master unit 26 included in the intercom system 2 via the control device 24 and the main line L1. More specifically, the acquisition unit 31 of this embodiment is configured to be able to acquire an image from an information terminal such as a smartphone 6 via the control device 24, the main line L1, and the intercom master unit 26. For example, by using the imaging unit of the smartphone 6, there is an advantage in that a resident can easily prepare an image to be used as an authentication image.

As described above, an image that is determined by the image quality judgment unit 41 of the server 4 to meet the predetermined image quality standard is transmitted from the intercom master unit 26 to the judgment device 3 (acquisition unit 31). On the other hand, an image that is determined by the image quality judgment unit 41 of the server 4 not to meet the predetermined image quality standard is not transmitted from the intercom master unit 26 to the acquisition unit 31. That is, the acquisition unit 31 of this embodiment acquires images that are determined by the image quality judgment unit 41 to meet the predetermined image quality standard, and does not acquire images that are determined by the image quality judgment unit 41 not to meet the predetermined image quality standard. By not having the acquisition unit 31 acquire images that do not meet the predetermined image quality standard, the registration judgment unit 32 can reduce the number of registration judgments made for images that do not meet the predetermined image quality standard, which has the advantage of reducing the processing burden on the registration judgment unit 32.

As described above, the registration determination unit 32 determines whether or not to register the image acquired by the acquisition unit 31 as an authentication image. When the image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the image acquired by the acquisition unit 31 is to be registered as an authentication image. More specifically, in this embodiment, when the image acquired by the acquisition unit 31 is associated with the above-mentioned transmission source information, the registration determination unit 32 determines that the image is an image acquired via the main line L1.

Furthermore, when the image quality judgment unit 41 of the server 4 judges that an image satisfies a predetermined image quality standard and the image has been acquired by the acquisition unit 31 via the main line L1, the registration judgment unit 32 judges that the image acquired by the acquisition unit 31 should be registered as an authentication image. Since an image judged by the image quality judgment unit 41 to satisfy the predetermined image quality standard for an authentication image can be registered as an authentication image, there is an advantage in that the accuracy of authentication is improved. Note that in this embodiment, since the image acquired by the acquisition unit 31 is an image judged by the image quality judgment unit 41 to satisfy the predetermined image quality standard, the registration judgment unit 32 does not need to check the result of the image quality judgment for that image.

The registration determination unit 32 also determines whether an image acquired by the acquisition unit 31 and determined by the image quality determination unit 41 of the server 4 to meet a predetermined image quality standard has passed through the main line L1, thereby determining whether the image should be registered as an authentication image. The registration determination unit 32 of this embodiment determines whether an image determined by the image quality determination unit 41 to meet a predetermined image quality standard should be registered as an authentication image, which has the advantage of reducing unnecessary determinations for images that do not meet the predetermined image quality standard. In other words, it has the advantage of reducing the processing burden on the registration determination unit 32.

After the registration judgment unit 32 makes a registration judgment, the output unit 33 outputs information related to the judgment result of the registration judgment unit 32. In this embodiment, the output unit 33 transmits (outputs) information related to the judgment result of the registration judgment by the registration judgment unit 32 to the intercom master unit 26 that transmitted the image that was the subject of the registration judgment via the main line L1. The output unit 33 may also transmit (output) information related to the judgment result of the registration judgment via the network NT1 or the like to the smartphone 6 carried by the resident of the dwelling unit 22 in which the intercom master unit 26 that transmitted the image that was the subject of the registration judgment is installed.

By outputting information indicating the result of the registration decision from the output unit 33, for example, the intercom master unit 26 can notify the resident of the result of the registration decision via a display unit or speaker, etc., of the intercom master unit 26. The result of the registration decision may also be notified via a display unit or speaker, etc., of an information terminal, such as a smartphone 6, that the resident owns.

As described above, the registration unit 34 registers the image that the registration determination unit 32 has determined to be registered as an authentication image in the database 5 as an authentication image. In this embodiment, the registration unit 34 registers the image acquired by the acquisition unit 31 from the intercom master unit 26 included in the intercom system 2, thereby preventing a decrease in security.

(3) Operation of the Determination System Hereinafter, the operation of the determination system 1 according to this embodiment will be described with reference to FIGS.

Figure 2 is a sequence diagram showing the operation of the judgment system 1. In this embodiment, we will explain the case where an image captured by a resident using the imaging unit of the smartphone 6 is an image to be used as an authentication image for the intercom system 2.

First, the resident performs a predetermined operation on the smartphone 6, and uses the imaging unit of the smartphone 6 to prepare an image to be used as an authentication image for the intercom system 2. That is, the imaging unit of the smartphone 6 captures an image of the resident, etc., and generates an image to be used as an authentication image for the intercom system 2 (S1). Here, the smartphone 6 may have dedicated application software installed for generating an image to be used as an authentication image for the intercom system 2. The dedicated application software may be software that instructs the resident on how to take a photo, etc., via the display unit or speaker of the smartphone 6. Having the dedicated application software executed (launched) on the smartphone 6 has the advantage that it is easier for the resident to prepare an image suitable for the authentication image.

The smartphone 6 communicates with the intercom master unit 26, for example, wirelessly, and transmits the generated image to the intercom master unit 26 (S2). After receiving the image from the resident's smartphone 6, the intercom master unit 26 transmits the received image to the server 4 (S3).

The server 4 performs a picture quality judgment on the received image (S4). After performing the picture quality judgment, the server 4 associates information indicating the result of the picture quality judgment with the image, and transmits the image and the result information to the intercom master unit 26 (S5).

The intercom master unit 26 checks the result information associated with the image. If the result information indicates that the image meets the predetermined image quality standard, the intercom master unit 26 transmits the image to the judgment device 3 via the main line L1 (S6). However, if the result information indicates that the image does not meet the predetermined image quality standard, the intercom master unit 26 outputs the result information to the smartphone 6 without transmitting the image to the judgment device 3. Then, the smartphone 6, which has received the result information, is notified that the image does not meet the predetermined image quality standard.

After receiving the image from the intercom master unit 26, the judgment device 3 performs a registration judgment on the image (S7). Specifically, the judgment device 3 checks whether the image has been determined by the server 4 to satisfy a predetermined image quality standard, and whether the image has been obtained via the main line L1 of the intercom system 2.

If the server 4 determines that the image meets a predetermined image quality standard and the image has been acquired via the trunk line L1, the judgment device 3 transmits the image to the database 5 (S8). Then, the authentication image is registered in the database 5 (S9).

The judgment device 3 transmits the result information of the registration judgment to the intercom master unit 26 (S10). The intercom master unit 26 transmits the result information received from the judgment device 3 to the smartphone 6 (S11). The intercom master unit 26 may notify the resident of the result of the registration judgment via the display or speaker of the intercom master unit 26 without transmitting the result information to the smartphone 6. When the smartphone 6 receives the result information from the intercom master unit 26, it notifies the resident of the result of the registration judgment (S12).

Note that the sequence diagram shown in FIG. 2 is merely an example, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

Next, the operation of the determination device 3 of this embodiment will be described with reference to FIG. 3. FIG. 3 is a flowchart showing the operation of the determination device 3, and corresponds to the processing of steps S7, S8, and S10 in FIG. 2.

First, the judgment device 3 checks whether the acquisition unit 31 has acquired an image (S21). If the acquisition unit 31 has not acquired an image (S21: No), the judgment device 3 repeats the process of step S21 until the acquisition unit 31 acquires an image. On the other hand, if the acquisition unit 31 has acquired an image (S21: Yes), the registration judgment unit 32 checks whether the image has been acquired by the acquisition unit 31 via the main line L1 of the intercom system 2 (S22). In this embodiment, the registration judgment unit 32 checks whether the image acquired by the acquisition unit 31 is associated with transmission source information, thereby determining whether the image has been acquired by the acquisition unit 31 via the main line L1.

If the image is associated with transmission source information, i.e., if the image has been acquired by the acquisition unit 31 via the main line L1 (S22: Yes), the registration determination unit 32 determines that the image should be registered as an authentication image for the intercom system 2 (S23). The registration unit 34 transmits the image determined by the registration determination unit 32 to be registered as an authentication image to the database 5 (S24). Then, the image determined by the registration determination unit 32 to be registered as an authentication image is registered in the database 5. The output unit 33 transmits the determination result of the registration determination unit 32, i.e., the determination result that the image should be registered as an authentication image, to the intercom master unit 26 (S25). Then, the determination device 3 ends the process.

On the other hand, if the image is not associated with transmission source information, i.e., if the image has not been acquired by the acquisition unit 31 via the main line L1 (S22: No), the registration judgment unit 32 judges that the image should not be registered as an authentication image for the intercom system 2 (S26). The output unit 33 transmits the judgment result of the registration judgment unit 32, i.e., the judgment result that the image should not be registered as an authentication image, to the intercom master unit 26 (S27). Then, the judgment device 3 ends the process.

Note that the flowchart shown in FIG. 3 is merely an example, and the order of processes may be changed as appropriate, and processes may be added or deleted as appropriate.

(4) Modifications The above embodiment is merely one of various embodiments of the present disclosure. The above embodiment can be modified in various ways depending on the design and the like as long as the object of the present disclosure can be achieved.

Furthermore, functions equivalent to the judgment system 1 according to the above embodiment may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded. The judgment method according to one embodiment has an acquisition step, a judgment step, and a registration step. In the acquisition step, an image to be used as an authentication image for the intercom system 2 is acquired. In the judgment step, it is judged whether or not the image acquired in the acquisition step should be registered as an authentication image. In the registration step, the image judged in the judgment step to be registered as an authentication image is registered as an authentication image. In the judgment step, if an image is acquired in the acquisition step via the main line L1 of the intercom system 2, the image is registered as an authentication image. The program according to one embodiment is a program for causing one or more processors to execute the above judgment method.

The judgment system 1 in the present disclosure includes, for example, a computer system. The computer system is mainly composed of a processor and a memory as hardware. The processor executes a program recorded in the memory of the computer system to realize the function of the judgment system 1 in the present disclosure. The program may be pre-recorded in the memory of the computer system, provided through an electric communication line, or recorded and provided in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. The processor of the computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large-scale integrated circuit (LSI). The integrated circuits such as IC or LSI referred to here are called differently depending on the degree of integration, and include integrated circuits called system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Furthermore, a field-programmable gate array (FPGA) that is programmed after the manufacture of the LSI, or a logic device that can reconfigure the connection relationship inside the LSI or reconfigure the circuit partition inside the LSI, can also be adopted as a processor. The multiple electronic circuits may be integrated into one chip, or may be distributed across multiple chips. The multiple chips may be integrated into one device, or may be distributed across multiple devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

The judgment system 1 must include at least an acquisition unit 31, a registration judgment unit 32, and a registration unit 34.

It is not essential for the judgment system 1 that at least some of the functions of the judgment device 3 be concentrated in one housing, and at least some of the functions of the judgment device 3 may be distributed across multiple housings. For example, at least some of the functions of the judgment device 3 may be provided in the lobby intercom 25 or the server 4.

It is not essential for the judgment system 1 that at least some of the functions of the server 4 are concentrated in one housing, and at least some of the functions of the server 4 may be distributed across multiple housings. For example, at least some of the functions of the server 4 may be provided in the lobby intercom 25 or the judgment device 3.

Visitor authentication is not limited to being performed by the lobby intercom 25, but may be performed by another authentication device such as a server installed outside the facility 20. Furthermore, the image capturing unit 251 of the lobby intercom 25 is not limited to capturing an image of the visitor. For example, the image of the visitor may be captured by an image capturing unit provided in the lobby 21 separate from the lobby intercom 25.

In the above embodiment, the network NT1 is an external network of the facility 20, but the network NT1 may be an internal network of the facility 20, such as a local area network (LAN). In this case, the server 4 and the database 5 are provided inside the facility 20. One of the server 4 and the database 5 may be connected to a network external to the facility 20, and the other of the server 4 and the database 5 may be connected to a network internal to the facility 20.

The acquisition unit 31 may be configured to acquire an image to be used as an authentication image from the intercom handset 27 connected to the intercom master 26 via the intercom master 26 and the main line L1. For example, by using the imaging unit 271 of the intercom handset 27, there is an advantage that the resident can easily prepare an image to be used as an authentication image.

The server 4 may receive an image to be used as an authentication image for the intercom system 2 from the smartphone 6 without going through the intercom master unit 26. The image quality judgment unit 41 of the server 4 judges whether the image to be used as an authentication image received from the smartphone 6 satisfies a predetermined image quality standard for an authentication image. The output unit 42 of the server 4 associates information indicating the result of the image quality judgment with the image that was the subject of the image quality judgment, and transmits (outputs) the image and the result information to the smartphone 6. Then, if information indicating that the image satisfies the predetermined image quality standard for an authentication image is associated with the image, the smartphone 6 transmits the image to the judgment device 3 via the intercom master unit 26 and the main line L1.

When the control device 24 of the intercom system 2 receives an image from the intercom master unit 26 via the trunk line L1 and transmits the image to the judgment device 3, the control device 24 may transmit information indicating that the image was received via the trunk line L1 in association with the image to the judgment device 3. The registration judgment unit 32 of the judgment device 3 may determine whether or not to register the image as an authentication image depending on the presence or absence of information indicating that the image was received via the trunk line L1.

The intercom master unit 26 may also be capable of reading images stored in a portable recording medium such as the memory card 7. The intercom master unit 26 may then transmit the image stored in the memory card 7 to the determination device 3 via the main line L1 as an image to be used as an authentication image for the intercom system 2.

The lobby intercom 25 (imaging unit 251) may capture an image to be used as a temporary authentication image for temporarily permitting entry of a delivery person or the like entering the facility 20. The lobby intercom 25 associates information indicating that the image is to be used as a temporary authentication image with the image to be used as a temporary authentication image, and transmits the image and the information to the judgment device 3. The judgment device 3 registers the image captured by the lobby intercom 25 in the database 5 as a temporary authentication image. Figure 4 is a flowchart showing the operation of the judgment device 3 when registering a temporary authentication image. Note that the processing from steps S21 to S27 is the same as that in Figure 3, so the description will be omitted. When the image is acquired by the acquisition unit 31 (S21: Yes), the registration judgment unit 32 checks whether the image is for temporary registration based on the presence or absence of information indicating that the image is to be used as a temporary authentication image (S28). If the image is associated with information indicating that the image is to be used as a temporary authentication image (S28: Yes), the registration determination unit 32 determines to register the image as a temporary authentication image (S29). The registration unit 34 transmits the image determined by the registration determination unit 32 to be registered as a temporary authentication image to the database 5 (S30). Then, the image determined by the registration determination unit 32 to be registered as a temporary authentication image is registered in the database 5. In the process of step S28, if the image is not associated with information indicating that the image is to be used as a temporary authentication image (S28: No), the process proceeds to step S22. Note that the flowchart shown in FIG. 4 is merely an example, and the order of the processes may be changed as appropriate, and processes may be added or deleted as appropriate.

(5) First Modification Next, a first modification of the above embodiment will be described with reference to FIGS.

As shown in Figures 5 and 6, in the judgment system 1 according to the first modified example, the lobby intercom 25 has at least some of the functions of the judgment system 1. In addition, the judgment system 1 according to the first modified example stores (registers) the authentication image not in the database 5 (see Figure 1) but in the memory unit 256 described below.

First, the details of the lobby intercom 25 according to the first modified example will be described. As shown in FIG. 6, the lobby intercom 25 according to the first modified example includes an imaging unit 251, a communication unit 252, a call unit 253, a display unit 254, an operation unit 255, a memory unit 256, and a control unit 257.

The communication unit 252 has an interface capable of communicating with the door 23 (or electric lock), an interface capable of communicating with the control device 24, an interface capable of communicating with the server 4, and an interface capable of communicating with the lobby camera 28 (see FIG. 5). The communication unit 252 can communicate with the intercom master unit 26 via the control device 24 and the main line L1, etc.

The communication unit 252 of the first modified example transmits a plurality of images to the intercom master unit 26, including a live image G1 (see FIG. 7) captured by the imaging unit 251 of the visitor, and a playback image G3 (see FIG. 7) captured by the imaging unit 251 of the visitor while the imaging unit 251 is operating the operation unit 255. The live image G1 and the playback image G3 are videos including a plurality of frames (still images). Both the live image G1 and the playback image G3 are images of the visitor captured by the imaging unit 251. The playback image G3 is an image from an earlier time than the live image G1. Note that the playback image G3 may be a still image.

In addition to the live image G1 and playback image G3, the communication unit 252 of the first modified example also transmits to the intercom master unit 26 a lobby image G2 (see FIG. 7) captured by the lobby camera 28 of the lobby 21. The lobby camera 28 is installed in the lobby 21 and positioned so that it can capture images of visitors to the lobby 21. The lobby image G2 of the first modified example is a video captured by the lobby camera 28 at the same time as the live image G1.

The communication unit 253 includes a speaker and a microphone. The communication unit 253 of the first modified example is configured to be capable of communicating with the intercom master unit 26.

The display unit 254 is, for example, a liquid crystal display. For example, the display unit 254 is configured to display an image captured by the imaging unit 251 and also a message for the visitor. The message is, for example, a message to encourage the visitor to speak. If the lobby intercom 25 is equipped with a touch panel display, the touch panel display may serve as both the display unit 254 and the operation unit 255.

The operation unit 255 is configured to accept operations by the visitor. The operation unit 255 is, for example, an input interface having multiple push button switches, a touch panel, etc.

When a visitor performs a specified operation on the operation unit 255, the lobby intercom 25 transmits a call signal to the intercom master unit 26 to call the intercom master unit 26. Furthermore, the lobby intercom 25 transmits an image captured by the imaging unit 251 (live image G1) to the intercom master unit 26. As a result, the image of the visitor captured by the imaging unit 251 of the lobby intercom 25 can be displayed on the intercom master unit 26.

As described above, the lobby intercom 25 of the first modified example transmits to the intercom master 26 an image (playback image G3) captured by the imaging unit 251 of the visitor while the visitor is operating the operation unit 255, and a lobby image G2 captured by the lobby camera 28, together with a live image G1.

The storage unit 256 is configured with a device selected from a hard disk drive (HDD), a solid state drive (SSD), a read only memory (ROM), a random access memory (RAM), an electrically erasable programmable read only memory (EEPROM), etc. The storage unit 256 stores, for example, an authentication image.

The control unit 257 is mainly composed of a computer system having one or more processors and one or more memories. In the control unit 257, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the control unit 257. The program may be pre-recorded in the memory, may be provided via a telecommunications line such as the Internet, or may be provided by recording it on a non-transitory recording medium such as a memory card.

The control unit 257 has an acquisition unit 31, a registration determination unit 32, an output unit 33, and a registration unit 34.

The acquisition unit 31 of the first modified example acquires from the intercom master unit 26 one image selected by the intercom master unit 26 from among the live image G1, the playback image G3, and the lobby image G2, as an image to be used as an authentication image.

Next, we will explain the details of the intercom master unit 26 in the first modified example.

As shown in FIG. 6, the intercom master unit 26 of the first modified example includes a communication unit 261, a call unit 262, a display unit 263, an operation unit 264, a memory unit 265, and a control unit 266.

The communication unit 261 has an interface capable of communicating with the control device 24, an interface capable of communicating with the intercom handset 27, and an interface capable of communicating with an information terminal (other information terminal) such as a smartphone, tablet, or personal computer owned by a resident of the dwelling unit 22. The communication unit 261 can communicate with the lobby intercom 25 via the main line L1 and the control device 24, etc.

The intercom unit 262 includes a speaker and a microphone. The intercom unit 262 of the first modified example is configured to be capable of communicating with the lobby intercom 25 and the intercom handset 27.

The display unit 263 is, for example, a liquid crystal display. For example, the display unit 263 is configured to display a live image G1 captured by the imaging unit 251 of the lobby intercom 25. Note that the intercom master unit 26 of this embodiment is equipped with a touch panel display, and the touch panel display serves as both the display unit 263 and at least a part of the operation unit 264.

The operation unit 264 is configured to accept operations by the resident. The operation unit 264 is, for example, an input interface having multiple push button switches, a touch panel, etc.

The memory unit 265 is configured with a device selected from a HDD, SSD, ROM, RAM, EEPROM, etc. The memory unit 265 of the first modified example stores at least a portion of the live image G1, lobby image G2, and playback image G3 received from the lobby intercom 25.

The control unit 266 mainly comprises a computer system having one or more processors and one or more memories. In the control unit 266, the one or more processors execute a program recorded in the memory, thereby realizing the functions of the control unit 266. The program may be pre-recorded in the memory, may be provided via a telecommunications line such as the Internet, or may be recorded on a non-transitory recording medium such as a memory card and provided. The control unit 266 has a selection unit 267.

The selection unit 267 selects one image from among the live image G1, the lobby image G2, and the playback image G3 (multiple images) received from the lobby intercom 25 (communication unit 252) based on predetermined conditions.

As shown in FIG. 7, when a resident performs a predetermined operation on the operation unit 264, a selection screen D1 is displayed on the display unit 263. The selection screen D1 is a screen that allows the resident to select one image to be used as an authentication image from among a live image G1, a lobby image G2, and a playback image G3.

The selection screen D1 includes a first region R1, a second region R2, and a third region R3. The first region R1 is an area in which a live image G1 is displayed. The first region R1 is located to the left of the second region R2 and the third region R3. The second region R2 is an area in which a lobby image G2 is displayed. The second region R2 is located to the right of the first region R1 and above the third region R3. The third region R3 is an area in which a playback image G3 is displayed. The third region R3 is located to the right of the first region R1 and below the second region R2.

By performing a specific operation on the selection screen D1, the resident can select one image from the live image G1, the lobby image G2, and the playback image G3 to be used as the authentication image. As described above, the live image G1, the lobby image G2, and the playback image G3 are videos that include multiple frames (still images), so the resident can select one frame from the multiple frames as the image to be used as the authentication image.

When the selection unit 267 accepts an operation by a resident to select an image to be used as an authentication image, it transmits the selected image to the lobby intercom 25 via the communication unit 261, etc.

According to the first modified example of the judgment system 1, one image from among multiple images taken of the same visitor can be selected as the image to be used as the authentication image, and an image suitable as an authentication image can be obtained.

In the first modified example, the selection unit 267 selects an image selected by a resident as the first image. However, the selection unit 267 may perform a quality judgment on each of the live image G1, the lobby image G2, and the playback image G3, and select the image most suitable as an authentication image (the image with the highest score) as the first image. For example, the quality judgment may be performed based on the orientation, size, and image quality of the facial image contained in the multiple images to determine suitability as an authentication image, and indicate the suitability as an authentication image with a score.

The selection unit 267 may also select an image that includes the largest facial image among the multiple images as the first image. The selection unit 267 may also select a predetermined image among the live image G1, the lobby image G2, and the playback image G3 as the first image.

The same functions as the judgment system 1 according to the first modified example may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded, etc.

The various configurations described in the first modified example can be adopted in appropriate combination with the various configurations (including modified examples) described in the above embodiment.

(6) Second Modification Next, a second modification of the above embodiment will be described with reference to FIGS.

As shown in Figures 5 and 8, in the judgment system 1 according to the second modified example, the lobby intercom 25 has at least some of the functions of the judgment system 1. In addition, the judgment system 1 according to the second modified example stores (registers) the authentication image in the memory unit 256, rather than in the database 5 (see Figure 1).

As shown in FIG. 8, the control unit 257 of the lobby intercom 25 in the second modified example further includes an extraction unit 35 and an update unit 36 in addition to an acquisition unit 31, a registration determination unit 32, an output unit 33, and a registration unit 34.

The extraction unit 35 extracts a facial image from an image (live image G1 or playback image G3) of the visitor captured by the imaging unit 251. The extraction unit 35 may also extract a facial image from an image (lobby image G2) of the visitor captured by the lobby camera 28. In other words, the extraction unit 35 may extract multiple facial images from multiple images.

The extraction unit 35 extracts facial images, for example, by performing image processing (pattern recognition processing) on multiple images. In this disclosure, "pattern recognition processing" refers to image processing that recognizes what a subject is contained in an image based on the shape of the image of the subject. Examples of this type of pattern recognition processing include pattern matching processing and processing that recognizes subjects appearing in an image using a trained model created by machine learning.

When the extraction unit 35 extracts, for example, multiple facial images from multiple images, the communication unit 252 transmits the multiple facial images extracted by the extraction unit 35 together with the multiple images to the intercom master unit 26.

In the second variant, the intercom master unit 26 transmits the facial image corresponding to the image selected by the selection unit 267 to the lobby intercom 25 as the image to be used as the authentication image.

In other words, the acquisition unit 31 of the second modified example acquires the facial image selected by the intercom master unit 26 from the intercom master unit 26 as an image to be used as an authentication image.

The registration determination unit 32 of the second modified example determines whether or not to register the facial image acquired by the acquisition unit 31 as an authentication image. The registration determination unit 32 of the second modified example determines whether or not to register the facial image acquired by the acquisition unit 31 as an authentication image. More specifically, the registration determination unit 32 determines to register the facial image as an authentication image when the facial image is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2.

On the other hand, if the facial image is not acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration judgment unit 32 determines not to register the facial image as an authentication image.

In the second modified example, the registration unit 34 registers (stores) the face image that the registration determination unit 32 has determined to be registered as an authentication image in the memory unit 256 as an authentication image.

The facial image extracted by the extraction unit 35 has a smaller data size than the image from which it is extracted (such as the live image G1). This reduces the communication load when the lobby intercom 25 communicates with the intercom master unit 26.

The update unit 36 of the second modified example performs an update process to update the authentication image (face image) registered by the registration unit 34. For example, in the update process, the update unit 36 compares (matches) the face image acquired by the acquisition unit 31 with a plurality of authentication images (template data) stored in the memory unit 256. Here, the update unit 36 determines whether or not there is a face image among the plurality of face images (authentication images) registered by the registration unit 34 whose similarity with the face image acquired by the acquisition unit 31 is equal to or greater than a threshold value.

Then, when there is a face image among the multiple face images registered by the registration unit 34 whose similarity with the face image acquired by the acquisition unit 31 is equal to or greater than a threshold, the update unit 36 replaces the face image acquired by the acquisition unit 31 with the face image whose similarity is equal to or greater than the threshold, and updates the authentication image.

On the other hand, if there is no face image whose similarity with the face image acquired by the acquisition unit 31 is equal to or greater than the threshold value among the multiple face images registered by the registration unit 34, the update unit 36 does not update the authentication image. If the update unit 36 does not update the authentication image, the registration unit 34 of the second modified example registers the face image acquired by the acquisition unit 31 as the authentication image. Note that the registration unit 34 does not register the face image updated by the update unit 36 as the authentication image.

The update unit 36 performs the above-mentioned update process when the registration determination unit 32 determines that the facial image acquired by the acquisition unit 31 is to be registered as an authentication image. On the other hand, the update unit 36 does not perform the above-mentioned update process when the registration determination unit 32 determines that the facial image acquired by the acquisition unit 31 is not to be registered as an authentication image.

According to the second modified example of the judgment system 1, it is possible to update the face image registered in the memory unit 256 as an authentication image.

The same functions as the judgment system 1 according to the second modified example may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded, etc.

The various configurations described in the second modified example can be adopted in appropriate combination with the various configurations (including modified examples) described in the above embodiment.

(7) Third Modification Next, a third modification of the above embodiment will be described with reference to FIGS.

As shown in Figures 5 and 9, in the judgment system 1 according to the third modified example, the lobby intercom 25 has at least some of the functions of the judgment system 1. In addition, the judgment system 1 according to the third modified example stores (registers) the authentication image in the memory unit 256, rather than in the database 5 (see Figure 1).

As shown in FIG. 9, the control unit 266 of the intercom master unit 26 in the second modified example further includes an extraction unit 35 in addition to a selection unit 267.

The extraction unit 35 extracts a facial image from an image received from the lobby intercom 25 (communication unit 252). That is, the intercom master unit 26 of the third modified example extracts a facial image from an image received from the lobby intercom 25 (communication unit 252).

In the third variant, the intercom master unit 26 transmits a facial image corresponding to one of the images selected by the selection unit 267 to the lobby intercom 25 as an image to be used as an authentication image.

The acquisition unit 31 of the lobby intercom 25 in the third modified example acquires the face image selected by the intercom master unit 26 from the intercom master unit 26 as an image to be used as an authentication image.

The facial image extracted by the extraction unit 35 has a smaller data size than the image from which it is extracted (such as the live image G1). This reduces the communication load imposed when the acquisition unit 31 of the lobby intercom 25 acquires an image to be used as an authentication image from the intercom master unit 26.

The same functions as the judgment system 1 according to the third modified example may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded, etc.

The various configurations described in the third modified example can be used in appropriate combination with the various configurations (including modified examples) described in the above embodiment.

(8) Fourth Modification Next, a fourth modification of the above embodiment will be described with reference to FIG. 5 and FIG.

As shown in Figures 5 and 8, in the judgment system 1 according to the fourth modified example, the lobby intercom 25 has at least some of the functions of the judgment system 1. In addition, the judgment system 1 according to the fourth modified example stores (registers) the authentication image in the memory unit 256, rather than in the database 5 (see Figure 1).

As shown in FIG. 8, the lobby intercom 25 according to the fourth modified example includes a communication unit 252, an acquisition unit 31, a registration determination unit 32, a registration unit 34, an extraction unit 35, and an update unit 36.

The communication unit 252 transmits a plurality of images, including a live image G1 and a playback image G3, captured by the imaging unit 251 of the visitor, to the intercom master unit 26.

The extraction unit 35 extracts facial features from images (live image G1, playback image G3) of the visitor captured by the imaging unit 251. More specifically, the extraction unit 35 extracts facial features from each of a plurality of frames (still images) included in the images of the visitor captured by the imaging unit 251. Furthermore, the extraction unit 35 of the fourth modified example is configured to be able to extract facial features from each of a plurality of frames included in the lobby image G2 captured by the lobby camera 28.

More specifically, the extraction unit 35 of the fourth modified example extracts one facial feature from each of a plurality of frames. That is, the extraction unit 35 of the fourth modified example extracts one facial feature from one frame.

According to the fourth modified example of the judgment system 1, even if a single frame contains multiple face images, a single feature extracted from a single frame can be used as an authentication image of any one of the people captured in the single frame.

In addition, in cases where one frame includes multiple face images, for example, the extraction unit 35 may be configured to extract the features of the largest face among the multiple face images included in one frame. The extraction unit 35 may also perform a quality judgment on each of the multiple face images included in one frame, and extract the features of the face image that is most suitable as an authentication image (has the highest score). For example, the quality judgment may determine the suitability of the image for authentication based on the orientation, size, image quality, etc. of the face image, and indicate the suitability of the image for authentication with a score.

As shown in Table 1 below, the extraction unit 35 of the fourth modified example associates the extracted feature amount, the identification information of the live image G1 or playback image G3 from which the feature amount was extracted, and the frame number of the live image G1 or playback image G3 from which the feature amount was extracted, and temporarily stores them, for example, in the storage unit 256. The frame numbers are numbers assigned in chronological order to each of the multiple frames (still images) included in the live image G1 or playback image G3. After storing the feature amount, the identification information, and the frame number in association with each other, the extraction unit 35 of the fourth modified example deletes the original image (live image G1 or playback image G3) from which the feature amount was extracted.

The intercom master unit 26 in the fourth modified example transmits specific information corresponding to one image (one frame) selected by the selection unit 267 to the lobby intercom 25. In this disclosure, "specific information" refers to information that includes at least one of identification information and a frame number.

The acquisition unit 31 acquires specific information that identifies at least one frame among the multiple frames from the intercom master unit 26 included in the intercom system 2.

The registration determination unit 32 determines whether or not to register the feature quantity corresponding to the frame specified by the specific information acquired by the acquisition unit 31 as an authentication image for the intercom system 2. More specifically, when the specific information is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration determination unit 32 determines that the feature quantity corresponding to the frame specified by the specific information is to be registered as an authentication image.

On the other hand, if the specific information is not acquired by the acquisition unit 31 via the main line L1 of the intercom system 2, the registration judgment unit 32 determines not to register the feature quantity corresponding to the frame identified by the specific information as an authentication image.

The registration unit 34 registers the feature amount that the registration determination unit 32 has determined to be registered as an authentication image as an authentication image. The registration unit 34 of the fourth modified example stores (registers) the feature amount (authentication image) in the storage unit 256.

According to the judgment system 1 of the fourth modified example, the imaging unit 251 does not store the image of the visitor, but registers the feature amount, thereby improving the confidentiality of the data.

The update unit 36 of the fourth modified example performs an update process to update the authentication image (feature amount) registered by the registration unit 34. For example, in the update process, the update unit 36 compares (matches) the feature amount corresponding to the frame specified by the specific information with a plurality of authentication images (template data) stored in the storage unit 256. Here, the update unit 36 determines whether or not there is a feature amount among the plurality of feature amounts (authentication images) registered by the registration unit 34 whose similarity with the feature amount corresponding to the frame specified by the specific information is equal to or greater than a threshold value.

Then, the update unit 36 updates the features when there is a feature among the multiple feature amounts registered by the registration unit 34 whose similarity to the feature amount corresponding to the frame specified by the specific information is equal to or greater than a threshold value. More specifically, the update unit 36 replaces the feature amount corresponding to the frame specified by the specific information with the feature amount whose similarity is equal to or greater than a threshold value, and updates the authentication image.

On the other hand, if there is no feature among the multiple feature amounts registered by the registration unit 34 whose similarity with the feature amount corresponding to the frame specified by the specific information is equal to or greater than the threshold value, the update unit 36 does not update the authentication image. If the update unit 36 does not update the authentication image, the registration unit 34 of the fourth modified example registers the feature amount corresponding to the frame specified by the specific information as the authentication image. Note that the registration unit 34 does not register the face image updated by the update unit 36 as the authentication image.

The update unit 36 performs the above-mentioned update process when the specific information is acquired by the acquisition unit 31 via the main line L1 of the intercom system 2. On the other hand, the update unit 36 does not perform the above-mentioned update process when the specific information is acquired by the acquisition unit 31 without going through the main line L1 of the intercom system 2.

According to the judgment system 1 of the fourth modified example, it is possible to update the features registered in the memory unit 256 as an authentication image.

In the fourth modified example, the registration unit 34 stores the features of the authentication image in the memory unit 256, but the registration unit 34 may store the features in another storage device (storage medium) such as the database 5 (see FIG. 1).

The function equivalent to the judgment system 1 according to the fourth modified example may be embodied in a judgment method, a (computer) program, or a non-transitory recording medium on which a program is recorded. The judgment method according to one embodiment includes an extraction step, an acquisition step, a registration judgment step, and a registration step. In the extraction step, facial features are extracted from each of a plurality of still images included in an image captured by the imaging unit 251 of a visitor. In the acquisition step, specific information for identifying at least one of the plurality of still images is acquired from an information terminal included in the intercom system 2. In the registration judgment step, it is determined whether or not the feature corresponding to the still image identified by the specific information acquired in the acquisition step is to be registered as an authentication image of the intercom system 2. In the registration step, the feature determined to be registered as an authentication image in the registration judgment step is registered as an authentication image. In the registration judgment step, when the specific information is acquired through the main line L1 of the intercom system 2 in the acquisition step, it is determined that the feature corresponding to the still image identified by the specific information is to be registered as an authentication image. The program according to one embodiment is a program for causing one or more processors to execute the above judgment method.

The various configurations described in the fourth modified example can be adopted in appropriate combination with the various configurations (including modified examples) described in the above embodiment.

(summary)
As described above, the judgment system (1) according to the first aspect includes an acquisition unit (31), a registration judgment unit (32), and a registration unit (34). The acquisition unit (31) acquires an image to be used as an authentication image for the intercom system (2). The registration judgment unit (32) judges whether or not to register the image acquired by the acquisition unit (31) as an authentication image. The registration unit (34) registers the image judged by the registration judgment unit (32) to be registered as an authentication image as an authentication image. When the image is acquired by the acquisition unit (31) via the main line (L1) of the intercom system (2), the registration judgment unit (32) judges to register the image as an authentication image.

According to this aspect, the judgment system (1) allows residents of an apartment building (facility 20) to register their own authentication images, improving convenience. In addition, by judging that the image acquired via the main intercom line (L1) of the apartment building should be registered as an authentication image, a decrease in security can be suppressed.

In the judgment system (1) according to the second aspect, in the first aspect, the acquisition unit (31) is configured to acquire the above image from an information terminal (intercom master unit 26) included in the intercom system (2) via the trunk line (L1).

According to this embodiment, the image is obtained from an information terminal included in the intercom system (2), such as the intercom master unit (26), so that a decrease in security can be suppressed.

In the judgment system (1) according to the third aspect, in the second aspect, the information terminal (intercom master unit 26) is configured to be able to communicate with another information terminal (smartphone 6) via a route different from the trunk line (L1). The acquisition unit (31) is configured to be able to acquire the above image from the other information terminal via the information terminal and the trunk line (L1).

According to this embodiment, residents can easily prepare images for face recognition by using other information terminals such as smartphones (6).

In the judgment system (1) according to the fourth aspect, in the second or third aspect, the acquisition unit (31) is configured to be able to acquire the above image from the intercom handset (27) connected to the information terminal (intercom master 26) via the information terminal and the trunk line (L1).

According to this embodiment, for example, by using a camera in the intercom handset (27), residents can easily prepare an image for face recognition.

The judgment system (1) according to the fifth aspect is any one of the first to fourth aspects, and further includes an image quality judgment unit (41). The image quality judgment unit (41) judges whether the image satisfies a predetermined image quality standard as an image for authentication. The registration judgment unit (32) judges to register the image as an image for authentication when the image quality judgment unit (41) judges that the image satisfies the predetermined image quality standard and the image has been acquired by the acquisition unit (31) via the trunk line (L1).

According to this aspect, the image that meets the predetermined image quality standards for an authentication image can be registered as an authentication image.

In the judgment system (1) according to the sixth aspect, in the fifth aspect, the registration judgment unit (32) judges whether the image judged by the image quality judgment unit (41) to satisfy a predetermined image quality standard has passed through a trunk line (L1), thereby judging whether to register the image as an authentication image.

According to this aspect, for example, it is possible to reduce the number of times the registration judgment unit (32) makes a judgment on the image that does not satisfy a predetermined image quality standard, thereby reducing the processing load on the registration judgment unit (32).

In the judgment system (1) according to the seventh aspect, in the fifth aspect, the image quality judgment unit (41) judges whether or not the image satisfies a predetermined image quality standard before the acquisition unit (31) acquires the image. The acquisition unit (31) acquires the image that is judged by the image quality judgment unit (41) to satisfy the predetermined image quality standard, and does not acquire the image that is judged by the image quality judgment unit (41) not to satisfy the predetermined image quality standard.

According to this aspect, the acquisition unit (31) does not acquire the image that does not satisfy the predetermined image quality standard, so that the registration judgment unit (32) can reduce judgments on the image that does not satisfy the predetermined image quality standard, and the processing load on the registration judgment unit (32) can be reduced.

The judgment system (1) according to the eighth aspect is any one of the fifth to seventh aspects, and further includes an output unit (33). The output unit (33) outputs information related to the judgment result of the image quality judgment unit (41).

According to this embodiment, the result of the judgment regarding the image quality of the image can be notified to residents, etc., via a display unit, etc., of an information terminal (intercom master unit 26) included in the intercom system (2), for example.

The judgment system (1) according to the ninth aspect further includes an output unit (42) in any one of the first to eighth aspects. The output unit (42) outputs information related to the judgment result of the registration judgment unit (32).

According to this aspect, the resident or the like can be notified of the result of the judgment regarding the registration of the authentication image, for example, via a display unit or the like.

The judgment system (1) according to the tenth aspect further includes a communication unit (252) in any of the second to fourth aspects. The communication unit (252) transmits a plurality of images (live image G1; playback image G3) of a visitor captured by the imaging unit (251) to an information terminal (intercom master unit 26). The information terminal selects one image from the plurality of images received from the communication unit (252). The acquisition unit (31) acquires the one image from the information terminal as an image to be used as an authentication image.

According to this aspect, one of multiple images (live image G1; playback image G3) of the same visitor can be selected as the image to be used as the authentication image, and an image suitable as an authentication image can be obtained.

The judgment system (1) according to the eleventh aspect, in any of the second to fourth aspects, further includes an extraction unit (35) and a communication unit (252). The extraction unit (35) extracts a facial image from an image (live image G1; playback image G3) of a visitor captured by the imaging unit (251). The communication unit (252) transmits the facial image extracted by the extraction unit (35) to an information terminal (intercom master unit 26). The acquisition unit (31) acquires the facial image selected by the information terminal from the information terminal as an image to be used as an authentication image.

According to this embodiment, the communication load when the judgment system (1) communicates with the information terminal (intercom master unit 26) can be reduced.

The judgment system (1) according to the twelfth aspect further includes a communication unit (252) in any of the second to fourth aspects. The communication unit (252) transmits images (live images G1; playback images G3) of a visitor captured by the imaging unit (251) to an information terminal (intercom master unit 26). The information terminal extracts a facial image from the images received from the communication unit (252). The acquisition unit (31) acquires the facial image from the information terminal as an image to be used as an authentication image.

According to this aspect, it is possible to reduce the communication load when the acquisition unit (31) acquires an image to be used as an authentication image.

The judgment system (1) according to the thirteenth aspect includes an extraction unit (35), an acquisition unit (31), a registration judgment unit (32), and a registration unit (34). The extraction unit (35) extracts facial features from each of a plurality of still images included in an image (live image G1; playback image G3) of a visitor captured by the imaging unit (251). The acquisition unit (31) acquires specific information for identifying at least one still image among the plurality of still images from an information terminal (intercom master unit 26) included in the intercom system (2). The registration judgment unit (32) judges whether or not to register the feature corresponding to the still image identified by the specific information acquired by the acquisition unit (31) as an authentication image for the intercom system (2). The registration unit (34) registers the feature determined by the registration judgment unit (32) to be registered as an authentication image as an authentication image. If the specific information is acquired by the acquisition unit (31) via the main line (L1) of the intercom system (2), the registration determination unit (32) determines that the feature amount corresponding to the still image identified by the specific information should be registered as an authentication image.

According to this aspect, the imaging unit (251) does not store the image of the visitor, but registers the feature amount, thereby improving the confidentiality of the data.

The judgment system (1) according to the fourteenth aspect is the thirteenth aspect, and further includes an update unit (36). The update unit (36) updates the feature amounts registered by the registration unit (34). When there is a feature amount among the multiple feature amounts registered by the registration unit (34) whose similarity to a feature amount corresponding to a still image identified by the specific information is equal to or greater than a threshold value, the update unit (36) replaces the identified feature amount with the feature amount whose similarity is equal to or greater than the threshold value.

According to this aspect, it is possible to update the features registered as an authentication image.

In the determination system (1) according to the fifteenth aspect, in the thirteenth aspect, the extraction unit (35) extracts a feature amount of one face from each of the multiple still images.

According to this aspect, even if a single frame contains images of multiple people, the feature amount extracted from the single frame can be used as an authentication image of any of the people captured in the single frame.

Configurations other than the first aspect are not essential to the determination system (1) and may be omitted as appropriate.

The judgment method according to the sixteenth aspect has an acquisition step, a judgment step, and a registration step. In the acquisition step, an image to be used as an authentication image for the intercom system (2) is acquired. In the judgment step, it is judged whether or not the image acquired in the acquisition step should be registered as an authentication image. In the registration step, the image judged in the judgment step to be registered as an authentication image is registered as an authentication image. In the judgment step, if the image is acquired in the acquisition step via the main line (L1) of the intercom system (2), the image is registered as an authentication image.

According to this aspect, residents of an apartment building (facility 20) can register their own authentication image. In addition, by deciding to register the image acquired via the main intercom line (L1) of the apartment building as an authentication image, it is possible to prevent a decrease in security.

The judgment method according to the seventeenth aspect includes an extraction step, an acquisition step, a registration judgment step, and a registration step. In the extraction step, facial features are extracted from each of a plurality of still images included in an image of a visitor captured by the imaging unit (251). In the acquisition step, specific information for identifying at least one of the plurality of still images is acquired from an information terminal included in the intercom system (2). In the registration judgment step, it is determined whether or not the feature corresponding to the still image identified by the specific information acquired in the acquisition step is to be registered as an authentication image for the intercom system (2). In the registration step, the feature determined to be registered as an authentication image in the registration judgment step is registered as an authentication image. In the registration judgment step, if the specific information is acquired in the acquisition step via the main line (L1) of the intercom system (2), it is determined that the feature corresponding to the still image identified by the specific information is to be registered as an authentication image.

According to this aspect, the imaging unit (251) does not store the image of the visitor, but registers the feature amount, thereby improving the confidentiality of the data.

The program according to the eighteenth aspect is a program for causing one or more processors to execute the determination method according to the sixteenth or seventeenth aspect.

According to this aspect, residents of an apartment building (facility 20) can register their own authentication image. In addition, by deciding to register the image acquired via the main intercom line (L1) of the apartment building as an authentication image, it is possible to prevent a decrease in security.

1 Determination system 2 Intercom system 251 Imaging unit 252 Communication unit 26 Intercom master unit (information terminal)
27 Intercom handset 31 Acquisition unit 32 Registration judgment unit 33 Output unit 34 Registration unit 35 Extraction unit 36 Update unit 41 Image quality judgment unit 42 Output unit 6 Smartphone (other information terminal)
L1 Main line

Claims (11)

an acquisition unit that acquires an image to be used as an authentication image for the intercom system;
a registration determination unit that determines whether or not to register the image acquired by the acquisition unit as the authentication image;
a registration unit that registers the image determined by the registration determination unit to be registered as the authentication image as the authentication image;
an image quality determination unit that determines whether the image satisfies a predetermined image quality standard for the authentication image;
Equipped with
The registration determination unit is
when the image quality determination unit determines that the image satisfies the predetermined image quality standard and the image is acquired by the acquisition unit via the trunk line of the intercom system, determine that the image is to be registered as the authentication image;
determining whether the image, which is determined by the image quality determination unit to satisfy the predetermined image quality standard, has passed through the trunk line, thereby determining whether to register the image as the authentication image;
Judgment system. the acquiring unit is configured to acquire the image from an information terminal included in the intercom system via the trunk line,
The determination system according to claim 1 . the information terminal is configured to be able to communicate with other information terminals via a route different from the trunk line;
the acquisition unit is configured to be able to acquire the image from the other information terminal via the information terminal and the trunk line,
The determination system according to claim 2 . The acquisition unit is configured to acquire the image from an intercom slave connected to the information terminal via the information terminal and the trunk line.
The determination system according to claim 2 . An output unit that outputs information related to a result of the judgment by the image quality judgment unit.
The determination system according to claim 1 . An output unit that outputs information regarding a result of the determination by the registration determination unit.
The determination system according to claim 1 . A communication unit that transmits a plurality of images of the visitor captured by the imaging unit to the information terminal,
the information terminal selects one image from the plurality of images received from the communication unit;
The acquisition unit acquires the one image as the authentication image from the information terminal.
The determination system according to claim 2 . an extraction unit that extracts a face image from an image of the visitor captured by the imaging unit;
a communication unit that transmits the facial image extracted by the extraction unit to the information terminal;
Further comprising:
The acquisition unit acquires the face image selected by the information terminal from the information terminal as the authentication image.
The determination system according to claim 2 . A communication unit that transmits an image of the visitor captured by the imaging unit to the information terminal,
The information terminal extracts a face image from the image received from the communication unit,
The acquisition unit acquires the face image as the authentication image from the information terminal.
The determination system according to claim 2 . An acquisition step of acquiring an image to be used as an authentication image for the intercom system;
a registration determination step of determining whether or not to register the image acquired in the acquisition step as the authentication image;
a registration step of registering the image determined to be registered as the authentication image in the registration determination step as the authentication image;
an image quality determination step for determining whether the image satisfies a predetermined image quality standard for the authentication image;
having
In the registration determination step,
When it is determined in the image quality determination step that the image satisfies the predetermined image quality standard, and when the image is acquired through a trunk line of an intercom system in the acquisition step, it is determined that the image is to be registered as the authentication image;
determining whether the image, which is determined in the image quality determination step to satisfy the predetermined image quality standard, has passed through the trunk line, thereby determining whether or not to register the image as the authentication image;
Judgment method. A program for causing one or more processors to execute the determination method according to claim 10.

Images