JP7804291B2 - System, program and information processing method - Google Patents

Description

This disclosure relates to a system, a program, and an information processing method.

Technology is known in which security devices monitor buildings for abnormalities.

For example, Patent Document 1 discloses an invention in which a security device monitors the building being guarded for abnormalities, and if an abnormality is detected, it reports it to a security center, which then takes necessary measures, such as dispatching security guards to the building.

Japanese Patent Application Laid-Open No. 2018-137673

The technology described in Patent Document 1 above is a technology that detects abnormalities and reports the detected abnormalities to a security center, and is not a technology that uses authentication results based on the visitor's facial image.

This disclosure has been made with these points in mind, and aims to provide a system, program, and information processing method that can issue warning notifications based on the authentication results of visitors to a specified area.

The system of the present disclosure comprises:
an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
A system comprising:
The system functions as a visitor registration information receiving means, an authentication means, an admission restriction lifting means, and a warning notification means by executing a program,
the visitor registration information receiving means receives visitor registration information including information about a face image of the visitor and visit date and time information;
the authentication means performs authentication of the visitor by comparing information about the visitor's facial image captured by the imaging device with information about the visitor's facial image registered by the visitor registration information accepting means;
the entry restriction release means releases the restriction on entry into the specified area imposed by the entry restriction device when the visitor is authenticated by the authentication means and the date and time when the visitor was imaged by the imaging device and the visit date and time in the registration information accepted by the visitor registration information acceptance means satisfy a specified condition;
The warning notification means transmits warning notification information to a predetermined terminal when the number of times the visitor registration information accepting means accepts visitor registration information or the number of times the authentication means authenticates visitors within a predetermined period of time exceeds a predetermined number.

In the above system, the visitor registration information accepting means may form feature data of the facial image.

Furthermore, in the system, the feature data of the facial image may be a set of pixel values of pixels corresponding to the facial image.

Furthermore, in the above system, the visitor registration information accepting means may form one of a hash value, a checksum, or binary compressed data of the feature data of the facial image.

In addition, in the above system, the authentication means may detect the contours of each facial part contained in the captured visitor's facial image and the registered visitor's facial image based on pixel values contained in information related to the visitor's facial image captured by the imaging device and information related to the visitor's facial image registered by the visitor registration information receiving means.

Furthermore, in the above system, the authentication means may compare the contour lines of the detected captured visitor's facial image with those of the registered visitor, and determine whether the person depicted in the captured visitor's facial image and the registered visitor's facial image are the same person based on the degree of similarity of the contour lines of the compared objects.

Furthermore, in the above system, the authentication means may grant permission as the authentication if it determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person.

Furthermore, in the above system, the authentication means may reject the authentication if it determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person.

The program of the present disclosure is
an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
A program that causes a control unit of a system to function as a visitor registration information receiving means, an authentication means, an admission restriction release means, and a warning notification means when executed by the control unit of the system,
the visitor registration information receiving means receives visitor registration information including information about a face image of the visitor and visit date and time information;
the authentication means performs authentication of the visitor by comparing information about the visitor's facial image captured by the imaging device with information about the visitor's facial image registered by the visitor registration information accepting means;
the entry restriction release means releases the restriction on entry into the specified area imposed by the entry restriction device when the visitor is authenticated by the authentication means and the date and time when the visitor was imaged by the imaging device and the visit date and time in the registration information accepted by the visitor registration information acceptance means satisfy a specified condition;
The warning notification means transmits warning notification information to a predetermined terminal when the number of times the visitor registration information accepting means accepts visitor registration information or the number of times the authentication means authenticates visitors within a predetermined period of time exceeds a predetermined number.

The information processing method of the present disclosure includes:
an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
An information processing method executed by a control unit of a system comprising:
Accept visitor registration information, including information about the visitor's facial image and visit date and time information,
authenticates the visitor by comparing information about the visitor's face image captured by the imaging device with information about the visitor's face image registered by the visitor registration information receiving means;
when the authentication means authenticates the visitor and the date and time when the visitor was photographed by the imaging device and the visit date and time in the registration information accepted by the visitor registration information accepting means satisfy a predetermined condition, the restriction on entry into the predetermined area imposed by the entry restricting device is lifted;
When the number of times that the visitor registration information receiving means receives the visitor's registration information or the number of times that the authentication means performs visitor authentication within a predetermined period of time exceeds a predetermined number, warning notification information is sent to a predetermined terminal that has been set in advance.

The system disclosed herein can provide a system that can issue warning notifications based on the authentication results of visitors to a specified area.

1 is a schematic diagram showing the overall configuration of a system according to an embodiment of the present invention. FIG. 1 is an activity diagram showing the flow of information between elements when registering an intermediary in the system according to the present embodiment. FIG. 1 is an activity diagram showing the flow of information between elements when booking a preview of a property in the system according to the present embodiment. FIG. 1 is an activity diagram showing the flow of information between elements during a property viewing in the system according to the present embodiment. (A) A figure showing an example of a display format in which candidate viewing dates and times presented when booking a preview in a system according to this embodiment can be selected, and (B) a figure showing an example of a display that appears after selecting a candidate viewing date and time. 10 is a flowchart showing the flow of processing by an intermediary in the system according to the present embodiment. 10 is a flowchart showing the flow of processing for dealing with a visitor based on whether or not authentication has been successful in the system according to the present embodiment. 10 is a flowchart showing the process of suspending use and deleting registered information of a resident who has already moved out in the system according to the present embodiment.

The present embodiment will be described below with reference to the drawings.

<System 1>
1, in system 1 according to this embodiment, an employee of a real estate agent who has registered information about his or her facial image in advance in a management server (computer 10) releases the restriction on entry into a predetermined area (specifically, a shared space in an apartment building) imposed by an entry restriction device 30 based on information about the facial image captured by an imaging device 20. The configuration of such system 1 will be described using FIG.

As shown in FIG. 1, system 1 includes an entry restriction device 30, an imaging device 20, a computer 10 (management server), a resident terminal 40, a broker terminal 50, and an administrator terminal 60. Computer 10 is communicatively connected to each of the entry restriction device 30, imaging device 20, resident terminal 40, broker terminal 50, and administrator terminal 60 via a network such as the Internet. Furthermore, entry restriction device 30 and imaging device 20 are communicatively connected to each other wirelessly or via a wired connection. Furthermore, entry restriction device 30, imaging device 20, resident terminal 40, broker terminal 50, and administrator terminal 60 are communicatively connected to each other via a network such as the Internet.

<Computer 10>
The computer 10 is, for example, a management server of a system company. The computer 10 has a control unit 11, a memory unit 12, and a communication unit 13. The control unit 11 is, for example, a CPU, and by executing programs stored in the memory unit 12, functions as a visitor registration information receiving means 110, a real estate agent registration means 111, a preview available date and time presentation means 112, a preview reservation receiving means 113, a first authentication means 114, a first entry restriction lifting means 115, a warning notification means 116, a tenant registration information receiving means 117, a usage suspension means 118, a tenant registration information deletion means 119, an employee registration information deletion means 120, and a visitor registration information deletion means 121.

<Control system applied to intermediaries>
The intermediary registration means 111 generates facial image feature data of the intermediary's employees upon receiving registration application information from the intermediary terminal 50, and registers the identification information and facial image information of the intermediary employees. The facial image information of the intermediary employees includes at least one of a hash value, a checksum, and binarized compressed data of the facial image feature data of the intermediary employees. Here, the facial image feature data is facial image data showing the facial features of a person, such as a set of pixel values of pixels corresponding to the facial image. Furthermore, the identification information of the intermediary employees refers to an identifier such as an ID that identifies the intermediary employees. As shown in FIG. 2 , the intermediary registration means 111 transmits the received registration application information to the administrator terminal 60 via the communication unit 13. Furthermore, the intermediary registration means 111 transmits approval information received from the administrator terminal 60 to the intermediary terminal 50 via the communication unit 13. Furthermore, the intermediary registration means 111 can also transmit facial image information of registered intermediary employees to the entry control device 30 via the communication unit 13.

As shown in FIG. 3, the viewing available date and time presentation means 112 accepts viewing request information sent via the agent terminal 50 from an employee of an agent registered by the agent registration means 111. The viewing request information refers to information regarding the desired viewing date and time of a person (viewing candidate) who wishes to view a property, which is entered into the system 1 by an employee of the agent, based on one or more desired viewing dates and times submitted to the agent by the person. Triggered by the receipt of the viewing request information, the viewing available date and time presentation means 112 also sends a display signal to the agent terminal 50 to cause the agent terminal 50 to display candidate viewing dates and times based on the available viewing dates and times stored in the memory unit 12.

The preview reservation acceptance means 113 accepts preview reservation information containing preview date and time information for the date and time at which the preview will take place, selected from the candidate preview dates and times displayed on the real estate agent terminal 50, based on the display signal transmitted from the preview date and time presentation means 112, and identification information for the real estate agent's employee. The preview reservation acceptance means 113 also stores the preview date and time information in the accepted preview reservation information in the memory unit 12. The preview reservation is confirmed by storing the preview reservation information in the memory unit 12. At this time, the candidate preview dates and times are displayed in a calendar format, for example, as shown in Figure 5(A), and the preview reservation can be confirmed by associating them with the name of the real estate agent's employee and the property name, as shown in Figure 5(B).

Also, as shown in FIG. 3, the preview reservation acceptance means 113 transmits the preview reservation information to the manager terminal 60 via the communication unit 13. At this time, the preview reservation acceptance means 113 can also transmit the preview reservation information to the entry restriction device 30 via the communication unit 13.

The preview reservation acceptance means 113 also sends reservation confirmation information for the confirmed preview reservation to the agent terminal 50 via the communication unit 13. A pairing ID is assigned to the agent employee's identification information, facial image information, and preview date and time information to associate each piece of information.

The first authentication means 114 authenticates the agent's employee by comparing information relating to the facial image of the agent's employee captured by the imaging device 20 with information relating to the facial image of the agent's employee registered by the agent registration means 111.

The first authentication means 114 detects the contours of each facial feature contained in the captured facial image of the agent's employee and the registered facial image of the agent's employee based on pixel values contained in information relating to the facial image of the agent's employee captured by the imaging device 20 and information relating to the facial image of the agent's employee registered by the agent registration means 111. The first authentication means 114 compares the information relating to the facial image of the agent's employee captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features contained in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

The first authentication means 114 compares the contours of the detected captured facial image of the agent's employee with the facial image of the registered agent's employee.

Furthermore, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity between the contours of the detected facial image of the agent's employee captured and the facial image of the registered agent's employee that are the subject of the comparison.

The first authentication means 114 also calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, and the number of enclosed closed curves. For example, when closed curves within an image are appropriately matched one-to-one within the image, if there are no unmatched closed curves, the first authentication means 114 will assign the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parents) match, the first authentication means 114 will add another point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is assigned as the final score between the images. The higher this score, the more the first authentication means 114 qualitatively determines that the degree of similarity between the two images is greater in stages according to the score.

Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the intermediary agent employee and the registered facial image of the intermediary agent employee are the same person.Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the intermediary agent employee and the registered facial image of the intermediary agent employee are not the same person, while leaving open the possibility that they are not the same person.

Furthermore, if the first authentication means 114 determines that the person shown in the captured facial image of the intermediary agent employee and the facial image of the registered intermediary agent employee are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured facial image of the intermediary agent employee and the facial image of the registered intermediary agent employee are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

The first authentication means 114 also determines whether the date and time the real estate agent's employee was imaged by the imaging device 20 and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means 113 satisfy predetermined conditions. For example, the first authentication means 114 determines whether the date the real estate agent's employee was imaged by the imaging device 20 for the property matches the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113. The first authentication means 114 also determines whether the time the real estate agent's employee was imaged by the imaging device 20 for the property matches the viewing time or is included in the time period for the viewing in the viewing reservation information accepted by the viewing reservation acceptance means 113.

If it is determined that the date on which an image of an agent's employee was captured by the imaging device 20 for a property matches the viewing date in the viewing reservation information received by the viewing reservation acceptance means 113, and the time at which the image of the agent's employee was captured by the imaging device 20 matches the viewing time or is within the time period in the viewing reservation information received by the viewing reservation acceptance means 113 (matching date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person. If it is determined that the person shown in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person, the first authentication means 114 links the permission signal and information related to the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information accepted by the viewing reservation acceptance means 113 or is not included in the time period (mismatch in date and time information), the first authentication means 114 links the denial signal and information related to the mismatch in date and time information, or does not link them, and performs processing to not output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

The first entry restriction release means 115 releases the restriction on entry into a specified area imposed by the entry restriction device 30 when the agent's employee is authenticated by the first authentication means 114 and the date and time the agent's employee is photographed by the imaging device 20 and the viewing date and time in the viewing reservation information accepted by the viewing reservation acceptance means 113 satisfy specified conditions.

Also, as shown in FIG. 4, after receiving the entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 notifies the manager that the entry restriction to the property has been lifted by transmitting the entry restriction lifting information to the manager terminal 60.

When the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the entry restriction into the specified area imposed by the entry restriction device 30.

When the employee registration information deletion means 120 receives an instruction to delete the registration information of a specific intermediary's employee from the administrator terminal 60 or the intermediary terminal 50, it deletes information related to the facial image of the specific intermediary's employee registered by the intermediary registration means 111, triggered by the receipt of the instruction to delete the registration information of the specific intermediary's employee.

<Control system applied to visitors>
The visitor registration information receiving means 110 forms feature data of the visitor's facial image and receives visitor registration information including information about the visitor's facial image and the visit date and time (visit date and time information). The information about the visitor's facial image includes at least one of a hash value, a checksum, and binarized compressed data of the feature data of the visitor's facial image. Here, the feature data of the facial image is facial image data showing the facial features of a person, such as a set of pixel values of pixels corresponding to the facial image. Furthermore, the visitor's visit date and time information refers to information about the planned date and time of a visit by a visitor who is scheduled to visit the property. Here, a visitor refers to a person who visits the property and is a third party other than the resident or an employee of the real estate agent. Examples of visitors include the resident's friends and relatives. A pairing ID is assigned to the visitor's facial image information and visit date and time information to associate each piece of information.

The first authentication means 114 authenticates the visitor by comparing information about the visitor's facial image captured by the imaging device 20 with information about the visitor's facial image registered by the visitor registration information receiving means 110.

The first authentication means 114 also detects the contours of each facial feature contained in the captured visitor's facial image and the registered visitor's facial image based on pixel values contained in information related to the visitor's facial image captured by the imaging device 20 and information related to the visitor's facial image registered by the visitor registration information receiving means 110. The first authentication means 114 compares the information related to the visitor's facial image captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features contained in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

The first authentication means 114 also compares the contours of the detected captured facial image of the visitor with those of the registered visitor. Based on the comparison results, the first authentication means 114 determines whether the people in both facial images are the same based on the degree of similarity of the contours of the detected captured facial image of the visitor and the registered facial image of the visitor that are being compared.

The first authentication means 114 also calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, and the number of enclosed closed curves. For example, if closed curves within an image are appropriately matched one-to-one within the image and there are no unmatched closed curves, the first authentication means 114 will assign the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parent curves) match, the first authentication means 114 will add another point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is used as the final score between the images. The higher the score, the greater the degree of similarity between the two images, as determined by the first authentication means 114, in stages according to the score. Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person. Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person, while leaving open the possibility that they are not the same person.

Furthermore, if the first authentication means 114 determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

The first authentication means 114 also determines whether the date and time the visitor was imaged by the imaging device 20 and the visit date and time accepted by the visitor registration information accepting means 110 satisfy predetermined conditions. For example, the first authentication means 114 determines whether the date the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information accepted by the visitor registration information accepting means 110. The first authentication means 114 also determines whether the time the visitor was imaged by the imaging device 20 at the property matches the visit time or is included in the time period of the visit in the visit date and time information accepted by the visitor registration information accepting means 110.

If it is determined that the date on which the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information received by the visitor registration information receiving means 110, and that the time at which the visitor was imaged by the imaging device 20 matches the visit time or is within the time period in the visit date and time information received by the visitor registration information receiving means 110 (matching date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person. If it is determined that the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person, the first authentication means 114 links the permission signal and information related to the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

On the other hand, if the first authentication means 114 determines that the date on which the visitor was imaged by the imaging device 20 at the property does not match the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, or that the time on which the visitor was imaged by the imaging device 20 does not match the visit time in the visit date and time information accepted by the visitor registration information accepting means 110 or is not included in the time period (date and time information mismatch), the first authentication means 114 links the denial signal and information related to the date and time information mismatch, or does not link them at all, and performs processing to not output restriction lift information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

Furthermore, the first entry restriction lifting means 115 lifts the restriction on entry into a specified area imposed by the entry restriction device 30 when the visitor is authenticated by the first authentication means 114 and the date and time the visitor was imaged by the imaging device 20 and the date and time of visit in the registration information accepted by the visitor registration information accepting means 110 satisfy specified conditions. Furthermore, as shown in FIG. 4, after receiving entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 notifies the manager that the entry restriction to the property has been lifted by transmitting the entry restriction lifting information to the manager terminal 60.

When the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the entry restriction into the specified area imposed by the entry restriction device 30.

The warning notification means 116 determines whether the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period of time has exceeded a predetermined number. If the number of times the visitor registration information receiving means 110 has received visitor registration information or the number of times the first authentication means 114 has authenticated a visitor within a predetermined period of time has exceeded a predetermined number of times, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60). The warning notification includes, for example, an audio alert or a visual alert.

When the visitor registration information deletion means 121 receives an instruction to delete the registration information of a specific visitor from the resident terminal 40, the administrator terminal 60, or the intermediary terminal 50, it deletes the information related to the facial image of the specific visitor registered by the visitor registration information reception means 110, triggered by the receipt of the instruction to delete the registration information of the specific visitor.

<Control system applied to residents>
The resident registration information receiving means 117 generates feature data of the resident's facial image and registers the resident's identification information and information about the facial image. The information about the resident's facial image includes at least one of a hash value, a checksum, and binarized compressed data of the feature data of the resident's facial image. Here, the feature data of the facial image is facial image data that indicates the facial features of a person, such as a set of pixel values of pixels corresponding to the facial image. Furthermore, the resident's identification information refers to an identifier such as an ID that identifies the resident residing in the property. A pairing ID is assigned to the resident's identification information and information about the facial image to associate each piece of information. Furthermore, the resident registration information receiving means 117 receives visitor registration information, including information about the date and time the resident will move out of the property (moving date and time information). Note that the term "resident" includes those who move out.

The first authentication means 114 authenticates the resident by comparing information about the resident's facial image captured by the imaging device 20 with information about the resident's facial image registered by the resident registration information receiving means 117.

The first authentication means 114 also detects the contours of each facial feature contained in the captured facial image of the resident and the registered facial image of the resident, based on pixel values contained in information related to the facial image of the resident captured by the imaging device 20 and information related to the facial image of the resident registered by the resident registration information receiving means 117. The first authentication means 114 compares the information related to the facial image of the resident captured by the imaging device 20 with each piece of information using the pairing ID as a marker. Here, facial features contained in the facial image include, for example, eyebrows, eyes, nose, mouth, ears, moles, etc.

The first authentication means 114 also compares the contours of the detected captured facial image of the resident with those of the registered facial image of the resident. Based on the comparison results, the first authentication means 114 determines the identity of the person in both facial images based on the degree of similarity of the contours of the detected captured facial image of the resident and the registered facial image of the resident that are being compared.

The first authentication means 114 also calculates the degree of similarity between each image. The degree of similarity is calculated based on, for example, the number of closed curves between the images, the number of closed curves adjacent to the closed curves, and the number of enclosed closed curves. For example, if closed curves within an image are appropriately matched one-to-one within the image and there are no unmatched closed curves, the first authentication means 114 will assign the number of closed curves as a score. Furthermore, if the number of adjacent closed curves (adjacent lines) between the matched closed curves and the number of enclosed closed curves (nested parent curves) match, the first authentication means 114 will add another point to the score. This calculation is performed for all combinations of closed curves, and the maximum score is used as the final score between the images. The higher the score, the greater the degree of similarity between the two images, as determined by the first authentication means 114, in stages according to the score. Furthermore, if the calculated score is equal to or greater than a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person. Furthermore, if the calculated score is below a preset threshold, the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, while leaving open the possibility that they are not the same person.

Furthermore, if the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, it outputs a signal equivalent to permission (permission signal) as authentication. On the other hand, if the first authentication means 114 determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, it outputs a signal equivalent to denial (denial signal) as authentication.

The first authentication means 114 also determines whether the date and time the image of the resident was captured by the imaging device 20 and the move-out date and time received by the resident registration information receiving means 117 satisfy predetermined conditions. For example, the first authentication means 114 determines whether the date the image of the resident was captured by the imaging device 20 in the property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117. The first authentication means 114 also determines whether the time the image of the resident was captured by the imaging device 20 in the property matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117.

If it is determined that the date on which a resident's image was captured by the imaging device 20 in a property matches the move-out date in the move-out date and time information received by the resident registration information receiving means 117, and that the time at which the resident was captured by the imaging device 20 matches or is included in the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117, and that the move-out date and time has not passed (match in date and time information), the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, and if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links the permission signal and information related to the match in the date and time information, and performs processing to output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

Furthermore, if the first authentication means 114 determines that the date on which the image of the resident was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time at which the image of the resident was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period specified to include the move-out time has passed) (mismatch in date and time information), the first authentication means 114 performs processing to not output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30. Alternatively, the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, and if it determines that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 performs processing to link the denial signal and information related to the mismatch in date and time information, or not to link them, and not to output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

Furthermore, if the first authentication means 114 determines that the date on which the image of the resident was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has not arrived), or that the time at which the image of the resident was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has not arrived), or is not included in the time period (the time period specified to include the move-out time has not arrived) (date and time information mismatch), the first authentication means 114 performs processing to link the denial signal and information related to the date and time information mismatch, or without linking them, and not output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30.

On the other hand, if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links information regarding the mismatch between the permission signal and the date and time information, and performs processing to output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30.

When the first authentication means 114 has authenticated the resident, the first entry restriction lifting means 115 lifts the restriction on entry into the specified area imposed by the entry restriction device 30. Also, as shown in FIG. 4, after receiving entry restriction lifting information from the entry restriction device 30, the first entry restriction lifting means 115 notifies the manager that the entry restriction to the property has been lifted by transmitting the entry restriction lifting information to the manager terminal 60.

In addition, when the first entry restriction lifting means 115 receives entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the entry restriction into the specified area, in order to lift the entry restriction imposed by the entry restriction device 30 into the specified area.

When the usage suspension means 118 receives information regarding suspension of usage by a specific resident from the administrator terminal 60, it does not authenticate the resident using the first authentication means 114, even if it receives information regarding a facial image of the resident captured by the imaging device 20.

When the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident, it deletes the information related to the resident's facial image registered by the resident registration information reception means 117, triggered by the receipt of the instruction to delete the registration information of the specific resident.

The programs executed by the control unit 11 are not limited to those stored in the memory unit 12. The programs executed by the control unit 11 may be those transmitted to the control unit 11 from an external device via the communication unit 13, those stored in a storage medium such as a USB memory attached to the computer 10, or those stored in a server separate from the computer 10 (for example, a cloud server).

The memory unit 12 is composed of a hard disk drive (HDD), random access memory (RAM), read-only memory (ROM), or solid state drive (SSD), etc. Various programs are stored in the memory unit 12, including programs executed by the control unit 11. The memory unit 12 also stores information related to facial images and visit date and time information of registered visitors, information related to facial images and identification information of registered tenants, and identification information and information related to facial images of registered employees of real estate agents.

The communication unit 13 is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit 13 is composed of a communication interface configured to communicate with other devices via a communication network such as the Internet.

<Resident terminal 40>
The resident terminal 40 is a smartphone, a portable tablet computer, etc., owned by a resident of the property. The resident terminal 40 has a control unit, a display unit, an operation unit, an imaging unit, a memory unit, and a communication unit (not shown), and these components are electrically connected.

The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

The display unit is, for example, a display, and is used to display input, output, etc. The display can be a known liquid crystal display, etc. The operation unit is a keyboard or operation keys, etc., and is used to perform the above-mentioned input. A touch panel display that serves as both a display unit and an operation unit can also be used. In the following, as an example, input via the operation unit will be performed by touch input. The imaging unit is a camera, etc., that can capture images of the resident's face, identification card, luggage, etc.

The memory unit is composed of an auxiliary storage device such as an HDD or SSD, and stores various data and programs for operating the resident terminal 40. The programs are used to perform various processes, as described below. The control unit is configured to interpret and execute these programs to perform various processes.

The communication unit is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit is composed of a communication interface configured to communicate with other devices via a communication network such as the Internet.

The specific hardware configuration of the resident terminal 40 can be adjusted depending on the embodiment, with components being omitted, replaced, or added as appropriate. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. The resident terminal 40 may also be a terminal dedicated to this system, or it may be used by installing the above-mentioned program on a general-purpose smartphone or similar device.

The following processing is performed on the resident terminal 40. That is, the control unit of the resident terminal 40 loads the program stored in the memory unit into RAM, and then the CPU interprets and executes the program.

<Intermediary terminal 50>
The agent terminal 50 is a personal computer or the like installed in the office of an agent who brokers properties, and an employee of the agent who operates the agent terminal 50 can use the agent terminal 50 to send and receive information to and from the resident terminal 40 and the manager terminal 60. Applications that utilize the system 1 can be downloaded to the agent terminal 50 via the agent terminal 50. The agent terminal 50 also transmits various registration-related information (registration application information) to the computer 10 in this embodiment, and receives various information from the computer 10. The agent terminal 50 also transmits preview reservation information to the computer 10.

<Administrator terminal 60>
The administrator terminal 60 is a smartphone, portable tablet computer, personal computer, or the like installed in the office of the administrator who manages the property in this embodiment. The administrator terminal 60 has a control unit, display unit, operation unit, imaging unit, memory unit, and communication unit (not shown), and these components are electrically connected. The administrator terminal 60 also receives registration application information transmitted from the real estate agent registration means 111. The administrator terminal 60 also allows a user to determine whether to apply for registration based on the received registration application information. If the user approves the registration application, the administrator terminal 60 transmits approval information to the computer 10, as shown in FIG. 2. The administrator terminal 60 also allows a user to output information (information regarding suspension of use) specifying that a specific resident of the property has been suspended or prohibited from using the property. The administrator terminal 60 also allows a user to output information (information regarding deletion of registration information) instructing the system 1 to delete the registration information of a specific resident of the property.

The control unit includes a CPU, RAM, ROM, etc., and is configured to perform various information processing based on programs and data.

The display unit is, for example, a display, and is used to display input, output, etc. The display can be a known liquid crystal display, etc. The operation unit is a keyboard or operation keys, etc., and is used to perform the above-mentioned input. A touch panel display that serves as both a display unit and an operation unit can also be used. In the following, as an example, input via the operation unit will be performed by touch input. The imaging unit is a camera, etc., that can capture images of the resident's face, identification card, etc.

The memory unit is composed of an auxiliary storage device such as an HDD or SSD, and stores various data and programs for operating the resident terminal 40. The programs are used to perform various processes, as described below. The control unit is configured to interpret and execute these programs to perform various processes.

The communication unit is, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc., and includes an interface for wired or wireless communication. In other words, the communication unit is composed of a communication interface configured to communicate with other devices via a communication network such as the Internet.

The specific hardware configuration of the administrator terminal 60 can be adjusted depending on the embodiment, with components being omitted, replaced, or added as appropriate. For example, the control unit may include multiple processors. The control unit may be configured using an FPGA. The storage unit may be configured using RAM and ROM included in the control unit. The administrator terminal 60 may also be a terminal dedicated to this system, or it may be used by installing the above-mentioned program on a general-purpose smartphone or the like.

The following processing is performed on the administrator terminal 60. That is, the control unit of the administrator terminal 60 loads the program stored in the storage unit into RAM, and then the CPU interprets and executes the program.

<Entry Restriction Device 30 and Imaging Device 20>
The entry restriction device 30 and the imaging device 20 are each installed near the entrance to the property. The entry restriction device 30 selectively restricts movement from outside the property to the shared space or the private space. For example, if a door is installed at the entrance to the shared space, the entry restriction device 30 includes a locking device that locks and unlocks the door. Specifically, the locking device normally locks the door installed at the entrance to the shared space, thereby restricting third parties from outside the property from entering the shared space or the private space. On the other hand, if the person whose face image is captured by the imaging device 20 is authenticated as a pre-registered employee, visitor, or resident of the real estate agent based on the facial image information transmitted from the imaging device 20, the entry restriction device 30 (specifically, the locking device) unlocks the door, as shown in FIG. 4 , allowing the real estate agent's employee, visitor, or resident to enter the shared space or the private space from outside the property. Note that the door is unlocked for a predetermined period of time, and the locking device automatically relocks the door after this period has elapsed. After the entrance restriction device 30 has lifted the entrance restriction, it transmits entrance restriction lifting information to the computer 10 as shown in FIG.

Furthermore, if a sliding automatic door is installed at the entrance to the shared space of the property, the entry restriction device 30 includes a sliding device that slides the automatic door. Specifically, the sliding device normally keeps the automatic door in a closed position so that it blocks the entrance to the shared space, thereby restricting third parties from outside the property from entering the shared space. On the other hand, if the person whose face image is captured by the imaging device 20 is authenticated as a pre-registered employee, visitor, or resident of the real estate agent based on the facial image information transmitted from the imaging device 20, the entry restriction device 30 (specifically, the sliding device) slides the automatic door to the open position, thereby unblocking the entrance to the shared space and allowing users such as real estate agent employees, visitors, or resident users to enter the shared space or private space from outside the property. The automatic door remains in the open position for a predetermined period of time, and when this period has elapsed, the sliding device moves the automatic door from the open position back to the closed position.

The entry restriction device 30 includes a control unit 31, a memory unit 32, and a communication unit 33. The control unit 31 is, for example, a CPU, and functions as a second authentication means 310 and a second entry restriction lifting means 311 by executing a program stored in the memory unit 32. The second authentication means 310 verifies whether the person captured by the image capture device 20 is a pre-registered employee, visitor, or resident of the brokerage firm by comparing information about facial images of the agent's employees, visitors, and residents stored in the memory unit 32 with information about facial images transmitted from the image capture device 20. The second entry restriction lifting means 311 lifts the entry restriction on authenticated agents' employees, visitors, and residents into a specified area. The first authentication means 114 and the second authentication means 310, as well as the first entry restriction lifting means 115 and the second entry restriction lifting means 311, are each selectively controlled. In other words, when the first authentication means 114 is applied to the system 1, the second authentication means 310 is not applied, and the operation of the second authentication means 310 is stopped or the second authentication means 310 is not set. Furthermore, when the first entrance restriction release means 115 is applied to the system 1, the second entrance restriction release means 311 is not applied, and the operation of the second entrance restriction release means 311 is stopped or the second entrance restriction release means 311 is not set.

The programs executed by the control unit 31 are not limited to those stored in the memory unit 32. The programs executed by the control unit 31 may be those transmitted to the control unit 31 from an external device via the communication unit 33, those stored in a storage medium such as a USB memory attached to the entrance control device 30, or those stored in a server separate from the entrance control device 30 (for example, a cloud server).

The memory unit 32 is composed of a hard disk drive (HDD), random access memory (RAM), read-only memory (ROM), or solid state drive (SSD), etc. The memory unit stores various programs, including programs executed by the control unit. The memory unit also stores information regarding facial images of registered agents' employees and visitors, as well as information regarding facial images of registered residents.

The imaging device 20 has a control unit 21, an imaging unit 22, and a communication unit 23. The imaging unit 22 and the communication unit 23 are connected to the control unit 21, for example, via a bus. The control unit 21 is a CPU or the like, and controls the imaging unit 22 and the communication unit 23. The imaging unit 22 is a camera or the like capable of capturing facial images of the agent's employees, visitors, and tenants. The communication unit 23 is, for example, a wired LAN (Local Area Network) module or a wireless LAN module, and includes an interface for wired or wireless communication. In other words, the communication unit 23 is composed of a communication interface configured to communicate with other devices via a communication network such as the Internet. Note that the imaging device 20 may not be communicatively connected to the computer 10 via a network such as the Internet, and may be communicatively connected only to the entry control device 30 via a wired or wireless connection.

Next, we will explain the flow of each process in System 1.

(Example 1: Processing flow by an employee of a real estate agent in property viewing operations)
As shown in FIG. 6, first, the agent registration means 111 registers in advance the identification information and facial image information of the agent's employees (step S10).

Next, the person wishing to view the property makes a reservation for viewing the property through the real estate agent. Operated by an employee of the real estate agent, the viewing reservation acceptance means 113 accepts viewing reservation information including the identification information of the employee of the real estate agent and viewing date and time information regarding the date and time of the viewing (step S20).

Next, the first authentication means 114 determines whether the date on which the real estate agent's employee was photographed by the imaging device 20 at the property matches the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, and whether the time on which the real estate agent's employee was photographed by the imaging device 20 matches or is included in the viewing time period in the viewing reservation information accepted by the viewing reservation acceptance means 113 (match or mismatch of date and time information) (step S30).

On the other hand, if the first authentication means 114 determines that the date on which the real estate agent's employee was photographed by the imaging device 20 at the property does not match the viewing date in the viewing reservation information accepted by the viewing reservation acceptance means 113, or that the time on which the real estate agent's employee was photographed by the imaging device 20 does not match the viewing time in the viewing reservation information accepted by the viewing reservation acceptance means 113 or is not included in the time period (mismatch in date and time information), the first authentication means 114 performs a process of linking the denial signal and information related to the mismatch in date and time information, or without linking them, and not outputting restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S40).

If it is determined that the date and time information matches, the first authentication means 114 compares information related to the facial image of the agent's employee captured by the imaging device 20 with information related to the facial image of the agent's employee registered by the agent registration means 111 to authenticate the agent's employee (determine whether the person depicted in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person) (step S50).

Here, if it is determined that the date and time information matches, the first authentication means 114 determines whether the person shown in the captured facial image of the intermediary agent employee and the facial image of the registered intermediary agent employee are the same person. If it is determined that the person shown in the captured facial image of the intermediary agent employee and the facial image of the registered intermediary agent employee are the same person, the first authentication means 114 links the permission signal and information regarding the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S60).

On the other hand, if it is determined that the person shown in the captured facial image of the intermediary agent's employee and the registered facial image of the intermediary agent's employee are not the same person, the first authentication means 114 outputs a denial signal, links the denial signal to information regarding the mismatch in date and time information, or does not link them, and does not output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S70).

Next, when the first entry restriction lifting means 115 receives the entry restriction lifting information output by the first authentication means 114, it sends information to the entry restriction device 30 to lift the restriction on entry into the specified area imposed by the entry restriction device 30. In this way, the entry restriction process for property viewings by employees of the real estate agent in the property viewing business proceeds.

(Example 2: Processing flow for dealing with visitors based on whether they have been authenticated)
As shown in FIG. 7, first, visitor registration information including information on the visitor's facial image and the visit date and time (visit date and time information) is registered in advance by the visitor registration information receiving means 110 (step S80).

Here, the warning notification means 116 determines whether the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within a predetermined period of time has reached a predetermined number or more (step S90). If the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60) (step S100). If the number of times that the visitor registration information accepting means 110 has accepted the visitor's registration information within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns processing to the first authentication means 114.

Next, the first authentication means 114 determines whether the date and time the visitor was imaged by the imaging device 20 at the property and the visit date and time accepted by the visitor registration information accepting means 110 satisfy predetermined conditions (step S110).

Here, if the first authentication means 114 determines that the date on which the visitor was imaged by the imaging device 20 at the property does not match the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, or that the time on which the visitor was imaged by the imaging device 20 does not match the visit time in the visit date and time information accepted by the visitor registration information accepting means 110 or is not included in the time period (date and time information mismatch; specified conditions are not met), the first authentication means 114 performs a process of linking the denial signal and information related to the date and time information mismatch, or without linking them, and not outputting restriction lifting information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S120).

Here, the warning notification means 116 determines whether the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more (step S130). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60) (step S140). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns processing to the first authentication means 114.

If it is determined that the date on which the visitor was imaged by the imaging device 20 at the property matches the visit date in the visit date and time information accepted by the visitor registration information accepting means 110, and that the time at which the visitor was imaged by the imaging device 20 matches the visit time or is included in the time period in the visit date and time information accepted by the visitor registration information accepting means 110 (match in date and time information; predetermined conditions are met), the first authentication means 114 authenticates the visitor by comparing information related to the visitor's facial image taken by the imaging device 20 with information related to the visitor's facial image registered by the visitor registration information accepting means 110 (determines whether the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person) (step S150).

If it is determined that the person shown in the captured visitor's facial image and the registered visitor's facial image are not the same person, the first authentication means 114 outputs a denial signal, links the denial signal to information regarding the mismatch in date and time information, or does not link them, and does not output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S160).

Here, the warning notification means 116 determines whether the number of times that the first authentication means 114 has authenticated the visitor within a predetermined period of time has reached a predetermined number or more (step S170). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has reached a predetermined number or more, the warning notification means 116 sends warning notification information to a predetermined terminal (at least one of the resident terminal 40, the intermediary agent terminal 50, and the manager terminal 60) (step S180). If the number of times that the first authentication means 114 has authenticated the visitor within the predetermined period of time has not reached a predetermined number or more, the warning notification means 116 returns processing to the first authentication means 114.

If it is determined that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person, the first authentication means 114 links the information regarding the match between the permission signal and the date and time information, and outputs restriction release information to release the restriction on entry into the specified area imposed by the entry restriction device 30 (step S190).

Here, if the number of times that the visitor registration information receiving means 110 receives the visitor's registration information or the number of times that the first authentication means 114 performs visitor authentication within a specified period of time does not reach or exceed the specified number, the warning notification means 116 repeats the process until the number of times that the visitor registration information receiving means 110 receives the visitor's registration information or the number of times that the first authentication means 114 performs visitor authentication within the specified period of time reaches or exceeds the specified number.

(Example 3: Processing flow for suspending or deleting registered information of resident who has already moved out)
8, first, the resident's identification information and facial image information are registered in advance by the resident registration information receiving means 117. Also, the resident registration information receiving means 117 registers visitor registration information in advance, including information on the date and time when the resident will leave the property (moving date and time information) (step S200).

Next, the first authentication means 114 determines whether the date and time the image of the resident was captured by the imaging device 20 and the move-out date and time received by the resident registration information receiving means 117 meet predetermined conditions (step S210).

Here, if the first authentication means 114 determines that the date on which the image of the resident was captured by the imaging device 20 in the property does not match the move-out date in the move-out date and time information received by the resident registration information receiving means 117 (the move-out date has passed), or that the time at which the image of the resident was captured by the imaging device 20 does not match the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (the move-out time has passed), or is not included in the time period (the time period specified to include the move-out time has passed) (date and time information mismatch; specified conditions are not met), the first authentication means 114 links the denial signal and information related to the date and time information mismatch, or does not link them, and does not output restriction release information for lifting the restriction on entry into the specified area imposed by the entry restriction device 30 (step S220).

Next, the first authentication means 114 authenticates the resident (determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person) by comparing information about the facial image of the resident captured by the imaging device 20 with information about the facial image of the resident registered by the resident registration information receiving means 117 (step S230).

Here, if it is determined that the date on which the image of the resident was captured by the imaging device 20 in the property matches the move-out date and time in the move-out date and time information received by the resident registration information receiving means 117, and the time at which the image of the resident was captured by the imaging device 20 matches or is within the time period of the move-out time in the move-out date and time information received by the resident registration information receiving means 117 (matching of date and time information; if a specified condition is met (if the move-out date and time has not passed)), the first authentication means 114 determines whether the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person. If it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are the same person, the first authentication means 114 links the permission signal and information related to the match in the date and time information, and outputs restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S240).

On the other hand, if it is determined that the person shown in the captured facial image of the resident and the registered facial image of the resident are not the same person, the first authentication means 114 outputs a denial signal, links the denial signal to information regarding the mismatch in date and time information, or does not link them, and does not output restriction release information to lift the restriction on entry into the specified area imposed by the entry restriction device 30 (step S250).

If restriction lifting information for lifting the restriction on entry into a specified area imposed by the entry restriction device 30 is not output, the usage suspension means 118 receives information regarding the suspension of usage by a specific resident from the administrator terminal 60 (step S260), and thereafter does not authenticate the resident using the first authentication means 114 even if it receives information regarding the resident's facial image captured by the imaging device 20 (step S270).

Furthermore, when the resident registration information deletion means 119 receives an instruction from the administrator terminal 60 to delete the registration information of a specific resident (step S280), the receipt of the instruction to delete the registration information of the specific resident triggers the deletion of the information relating to the resident's facial image registered by the resident registration information reception means 117 (step S290).

According to the system 1, program, and information processing method of the present embodiment configured as described above, the system 1 comprises an entry restriction device 30 that selectively restricts entry into a predetermined area, an imaging device 20 that captures facial images of users whose entry restriction into the predetermined area by the entry restriction device 30 should be lifted, and a computer 10. By executing the program, the system 1 functions as a visitor registration information receiving means 110, an authentication means (first authentication means 114), an entry restriction lifting means (first entry restriction lifting means 115), and a warning notification means 116. The visitor registration information receiving means 110 receives visitor registration information including information related to the visitor's facial image and visit date and time information, and the authentication means (first authentication means 114) receives the visitor's facial image captured by the imaging device 20. The visitor is authenticated by comparing information about the facial image with information about the visitor's facial image registered by the visitor registration information accepting means 110. The entry restriction release means (first entry restriction release means 115) releases the restriction on entry into the specified area imposed by the entry restriction device 30 when the visitor is authenticated by the authentication means (first authentication means 114) and the date and time the visitor was imaged by the imaging device 20 and the visit date and time in the registration information accepted by the visitor registration information accepting means 110 satisfy a predetermined condition. The warning notification means 116 sends warning notification information to a predetermined terminal when the number of times the visitor registration information accepting means 110 accepts the visitor's registration information or the number of times the authentication means (first authentication means 114) authenticates the visitor reaches a predetermined number within a predetermined period. Conventionally, techniques have been known in which a security device monitors abnormalities in a guarded building. For example, the security device monitors abnormalities in a guarded building, and when it detects an abnormality, it reports it to a security center, and necessary measures, such as dispatching a security guard to the building, are taken. However, this technology detects abnormalities and reports them to a security center, and does not use the results of authentication using a visitor's facial image. According to the system 1, program, and information processing method of this embodiment, it is possible to issue a warning based on the number of visitor authentications and the number of times registration information has been received.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the visitor registration information accepting means 110 may form facial image feature data. In this case, the system 1 can use facial image data that indicates the facial features of a person.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the feature data of a facial image may be a collection of pixel values of pixels corresponding to the facial image. In this case, the values of pixels, which are the smallest elements that make up an image, can be used, making it easy to process the information contained in pixels, and therefore image processing can be performed easily.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the visitor registration information accepting means 110 may form one of a hash value, a checksum, or binarized compressed data of the feature amount data of the facial image. In this case, it becomes possible to further process the image.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may detect the contours of each facial feature contained in the captured visitor's facial image and the registered visitor's facial image, based on pixel values contained in information relating to the visitor's facial image captured by the imaging device 20 and information relating to the visitor's facial image registered by the visitor registration information receiving means 110. In this case, it is possible to compare facial images based on multiple facial features shown in the facial image, allowing for a detailed comparison.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may compare the contour lines of the detected captured visitor's facial image with those of a registered visitor, and determine whether the person depicted in the captured visitor's facial image and the registered visitor's facial image are the same person based on the degree of similarity of the compared contour lines. In this case, authentication can be performed with a certain level of accuracy even if there are slight changes in the face of the person being compared.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may grant permission as authentication when it determines that the person shown in the captured visitor's facial image and the registered visitor's facial image are the same person. In this case, restrictions can be lifted based on the degree of similarity.

Furthermore, in the system 1, program, and information processing method according to this embodiment, as described above, the authentication means (first authentication means 114) may deny authentication if it determines that the person shown in the captured facial image of the visitor and the registered facial image of the visitor are not the same person. In this case, processing can be performed to maintain the restrictions based on the degree of similarity.

Note that the system 1 according to this embodiment is not limited to the above-described configuration, and various modifications can be made.

For example, in this embodiment, even if the date and time information does not match, a determination is made as to whether the person depicted in the captured facial image of the agent's employee and the registered facial image of the agent's employee are the same person, but in this case, such a determination does not need to be made.

1: System 10: Computer 11: Control unit 12: Memory unit 13: Communication unit 20: Imaging device 21: Control unit 22: Imaging unit 23: Communication unit 30: Entry restriction device 31: Control unit 32: Memory unit 33: Communication unit 40: Tenant terminal 50: Real estate agent terminal 60: Manager terminal 110: Visitor registration information acceptance means 111: Real estate agent registration means 112: Preview available date and time presentation means 113: Preview reservation acceptance means 114: First authentication means 115: First entry restriction release means 116: Warning notification means 117: Tenant registration information acceptance means 118: Usage suspension means 119: Tenant registration information deletion means 120: Employee registration information deletion means 121: Visitor registration information deletion means 310: Second authentication means 311: Second entry restriction release means

Claims (10)

an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
A system comprising:
The system functions as a visitor registration information receiving means, an authentication means, an admission restriction lifting means, and a warning notification means by executing a program,
the visitor registration information receiving means receives information relating to a face image of the visitor and information on the visit date and time of the visitor;
the authentication means performs authentication of the visitor by comparing information about the visitor's facial image captured by the imaging device with information about the visitor's facial image registered by the visitor registration information accepting means;
the entry restriction release means releases the restriction on entry into the specified area imposed by the entry restriction device when the authentication means authenticates the visitor and determines that the person shown in the captured face image of the visitor and the person shown in the registered face image of the visitor are the same person, and when the date and time the visitor was captured by the imaging device and the visit date and time accepted by the visitor registration information acceptance means satisfy a specified condition;
the warning notification means transmits warning notification information to a predetermined terminal when the number of times that the visit date and time information is received by the visitor registration information receiving means within a predetermined period of time reaches or exceeds a predetermined number.
system. the visitor registration information accepting means forms feature amount data of the facial image;
The system of claim 1 . the feature amount data of the face image is a set of pixel values of pixels corresponding to the face image;
The system of claim 2 . the visitor registration information accepting means forms one of a hash value, a checksum, and binarized compressed data of the feature amount data of the face image;
The system of claim 1 . the authentication means detects contours of each facial part included in the captured visitor's facial image and the registered visitor's facial image based on pixel values included in information about the visitor's facial image captured by the imaging device and information about the visitor's facial image registered by the visitor registration information accepting means;
The system of claim 1 . the authentication means compares the contour lines of the detected captured visitor's face image with those of the registered visitor, and determines whether the person shown in the captured visitor's face image and the registered visitor's face image are the same person based on the degree of similarity of the contour lines of the compared objects;
The system of claim 5. When the authentication means determines that the person shown in the captured face image of the visitor and the person shown in the registered face image of the visitor are the same person, the authentication means performs authorization.
The system of claim 6. the authentication means denies the authentication when it determines that the person shown in the captured face image of the visitor and the person shown in the registered face image of the visitor are not the same person;
The system of claim 6. an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
A program that causes a control unit of a system to function as a visitor registration information receiving means, an authentication means, an admission restriction release means, and a warning notification means when executed by the control unit of the system,
the visitor registration information receiving means receives information relating to a face image of the visitor and information on the visit date and time of the visitor;
the authentication means performs authentication of the visitor by comparing information about the visitor's facial image captured by the imaging device with information about the visitor's facial image registered by the visitor registration information accepting means;
the entry restriction release means releases the restriction on entry into the specified area imposed by the entry restriction device when the authentication means authenticates the visitor and determines that the person shown in the captured face image of the visitor and the person shown in the registered face image of the visitor are the same person, and when the date and time the visitor was captured by the imaging device and the visit date and time accepted by the visitor registration information acceptance means satisfy a specified condition;
the warning notification means transmits warning notification information to a predetermined terminal when the number of times that the visit date and time information is received by the visitor registration information receiving means within a predetermined period of time reaches or exceeds a predetermined number.
program. an entrance control device that selectively restricts entrance into a predetermined area;
an imaging device that captures a face image of a user whose entry restriction into a predetermined area by the entry restriction device should be lifted;
A computer,
An information processing method executed by a control unit of a system comprising:
Accepting information regarding the visitor's facial image and information regarding the visitor's visit date and time,
The visitor is authenticated by comparing information about the visitor's facial image captured by the imaging device with information about registered visitor facial images ;
When the visitor is authenticated and it is determined that the person shown in the captured facial image of the visitor and the registered facial image of the visitor are the same person, and the date and time when the visitor was captured by the imaging device and the accepted date and time of the visit satisfy a predetermined condition, the restriction on entry into the predetermined area imposed by the entry restriction device is lifted;
An information processing method, wherein when the number of times the visit date and time information is received within a predetermined period of time reaches or exceeds a predetermined number, warning notification information is transmitted to a predetermined terminal that has been set in advance.