JP5001194B2 - Entrance management system - Google Patents

Description

The present invention relates to an entry management system that uses a plurality's co-face authentication equipment to authenticate more than one person of entry seekers at the same time.

  Conventionally, in an entrance management system provided in a building or the like, an individual's physical characteristics, for example, the iris of the face or eyes are read to confirm the identity of the person, and only when the person is a pre-registered admitted person Is allowed to enter. In this room management system, when a plurality of people enter the room at a time, the physical characteristics are read one by one to confirm the identity of the person. There is a problem.

  On the other hand, it is conceivable to allow a plurality of people to enter the room at the same time only by confirming one person's identity. However, if multiple persons are allowed to enter the room at the same time only by confirming one person's identity, there is a possibility that a suspicious person will be mixed into the plurality of persons. Therefore, for example, in the entrance management system disclosed in Patent Document 1, an input means for inputting the number of people entering the room and a counting means for counting the number of people actually entering the room are provided, and after the identity of one person is confirmed, the room is entered. The door is unlocked, and then the entrance door is locked when the number of persons counted by the counting means reaches the number of persons input from the input means.

JP 2001-40963 A Japanese Patent Laid-Open No. 10-134188 JP 2007-164668 A

  However, in the entrance management system disclosed in Patent Document 1 described above, one person is confirmed, but the other person is not confirmed, and only the number of persons entering the room is checked. There is a risk of allowing unintended people to enter the room.

The present invention has been made to solve such problems, and the object of the present invention is to strictly limit the entry of unauthorized persons when permitting the entry of a plurality of persons at once. and to provide a that entrance room management system.

In order to achieve such an object, an entrance management system according to the present invention includes an imaging unit that simultaneously captures a face image of a plurality of applicants, and all members included in the image from the images captured by the imaging unit. Multiple-person simultaneous face comprising: a face image extracting means for extracting a face image of the person and a face image collating means for collating each face image extracted by the face image extracting means with a face image of a person permitted to enter the room The authentication device, the control device that unlocks the entrance door only when it is determined that the authentication is successful by the multiple face authentication device, and the actual number of people who want to enter the room located in a predetermined area in front of the entrance door The simultaneous face authentication apparatus for detecting the number of persons includes a number of face images extracted by the face image extracting means and a real number of persons who wish to enter the room detected by the real number detecting means. Match If not, the means for determining that authentication is unsuccessful, the number of face images of all the members extracted by the face image extracting means, and the actual number of people who want to enter the room detected by the actual number detecting means match, and the face And an authentication unit that determines that the authentication is successful only when the face image collation unit confirms that all the face images extracted by the image extraction unit match the face image of the person permitted to enter the room.

According to the present invention, the actual number of people who want to enter the room located in a predetermined area in front of the entrance door is detected, while the face images of a plurality of people who want to enter the room are taken at the same time. The face images of all the members included in the image are extracted from the images, and each of the extracted face images is collated with the face image of the person permitted to enter the room registered in advance. Here, it is confirmed that the number of extracted face images of all the persons coincides with the detected actual number of people who want to enter the room, and that all the extracted face images match the face images of the person permitted to enter the room. Then, it is determined that the authentication is successful, and the entrance door is unlocked. As a result, when allowing a plurality of people to enter the room at once, the entry of unauthorized persons is severely restricted.
In the present invention, it is determined that the authentication is unsuccessful when the number of extracted face images of all the persons does not match the detected actual number of people who want to enter the room. In this way, when capturing the face images of multiple people who want to enter the room at the same time, for example, if there is a person who is hidden in the shadow of the person or crouched so that it does not appear intentionally Since the number of face images of all the members and the actual number of people who wish to enter the room do not match, even if the face images of all the members extracted from the captured images match the face image of the person permitted to enter the room, it is determined that the authentication is successful. There is nothing to do.

In the entrance management system of the present invention , the multiple-person simultaneous face authentication device extracts the face images of all persons included in the image from the captured image, but this face image may be a two-dimensional face image, It may be a three-dimensional face image. In the case of a two-dimensional face image, for example, there is a possibility that the face of a person image in a poster pasted on a wall is erroneously extracted as a face image. On the other hand, when a three-dimensional face image is used, only an actual human face having irregularities is extracted, and there is no possibility that the face of the person image in the poster is erroneously extracted as a face image.

  When the face image to be extracted is a three-dimensional face image, as the imaging unit, a first imaging unit that simultaneously images the face images of a plurality of people who want to enter the room from one direction, and a direction different from the first imaging unit Second imaging means for simultaneously capturing the face images of a plurality of people who want to enter the room, and as the face image extracting means, a three-dimensional image is obtained from the image captured by the first imaging means and the image captured by the second imaging means. 3D image creating means for creating an image, and 3D face image for extracting all 3D face images included in the image from the 3D image created by the 3D image creating means as face images of all members An extraction means may be provided.

According to the present invention, while detecting the actual number of people who want to enter the room in the predetermined area in front of the entrance door, the face images of a plurality of people who want to enter the room are picked up at the same time. All face images included in the image are extracted, and each extracted face image is collated with the face image of the person permitted to enter the room in advance. The number of face images of all the extracted face images is determined to be authentication success only when the actual number of the person matches and all the extracted face images are confirmed to match the face images of the person permitted to enter the room. If the actual number of people who want to enter the room does not match, it is judged that the authentication is unsuccessful. To be able to limit.

  Hereinafter, the present invention will be described in detail with reference to the drawings.

[ Reference Example 1 ]
FIG. 1 is a diagram showing a main part of a reference example (reference example 1) before entering into the description of an embodiment of a room entrance management system using a multiple-person simultaneous face authentication apparatus according to the present invention. In the figure, 1 is a multiple face recognition device, 2 is a control device, 3 is an entrance door, and 4 is an electric lock provided for the entrance door. The multi-person simultaneous face authentication device 1 and the electric lock 3 are connected via the control device 2.

  In this room entry management system, the multiple-person simultaneous face authentication device 1 includes a CPU 1A, a RAM 1B, a ROM 1C, a storage device 1D, a CCD camera 1E, a display device 1F, and interfaces 1G to 1I.

The CPU 1A operates according to a program stored in the ROM 1C while accessing the RAM 1B. The ROM 1C stores a multiple face authentication program . In addition, a face image of a person who is permitted to enter the room is stored in the storage device 1D. In this example, the number of registered entry permitters is N, and one two-dimensional face image is stored for each of the N entry permitters.

FIG. 7 shows a functional block diagram of the main part of the multiple-person simultaneous face authentication device 1 in the entrance management system of the first reference example . In this entrance management system, the multiple-person simultaneous face authentication device 1 includes an imaging unit 1-1 including a camera that simultaneously captures face images of a plurality of people who wish to enter the room, and an image captured by the imaging unit 1 A face image extraction unit 1-2 that extracts the face images of all members included in the image, a storage unit 1-3 that stores a two-dimensional face image of a person who has been registered in advance, and a face image extraction unit 1- Face image collation unit 1-4 that collates each face image (extracted face image) extracted by step 2 with the face image (registered face image) of the person permitted to enter the room stored in the storage unit 1-3, and all extraction Only when it is confirmed that the face image matches the registered face image, the authentication is determined to be successful, and when any one of the extracted face images does not match the registered face image, the authentication is unsuccessful. And an authentication unit 1-5 for judging. In this multiple-person simultaneous face authentication device 1, the face image extraction unit 1-2, the face image collation unit 1-4, and the authentication unit 1-5 are realized as processing functions of the CPU 1A.

  Hereinafter, with reference to the flowchart shown in FIG. 2, the processing operation executed by the CPU 1A in accordance with the multiple face authentication program will be described.

  Now, it is assumed that a plurality of people who wish to enter the room stand in front of the CCD camera 1E and perform an operation to the effect that they want to enter the multiple-face simultaneous face authentication device 1. In response to this, the CPU 1A sends an imaging command to the CCD camera 1E, and simultaneously captures the face images of a plurality of people who want to enter the room standing in front of the CCD camera 1E (step S101).

  The CPU 1A captures an image captured by the CCD camera 1E, and extracts the face images of all members included in the image from the captured image (step S102). In this example, for example, using the technique disclosed in Patent Document 2, a two-dimensional face image included in the image is extracted. At this time, the number of extracted two-dimensional face images (hereinafter referred to as extracted face images) is t.

  Next, the CPU 1A sets n = 1 (step S103), and reads the face images (two-dimensional face images (hereinafter referred to as registered face images)) of N room-permitted persons stored in the storage device 1D. (Step S104). Then, after confirming that n> t is not satisfied (NO in step S105), the collation (1: N collation) between the n = 1 extracted face image and the N registered face images is performed (step S106).

  In the collation between the n = 1 extracted face image and the N registered face images, if the collation score exceeds the threshold th (YES in step S107), n of the N registered face images = Assuming that a face image matching the first extracted face image has been confirmed, n = n + 1 = 2 is set (step S108), and the process returns to step S105, where n = 2nd extracted face image and N registered faces The image is collated (step S106).

  In the collation between the n = 2nd extracted face image and the N registered face images, if the collation score exceeds the threshold th (YES in step S107), n of the N registered face images = Assuming that a face image matching the second extracted face image has been confirmed, n = n + 1 = 3 is set (step S108), and the process returns to step S105.

  Here, for example, if the number t of extracted face images is two, n> t (YES in step S105), the CPU 1A confirms that all the extracted face images match the registered face images, and authenticates. And “authentication OK” is displayed on the screen of the display device 1F (step S110). Further, a predetermined signal is transmitted to the control device 2 to notify that the authentication is successful (step S111). Upon receiving the notification of successful authentication, the control device 2 sends an unlocking command to the electric lock 4 and unlocks the entrance door 3.

  In this example, the number t of extracted face images is two. Similarly, when t ≧ 3, if all the extracted face images are confirmed to match the registered face images, it is determined that the authentication is successful. Is done. On the other hand, if any one of the extracted face images does not match the registered face image (NO in step S107), the CPU 1A determines that the authentication is unsuccessful and displays “authentication NG” on the display device 1F. It is displayed on the screen (step S109).

As described above, in Reference Example 1 , it is determined that the authentication is successful only when all the extracted face images match the registered face image, and even one of the extracted face images does not match the registered face image. In this case, it is determined that the authentication is unsuccessful, and when a plurality of persons are allowed to enter the room at one time, the entry of unauthorized persons can be strictly restricted.

  In the flowchart shown in FIG. 2, a two-dimensional face image is extracted from the image captured by the CCD camera 1E in step S102. However, a three-dimensional face image is not a two-dimensional face image. You may make it extract. In the case of a two-dimensional face image, for example, there is a possibility that the face of a person image in a poster pasted on a wall is erroneously extracted as a face image. On the other hand, if the face image to be extracted is a three-dimensional face image, only the actual human face with unevenness is extracted, and the face of the person image in the poster may be erroneously extracted as a face image. This disappears.

[ Reference Example 2 ]
FIG. 3 shows a main part of the entrance management system when a three-dimensional face image is extracted as Reference Example 2 . In the case of extracting a three-dimensional face image, two CCD cameras 1E1 and 1E2 are provided. The CCD camera 1E1 simultaneously captures face images of a plurality of people who want to enter the room from one direction, and the CCD camera 1E2 and the CCD camera 1E1. Takes images of the faces of a plurality of applicants from different directions at the same time.

Further, in the process according to the simultaneous face authentication program of the CPU 1A, a three-dimensional image is created from an image captured by the CCD camera 1E1 and an image captured by the CCD camera 1E2, for example, using the technique disclosed in Patent Document 3. Then, all the three-dimensional face images included in the created three-dimensional image are extracted as the face images of all members. Further, the storage device 1D stores a three-dimensional face image as a registered face image. In this Example 2, in the same manner as in Reference Example 1, according to the flowchart shown in FIG. 2, performing the successful authentication / unsuccessful determination.

FIG. 8 shows a functional block diagram of a main part of the multiple face authentication device 1 in the room entrance management system of the reference example 2 . In this entrance management system, the multiple-person simultaneous face authentication device 1 includes a first imaging unit 1-6 including a camera that simultaneously captures face images of a plurality of people who want to enter the room from one direction, and the first imaging unit 1 The second imaging unit 1-7 including a camera that simultaneously captures face images of a plurality of people who want to enter the room from a direction different from -6, the image captured by the first imaging unit 1-6, and the second imaging unit 1 A three-dimensional image creation unit 1-8 that creates a three-dimensional image from the image captured by -7, and all three included in the image from the three-dimensional image created by the three-dimensional image creation unit 1-8 3D face image extraction unit 1-9 that extracts a 3D face image as a face image of all members, a storage unit 1-10 that stores a 3D face image of a person who has been registered in advance, and a 3D face Each face image (extracted face image) extracted by the image extraction unit 1-9 is stored in the storage unit 1- Authentication is successful only when the face image matching unit 1-11 that matches the face image (registered face image) of the person permitted to be stored stored in 0 and the registered face image for all the extracted face images are confirmed to match. And an authentication unit 1-12 that determines that the authentication is unsuccessful if any one of the extracted face images does not match the registered face image. In this multiple-person simultaneous face authentication device 1, the 3D image creation unit 1-8, the 3D face image extraction unit 1-9, the face image collation unit 1-11, and the authentication unit 1-12 are realized as processing functions of the CPU 1A. The Further, the three-dimensional image creation unit 1-8 and the three-dimensional face image extraction unit 1-9 constitute the face image extraction means referred to in the present invention.

Embodiment
In the reference examples 1 and 2 described above, when simultaneously capturing the face images of a plurality of people who want to enter the room, for example, when there is a person who hides in the shadow of the person or crouches so that it does not appear intentionally, It may be determined that authentication is successful. On the other hand, as shown in FIG. 4, the real number detection means 5 for detecting the real number tR of the person who wants to enter the room located in the predetermined area AR1 in front of the entrance door 3 is provided, and a multiple person simultaneous face authentication device is provided. 1, the number t of all face images extracted from the captured face image is compared with the actual number tR of the person who wants to enter the room detected by the real number detection means 5, and authentication is performed when the two do not match. If it is determined as unsuccessful, it is possible to prevent the authentication from being determined as successful. The system configured as described above is the room entry management system of the present embodiment.

  For example, as the real number detection means 5, a CCD camera is provided on the upper surface of the area AR1. An image of the head of the person who wants to enter the room is extracted from the image captured by the CCD camera, and the actual number tR of persons who wish to enter the room located in the area AR1 is counted from the extracted image of the head. In the multiple-person simultaneous face authentication device 1, in the process according to the multiple-person simultaneous face authentication program of the CPU 1A, for example, as shown in FIG. 5, step S112 is provided between step S105 and step S110, and the number t of extracted face images The actual number tR of the person who wants to enter the room is compared. If the number t of the extracted face images and the actual number tR of the person who wants to enter the room do not match (NO in step S112), it is determined that the authentication is unsuccessful (step S109). . As a result, even if the extracted face images of all coincide with the registered face images, it is not determined that the authentication is successful, and the suspicious person can be prevented from entering the room.

  In FIG. 5, step S112 is provided between step S105 and step S110. However, as shown in FIG. 6, step S112 may be provided between step S102 and step S103. In this way, after the face image is extracted from the image captured by the CCD camera 1E, if the number t of the extracted face images does not match the actual number tR of people who want to enter the room, it is immediately determined that the authentication has failed. Will be.

It is a figure which shows the principal part of the reference example (reference example 1) before starting description of embodiment of the entrance management system using the multiple person simultaneous face authentication apparatus which concerns on this invention. It is a flowchart which shows the processing operation according to the multiple person simultaneous face authentication program which CPU of the multiple person simultaneous face authentication apparatus in this room entrance management system performs. It is a figure which shows the principal part of the entrance management system ( reference example 2 ) at the time of making it extract a three-dimensional face image. It is a figure which shows the example which provided the real number detection means which detects the real number of persons who wish to enter the room located in the predetermined area in front of the entrance door. It is a flowchart which shows an example of the processing operation according to the multiple person simultaneous face authentication program which CPU of a multiple person simultaneous face authentication apparatus at the time of providing a real number detection means. It is a flowchart which shows another example of the processing operation according to the multiple person simultaneous face authentication program which CPU of a multiple person simultaneous face authentication apparatus at the time of providing a real number detection means. It is a functional block diagram of the principal part of the multiple-person simultaneous face authentication apparatus in the entrance management system of Reference Example 1 . It is a functional block diagram of the principal part of the multiple-person simultaneous face authentication apparatus in the entrance management system of the reference example 2 .

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Multiple-person simultaneous face authentication apparatus, 1A ... CPU, 1B ... ROM, 1C ... RAM, 1D ... Storage device, 1E, 1E1,1E2 ... CCD camera, 1F ... Display device, 1G-1J ... Interface, 2 ... Control device DESCRIPTION OF SYMBOLS 3 ... Entrance door, 4 ... Electric lock, 5 ... Real number detection means, AR1 ... Predetermined area, 1-1 ... Imaging part, 1-2 ... Face image extraction part, 1-3 ... Memory | storage part, 1-4 ... face image matching unit, 1-5 ... authentication unit, 1-6 ... first imaging unit, 1-7 ... second imaging unit, 1-8 ... 3D image creation unit, 1-9 ... 3D face image extraction Unit, 1-10... Storage unit, 1-11... Face image matching unit, 1-12.

Claims (2)

By means of imaging means for simultaneously capturing the face images of a plurality of people who wish to enter the room, face image extracting means for extracting the face images of all members included in the images from the images taken by the imaging means, and the face image extracting means A multiple-person simultaneous face authentication device comprising face image matching means for matching each extracted face image with a face image of a person permitted to enter the room registered in advance;
A control device that unlocks the entrance door only when it is determined that the authentication is successful by the multiple face authentication device;
An actual number detecting means for detecting the actual number of persons who want to enter the room located in a predetermined area in front of the entrance door;
The multiple-person simultaneous face authentication device
Means for determining that the authentication is unsuccessful if the number of face images of all persons extracted by the face image extraction means and the actual number of persons who wish to enter the room detected by the real number detection means do not match;
The number of face images of all persons extracted by the face image extracting means matches the actual number of people who want to enter the room detected by the real number detecting means, and all the face images extracted by the face image extracting means An entrance management system, comprising: an authentication unit that determines that authentication is successful only when a face image matches the face image of the person permitted to enter the room by the face image matching unit . In the entrance management system according to claim 1,
The imaging means includes
First imaging means for simultaneously imaging the face images of the plurality of people who want to enter the room from one direction;
A second imaging unit that simultaneously captures the face images of the plurality of people who want to enter the room from a direction different from the first imaging unit;
The face image extraction means includes
3D image creation means for creating a 3D image from the image captured by the first imaging means and the image captured by the second imaging means;
3D face image extracting means for extracting all 3D face images included in the 3D image created by the 3D image creating means as the face images of all the members. Entrance management system .

Images