JP6704433B2 - Access control server and access control system - Google Patents

Description

The present invention relates to an authentication method for entering/leaving a room.

Conventionally, as a room entrance/exit management system, a system using a non-contact type IC card has been used.
When using a non-contact IC card, it is necessary to hold the card when passing through the gate, which is inconvenient if there is baggage.
Patent Document 1 discloses an automatic gate system that does not require the operation of holding a card.

JP, 2003-331323, A

However, in Patent Document 1, although the passage permission is performed by determining the face data stored in the IC card and the data captured by the camera, the personal identification is performed only once, and the security is sufficient. It can not be said.
In order to improve security, it is possible to add a new authentication method. For example, it is conceivable to prepare a key for a new authentication method, but this requires management of a new resource.

The present invention has been made in consideration of the above points, and an object of the present invention is to improve security in an entry/exit management system that ensures convenience without requiring additional resources for authentication.

The entry/exit management server is an entry/exit management server connected to a camera and a receiver via a network, and extracts the first authentication information and the second authentication information from the image of the user captured by the camera. The encrypted third authentication information for identifying the user is acquired from the feature point extraction unit to be extracted and the receiver, and the third authentication information is decrypted by the first authentication information and decrypted. The third authentication information is compared with the second authentication information to authenticate the user's entry/exit.

When the third authentication information and the second authentication information match, the authentication unit permits the user to enter and leave the room, and the third authentication information and the second authentication information do not match. In this case, users are not allowed to enter or leave the room.

The feature point extraction unit extracts the third authentication information and the fourth authentication information from an image of a user, and stores the third authentication information encrypted with the fourth authentication information. A mobile card issuing unit that creates a mobile card and a signal receiving unit that acquires a signal emitted by the mobile card from the receiver are provided.

The positional relationship of biometric information from the image of the user is used as the first authentication information and the second authentication information.

The signal reception unit stores the encrypted third authentication information acquired from the receiver, and the feature point extraction unit extracts an image of the user every time the image of the user is captured. The first authentication information and the second authentication information are extracted, and the authentication unit decrypts the third authentication information imaged by the feature point extraction unit with the first authentication information, and decrypts the third authentication information. By comparing the generated third authentication information and the second authentication information, the user's entry/exit authentication is performed, and the user's entry/exit authentication is not confirmed. Authentication is repeated for a while.

Furthermore, when the authentication unit determines that the user is allowed to enter or leave the room, the authentication unit instructs a gate connected to the room entrance/exit management server via the network to open the gate, or When it is determined that the user is not allowed to enter or leave the room, the gate is instructed to be closed.

The entry/exit management display terminal includes a feature point extraction unit that extracts the first authentication information and the second authentication information from the captured image of the user, and an encrypted third feature that identifies the user from the receiver. Of the user by decrypting the third authentication information with the first authentication information and comparing the decrypted third authentication information with the second authentication information. A display terminal connected via a network to an entry/exit management server including an entry/exit authentication unit, which receives a user entry/exit authentication result from the entry/exit management server, An alert display unit for displaying the authentication result on the screen is provided.

According to the present invention, it is possible to improve security without requiring additional resources for authentication while ensuring convenience.

1 is a configuration diagram of a room entry/exit management system 1 according to the first embodiment. FIG. 3 is a configuration diagram of an entry/exit management server 10 according to the first embodiment. FIG. 3 is a configuration diagram of a room entry/exit management registration terminal 70 according to the first embodiment. FIG. 6 is a flow chart of a mobile card creation process according to the first embodiment. FIG. 6 is a flow chart of a mobile card creation process according to the first embodiment. FIG. 3 is a flow chart showing entry/exit management of entry/exit management processing according to the first embodiment. FIG. FIG. 3 is a flow chart showing entry/exit management of entry/exit management processing according to the first embodiment. FIG. Explanatory drawing of the user table 151 and contract content table 152 which concern on Embodiment 1. FIG. FIG. 3 is an explanatory diagram of first authentication information and fourth authentication information according to the first embodiment. FIG. 3 is an explanatory diagram of second authentication information and third authentication information according to the first embodiment. 6 is an explanatory diagram of a feature point table 153 according to the first embodiment. FIG. Explanatory drawing of the mobile card table 154 which concerns on Embodiment 1. FIG. Explanatory drawing of the feature point information table 155 which concerns on Embodiment 1. FIG. 1 is a configuration diagram of a room entry/exit management system 1 according to the first embodiment. The block diagram of the entrance/exit management system 1 which concerns on Embodiment 2. FIG. 6 is an explanatory diagram of a room entry/exit management display terminal 80 according to the second embodiment. FIG. 9 is a flow chart showing entry/exit management of entry/exit management processing according to the second embodiment. FIG. 9 is a flow chart showing entry/exit management of entry/exit management processing according to the second embodiment. FIG. 9 is a flow chart showing entry/exit management of entry/exit management processing according to the second embodiment. FIG. 6 is an explanatory diagram of a signal information table 156 according to the second embodiment. Explanatory drawing of the inspection result table 157,857 which concerns on Embodiment 2. FIG.

Embodiment 1.
In the first embodiment, a room entry/exit management system 1 for managing users who enter and exit a ticket gate of a railway company will be described.
***Description of structure***
The configuration of the entry/exit management system 1 according to the first embodiment will be described with reference to FIG.
The entrance/exit management system 1 includes an entrance/exit management server 10, a mobile card 20, a camera 30, a receiver 40, a gate 50, and an entrance/exit management registration terminal 70. The entry/exit management server 10, the camera 30, the receiver 40, the gate 50, and the entry/exit management registration terminal 70 are connected via a network 60.

The entry/exit management server 10 and the entry/exit management registration terminal 70 are computers that provide entry/exit management services. The entry/exit management server 10 is usually installed in a place such as a company that provides a service or a data center used by a company that provides a service. The entry/exit management registration terminal 70 is installed in the company that provides the service, but may be installed in the same LAN as the camera 30 and the receiver 40.
The room entry/exit management registration terminal 70 is a computer used by a user, such as a PC (Personal Computer).
The mobile card 20 is a card in which an integrated circuit is incorporated. Information that can identify a user is recorded, and communication with the receiver 40 is possible through a predetermined interface. Specifically, it is a beacon card. It may be an RFID card or the like as long as it can communicate with the receiver 40.
The camera 30 is an imaging device for capturing a video of the user.
The receiver 40 is a device capable of communicating with the mobile card 20 through a predetermined interface. The gate 50 is connected to the entrance/exit management server 10 via the network 60, and is a device that restricts the entrance/exit of a user by opening/closing the gate 50 according to an instruction from the entrance/exit management server 10.
The network 60 is a transmission path that connects the entry/exit management server 10, the camera 30, the receiver 40, and the entry/exit management registration terminal 70, and enables communication through a predetermined interface.

The configuration of the entry/exit management server 10 according to the first embodiment will be described with reference to FIG.
The entry/exit management server 10 includes a processor 11 and other hardware such as a memory 13, a storage device 12 including an auxiliary storage device 14, and an input/output interface 16. The processor 11 is connected to other hardware via a signal line and controls these other hardware.

The room entry/exit management server 10 has, as functional elements, a feature point extraction unit 111, a mobile card issuing unit 112, an authentication unit 113, a card inspection unit 114, a signal reception unit 115, an image recording unit 116, and file transmission/reception. And a section 117. In the following description, the functions of the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117 will be described. The function of the “part” of the entrance/exit management server 10. The functions of the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117 are realized by software. It
The storage unit 15 is realized by the storage device 12. The storage unit 15 has a user table 151, a contract content table 152, a feature point table 153, a mobile card table 154, a feature point information table 155, a signal information table 156, an inspection result table 157, and an image. The table 158 is stored.

The configuration of the room entry/exit management registration terminal 70 according to the first embodiment will be described with reference to FIG.
The room entry/exit management registration terminal 70 includes a processor 71, a memory 73 including a memory 73 and an auxiliary storage device 74, and other hardware such as an input/output interface 76. The processor 71 is connected to other hardware via a signal line, and controls these other hardware.

The room entry/exit management registration terminal 70 includes a personal information input unit 711, a card issuing unit 712, an alert display unit 713, and a file transmission/reception unit 714 as functional elements. In the following description, the functions of the personal information input unit 711, the card issuing unit 712, the alert display unit 713, and the file transmission/reception unit 714 are referred to as the “part” function of the entry/exit management registration terminal 70. The functions of the personal information input unit 711, the card issuing unit 712, the alert display unit 713, and the file transmission/reception unit 714 are realized by software.
The storage unit 75 is realized by the storage device 72. The storage unit 75 stores a user table 751, a contract content table 752, a feature point table 753, a mobile card table 754, an inspection result table 757, and an image table 758.

2 and 3, the processors 11 and 71 are ICs (Integrated Circuits) that perform processing. The specific examples of the processors 11 and 71 are a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a GPU (Graphics Processing Unit).

The storage device 12 includes a memory 13 and an auxiliary storage device 14. The storage unit 15 is realized by the memory 13. The storage unit 15 may be realized by the auxiliary storage device 14, or may be realized by both the memory 13 and the auxiliary storage device 14.
The storage device 72 includes a memory 73 and an auxiliary storage device 74. The storage unit 75 is realized by the memory 73. The storage unit 75 may be realized by the auxiliary storage device 74, or may be realized by both the memory 73 and the auxiliary storage device 74.

The memories 13 and 73 are storage devices that temporarily store data. The specific examples of the memories 13 and 73 are SRAM (Static Random Access Memory) and DRAM (Dynamic Random Access Memory).

The auxiliary storage devices 14 and 74 are storage devices that store data. As a specific example, the auxiliary storage devices 14 and 74 are HDDs (Hard Disk Drives). The auxiliary storage devices 14 and 74 are SD (registered trademark, Secure Digital) memory card, CF (registered trademark, CompactFlash), NAND flash, flexible disk, optical disc, compact disc, Blu-ray (registered trademark) disc, DVD (Digital). It may be a portable storage medium such as Versatile Disk.

The auxiliary storage devices 14 and 74 store a program that realizes the function of “unit”. This program is loaded into the memories 13 and 73, read into the processors 11 and 71, and executed by the processors 11 and 71. An OS (Operating System) is also stored in the auxiliary storage devices 14 and 74. At least a part of the OS is loaded into the memories 13 and 73, and the processors 11 and 71 execute the program that realizes the function of the “unit” while executing the OS.

The input/output interfaces 16 and 76 are interfaces for communicating with external devices. The input/output interfaces 16 and 76 are, as specific examples, Ethernet (registered trademark), USB (Universal Serial Bus), and HDMI (registered trademark, High-Definition Multimedia Interface) ports.

In the entry/exit management server 10 of FIG. 2, only one processor 11 is shown. However, the entry/exit management server 10 may include a plurality of processors that replace the processor 11. The functions of the plurality of processors are the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117. The execution of the program that realizes is shared. Each processor, like the processor 11, is an IC that performs processing.

Similarly, in the entry/exit management registration terminal 70 of FIG. 3, only one processor 71 is shown. However, the room entry/exit management registration terminal 70 may include a plurality of processors that replace the processor 71. These multiple processors share the execution of programs that realize the functions of the card issuing unit 712, the alert display unit 713, and the file transmitting/receiving unit 714. Each processor is an IC that performs processing similarly to the processor 71.

***Description of operation***
The operation of the entry/exit management system 1 according to the first embodiment will be described with reference to FIGS. 4 to 7.
The operation of the entry/exit management system 1 according to the first embodiment corresponds to the entry/exit management method according to the first embodiment. The operation of the entry/exit management system 1 according to the first embodiment corresponds to the processing of the entry/exit management program according to the first embodiment.

Regarding the entry/exit management system 1, a mobile card creation flow and an entry/exit management flow used in the entry/exit management system 1 will be respectively described.

First, the mobile card creation flow will be described with reference to FIGS. 4 and 5.
A user of the entry/exit management system 1 according to the first embodiment needs to create the mobile card 20 in advance.
The personal information input unit 711 of the entry/exit management registration terminal 70 registers the personal information of the user by input from the user (step S1).
The user information input by the user is information indicating the person such as name and age as shown in the user table 751 of FIG. The entered information is registered together with the user ID. The user ID is information that identifies the input user information.

Next, the personal information input unit 711 captures the face image of the user who needs to be registered (step S2). The face image is used as two pieces of authentication information, and any biometric information that can identify the person is not limited to the face image and may be an image of the appearance or the like.
Although the authentication is performed in two steps in the first embodiment, when performing authentication in multiple steps, the authentication information corresponding to the number of times of authentication is extracted from one face image.
The captured face image is stored in the image table 758 (not shown).

Next, the personal information input unit 711 registers the contract information of the user by the input from the user (step S3).
As the contract information input by the user, as shown in the contract content table 752 in FIG. 8, information such as contract content 1, contract content 2, and contract content 3 is registered together with the user ID.

When the registration of the personal information is completed, the file transmission/reception unit 714 inputs the personal information, the face image, and the contract information, which are input by the personal information input unit 711, into the entrance/exit management server as the input information stored in the mobile card 20. 10 (step S4).

The file transmission/reception unit 117 of the entry/exit management server 10 receives the input information sent from the entry/exit management registration terminal 70 (step S5).

The feature point extraction unit 111 of the entry/exit management server 10 extracts the fourth authentication information from the face image included in the input information (step S6). An example of extracting the fourth authentication information will be described later.

Next, the feature point extraction unit 111 of the entry/exit management server 10 extracts the third authentication information from the same face image used in step S6 (step S7).

A method of extracting the fourth authentication information and the third authentication information from the face image will be described with reference to FIGS. 9 and 10.
The difference between the fourth authentication information and the third authentication information is the difference in the items used for authentication. There are more items of the third authentication information than the fourth authentication information.
In the example of FIG. 9, as the fourth authentication information, the inner lengths of the left and right eyes, the lengths of the eyes and nose, and the lengths of both ends of the mouth among the feature points of the user's face are the human authentication information. Is used as.
In the example of FIG. 10, as the third authentication information, in addition to the inner lengths of the left and right eyes, the lengths of the eyes and the nose, and the lengths of both ends of the mouth among the feature points of the user's face, The length of the inside of the eyebrows and the right eyebrows, the length of the outside of the left and right eyebrows, the length of the eyes and eyebrows, and the length of the eyes and both ends of the mouth are added as authentication information.

Information about these characteristic points is likely to have an error depending on the distance between the camera 30 and the subject, the angle at which the image is captured, the accuracy of the camera 30, the environment of the subject, and the like. For example, when a user who is stationary from a distance of 1 meter is photographed, even if the inner length of the left and right eyes of the user is 1.34 cm, the same as walking from a distance of 3 emails. When photographing a pedestrian, it is quite possible that the inside lengths of the user's left and right eyes are recognized as 1.33 cm.
Therefore, in order to absorb the error due to the environment, the acquired information is rounded so that the person can be correctly recognized. In the case of the above example, by registering the inner lengths of the left and right eyes of the user as 1.3 cm instead of 1.34 cm, it is possible to prevent the case where the information of the characteristic points of the user is not recognized as the user. It becomes possible.
On the other hand, performing the rounding process as described above increases the number of cases in which erroneous recognition is performed. However, even if there is a risk of erroneously recognizing each feature point information, the risk of erroneous recognition can be reduced by increasing the number of items to be authenticated as shown in the third authentication information, and the user is erroneously recognized. It is possible to specify without any. In this way, the positional relationship of biometric information from the face image of the user is used as the third authentication information and the fourth authentication information.

The above authentication algorithm itself is not limited. Further, the items of the respective characteristic points do not have to completely match, and the authentication determination may be performed based on the matching rate.
The 1st attestation information and the 2nd attestation information mentioned below are extracted from a face image by the same mechanism as the 4th attestation information and the 3rd attestation information, respectively.

The extracted third authentication information and fourth extracted authentication information are stored in the feature point table 153 together with the user ID and the image data as shown in FIG. The user ID is information for identifying the user who is the subject of the captured image.
In the example of FIG. 11, the user ID is 10000001 and the image data is 10000001. jpg, the fourth authentication information is stored in Athkoo98L30kLhil, and the third authentication information is stored in mch9rtlkAjey2wG=.
In the example of FIG. 11, the image format of the image data to be stored is jpg, but it may be an image format such as png, gif, bmp.

The mobile card issuing unit 112 stores information in the mobile card 20 based on the user table 151 received from the entry/exit management registration terminal 70, the contract content table 152, and the third authentication information extracted in step S7. To create.
The information stored in the mobile card 20 is encrypted with the fourth authentication information (step S8).

The mobile card issuing unit 112 stores the input information to be stored in the mobile card 20 created based on the input information (step S9).
Information stored in the mobile card 20 is encrypted and stored with the user ID, name, age, contract content 1, contract content 2 and third authentication information as shown in the mobile card table 154 of FIG. To be done.
Information that is not sensitive may be stored without being encrypted as in the contract content 3 of the mobile card table 154 of FIG.

The file transmission/reception unit 117 transmits the information stored in the mobile card table 154 to the entry/exit management registration terminal 70 (step S10).

The file transmission/reception unit 714 of the entry/exit management registration terminal 70 receives the input information transmitted from the entry/exit management server 10 (step S11).

The card issuing unit 712 of the entry/exit management registration terminal 70 writes the received input information to the mobile card 20 and issues the mobile card 20 (step S12). Information stored in the mobile card table 154 of FIG. 12 is stored in the mobile card 20. The third authentication information is encrypted with the fourth authentication information and stored in the mobile card 20.

Next, an entry/exit management flow of the entry/exit management system 1 will be described with reference to FIGS. 6 and 7.
In the entry/exit management flow of the entry/exit management system 1, the camera 30 installed at the ticket gate of the station captures a face image of a user who is going through the ticket gate (step S21). The face image captured by the camera 30 is sent to the entrance/exit management server 10.

The image recording unit 116 of the entrance/exit management server 10 receives the face image captured by the camera 30 (step S22). The received face image is stored in the image table 158 (not shown).

On the other hand, the receiver 40 acquires the signal emitted by the mobile card 20 (step S23).

The signal receiving unit 115 of the entry/exit management server 10 receives the signal emitted by the mobile card 20 from the receiver 40 (step S24).

In the ticket gate of the railway company in the first embodiment, it is possible to easily associate the signal emitted by the mobile card 20 held by the user with the face image of the user.
For example, even when a plurality of gates 50 are installed, if each gate 50 is used, the user will pass through the gates 50 one by one. Therefore, the correspondence can be performed by sequentially associating the signal emitted by the mobile card 20 and the face image of the user who passes through the gate receiving the signal.
The authentication unit 113 of the entry/exit management server 10 associates the face image received by the image recording unit 116 with the signal received by the signal receiving unit 115 (step S25).
If the association is possible, the process proceeds to step S27 (Yes in step S26). If the correspondence cannot be established, the process returns to START (No in step S26). A case of No in step S26 is, for example, a case where a user who does not have the mobile card 20 passes through the gate 50.

When the face image and the signal can be associated in step S25, the feature point extraction unit 111 extracts the first authentication information from the face image of the user captured by the camera 30 (step S27).
The method of extracting the first authentication information is the same as the method of extracting the fourth authentication information described in step S6. The extracted first authentication information is stored in the feature point information table 155 together with the image data.
FIG. 13 shows an example of the feature point information table 155. The feature point information table 155 stores image numbers, image data, first authentication information, and second authentication information (described later in step S31). The image number is information for identifying the image data. The image data is a face image captured by the camera 30. The first authentication information is the first authentication information extracted from the face image by the authentication unit 113.

The authentication unit 113 uses the extracted first authentication information to decrypt the encrypted third authentication information that identifies the user from the signal received in step S23 and associated with the face image in step S25. Yes (step S28). The signal transmitted from the mobile card 20 is encrypted with the fourth authentication information.
If the fourth authentication information obtained by encrypting the third authentication information stored in the mobile card 20 is the same as the first authentication information extracted in step S27, the input stored in the mobile card 20 is input. The information is decrypted with the first authentication information. On the other hand, when the fourth authentication information obtained by encrypting the third authentication information stored in the mobile card 20 and the first authentication information extracted in step S27 are not the same, the input stored in the mobile card 20 is input. Decryption of information fails.

If the decryption is successful, the process proceeds to step S30 (Yes in step S29). On the other hand, if the decryption fails, the gate 50 is notified of the instruction to close the gate 50 (No in step S29). The case where decryption cannot be performed is, for example, a case where a user other than the original user uses the mobile card 20.

The authentication unit 113 extracts the input information from the signal (step S30). As shown in FIG. 12, the input information includes the user ID, the name, the age, the contract content 1, the contract content 2, etc., which is the input information when the user creates the mobile card 20, and the third authentication information. is there.
The information such as the contract content 1 and the contract content 2 is, for example, information such as a use start date, a use end date, and a balance.

Next, the feature point extraction unit 111 extracts the second authentication information from the face image of the user captured by the camera 30 (step S31).
The method for extracting the second authentication information is the same as the method for extracting the third authentication information described in step S7. The extracted second authentication information is stored as the second authentication information of the image No. corresponding to the feature point information table 155.

The authentication unit 113 performs personal authentication by comparing the third authentication information stored in the mobile card 20 decrypted in step S28 with the second authentication information extracted in step S31 (step S32). ).
For authentication, the third authentication information and the second authentication information are compared, and if the two match, the entry and exit of the user is permitted, and if the third authentication information and the second authentication information do not match, the user Entry/exit is prohibited.

Next, the card inspection unit 114 determines whether or not the mobile card 20 can be used (step S33). The availability is determined by a predetermined method.

The card inspection unit 114 determines availability based on steps S32 and S33 (step S34).
As a result of the personal authentication in step S32 and the availability determination in step S33, when it is determined to be available, the gate 50 is notified of the instruction to open the gate 50 (Yes in step S34). As a result of the personal authentication in step S32 and the availability determination in step S33, when it is determined to be unavailable, the gate 50 is notified of the instruction to close the gate 50 (No in step S34).

The gate 50, which has received the instruction to close the gate 50 from the authentication unit 113 of the entry/exit management server 10, closes the gate 50 (step S35). The case where the gate 50 is closed is, for example, a case where it is determined as impossible as a result of checking information such as contract content 1 and contract content 2 by a predetermined method.

The gate 50, which has received the instruction to open the gate 50 from the authentication unit 113 of the entry/exit management server 10, opens the gate 50 (step S36).

The gate 50 is opened and closed in consideration of the time difference between the image of the user passing through the gate 50 and the signal emitted by the mobile card 20 held by the user, and the speed at which the user moves, so that the user passes through the gate. It is carried out at the same time as when.
If the normal state of the gate 50 is the closed state, the step S34 notifies the gate 50 of an instruction to open the gate 50 only when it is determined that the gate 50 is available, and if the normal state of the gate 50 is the open state, Only when it is determined that the gate 50 cannot be used, the gate 50 may be instructed to close the gate 50.

When the user passes through the gate 50, the authentication unit 113 of the entry/exit management server 10 instructs the mobile card 20 to perform the necessary update (step S37).
The necessary update is, for example, settlement of the usage fee.
The user who has the mobile card 20 completes the authentication process and passes through the gate 50.

***Effect of Embodiment 1***
In the first embodiment, the authentication of the user entering and leaving the ticket gate of the railway company is extracted multiple times from one face image without using a new key, and the authentication is performed multiple times. It becomes possible to carry out, and security can be improved.

By using a beacon card or the like that can perform communication without having to cover the receiver as the mobile card 20, the operation of holding the card when passing through the gate is not necessary, and security can be improved while ensuring convenience. ..

***Other configurations***
<Modification 1>
In the first embodiment, the feature point extraction unit 111 of the entrance/exit management server 10, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file. The function with the transmitting/receiving unit 117 was realized by software. However, as a modified example 1, the feature point extraction unit 111 of the entrance/exit management server 10, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, and the image recording unit 116, The file transmission/reception unit 117 may be realized by hardware. Differences between the first modification and the first embodiment will be described.

The configuration of the entry/exit management system 1 according to Modification 1 will be described with reference to FIG. 14.
Functions of the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117 of the entrance/exit management server 10. When the above is realized by hardware, the entry/exit management server 10 includes a processing circuit 17 instead of the processor 11 and the storage device 12.
The processing circuit 17 of the entrance/exit management server 10 includes a feature point extraction unit 111, a mobile card issuing unit 112, an authentication unit 113, a card inspection unit 114, a signal reception unit 115, an image recording unit 116, and file transmission/reception. It is a dedicated electronic circuit that realizes the function of the “section” of the section 117 and the storage device 12.

The processing circuit 17 may be a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, a logic IC, a GA (Gate Array), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array). To be done.
Functions of the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117 of the entrance/exit management server 10. May be realized by one processing circuit 17, or the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, and the image recording unit 116. The function of the file transmitting/receiving unit 117 may be distributed to a plurality of processing circuits 17 to be realized.

<Modification 2>
As a second modification, some functions may be realized by hardware and other functions may be realized by software.
That is, the feature point extraction unit 111, the mobile card issuing unit 112, the authentication unit 113, the card inspection unit 114, the signal reception unit 115, the image recording unit 116, and the file transmission/reception unit 117 of the entry/exit management server 10. Of the functions described above, some functions may be realized by hardware and other functions may be realized by software.

The processor 11, the storage device 12, and the processing circuit 17 of the entry/exit management server 10 are collectively referred to as "processing circuitry".
That is, the function of each functional component is realized by the processing circuitry.

Embodiment 2.
In the second embodiment, as a modified example of the first embodiment, an entry/exit management system 1 for managing participants in a facility (venue etc.) will be described.
In the first embodiment, using the face image of the user passing through the ticket gate and the mobile card 20 carried by the user, the entrance/exit management is performed at the ticket gate, but in the second embodiment, the person has already entered the facility. A system for performing entrance/exit management in the facility by using the face image of the user and the mobile card 20 carried by the user will be described.
In the first embodiment, since the user who passes through the ticket gate is the confirmation target, the face image of the user and the mobile card 20 held by the user are associated with each other at the time of passing the ticket gate. In the second embodiment, since the user who has already entered the facility is to be confirmed, a new mechanism for associating the facial image of the user with the mobile card 20 carried by the user is required in the first embodiment. different.
Further, in the second embodiment, the entrance/exit management display terminal 80, which is a terminal device for confirming the authentication result in the facility, is provided. In the second embodiment, these different points will be described, and description of the same points will be omitted.

***Description of structure***
The configuration of the room entry/exit management system 1 according to the second embodiment will be described with reference to FIG.
The entry/exit management system 1 includes an entry/exit management server 10, a mobile card 20, a camera 30, a receiver 40, an entry/exit management registration terminal 70, and an entry/exit management display terminal 80. The room entrance/exit management server 10, the camera 30, the receiver 40, the room entrance/exit management registration terminal 70, and the room entrance/exit management display terminal 80 are connected via a network 60.
The entry/exit management server 10, the mobile card 20, the camera 30, the receiver 40, and the entry/exit management registration terminal 70 are the same as those in the first embodiment. The room entrance/exit management display terminal 80 is different from the room entrance/exit management system 1 of the first embodiment shown in FIG.

The room entry/exit management display terminal 80 is a computer used by a user, such as a PC (Personal Computer).

The configuration of the room entry/exit management display terminal 80 according to the second embodiment will be described with reference to FIG.
The entrance/exit management display terminal 80 includes a processor 81, and a storage device 82 including a memory 83 and an auxiliary storage device 84, and other hardware such as an input/output interface 86. The processor 81 is connected to other hardware via a signal line, and controls these other hardware.

The entrance/exit management display terminal 80 includes an alert display unit 813 and a file transmission/reception unit 814 as functional elements. In the following description, the functions of the alert display unit 813 and the file transmission/reception unit 814 are referred to as “part” functions of the entry/exit management display terminal 80. The functions of the alert display unit 813 and the file transmission/reception unit 814 are realized by software.
The storage unit 85 is realized by the storage device 82. The storage unit 85 stores a user table 851, a contract content table 852, a feature point table 853, a mobile card table 854, a feature point information table 855, a signal information table 856, and an inspection result table 857. To be done.

The processor 81 is an IC (Integrated Circuit) that performs processing. As a specific example, the processor 81 is a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or a GPU (Graphics Processing Unit).

The storage device 82 includes a memory 83 and an auxiliary storage device 84. The storage unit 85 is realized by the memory 83. The storage unit 85 may be realized by the auxiliary storage device 84, or may be realized by both the memory 83 and the auxiliary storage device 84.

The memory 83 is a storage device that temporarily stores data. The memory 83 is, for example, an SRAM (Static Random Access Memory) or a DRAM (Dynamic Random Access Memory).

The auxiliary storage device 84 is a storage device that stores data. The auxiliary storage device 84 is, as a specific example, an HDD (Hard Disk Drive). The auxiliary storage device 84 is an SD (registered trademark, Secure Digital) memory card, CF (registered trademark, CompactFlash), NAND flash, flexible disk, optical disk, compact disk, Blu-ray (registered trademark) disk, DVD (Digital Versatile Disk). ), which may be a portable storage medium.

The auxiliary storage device 84 stores a program that realizes the function of “unit”. This program is loaded into the memory 83, read into the processor 81, and executed by the processor 81. The auxiliary storage device 84 also stores an OS (Operating System). At least a part of the OS is loaded into the memory 83, and the processor 81 executes the program that realizes the function of “unit” while executing the OS.

The input/output interface 86 is an interface for communicating with an external device. The input/output interface 86 is, for example, an Ethernet (registered trademark), a USB (Universal Serial Bus), or an HDMI (registered trademark, High-Definition Multimedia Interface) port.

In the entry/exit management display terminal 80 of FIG. 15, only one processor 81 is shown. However, the room entry/exit management display terminal 80 may include a plurality of processors that replace the processor 81. These multiple processors share the execution of a program that realizes the functions of the alert display unit 813 and the file transmission/reception unit 814. Like each processor 81, each processor is an IC that performs processing.

***Description of operation***
The operation of the room entry/exit management system 1 according to the second embodiment will be described with reference to FIGS. 17 to 19.
The operation of the room entry/exit management system 1 according to the second embodiment corresponds to the room entry/exit management method according to the second embodiment. The operation of the entry/exit management system 1 according to the second embodiment corresponds to the processing of the entry/exit management program according to the second embodiment.

The flow of creating the mobile card 20 of the second embodiment is the same as that of the first embodiment, and will be omitted. A room entry/exit management flow according to the second embodiment will be described with reference to FIGS.
In the room entry/exit management flow of the second embodiment, the receiver 40 installed in the facility acquires a signal emitted by the mobile card 20 carried by the user (step S41).

The signal receiving unit 115 of the entry/exit management server 10 acquires the signal emitted by the mobile card 20 from the receiver 40 (step S42).

The signal receiving unit 115 of the entrance/exit management server 10 refers to the signal information table 156 to determine whether the received signal is a new signal that has already been received or a new signal that has not been received (step S43). The signal information table 156 will be described with reference to FIG.
The signal information table 156 is a table that has information of signal Nos, signal data, image Nos, and image data, and has received signals and image information associated with the received signals. The signal No. is information assigned to identify the received signal. The signal data is the received signal data.
The example of the signal information table 156 shown in FIG. 20 indicates that 10 signals with signal Nos. B0000001 to B00000010 are registered as received signals.

If the received signal is a new signal that has not been received (Yes in step S43), that is, if the signal is not registered in the signal information table 156, the signal reception unit 115 of the entry/exit management server 10 creates a new signal. (Step S44).
If the received signal is already registered, nothing is done and the process returns to START (No in step S43).

In parallel with the reception of the signal emitted by the mobile card 20, the camera 30 installed in the facility captures the face image of the participant (step S51). A plurality of cameras 30 are installed in the facility, and face images captured by the cameras 30 are sent to the entry/exit management server 10.

The image recording unit 116 of the entry/exit management server 10 receives the face image captured by the camera 30 (step S52). The received face image is stored in the image table 158 (not shown).

The feature point extraction unit 111 of the entry/exit management server 10 extracts the first authentication information from the face image captured by the camera 30 (step S53). The method for extracting the first authentication information is the same as the method for extracting the fourth authentication information described in step S7.

The authentication unit 113 of the entry/exit management server 10 associates the signal registered in step S44 with the face image received in step S52. Therefore, referring to the signal information table 156, there is a signal that is not associated with the face image. It is confirmed (step S54).
In the example of the signal information table 156 shown in FIG. 20, signals No. B0000001 to B0000003 have been input with the image No. and image data, indicating that the association between the signal and the face image has been completed. ing. On the other hand, the signals with signal Nos. B0000004 to B00000010 indicate that the image No and image data have not been input, and the association between the signal and the face image has not been completed.

If there is a signal whose association is not completed (Yes in step S54), for one of the unsupported signals, for example, in the example of the signal information table 156 in FIG. 20, for the signal data whose signal No. is B0000004, step S53. Decryption is performed using the first authentication information extracted in step S55.
The specific decoding method is the same as that in the first embodiment.
If the decryption is successful (Yes in step S56), the authentication unit 113 determines that the signal can be associated with the face information that is the source of the creation of the first authentication information, and the signal of the signal information table 156 is determined. The image No. and image data corresponding to No. B0000004 are updated, and the process proceeds to step S57.
If the decoding cannot be performed (No in step S56), the process returns to step S54, and decoding is performed for the next unsupported signal (signal No. B0000005) registered in the signal information table 156.

When it cannot be associated with any of the signals received by the signal receiving unit 115, or when there is no uncorresponding signal, the process returns to START (No in step S54).

The authentication unit 113 extracts the stored input information from the decrypted signal (step S57). The input information extracted is the same as the input information extracted in step S30 of the first embodiment.
The information such as the contract content 1 and the contract content 2 of the retrieved input information is, for example, information such as the use start time, the use end time, and the issue/registration date.

The feature point extraction unit 111 extracts the second authentication information from the face image of the user captured by the camera 30 (step S58). The method for extracting the second authentication information is the same as the method for extracting the third authentication information described in step S7.

The authentication unit 113 authenticates the person by comparing the third authentication information stored in the mobile card 20 decrypted in step S55 with the second authentication information extracted in step S58 (step S59). ).
The method of personal identification is the same as step S32.

The card inspection unit 114 determines whether the mobile card 20 is usable (step S60).
Similar to the first embodiment, whether or not the mobile card 20 can be used is determined by inspecting the contract contents stored by a predetermined method.
The authentication result performed in step S59 and the availability determination result performed in step S60 are stored in the inspection result table 157 shown in FIG.

An example of the inspection result tables 157 and 857 is shown in FIG.
The inspection result tables 157 and 857 of FIG. 21 have information of signal No, image data, authentication result, and availability. The signal No. is information for identifying the received signal, and the image data is image information associated with the received signal No.
The alert display unit 813 of the entry/exit management display terminal 80 receives the information of the inspection result table 157 from the entry/exit management server 10 and displays it on the screen (step S61).
By referring to the information of the inspection result table 857 displayed on the screen, it is possible to confirm the authentication information of the user and the availability determination result together with the face image data of the user.

The card inspection unit 114 determines whether or not the card can be used, and if it is determined that the card can be used, the process proceeds to step S63 (Yes in step S62). If it is determined to be unusable, the process proceeds to END (No in step S62).

When the mobile card 20 receives an instruction from the authentication unit 113 of the entry/exit management server 10 via the receiver 40, the mobile card 20 updates the information of the mobile card 20 (step S63).
As an example of updating the information of the mobile card 20, the mobile card table 154 may be provided with the information of the authentication confirmation time, and the authentication confirmation time may be updated when the authentication is completed.

***Effects of Embodiment 2***
In the second embodiment, the authentication of the user in the facility is not limited to the entrance/exit of the venue where entrance/exit management is performed, and a plurality of authentication information is extracted from one face image without adding a new key. It is possible to perform authentication multiple times and improve security.

By referring to the information of the inspection result table 857 displayed on the screen of the entrance/exit management display terminal 80, the authentication information of the user and the availability determination result can be confirmed together with the face image data of the user.

***Other configurations***
<Modification 3>
Although the gate 50 is not necessary in the configuration of the second embodiment, it is possible to provide the gate 50 and perform the entrance/exit management both inside the facility and at the gate 50.

1 entry/exit management system, 10 entry/exit management server, 20 mobile card, 30 camera, 40 receiver, 60 network, 80 entry/exit management display terminal, 111 feature point extraction unit, 112 mobile card issuing unit, 113 authentication unit, 115 Signal receiving unit, 813 alert display unit.

Claims (7)

A room entrance/exit management server connected to a camera and a receiver via a network, wherein the number of authentication items is larger than the first authentication information and the first authentication information from the image of the user captured by the camera. A feature point extraction unit that extracts the second authentication information;
The encrypted third authentication information for identifying the user is acquired from the receiver, the third authentication information is decrypted with the first authentication information, and the decrypted third authentication information is stored. An authentication unit that authenticates the user's entry/exit by comparing with the second authentication information;
A room entrance/exit management server. When the third authentication information and the second authentication information match, the authentication unit permits the user to enter and leave the room, and the third authentication information and the second authentication information do not match. In the case, the entry/exit management server according to claim 1, wherein entry/exit of the user is not permitted. The feature point extraction unit extracts the third authentication information and the fourth authentication information from an image of a user, and stores the third authentication information encrypted with the fourth authentication information. A mobile card issuing unit that creates a mobile card,
A signal receiving unit that acquires a signal emitted by the mobile card from the receiver,
The entry/exit management server according to claim 1, further comprising: The entrance/exit management server according to any one of claims 1 to 3, wherein a positional relationship of biometric information is used as the first authentication information and the second authentication information from an image of the user. The signal reception unit stores the encrypted third authentication information acquired from the receiver, and the feature point extraction unit extracts an image of the user every time the image of the user is captured. The first authentication information and the second authentication information are extracted, and the authentication unit decrypts the third authentication information imaged by the feature point extraction unit with the first authentication information, and decrypts the third authentication information. By comparing the generated third authentication information and the second authentication information, the user's entry/exit authentication is performed, and the user's entry/exit authentication is not confirmed. The entrance/exit management server according to claim 3, wherein authentication is repeated for a certain period of time. Furthermore, when the authentication unit determines that the user is allowed to enter or leave the room, the authentication unit instructs a gate connected to the room entrance/exit management server via the network to open the gate, or The entry/exit management server according to claim 2, wherein when the entry/exit of the user is determined not to be permitted, the gate is instructed to be closed. An entry/exit management system comprising an entry/exit management server and an entry/exit management display terminal connected to a camera and a receiver via a network,
A feature point extraction unit that extracts first authentication information and second authentication information having a larger number of authentication items than the first authentication information from the image of the user captured by the camera;
The encrypted third authentication information for identifying the user is acquired from the receiver, the third authentication information is decrypted with the first authentication information, and the decrypted third authentication information is stored. An authentication unit that authenticates the user's entry/exit by comparing with the second authentication information;
Equipped with
The entry/exit management display terminal is
An entry/exit management system, comprising: an alert display unit that receives an entry/exit authentication result of a user from the entry/exit management server and displays an entry/exit authentication result on a screen.

Images