JP6333603B2 - Information processing apparatus and information processing system - Google Patents

Description

  The present invention relates to an information processing apparatus and an information processing system capable of managing entrance of visitors to facilities, vehicles, and event venues.

  Conventionally, an entrance / exit management system or an entrance / exit management system using a wearable terminal has been proposed.

  In Patent Document 1 below, when a wristwatch-type non-contact type terminal attached to a user's arm approaches a processing unit main body such as an automatic ticket gate or an electric lock, the processing unit main body, the non-contact type terminal, A non-contact type terminal for exchanging data between them and driving a processor main body is disclosed.

  In Patent Document 2 below, the identification information transmitted from the wristwatch-type non-contact IC storage device is received, the key is locked and / or unlocked, and the time is recorded to perform entry / exit management. An apparatus is disclosed.

  Patent Document 3 listed below discloses that a wristband type authentication device performs authentication by detecting a vein pattern of an arm of a person to be authenticated and transmits an authentication result to an access object such as a door knob. .

JP 05-182038 A Japanese Patent Laid-Open No. 2001-034734 JP 2002-31324 A

  Usually, for example, when issuing or delivering tickets for an event, in order to prevent unauthorized use of the ticket, whether or not the person receiving the ticket or delivery is a legitimate ticket purchaser, such as a driver's license or passport. Confirmed by ID

  However, in the technologies described in Patent Documents 1 and 2, it is determined whether or not the person wearing the wristwatch-type terminal at the event venue or facility is the person who actually received the ticket, that is, whether or not it is a regular ticket purchaser. It cannot be confirmed. Therefore, these techniques do not eliminate the risk of unauthorized use of tickets.

  In the technique described in Patent Document 3, it is necessary to register biometric information such as vein patterns in advance, and it is troublesome for the user to read the biometric data of the user at the ticket issuing office or the delivery office. Sometimes it is not convenient. Moreover, since it is necessary to install a reader for reading biometric information at the ticketing office or the delivery office, the cost is increased.

  In view of the circumstances as described above, the object of the present invention is that a person who wears a wearable electronic ticket terminal for entering a facility, vehicle, or event venue is registered in advance without impairing user convenience. An object of the present invention is to provide an information processing apparatus and an information processing system that can authenticate the user and can prevent unauthorized use of the electronic ticket terminal at low cost without impairing the convenience of the user.

  In order to achieve the above object, an information processing apparatus according to an aspect of the present invention includes a storage unit, a communication unit, and a control unit. The said memory | storage part matches and memorize | stores the identification information of the wearable electronic ticket terminal for a user to enter a regulation area, and the face image acquired beforehand about the user who has the said wearable electronic ticket terminal. The communication unit can communicate with the wearable electronic ticket terminal and a monitoring camera that captures a surrounding area through which the user can pass when entering the restricted area. A face image corresponding to the stored identification information when receiving the wear detection information indicating that the wearable electronic ticket terminal is worn on a person from the wearable electronic ticket terminal together with the identification information. And the face image extracted from the captured image of the monitoring camera can be used to authenticate that the wearer of the wearable electronic ticket terminal is the user.

  As a result, the information processing apparatus can authenticate that the person wearing the wearable electronic ticket terminal for entering (entering / entering / riding) the facility, the vehicle, and the event venue is an authorized user registered in advance, Unauthorized use of the electronic ticket terminal can be prevented at a low cost without impairing user convenience. The face image of the user for registration is taken, for example, when a ticket is provided or acquired from an identification card. This face image pre-registration is less likely to harm the user's convenience compared to biometric pre-registration, and costs are relatively low, so the face image is used to authenticate the user wearing the ticket terminal. Thus, unauthorized use of tickets can be prevented at a low cost.

  The control unit acquires position information of the wearable electronic ticket terminal through wireless communication with the wearable electronic ticket terminal, and acquires a face image of a person existing at a position corresponding to the acquired position information in the captured image. It may be extracted.

  As a result, the information processing apparatus identifies the position of the wearable electronic ticket terminal and limits the search range in the captured image to that position, so that even when a plurality of persons are present in the shooting area at the same time, The face authentication of the wearer can be performed with high accuracy, and the face authentication process can be made more efficient and faster.

  The storage unit may store a correspondence relationship between a plurality of the surrounding areas and the monitoring camera that images each of the surrounding areas. In this case, the control unit may extract the face image from the captured image of the monitoring camera that captures the peripheral area corresponding to the acquired position information among the plurality of peripheral areas.

  As a result, the information processing apparatus performs face authentication on a person existing around the position of the wearable electronic ticket terminal, so that even when a plurality of persons are present in the photographing region at the same time, the face of the wearer can be accurately detected. In addition to performing authentication, the face authentication process can be made more efficient and faster.

  The control unit may determine whether or not the user is authenticated within a first time from reception of the wearing detection information by collating the face image.

  Accordingly, the information processing apparatus can take various measures when the authentication is not performed within the first time by providing a time restriction on the face authentication.

  The control unit is configured to notify the wearer or the surroundings that the user is not authenticated when the user is not authenticated within the first time from the reception of the wearing detection information. A notification request may be transmitted.

  Accordingly, the information processing apparatus detects a situation where face authentication is not performed within the first time period, that is, there is a possibility that a third party who is not a pre-registered user may wear the wearable electronic ticket terminal. be able to. In addition, by transmitting a notification request when face authentication is not performed within the first time, it is possible to prompt a person wearing the wearable electronic ticket terminal to consciously perform face authentication. If the wearer is a regular user, authentication is promptly performed by consciously facing the monitoring camera. In addition, by ringing the ticket terminal, it is possible to notify the surroundings of the possibility that the ticket terminal has dropped out of the user or that a person who does not have admission authority is wearing the ticket.

  If face authentication is not performed within the first time or longer than the first time since reception of the wearer detection information, the person at the position corresponding to the position information of the wearable electronic ticket terminal is sequentially acquired by the monitoring camera. The captured image may be analyzed and tracked. Furthermore, you may report the possibility of a suspicious person to the terminal which the guard in charge of security possesses.

  When the user is authenticated within a first time after receiving the wearing detection information, the control unit permits the received identification information of the wearing electronic ticket terminal to enter the restricted area. It may be stored in the storage unit as identification information of the wearable electronic ticket terminal.

  As a result, the information processing apparatus validates the wearable electronic ticket terminal upon confirming the identity of the ticket wearer, so that, for example, when the user enters the entry gate to the restricted area, the information processing apparatus determines whether the entry is possible. Judgment can be made strictly.

  In addition, when the user is authenticated within a first time from reception of the wearing detection information, the control unit transfers the wearing type electronic ticket terminal having the received identification information to the wearing type electronic ticket terminal. The biometric information transmission request which requests | requires transmitting the biometric information read from the wearer of this may be transmitted, and the received said biometric information may be matched with the said identification information, and may be memorize | stored in the said memory | storage part.

  As a result, the information processing apparatus registers the user's biometric information after verifying the identity by face authentication, so that it is possible to prevent improper registration of the biometric information of an unauthorized third party, and unauthorized use of the ticket. It can prevent more firmly. The biological information is, for example, a wrist or finger vein pattern, a fingerprint pattern, a pulse wave pattern, a palm print pattern, or the like.

  When the biological information read from the user wearing the wearable electronic ticket terminal is received from the wearable electronic ticket terminal entering the restricted area, the control unit receives the received biological information and the memory The biometric information may be collated, and whether or not the user can enter the restricted area may be determined according to the collation result.

  Thus, when the user enters the restricted area, the information processing apparatus can prevent entry into the restricted area due to unauthorized use of the ticket by authenticating with the biometric information that the user has been identified at the time of wearing. it can.

  The storage unit may store a date and time when the wearable electronic ticket terminal is provided. In this case, the control unit may determine whether or not the user is authenticated within a second time from the date and time when the wearable ticket terminal is provided, by collating the face image.

  As a result, the information processing apparatus is in a situation where face authentication is not performed within a predetermined time from the ticket provision date and time, that is, there is a possibility that a third party who is not a pre-registered user is wearing the wearable electronic ticket terminal. Can be detected.

An information processing system according to another aspect of the present invention includes a wearable electronic ticket terminal for allowing a user to enter a restricted area, and an information processing apparatus.
The wearable electronic ticket terminal includes a first storage unit, a first communication unit, a detection unit, and a first control unit. The first storage unit stores identification information of the wearable electronic ticket terminal. The first communication unit can communicate with the information processing apparatus. The detection unit can detect that the wearable electronic ticket terminal is worn by a person. When the mounting is detected, the first control unit transmits mounting detection information indicating detection of the mounting together with the stored identification information to the information processing apparatus.
The information processing apparatus includes a second storage unit, a second communication unit, and a second control unit. The second storage unit stores a face image acquired in advance for the user possessing the wearable electronic ticket terminal and the identification information in association with each other. The second communication unit can communicate with the wearable electronic ticket terminal and a monitoring camera that captures a surrounding area through which the user can pass when entering the restricted area. The second control unit, when receiving the wearing detection information together with the identification information from the wearing type electronic ticket terminal, extracts the face image corresponding to the stored identification information and the captured image of the monitoring camera. It is possible to authenticate that the wearer of the wearable electronic ticket terminal is the user by collating with the face image.

An information processing method according to another aspect of the present invention includes:
Storing the identification information of the wearable electronic ticket terminal for the user to enter the restricted area and the face image acquired in advance for the user possessing the wearable ticket terminal,
Receiving, from the wearable electronic ticket terminal, wearing detection information indicating that the wearable electronic ticket terminal is worn on a person, together with the identification information; and
By comparing the face image corresponding to the stored identification information with the face image extracted from the captured image of the monitoring camera that captures the peripheral area through which the user can pass when entering the restricted area And authenticating that the wearer of the wearable electronic ticket terminal is the user.

A program according to still another aspect of the present invention is provided in an information processing apparatus.
Storing the identification information of the wearable electronic ticket terminal for the user to enter the restricted area and the face image acquired in advance for the user possessing the wearable ticket terminal in association with each other;
Receiving, from the wearable electronic ticket terminal, wearing detection information indicating that wearing of the wearable electronic ticket terminal to the user is detected together with the identification information;
By comparing the face image corresponding to the stored identification information with the face image extracted from the captured image of the monitoring camera that captures the peripheral area through which the user can pass when entering the restricted area And authenticating that the wearer of the wearable electronic ticket terminal is the user.

  As described above, according to the present invention, it is possible to authenticate that a person wearing a wearable electronic ticket terminal for entering a facility, vehicle, or event venue is an authorized user registered in advance. Can be prevented at low cost without impairing the convenience of the user. However, this effect does not limit the present invention.

It is the figure which showed the outline | summary of the ticket authentication system which concerns on one Embodiment of this invention. It is the figure which showed the hardware constitutions of the ticket authentication server in the said system. It is the figure which showed the hardware constitutions of the wristband terminal in the said system. It is the figure which showed the flow of the monitoring process of the mounting state of the user by the said wristband terminal. It is the figure which showed the flow of the user's face authentication process by the said ticket authentication server and a surveillance camera, and the registration process of biometric information. It is the figure which showed the flow of operation | movement of the wristband terminal at the time of passage of a user's entrance gate apparatus.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[System Overview]
FIG. 1 is a diagram showing an outline of a ticket authentication system according to an embodiment of the present invention.

  As shown in the figure, the system includes a ticket authentication server 100 on a network, a wristband terminal 200, an entrance gate device 300, and a surveillance camera 400.

  The wristband terminal 200 has a wristband type shape that can be worn on the user's wrist, functions as an electronic ticket for entering a venue such as an event, and incorporates an IC tag that stores information for that purpose. For example, the wristband terminal 200 can be used by, for example, exchanging it with a ticket voucher brought by the user after the identity is confirmed by presenting an identification card such as a driver's license or passport at a ticket issuing office or a delivery office. Provided to the user.

  The ticket issuing office or the delivery office may be installed in a facility such as a station, airport, or hotel near the venue, or may be installed in a place away from the venue.

  Further, a camera is installed at the ticket issuing office or the ticket delivery office, and when the wristband terminal 200 is provided to the user, a face image of the user is taken. The captured face image is stored in the ticket authentication server 100 together with information such as user information and identification information of the wristband terminal 200.

  The user's face image can be obtained by reading the electronic data of the identification card, such as a driver's license or passport, presented at the time of identity verification, or by scanning the facial photo displayed on the identification card. Images can also be acquired.

  The monitoring camera 400 is installed in, for example, a plurality of areas around the venue, that is, a plurality of areas through which the user can pass when entering the venue. It is possible to transmit to the authentication server 100.

  In addition, the monitoring camera 400 is provided with an antenna (access point) capable of wireless communication with the wristband terminal 200. The antenna transmits to the authentication server 100 data related to reception status such as radio wave arrival time and intensity as information for specifying the position of the wristband terminal 200 together with the ID received from the wristband terminal 200.

  The user who receives the wristband terminal 200 wears the wristband terminal 200 when heading to the venue on the day of the event. The ticket authentication server 100 monitors the wearing state of the wristband terminal 200 by the user. When the wearing of the wristband terminal 200 is detected, the face image registered in the ticket authentication server 100 and the monitoring camera The face image extracted from the captured image is collated to authenticate the user.

  At this time, when the user is authenticated by the face image, the ticket authentication server 100 reads the user's biometric information read by the wristband terminal 200 (for example, the vein pattern of the wrist or finger, fingerprint, pulse wave, palm print, etc. ) And register the biometric information for user authentication.

  When the user passes through the entrance gate device 300 in the hall, authentication based on the user's biometric information is executed and authenticated by communication between the wristband terminal 200, the entrance gate device 300, and the ticket authentication server 100. The user is allowed to enter the venue.

  The admission gate device 300 detects the wristband terminal 200 by periodically sending a request signal to the surrounding area and detecting a response signal from the wristband terminal 200 in response to the request signal. The admission gate device 300 demodulates the response signal from the wristband terminal 200, acquires the ID, biometric information, or authentication result information of the wristband terminal 200 that has transmitted it, and transmits it to the ticket authentication server 100. Note that since there may be many users who pass through the above-described surrounding area at the same time, the entrance gate device 300 preferably has an anti-collision function (multiple simultaneous reading function). In addition, the entrance gate device 300 is installed at a plurality of locations in the venue, and may be installed for each facility in the venue.

  In the present embodiment, the wristband terminal 200 may be simply referred to as a “band”.

  The ticket authentication system of this embodiment is a form of the information processing system of the present invention. The ticket authentication server 100 corresponds to the information processing apparatus of the present invention, and the wristband terminal 200 corresponds to the wearable electronic ticket terminal of the present invention. To do. In addition, a venue for events and the surrounding area correspond to the restricted area and the surrounding area of the present invention, respectively.

[Hardware configuration of ticket authentication server]
FIG. 2 is a diagram showing a hardware configuration of the ticket authentication server 100. As shown in FIG. 1, a ticket authentication server 100 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an input / output interface 15, and a bus for connecting them together. 14.

  The CPU 11 appropriately accesses the RAM 13 or the like as necessary, and comprehensively controls each block of the ticket authentication server 100 while performing various arithmetic processes. The ROM 12 is a non-volatile memory in which an OS to be executed by the CPU 11, firmware such as programs and various parameters are fixedly stored. The RAM 13 is used as a work area for the CPU 11 and temporarily holds the OS, various applications being executed, and various data being processed.

  A display unit 16, an operation receiving unit 17, a storage unit 18, a communication unit 19, and the like are connected to the input / output interface 15.

  The display unit 16 is a display device using, for example, an LCD (Liquid Crystal Display), an OELD (Organic ElectroLuminescence Display), a CRT (Cathode Ray Tube), or the like.

  The operation reception unit 17 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, and other input devices. When the operation reception unit 17 is a touch panel, the touch panel can be integrated with the display unit 16.

  The storage unit 18 is a non-volatile memory such as an HDD (Hard Disk Drive), a flash memory (SSD; Solid State Drive), or other solid-state memory. The storage unit 18 stores the OS, various applications, and various data.

  In particular, in the present embodiment, the storage unit 18 associates the wristband ID for identifying the wristband terminal 200, the user information (name, address, etc.) of the user who is provided with the wristband terminal 200, and the face image in association with each other. Remember every time. In addition, the storage unit 18 stores the biometric information and the visitor registration flag of the user who has been registered through the authentication using the face image in association with the user information. The storage unit 18 also stores a program for authenticating the user based on the data. In addition, the storage unit 18 also stores information (position information) related to the shooting ranges of the plurality of monitoring cameras 400. Further, the storage unit 18 may also store information indicating the date and time when the user received the wristband terminal 200.

  The communication unit 19 is, for example, an Ethernet (registered trademark) NIC (Network Interface Card), and is responsible for communication processing between the wristband terminal 200, the entrance gate device 300, and the monitoring camera 400.

[Hardware configuration of wristband terminal]
FIG. 3 is a diagram illustrating a hardware configuration of the wristband terminal 200.

  Since the wristband terminal 200 is worn on a person's wrist, a flexible material such as rubber or resin is used for the main body of the wristband terminal 200, and the wristband terminal 200 has an annular or band shape. Therefore, it is easy to attach to and detach from the wrist, and when it is wound around and attached to the wrist, it is appropriately fixed to the wrist.

  As shown in the figure, the wristband terminal 200 includes a CPU 21, a storage device 22, a proximity sensor 23, an authentication sensor 24, a timer 25, an LED (Light Emitting Diode) light source 26, a battery 27, a connector 28, a vibration device 29, and a buzzer. The apparatus 30 includes a Bluetooth (registered trademark) communication unit 31, an NFC (Near field communication) communication unit 32, and a wireless LAN communication unit 33.

  The CPU 21 appropriately accesses the storage device 22 and the like as necessary, and comprehensively controls each block of the wristband terminal 200 while performing various arithmetic processes.

  The storage device 22 stores electronic ticket information such as the wristband ID and event information. The storage device 22 also has authentication result information indicating that the user has been authorized to enter the venue (admission permission) by the face authentication and biometric authentication, and the current wearing state detected by the proximity sensor 23. I remember it. The storage device 22 may store information related to the user who purchased the ticket, or user information may not be stored from the viewpoint of protecting personal information.

  The proximity sensor 23 is means for detecting the wearing state of the wristband terminal 200, and detects whether the wristband terminal 200 is worn or not by detecting the presence of an object (a user's wrist) in the vicinity thereof. . As the proximity sensor 23, for example, any type of sensor such as a capacitance type, an induction type, an ultrasonic type, a photoelectric type, and a magnetic type can be used. In addition, when the wristband terminal 200 has a belt-like shape and has both ends connected to the wrist, the connection between the ends is detected by a contact switch or an energized state, thereby detecting the wearing / non-wearing. You can also

  The authentication sensor 24 is a sensor that reads the user's biological information from the wearing part in a state where the wristband terminal 200 is worn on a predetermined part of the human body. In the present embodiment, the band is attached to the wrist, and the authentication sensor 24 reads the vein pattern of the user's wrist as biometric information. The authentication sensor 24 is provided, for example, at a position corresponding to a vein on the inner side of the user's wrist, and when the user is wearing the wristband terminal 200 correctly, the user does not need to operate the vein pattern. Can be read.

  For example, the timer 25 counts an elapsed time from the time when the proximity sensor 23 detects the user's wearing of the wristband terminal 200.

  The LED light source 26 can notify the user of, for example, the operation mode of the wristband terminal 200, the wearing state, the notified entrance availability, etc., for example, by emitting different colors.

  The battery 27 supplies operating power to each part of the wristband terminal 200.

  The connector 28 can be connected to a cable (for example, a USB cable) connected to a commercial power source for charging the battery.

  For example, when the face authentication process is timed up or when authentication using biometric information fails, the vibration device 29 is used to notify the user or prompt the user to perform another authentication process. The wristband terminal 200 is vibrated based on a command from the authentication server 100. Further, the vibration device 29 may be used for notifying the possibility that the wristband terminal 200 has dropped from the wrist of the user.

  The buzzer device 30 is used together with the vibration device or as an alternative to the vibration device 29 for the same purpose as the vibration device 29, and outputs a predetermined alarm sound.

  The Bluetooth (registered trademark) communication unit 31 can communicate with, for example, the ticket authentication server 100 and other information processing devices (for example, a smartphone carried by a user or a security guard around the venue) based on the Bluetooth (registered trademark) standard. It is.

  The NFC communication unit 32 can communicate with, for example, the entrance gate device 300 based on the NFC standard. The NFC communication unit 32 functions as the IC tag together with the storage device 22.

  The wireless LAN communication unit 33 can communicate with the ticket authentication server 100 via each access point based on a standard such as Wi-Fi (Wireless Fidelity). The wireless communication method with the ticket authentication server 100 is not limited to this, and a specific low power wireless may be used.

[System Operation]
Next, the operation of the system configured as described above will be described. In the following description, the CPU 11 of the ticket authentication server and the CPU 21 of the wristband terminal 200 will be described as main operating entities, but this operation is also performed in cooperation with programs executed under the control of these CPUs.

(Wristband terminal wearing monitoring process)
FIG. 4 is a diagram showing a flow of monitoring processing of a user's wearing state by the wristband terminal 200.

  As shown in the figure, the CPU 21 of the wristband terminal 200 determines whether or not the proximity sensor 23 detects a change in the wearing state of the user's wristband terminal 200 (step 41).

  When determining that the change in the wearing state has been detected (Yes), the CPU 21 determines whether or not the change is a change from the non-wearing state to the wearing state (step 42).

  If it is determined that the change is from the non-wearing state to the wearing state (Yes), the CPU 21 determines whether or not this is the first wearing after the wristband terminal 200 is provided to the user (step 43). .

  If it is determined that it is the first time of mounting (Yes), the CPU 21 notifies the ticket authentication server 100 of the detection of mounting by the wireless LAN communication unit 33 (step 44). The attachment detection notification includes the ID of the wristband terminal 200. With this notification of detection of attachment, the ticket authentication server 100 starts a face authentication process described later.

  Subsequently, the CPU 21 determines whether or not a biometric information transmission request is received from the ticket authentication server 100 (step 45).

  If it is determined that a biometric information transmission request has been received (Yes), the CPU 21 reads the biometric information of the user (wrist vein pattern) by the authentication sensor 24 (step 46), and the read biometric information is transmitted to the wireless LAN communication. The unit 33 transmits the ticket to the ticket authentication server 100 (step 47).

  On the other hand, when it is determined in step 42 that a change from the wearing state to the non-wearing state is detected (No), the CPU 21 deletes the authentication result information stored in the storage device 22 (step 48). The authentication result information storage process will be described later.

(Face authentication processing by ticket authentication server)
FIG. 5 is a diagram showing a flow of user face authentication processing and biometric information registration processing by the ticket authentication server 100 and the monitoring camera 400.

  As shown in the figure, the CPU 11 of the ticket authentication server 100 determines whether or not the first wearing detection notification is received from the wristband terminal 200 (step 51).

  When determining that the first wearing detection notification is received (Yes), the CPU 11 stores the ID of the wristband terminal 200 included in the wearing detection notification in the storage unit 18 (step 52).

  Subsequently, the CPU 11 starts a monitoring timer for a predetermined time for face authentication processing (step 53). The predetermined time is, for example, 30 seconds, 1 minute, 3 minutes, but is not limited thereto.

  Subsequently, the CPU 11 detects the position of the wristband terminal 200 (step 54). The position is based on the distance from the wristband terminal 200 to each antenna based on, for example, the arrival time and intensity of radio waves received from a plurality of antennas (access points) existing around the wristband terminal 200. It is grasped by the three-point positioning method.

  The position information may be detected by the wristband terminal 200 and included in the wearing detection notification. The position may be detected by other methods such as GPS (Global Positioning System) instead of the above three-point positioning method.

  Subsequently, the CPU 11 receives a captured image of the monitoring camera 400 from the monitoring camera 400 whose imaging range is (or exists in) the position (area) corresponding to the detected position information, and the captured image A person is extracted from (step 55). The CPU 11 may further set a range corresponding to the position of the wristband terminal 200 from the captured image, and extract a person included in the target range as a target person for face authentication. The person extraction range is, for example, from the position information of the wristband terminal 200 to a range of several meters.

  Subsequently, the CPU 11 determines whether or not a person has been extracted from the captured image (step 56).

  When it is determined that the person has been extracted (Yes), the CPU 11 extracts a face image from the person, and collates the extracted face image with the face image corresponding to the wristband ID, thereby It is authenticated that the wearer of wristband terminal 200 is a registered user (step 57). This face authentication confirms the band wearer's authority to enter the venue. When a plurality of persons are extracted around the wristband terminal 200, face authentication is sequentially performed from the person closest to the band position, and the process proceeds to the next process when the authentication is successful. If the extracted person includes a person who has already been registered as a user corresponding to another wristband terminal 200, the person is excluded from the target of the current face authentication. Also good.

  When the collated two face images match (Yes in Step 58), the CPU 11 transmits a biometric information transmission request to the wristband terminal 200 having the registered wristband ID (Step 59). .

  When the CPU 11 receives the biometric information transmitted from the wristband terminal 200 in response to the biometric information transmission request, the CPU 11 registers the biometric information in the storage unit 18 for authentication in association with the wristband ID ( Step 60).

  After completing the registration of the biometric information, the CPU 11 registers the wristband terminal 200 (corresponding to the wristband terminal 200) having the wristband ID as a band permitted to enter (turns on the attendee registration flag in the storage unit 18). (Step 61). At this time, the CPU 11 may notify the wristband terminal 200 that it has been registered as a user who can enter.

  On the other hand, if no person is extracted from the captured image of the monitoring camera 400 in the area corresponding to the position of the wristband terminal 200 in step 56 (No), and in step 58, band matching is performed by collating the face image. When the identity of the wearer cannot be confirmed (when the two collated face images do not match), the CPU 11 determines whether or not the monitoring timer has expired (step 62).

  When it is determined that the monitoring timer has expired (Yes), the CPU 11 transmits a ringing instruction (notification request) instructing buzzer output and / or vibration to the wristband terminal 200 having the wristband ID ( Step 63).

  This is performed to alert the wearer of the wristband terminal 200 that the face authentication is not successful, and thus, if the user is a legitimate user, the surveillance camera can be used so that the face authentication is successful. An effect of prompting an action for successful face authentication, such as facing 400 and standing still for a while, can be obtained. In addition, there is a possibility that the wristband terminal 200 has accidentally dropped from the user's body, a possibility that the user intentionally removed the wristband terminal 200, or a person who does not have admission authority wears the wristband terminal 200. It may also be employed to notify the user or the surrounding person of the possibility of being present.

  If it is determined that the monitoring timer has not expired (No), the CPU 11 repeats the processing from step 54 onward.

  The CPU 11 executes the above-described processing of Step 52 in the order of reception for each wristband terminal 200 that has received the first attachment detection notification.

(Authentication process when passing through the entrance gate device)
FIG. 6 is a diagram illustrating an operation flow of the wristband terminal 200 when the user passes through the entrance gate device 300.

  As shown in the figure, the CPU 21 of the wristband terminal 200 determines whether an authentication information request signal has been received from the admission gate device 300 by the NFC communication unit 32 (step 71).

  If it is determined that the request signal has been received (Yes), the CPU 21 determines whether authentication result information based on biometric information is held (step 72).

  When determining that the authentication result information is not held (No), the CPU 21 reads the user's biometric information (wrist vein pattern) by the authentication sensor 24 (step 73).

  Subsequently, the CPU 21 transmits the read biological information and the wristband ID of the wristband terminal 200 to the entrance gate device 300 (step 74).

  On the other hand, when it is determined in step 72 that the authentication result information is held (Yes), the CPU 21 transmits the authentication result information and the wristband ID of the wristband terminal 200 to the entrance gate device 300 ( Step 75).

  Here, the case where the wristband terminal 200 holds the authentication result information is a case where the entrance authority has been authenticated by the biometric information in the other entrance gate device 300 in the venue, and the user enters the venue for the first time. In such a case, the authentication result is not retained.

  Subsequently, the CPU 21 determines whether or not an admission permission notice has been received from the admission gate device 300 (step 76).

  When the ticket authentication server 100 receives the wristband ID and the biometric information or the authentication result information from the wristband terminal 200 via the entrance gate 300, the ticket authentication server 100 permits the user to enter when the authentication result information is received. If received, the user is allowed to enter if the biometric information stored in correspondence with the wristband ID matches and matches. Information necessary for authentication may be transmitted in advance from the ticket authentication server 100 to the admission gate device 300, and the admission permission may be determined by the admission gate device 300, or only when the ID and authentication result information are received. The gate device 300 may determine that admission is permitted.

  Here, the admission permission signal is transmitted (that is, the admission authority is authenticated) only when it is confirmed that the band wearer is a user having admission authority by the face authentication process described above. It is done. That is, if the identity of the band wearer has not been verified, the band wearer is not registered as a user who can enter, and the biometric information is not registered. A permission signal is transmitted.

  If it is determined in step 76 that an admission permission notification has been received (Yes), the CPU 21 notifies the user that admission has been permitted, for example, by light emission from the LED light source 26. In this case, for example, the LED light source 26 turns on a green LED.

  When the authentication result information is not yet stored in the storage device 22, the CPU 21 newly stores the authentication result information based on the admission permission notification in the storage device 22. That is, the CPU 21 stores in the storage device 22 a flag indicating that the admission authority has been authenticated. As described in the attachment monitoring process, the authentication result information is discarded when the wristband terminal 200 is removed (from attachment to non-attachment), but automatically when a certain period (for example, 60 minutes or 8 hours) has elapsed. Discarded.

  On the other hand, if it is determined in step 76 that the admission non-permission notification has been received (No), the CPU 21 notifies the user that admission is not permitted, for example, by the light emission of the LED light source 26 and the vibration of the vibration device 29. To do. In this case, for example, the LED light source 26 blinks the red LED.

  The wristband terminal 200 executes the above processing every time the user passes through each entrance gate device 300 inside and outside the venue.

  As described above, according to the present embodiment, the ticket authentication system registers the face image of the ticket purchaser when the wristband terminal 200 is provided, and confirms the identity of the band wearer by photographing in the area around the venue ( Biometric information is registered through face authentication processing, and biometric authentication is performed when the band wearer passes through the entrance gate device 300 at the entrance of the venue. Therefore, it is possible to confirm whether or not the band wearer is an authorized user by face authentication without registering biometric information such as vein patterns in advance, and facilities, vehicles, and events can be performed without sacrificing user convenience. Unauthorized use of entrance tickets to the venue can be prevented at a low cost. That is, the registration of a face image at the time of ticket provision is less resistance and less expensive than the registration of biometric authentication. Therefore, the biometric information is authenticated after authenticating the user with the face image. By authenticating the user, unauthorized use of the ticket can be prevented at low cost.

[Modification]
The present technology is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present technology.

  In the above-described embodiment, the ticket authentication server 100 starts the monitoring timer by receiving the notification of wearing detection of the wristband terminal 200 by the user. However, instead of this, or in addition to this, the ticket authentication server 100 may start the monitoring timer from the time of providing the wristband terminal 200 to the user. At the time of provision, for example, when a face image or user information is registered in the ticket authentication server 100 in association with a wristband ID in the ticket issuing office or ticket delivery office, or issued by the wristband terminal 200 after registration It is the time when In this case, the provision date and time of the wristband terminal 200 is stored, and it is determined whether or not the wristband terminal 200 is mounted and face authentication is performed within a predetermined time from the provision date and time. As a result, the system allows the user to wear the wristband terminal 200 and perform face authentication processing when the date and time until the event is limited, such as when the wristband terminal 200 is provided on the day of the event at the venue. It can be executed quickly.

  In the above-described embodiment, the ringing instruction is transmitted to the wristband terminal 200 when the monitoring timer expires. In addition to this, when a predetermined time has passed after the ringing instruction, the ticket authentication server 100 analyzes the captured images sequentially acquired by the monitoring camera 400 for persons at positions corresponding to the band position information. In addition, the position of the person and the captured image including the person may be reported as suspicious person information to a communication terminal possessed by a security guard or a venue manager.

  In the above-described embodiment, the biometric information authentication process is executed by the request signal from the entrance gate device 300. However, instead of the request signal, when the authentication button provided on the wristband terminal 200 is pressed, the buzzer or vibration is sounded and the wristband terminal 200 shifts to the authentication mode and the authentication process may be started. .

  In the above-described embodiment, the wristband terminal 200 is provided at a ticket issuing office or a delivery office. However, when the wristband terminal 200 is provided by mail or the like, for example, a photograph (paper) showing a face image may be mailed to the administrator of the ticket authentication server 100 and digitized, or face image data May be transmitted to the ticket authentication server 100.

  In the above-described embodiment, the vein pattern of the user's wrist is used as the biometric information. For example, a vein pattern of the back of the hand, a fingerprint pattern, a pulse wave pattern, a palm print pattern, or the like may be used for the user's finger. . When a fingerprint pattern is used, a wristband having the same shape as the wristband terminal 200 is used, and a fingerprint sensor that can read a fingerprint by placing a finger on the outer surface of the wristband terminal 200 is used. Good.

  Further, the present invention can be similarly applied to a wearable terminal other than the wristband shape according to the type of the biological information. For example, when using a finger vein pattern, a fingerprint pattern, or a pulse wave pattern, a cap shape or ring shape that can be attached to a fingertip that can be attached to the finger can be adopted, and when using a vein pattern or palm pattern on the back of the hand, A glove-like shape that can be worn on the hand can be adopted.

  In the embodiment described above, the authentication process using biometric information is executed by the ticket authentication server 100 via the entrance gate device 300. However, the authentication process may be executed alone by the ticket authentication server 100. In this case, when the ticket authentication server 100 detects that the wristband terminal 200 is present in the vicinity of the entrance gate device 300, the ticket authentication server 100 acquires biometric information from the wristband terminal 200 through a wireless LAN or the like and performs verification.

  The authentication process may be executed by the wristband terminal 200. In this case, the authentication sensor 24 of the wristband terminal 200 not only reads the biological information while the wristband terminal 200 is worn by the user, but also registers the read biological information in the storage device 22, and the registered biological information and Then, the authentication process is executed by collating with the biometric information read after that. The wristband terminal 200 holds the authentication result information in the storage device 22 so that when the user passes the entrance gate device 300, the wristband terminal 200 transmits the authentication result information to the entrance gate device 300 and receives permission to pass. It is possible. The authentication process may be executed when the wristband terminal 200 is detected to be worn, or may be executed by pressing an authentication button provided on the wristband terminal 200. When the biometric information is authenticated, the LED light source 26 may notify the authentication result.

  In the above-described embodiment, biometric authentication is executed when the user of the wristband terminal 200 passes through the entrance gate device 300 for the first time. However, instead of this, biometric authentication may be executed by the ticket authentication server 100 or the wristband terminal 200 every time the user wears the wristband terminal 200. In this case, since the wristband terminal 200 holds the authentication result information, the authentication process at the time of passing through the entrance gate device 300 becomes unnecessary. Further, the wristband terminal 200 may hold the authentication result information at the time when the registration of the biometric information to the ticket authentication server 100 is completed when the first wearing is detected. In addition, when the wristband terminal 200 is in the wearing state, the authentication process may be executed (for example, periodically).

  Further, in the above-described embodiment, the authentication result information when the user first passes through the entrance gate device 300 is held in the wristband terminal 200, and when the entrance gate device 300 passes thereafter, the authentication result information is transmitted. Therefore, the re-authentication process is unnecessary. However, the authentication result information may not be held, and biometric information reading and authentication processing may be executed each time the entrance gate device 300 passes.

  Furthermore, in the above-described embodiment, the ticket authentication server 100 monitors whether face authentication is performed within a predetermined time after the wristband terminal 200 is attached. However, the wristband terminal 200 may perform the monitoring instead. In this case, the wristband terminal 200 detects a change in state from non-wearing to wearing, and if this is the first time wearing, the wristband terminal 200 notifies the ticket authentication server 100 of wearing (step 44 in FIG. 4) and at a predetermined time. Start the monitoring timer. Then, until the monitoring timer expires, the read biometric information is transmitted in response to the biometric information request after the face authentication is successful in the ticket authentication server 100 (step 47), and the attendee registration is completed. Monitor for notifications.

  Further, in the above-described embodiment, entry into not only the venue (restricted area) but also the area around the venue (peripheral area) may be restricted. In this case, a gate device is also provided at the entrance to the venue surrounding area, and it is determined whether or not a person who passes through the gate device can enter the venue surrounding area from the outside. In view of the fact that face authentication for confirming the wearer's identity is performed in the venue surrounding area, the wristband terminal 200 is detected when entering the venue surrounding area, or the wristband terminal 200 is The band owner is allowed to enter on the condition that it is in the wearing state.

  In the above-described embodiment, the present invention is applied to the process for determining whether or not to enter the event venue. However, the present invention is applied to the process for determining whether or not to enter another place such as a predetermined facility, room, or vehicle. May be.

11 ... CPU
18 ... Storage unit 19 ... Communication unit 21 ... CPU
DESCRIPTION OF SYMBOLS 22 ... Memory | storage device 23 ... Proximity sensor 24 ... Authentication sensor 25 ... Timer 26 ... LED light source 29 ... Vibration apparatus 30 ... Buzzer apparatus 31 ... Bluetooth (trademark) communication part 32 ... NFC communication part 33 ... LAN communication part 100 ... Ticket authentication Server 200 ... Wristband terminal 300 ... Entrance gate device 400 ... Surveillance camera

Claims (8)

A storage unit that associates and stores identification information of a wearable electronic ticket terminal for entering the restricted area and a face image acquired in advance for a user who possesses the wearable electronic ticket terminal;
A communication unit capable of communicating with the wearable electronic ticket terminal and a monitoring camera that images a peripheral area through which the user can pass when entering the restricted area;
A face image corresponding to the stored identification information when receiving the wear detection information indicating that the wearable electronic ticket terminal is worn on a person from the wearable electronic ticket terminal together with the identification information. And a control unit capable of authenticating that the wearer of the wearable electronic ticket terminal is the user by comparing the face image extracted from the captured image of the monitoring camera with
The controller is
When the wearer of the wearable electronic ticket terminal is authenticated as the user by collating the face image, the biometric information requesting the wearable electronic ticket terminal to transmit the biometric information read from the wearer Transmitting a transmission request, and storing the biometric information of the wearer received in response to the biometric information transmission request in the storage unit in association with the identification information;
When biometric information read from a wearer of the wearable electronic ticket terminal is received from the wearable electronic ticket terminal entering the restricted area, the received biometric information and the stored biometric information are collated. , Determining whether or not the wearer can enter the restricted area according to the matching result,
An information processing apparatus characterized by that . The information processing apparatus according to claim 1,
The control unit acquires position information of the wearable electronic ticket terminal by wireless communication with the wearable electronic ticket terminal, and acquires a face image of a person existing at a position corresponding to the acquired position information in the captured image. Information processing device to extract. An information processing apparatus according to claim 2,
The storage unit stores a correspondence relationship between a plurality of the surrounding areas and the monitoring camera that images each of the surrounding areas,
The information processing apparatus that extracts the face image from the captured image of a monitoring camera that captures a peripheral area corresponding to the acquired position information among the plurality of peripheral areas. The information processing apparatus according to claim 1,
The control unit determines whether or not the user is authenticated within a first time from reception of the wearing detection information by collating the face image. The information processing apparatus according to claim 4,
The control unit is configured to notify the wearer or the surroundings that the user is unauthenticated to the wearable electronic ticket terminal when the user is not authenticated within a first time from the reception of the wear detection information. An information processing apparatus that transmits a notification request. The information processing apparatus according to claim 4,
When the user is authenticated within a first time after receiving the wearing detection information, the control unit permits the received identification information of the wearing electronic ticket terminal to enter the restricted area. An information processing apparatus that stores the identification information of the wearable electronic ticket terminal in the storage unit. The information processing apparatus according to claim 1,
The storage unit stores the date and time when the wearable electronic ticket terminal was provided,
The control unit determines whether or not the user is authenticated within a second time from the date and time when the wearable electronic ticket terminal is provided by collating the face image. An information processing system comprising a wearable electronic ticket terminal for a user to enter a restricted area and an information processing device,
The wearable electronic ticket terminal is
A first storage unit for storing identification information of the wearable electronic ticket terminal;
A first communication unit capable of communicating with the information processing apparatus;
A detection unit capable of detecting that the wearable electronic ticket terminal is worn by a person;
A first control unit that transmits mounting detection information indicating detection of the mounting together with the stored identification information to the information processing apparatus when the mounting is detected;
The information processing apparatus includes:
A second storage unit that stores a face image acquired in advance for the user possessing the wearable electronic ticket terminal and the identification information in association with each other;
A second communication unit capable of communicating with the wearable electronic ticket terminal and a monitoring camera that images a peripheral area through which the user can pass when entering the restricted area;
When the wear detection information is received together with the identification information from the wearable electronic ticket terminal, the face image corresponding to the stored identification information is collated with the face image extracted from the captured image of the monitoring camera. in, have a second controller capable certify that the wearer of the wearable electronic ticket terminal is the user,
The second controller is
When the wearer of the wearable electronic ticket terminal is authenticated as the user by collating the face image, the biometric information requesting the wearable electronic ticket terminal to transmit the biometric information read from the wearer Transmitting a transmission request, storing the biometric information of the wearer received in response to the biometric information transmission request in association with the identification information in the second storage unit;
When biometric information read from a wearer of the wearable electronic ticket terminal is received from the wearable electronic ticket terminal entering the restricted area, the received biometric information and the stored biometric information are collated. , Determining whether or not the wearer can enter the restricted area according to the matching result,
An information processing system characterized by this .