JP6927099B2 - Automatic ticket gates, ticket gate processing methods, and programs - Google Patents

Description

The present invention relates to an automatic ticket gate, a ticket gate processing method, and a program having a function of authenticating the authenticated person based on the acquired face information of the authenticated person.

Conventionally, there is known a face recognition function that authenticates a user based on a user's face image acquired by a camera or the like and user authentication information registered in advance. The face recognition function collates the feature amount extracted from the face image of the user with the registered authentication information, and authenticates the user when the degree of matching is equal to or higher than the reference value. As a conventional technique using the face recognition function, for example, the face data of a user who uses a paid facility is registered in advance as face matching data, and the face data of the user acquired when using the facility is matched with the face. An automatic ticket gate having a function of collating with data has been proposed (see, for example, Patent Document 1). The automatic ticket gate controls whether or not to pass to a pay facility based on the matching result of face data and the determination result of the usage medium discrimination means for discriminating the usage medium possessed by the user.

Japanese Unexamined Patent Publication No. 2005-135059

It is expected that automatic ticket gates equipped with the above-mentioned face recognition function will be installed at the ticket gates of stations in the future. Generally, in a conventional automatic ticket gate installed at a ticket gate of a station, a user who uses the automatic ticket gate uses various ticket media such as a magnetic ticket, an IC ticket, and a QR ticket. Therefore, the conventional automatic ticket gate has a configuration capable of performing ticket gate processing on various ticket media. When the above-mentioned face recognition function is added to such a conventional automatic ticket gate, the following problems may occur.

For example, a user who has registered face information in advance and has consented to perform face recognition processing at the time of ticket gate processing may wish to perform ticket gate processing using a ticket medium such as an IC ticket. .. This is, for example, when the user wants to use the amount charged in the IC ticket, when he / she owns an IC commuter pass and wants to use the IC commuter pass, or when he / she wants to use the IC commuter pass purchased in advance. For example, if you want to. In such a case, if the face recognition process is performed at the automatic ticket gate before the user uses the ticket medium at the automatic ticket gate, the user cannot use the ticket medium.

An object of the present invention is to provide an automatic ticket gate, a ticket gate processing method, and a program capable of using a ticket medium in ticket gate processing even for a user who has pre-registered face information.

The automatic ticket gate according to one aspect of the present invention acquires the face information of the authenticated person used in the face authentication process for determining whether or not to authenticate the authenticated person based on the face information of the authenticated person. The face information acquisition unit, the ticket information acquisition unit capable of acquiring the ticket information of the ticket medium used by the authenticated person after the face information is acquired by the face information acquisition unit, and the face information. A medium capable of executing a medium authentication process for determining whether or not to authenticate the ticket medium based on the ticket information acquired by the ticket information acquisition unit after the face information is acquired by the acquisition unit. Passage control that allows the person to be authenticated to pass through the ticket gate when the ticket medium is authenticated by the medium authentication process after the face information is acquired by the authentication processing unit and the face information acquisition unit. It is equipped with a department.

The automatic ticket gate according to another aspect of the present invention acquires the face information of the authenticated person used in the face authentication process for determining whether or not to authenticate the authenticated person based on the face information of the authenticated person. The ticket medium is authenticated based on the face information acquisition unit, the ticket information acquisition unit that acquires the ticket information of the ticket medium used by the authenticated person, and the ticket information acquired by the ticket information acquisition unit. It is specified from the media authentication processing unit that executes the media authentication process that determines whether or not, the operation information acquisition unit that acquires the operation information of the person to be authenticated, and the operation information acquired by the operation information acquisition unit. When it is determined that the operation of the person to be authenticated is an operation indicating the use of the ticket medium, the person to be authenticated is allowed to pass through the ticket gate passage based on the authentication result of the medium authentication process. While deciding whether to prohibit or prohibit, when it is determined that the operation of the authenticated person specified from the operation information acquired by the operation information acquisition unit is not an operation representing the use of the ticket medium. A traffic control unit for determining whether to allow or prohibit the person to be authenticated from passing through the ticket gate is provided based on the authentication result of the face authentication process.

The ticket gate processing method according to another aspect of the present invention acquires the face information of the authenticated person used in the face authentication process for determining whether or not to authenticate the authenticated person based on the face information of the authenticated person. Steps to be performed, a step in which the ticket information of the ticket medium used by the authenticated person can be acquired after the face information is acquired, and the ticket information acquired after the face information is acquired. Based on the step that can execute the medium authentication process for determining whether or not to authenticate the ticket medium, and when the ticket medium is authenticated by the medium authentication process after the face information is acquired. , The step of allowing the person to be authenticated to pass through the ticket gate.

The program according to another aspect of the present invention is a step of acquiring the face information of the person to be authenticated used in the face authentication process for determining whether or not to authenticate the person to be authenticated based on the face information of the person to be authenticated. Based on the step in which the ticket information of the ticket medium used by the authenticated person can be acquired after the face information is acquired, and the ticket information acquired after the face information is acquired. , A step capable of executing a medium authentication process for determining whether or not to authenticate the ticket medium, and when the ticket medium is authenticated by the medium authentication process after the face information is acquired, the above. It is a program for causing a program for a computer to execute a step of permitting an authenticated person to pass through a ticket gate.

According to the present invention, even a user who has pre-registered face information can use the ticket medium in the ticket gate processing.

FIG. 1 is a diagram showing a network configuration of a station affairs system according to an embodiment of the present invention. FIG. 2 is a block diagram showing a configuration of each device of the station affairs system according to the embodiment of the present invention. FIG. 3 is a block diagram showing a configuration of an automatic ticket gate according to an embodiment of the present invention. FIG. 4 is a perspective view showing an example of an automatic ticket gate according to an embodiment of the present invention. FIG. 5 is a flowchart showing an example of face information registration processing executed by the registration terminal device of the station affairs system according to the embodiment of the present invention. FIG. 6 is a flowchart showing an example of ticket gate processing executed by the automatic ticket gate according to the embodiment of the present invention. FIG. 7 is a flowchart showing another example of the ticket gate processing executed by the automatic ticket gate according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. It should be noted that the embodiments described below are merely examples that embody the present invention, and do not limit the technical scope of the present invention.

[Station system 100]
As shown in FIG. 1, the station affairs system 100 according to the embodiment of the present invention includes an automatic ticket gate 1 (an example of the automatic ticket gate of the present invention), a registration terminal device 2, a station server 3, and a center device 4. include. Note that FIG. 1 shows two stations 8 (8A, 8B), and the illustration of other stations is omitted. Each station 8 has a plurality of automatic ticket gates 1, a registration terminal device 2, a station server 3, a ticket vending machine (not shown), a checkout machine (not shown), and a station staff terminal (not shown) used by station staff. Office equipment is installed. These station affairs devices are connected to the station server 3 via a network N1 such as a LAN. Further, the station server 3 of each station 8 is connected to the center device 4 of the railway operator (railway company) via the network N2 such as a dedicated line and a public line.

The automatic ticket gate 1 is installed at the ticket gate of the station 8. The automatic ticket gate 1 serves as an automatic ticket gate for entrance that performs ticket gate processing (entrance ticket gate processing) for users who enter the station premises from the ticket gate, and participates from the station premises to the outside of the ticket gate. It plays the role of an automatic ticket gate for entry that performs ticket gate processing (participation ticket gate processing) for users.

The automatic ticket gate 1 acquires the face information of the user (certified person) who intends to pass through the ticket gate passage 6 (see FIG. 4) of the automatic ticket gate 1, and authenticates the user using the face information. It is provided with a face recognition function for authenticating a ticket medium and a medium authentication function for authenticating the ticket medium using the ticket information of the ticket medium when the user uses the ticket medium (for example, an IC ticket). Based on the authentication result by the face recognition function and the authentication result by the medium authentication function, the automatic ticket gate 1 opens the gate 15 to allow the ticket gate passage 6 to pass, or closes the gate 15 to allow the ticket gate passage. The passage of 6 is prohibited. In addition to the face recognition function, the automatic ticket gate 1 may be provided with an authentication function that authenticates the user by using a fingerprint, a palm print, a finger or palm vein pattern, or the like.

The registration terminal device 2 is installed near the ticket gate of the station 8 or the station office. The registration terminal device 2 registers the face information of the user used in the automatic ticket gate 1. For example, when a user who is permitted to use the station affairs system 100 operates the registration terminal device 2 and inputs the user ID of the user, the registration terminal device 2 displays the registration screen corresponding to the user ID. When face information is input from the user on the registration screen, authentication data (authentication information) used for face authentication processing executed by the automatic ticket gate 1 described later is created from the face information and used as a user ID. Correspond and register. As the face information, the relative position, size, shape feature amount, and the like of the user's facial parts (eyes, nose, mouth, chin, cheekbones, etc.) can be applied.

The registration terminal device 2 is not limited to the one installed as an independent terminal device. For example, the registration function for registering face information is installed in the ticket vending machine, the checkout machine, the station employee terminal, and the like. You may. Further, the registered terminal device 2 is not limited to the one installed at the station 8. For example, the registration terminal device 2 may be an information processing device connected to the center device 4 or the station server 3 via the Internet so that data communication is possible.

Hereinafter, specific configurations of the automatic ticket gate 1, the registration terminal device 2, the station server 3, and the center device 4 constituting the station affairs system 100 will be described.

[Registered terminal device 2]
The registration terminal device 2 is installed near the ticket gate of the station 8, the station office, etc., and as shown in FIG. 2, the control unit 21, the operation input unit 22, the display unit 23, and the storage unit 2 are stored. A unit 24, a face information acquisition unit 25, and a communication unit 26 are provided.

The communication unit 26 connects the registration terminal device 2 to the network N1 by wire or wirelessly, and executes data communication with an external device such as a station server 3 via the network N1 according to a predetermined communication protocol. It is a communication interface.

The operation input unit 22 is a user interface such as a mouse, keyboard, or touch panel that accepts user operations. By operating the operation input unit 22, the user performs the registration work of his / her own face information in the registration terminal device 2.

The display unit 23 is a display device such as a liquid crystal display or an organic EL display that displays various types of information. On the screen of the display unit 23, information input from the operation input unit 22, information acquired by the face information acquisition unit 25, and the like are displayed.

The storage unit 24 is a non-volatile storage medium including an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 24 stores a control program for causing the control unit 21 to execute various processes, authentication data used for face recognition processing executed by the automatic ticket gate 1, and the like.

The face information acquisition unit 25 acquires the face information of the registrant who intends to register the face information. For example, the face information acquisition unit 25 acquires a face image of a registrant by an imaging unit such as a digital camera, extracts a facial feature amount (an example of face information) from the acquired face image, and converts it into data.

When the face information of the registrant is acquired by the face information acquisition unit 25, the acquired face information (hereinafter, may be referred to as “authentication face information”) is associated with the user ID of the registrant. The authentication data is generated, and the authentication data is transmitted to the station server 3, the automatic ticket gate 1, the center device 4, and the like. Further, the authentication data is transmitted from the center device 4 to the station server 3 and the automatic ticket gate 1 of another station 8. Each device that has received the authentication data stores (stores) the authentication data.

The control unit 21 controls the operation of each unit of the registration terminal device 2. The control unit 21 has control devices such as a CPU, a ROM, and a RAM. The ROM is a non-volatile storage medium in which control programs such as a BIOS and an OS for causing the CPU to execute various processes are stored in advance. The RAM is a volatile or non-volatile storage medium that stores various types of information, and is used as a temporary storage memory (work area) for various processes executed by the CPU. The control unit 21 controls the registration terminal device 2 by executing various control programs stored in advance in the ROM or the storage unit 24 on the CPU.

As shown in FIG. 2, the control unit 21 includes various processing units such as a reception processing unit 211, an authentication data generation unit 212, and a data transmission unit 213. The control unit 21 functions as the various processing units by executing various processes according to the control program on the CPU. Further, a part or all of the processing units included in the control unit 21 may be composed of an electronic circuit. The control program may be a program for causing a plurality of processors to function as the various processing units.

The reception processing unit 211 acquires the information input from the operation input unit 22 and executes the processing according to the information. For example, when the face information registration instruction is input from the operation input unit 22, the reception processing unit 211 displays the registration screen corresponding to the user ID of the registrant entered together with the registration instruction.

The authentication data generation unit 212 generates authentication data in which the face information acquired by the face information acquisition unit 25, the input user ID of the registrant, and the registration date and time are associated with each other. The generated authentication data is used for the face authentication process executed by the automatic ticket gate 1. The authentication data is stored in the storage unit 24. Further, the generated authentication data is transmitted to the station server 3, the automatic ticket gate 1, the center device 4, and the like, and further transmitted from the center device 4 to the station server 3 and the automatic ticket gate 1 of another station 8. NS.

The data transmission unit 213 transmits various information through the networks N1 and N2. When the authentication data is generated by the authentication data generation unit 212, the data transmission unit 213 transmits the authentication data to the station server 3, the automatic ticket gate 1, and the like.

[Station server 3]
The station server 3 is a server device installed in a station office or the like, and includes a control unit 31, a storage unit 32, and a communication unit 33, as shown in FIG. The control unit 31 controls the operation of the station server 3. The storage unit 32 stores information necessary for the control executed by the control unit 31. For example, the storage unit 32 stores the above-mentioned authentication data transmitted from the registration terminal device 2. The communication unit 33 controls data communication with the station affairs equipment including the automatic ticket gate 1 and the center device 4.

The control unit 31 of the station server 3 transmits the authentication data to another automatic ticket gate 1 of the station 8 where the station server 3 is installed, and also transmits the authentication data to the center device 4.

[Center device 4]
The center device 4 is a central monitoring device managed by a railway operator that operates a railway business including a station 8, and is a station service such as a station server 3 and an automatic ticket gate 1 of all stations 8 operated by the railway operator. Manage the equipment. As shown in FIG. 2, the center device 4 includes a control unit 41, a storage unit 42, and a communication unit 43. The control unit 41 controls the operation of the center device 4. The storage unit 42 stores information necessary for the control executed by the control unit 41. The communication unit 43 controls data communication with the station server 3 of each station.

When the control unit 41 of the center device 4 receives the authentication data sent from the station server 3, the control unit 41 transmits the authentication data to the station servers 3 of all the stations 8A and 8B having jurisdiction, and the station server 3 Transfers the authentication data to the automatic ticket gates 1 installed at each station 8A and 8B. As a result, in the automatic ticket gates 1 of all stations 8A and 8B, the authentication data regarding all the registrants who have registered the face information is stored (stored), and the authentication data can be used.

[Automatic ticket gate 1]
The automatic ticket gate 1 is installed at the ticket gate of the station 8, and performs ticket gate processing for users who pass through the ticket gate. As shown in FIG. 3, the automatic ticket gate 1 includes a control unit 11, a storage unit 12, a display unit 13, a communication unit 14, a gate 15, an IC card reading unit 16, and a QR code reading unit 17. , A face information acquisition unit 18 (an example of the face information acquisition unit of the present invention), and these are provided in the housing 10 (see FIG. 4) of the automatic ticket gate 1.

The storage unit 12 is a non-volatile storage medium including an HDD or SSD that stores various types of information. In this embodiment, the configuration in which the storage unit 12 is provided in the automatic ticket gate 1 is illustrated. For example, a part or all of various information in the storage unit 12 is automatically ticketed through network N1 or network N2. It may be stored in an external device such as another server device capable of data communication with the machine 1 or a storage device capable of connecting to a network. Further, the authentication data storage unit 121, which will be described later, may be stored in the external device. In this case, the automatic ticket gate 1 reads the authentication data from the external device as needed.

The storage unit 12 contains a control program for causing the control unit 11 to execute various processes such as various control processes, face authentication process executed by the automatic ticket gate 1, media authentication process, and various data used for the various processes. Is remembered.

Further, the storage unit 12 is provided with an authentication data storage unit 121 as a storage area and an authentication information storage unit 122 (an example of the authentication information storage unit of the present invention).

The authentication data storage unit 121 stores authentication data used for face recognition processing in the automatic ticket gate 1. The authentication data is transmitted from the center device 4 to the station server 3, and is transferred from the station server 3 to the automatic ticket gate 1. When the automatic ticket gate 1 receives the authentication data transferred from the station server 3, the received authentication data is stored in the authentication data storage unit 121.

When the user is authenticated by the face recognition process by the face recognition processing unit 113 described later, the authentication information storage unit 122 stores the user's authentication information (an example of the authentication information of the present invention). The authentication information is associated with the user ID of the user, the date of use by the user using the automatic ticket gate 1, the time of use, the station used, the entry / exit record, etc., and is stored in the authentication information storage unit 122 as authenticated data. Be remembered. The authentication information is stored in all the automatic ticket gates 1 installed at the station 8, and is updated in all the automatic ticket gates 1 every time the user is authenticated. Further, the authentication information is information shared by all automatic ticket gates 1 of all stations 8 under the jurisdiction of the center device 4.

The display unit 13 displays a message to the user passing through the ticket gate passage 6 in accordance with the instruction from the control unit 11. The display unit 13 has, for example, a liquid crystal panel. As shown in FIG. 4, the display unit 13 is arranged on the upper surface of the housing 10 of the automatic ticket gate 1, and more specifically, the display unit 13 is defined in the ticket gate passage 6 (see FIG. 4) on the upper surface of the housing 10. It is arranged on the front side of the traveling direction D10. In the present embodiment, the display unit 13 is arranged in front of the gate 15 in the traveling direction D10. When the passage of the user is permitted, a message indicating that the user can pass is displayed on the display unit 13. If the user is not allowed to pass, the display unit 13 displays a message indicating that the user is impassable (prohibited). When the automatic ticket gate 1 is used for participation, for example, a message indicating that the fare is insufficient may be displayed on the display unit 13.

The communication unit 14 connects the automatic ticket gate 1 to the network N1 by wire or wirelessly, and executes data communication with an external device such as a station server 3 via the network N1 according to a predetermined communication protocol. It is a communication interface.

The gate 15 is installed at the exit of the automatic ticket gate 1. The gate 15 is, for example, a door that can be opened and closed. When the gate 15 is opened, the user can pass through the ticket gate 6 of the automatic ticket gate 1, and when the gate 15 is closed, the user passes through the ticket gate 6 of the automatic ticket gate 1. Becomes impossible. The gate 15 may be a physical door or an electronic door using light. Further, the gate 15 may be a voice gate that allows or prohibits the passage of the user by voice.

The IC card reading unit 16 is provided on the upper surface of the housing 10. The IC card reading unit 16 reads information (ticket information (hereinafter referred to as "IC ticket information")) of a ticket in the form of an IC card (hereinafter referred to as "IC ticket"). The IC ticket information read by the IC card reading unit 16 is transmitted to the control unit 11. The control unit 11 executes the ticket gate processing based on the IC ticket information. A user who uses an IC ticket holds the IC ticket in the IC card reading unit 16 and passes through the ticket gate passage 6.

The QR code reading unit 17 is provided on the upper surface of the housing 10 on the front side in the traveling direction D10 with respect to the IC card reading unit 16. The QR code reading unit 17 includes a digital camera (imaging unit) that captures an image of the QR code printed on the face of the QR ticket and outputs it as digital image data. Here, the QR ticket is a medium (for example, a medium) in which a two-dimensional code (hereinafter, referred to as a QR code (registered trademark)) on which ticket information (hereinafter referred to as “QR ticket information”) is recorded is printed on the face of the ticket. It was issued as a ticket (paper medium). The image data captured by the QR code reading unit 17 is transmitted to the control unit 11. The control unit 11 acquires QR ticket information based on the image data and executes ticket gate processing. The user who uses the QR ticket holds the QR code on the QR code reading unit 17 and passes through the ticket gate passage 6.

As described above, the automatic ticket gate 1 uses a face authentication function that authenticates the user using face information and a ticket information (ticket information) of a ticket medium such as an IC ticket and a QR ticket. It is equipped with a medium authentication function that authenticates the medium. Therefore, the automatic ticket gate 1 is provided with a face information acquisition unit 18, an IC card reading unit 16, a QR code reading unit 17, and the like.

The face information acquisition unit 18 acquires face information of a user who intends to use the automatic ticket gate 1. The face information acquisition unit 18 includes an imaging unit 181 and a face feature amount acquisition unit 182. The automatic ticket gate 1 may include a function of acquiring a fingerprint, a function of acquiring biological information such as a palm print and a vein pattern, and the like. For example, the automatic ticket gate 1 shown in FIG. 4 is provided with a fingerprint acquisition unit 19, which makes it possible to acquire the fingerprint of the user.

The image pickup unit 181 is a digital camera or the like that captures a user's face image. As shown in FIG. 4, the imaging unit 181 is provided on the upper surface of the housing 10 on the front side of the QR code reading unit 17 in the traveling direction D10. The imaging unit 181 captures an image of the user's face before the user enters the ticket gate passage 6. The face feature amount acquisition unit 182 analyzes the user's face image captured by the image pickup unit 181 and extracts the face feature amount captured in the face image and converts it into data. The face image itself or the extracted facial feature amount information (hereinafter referred to as "feature amount information") is the user's face information. The feature amount information is used for face recognition processing by the face recognition processing unit 113 of the control unit 11.

For example, when face recognition is performed by the automatic ticket gate 1, the user walks in the traveling direction D10 and approaches the ticket gate passage 6. At this time, the feature amount information of the user is acquired by the face feature amount acquisition unit 182. When the feature amount information is acquired, a face recognition process using the acquired face information is performed.

The control unit 11 controls the operation of each unit of the automatic ticket gate 1. The control unit 11 has control devices such as a CPU, a ROM, and a RAM. The ROM is a non-volatile storage medium in which control programs such as a BIOS and an OS for causing the CPU to execute various processes are stored in advance. The RAM is a volatile or non-volatile storage medium that stores various types of information, and is used as a temporary storage memory (work area) for various processes executed by the CPU. Then, the control unit 11 controls the automatic ticket gate 1 by executing various control programs stored in advance in the ROM or the storage unit 12 on the CPU.

As shown in FIG. 3, the control unit 11 includes a reading processing unit 111, a medium authentication processing unit 112 (an example of the media authentication processing unit of the present invention), and a face recognition processing unit 113 (an example of the face recognition processing unit of the present invention). , The determination processing unit 114, the traffic control unit 115 (an example of the traffic control unit of the present invention), the gate processing unit 116, the notification processing unit 117 (an example of the output unit of the present invention), and the like. The control unit 11 functions as the various processing units by executing various processes according to the control program on the CPU. Further, a part or all of the processing units included in the control unit 11 may be composed of an electronic circuit. The control program may be a program for causing a plurality of processors to function as the various processing units.

The reading processing unit 111 acquires the IC ticket information read by the IC card reading unit 16. Further, when the IC ticket is authenticated, the reading processing unit 111 updates the IC ticket information by adding ticket gate information including a ticket gate record (for example, entry record, entry record, etc.) to the IC ticket information. For example, in the automatic ticket gate 1 for participation, the reading processing unit 111 deducts a predetermined amount (fare) from the amount charged in the IC ticket, and the reduced remaining amount (remaining amount) is used for the IC ticket. Write to the information holding part of. In addition, the reading processing unit 111 adds information such as entry records and entry records of IC tickets. As described above, the reading processing unit 111 has a function of acquiring IC ticket information and a function of adding ticket gate information to the IC ticket information. The information such as the balance, the entry record, and the entry record is an example of the ticket gate information of the present invention. The reading processing unit 111 is an example of the ticket information acquisition unit of the present invention. Further, when the magnetic ticket is inserted into the ticket slot, the reading processing unit 111 acquires the information of the magnetic ticket and adds the ticket gate information to the information.

Further, when the reading processing unit 111 acquires the image data captured by the QR code reading unit 17, the reading processing unit 111 optically reads the QR code from the image data. Further, the reading processing unit 111 acquires the QR ticket information recorded in the read QR code.

When the IC card reading unit 16 acquires the IC ticket information, the media authentication processing unit 112 performs the media authentication processing using the IC ticket information. The IC ticket information includes information such as the issue date and expiration date of the IC ticket, the amount charged (remaining amount), and the user ID. In addition, the IC commuter pass includes an IC commuter pass, and the IC commuter pass information in the case of the IC commuter pass includes information such as the issue date and expiration date of the IC commuter pass, the boarding section, and the user ID. It has been. The medium authentication processing unit 112 performs a process of authenticating the IC ticket based on the IC ticket information.

Further, when the QR ticket information is acquired by the reading processing unit 111, the media authentication processing unit 112 performs the media authentication processing using the QR ticket information. The QR ticket information includes information such as a station name, a ticket vending machine, an issue date, an issue time, an issue ticket type (“for adults” or “for children”), an amount, and an issue number. The medium authentication processing unit 112 performs a process of authenticating the QR ticket based on the QR ticket information.

The media authentication processing unit 112 performs media authentication processing using the IC ticket information when the user uses the IC ticket, and media using the QR ticket information when the user uses the QR ticket. Perform authentication processing. Further, the medium authentication processing unit 112 is not limited to the IC ticket or the QR ticket, but when the user uses another medium such as a magnetic ticket in which the ticket information is magnetically recorded, the medium is boarded. Media authentication processing is performed using the ticket information. That is, the medium authentication processing unit 112 performs a process of authenticating the ticket medium by using the ticket information recorded on the ticket medium, which is different from the biometric information such as face information. The ticket information is an example of the ticket information of the present invention.

When the face information of the user is acquired by the face information acquisition unit 18, the face recognition processing unit 113 performs face recognition processing using the face information. In the present embodiment, the face recognition processing unit 113 performs a process of authenticating the user based on the acquired face information and the authentication data stored in the authentication data storage unit 121. Specifically, the acquired face information is sequentially collated with each of the authentication data of a plurality of persons stored in the authentication data storage unit 121, and the degree of matching is equal to or higher than a predetermined reference value for authentication. It is determined whether or not the authentication data including the face information exists. That is, it is determined whether or not the degree of coincidence between the acquired face information and the registered face information for authentication stored in the authentication data storage unit 121 is equal to or higher than the reference value. Here, the reference value is a threshold value that can be evaluated as being able to reliably determine that the user (authenticated person) to be authenticated is the person in the face recognition process.

For example, the face recognition processing unit 113 has a feature amount for authentication (face information for authentication) in which the degree of matching of the feature amount of the face in the face image acquired from a plurality of authentication data is 85% (an example of a reference value) or more. ) Is included in the authentication data. Then, when the authentication data having the matching degree equal to or higher than the reference value exists, the user is authenticated as the person himself / herself. On the other hand, if there is no authentication data whose degree of matching is equal to or higher than the reference value, the user is not authenticated as the person himself / herself.

When the user is authenticated by the face recognition process, the face recognition processing unit 113 registers the user's authentication information in the authentication information storage unit 122. As a result, the authentication information of the user authenticated by the face authentication process is accumulated in the authentication information storage unit 122. Since the authentication information is shared by all the automatic ticket gates 1 of all the stations 8 under the jurisdiction of the center device 4, when the user participates, the face recognition processing unit 113 performs the face image captured at the time of participation. The face recognition process is performed based on the face information, the authentication data, and the authentication information.

After the face recognition processing is executed by the face recognition processing unit 113, for example, the face information acquisition unit 18 acquires the user's face information, the determination processing unit 114 uses the IC card reading unit 16 to acquire the IC ticket. Determine if the information has been read.

The traffic control unit 115 permits the user to pass through the ticket gate passage 6 when a predetermined condition is satisfied. The passage control unit 115 permits the user to pass through the ticket gate passage 6 based on the authentication result of the medium authentication process by the medium authentication processing unit 112 and the authentication result of the face authentication process by the face authentication processing unit 113. proclaim.

The gate processing unit 116 controls the operation (opening and closing, etc.) of the gate 15. For example, when the passage of the user in the ticket gate passage 6 is permitted, the gate processing unit 116 opens the gate 15. On the other hand, when the passage of the user in the ticket gate passage 6 is prohibited, the gate processing unit 116 closes the gate 15.

The notification processing unit 117 outputs each of the above messages to the user passing through the ticket gate passage 6 based on the determination result of the determination processing unit 114. For example, the notification processing unit 117 may display each of the above messages on the display unit 13, or may announce by voice from a speaker (not shown).

In the automatic ticket gate 1, for example, when the user walks in the traveling direction D10 and approaches a position about 1 m to 1.5 m in front of the automatic ticket gate 1, the image pickup unit 181 images the user's face image. , The face recognition process is started. That is, the user's face recognition process is executed before the user enters the ticket gate passage 6 of the automatic ticket gate 1.

Therefore, the following problems may occur. For example, a user who has registered face information in advance and has consented to perform face recognition processing at the time of ticket gate processing wants to perform ticket gate processing using a ticket medium such as an IC ticket that he / she owns. In some cases. For example, when the user wants to use the amount charged in the IC ticket, when he / she owns the IC commuter pass and wants to use the IC commuter pass, or when he / she wants to use the coupon ticket purchased in advance. Is. In such a case, if the face recognition process is performed at the automatic ticket gate before the user uses the ticket medium at the automatic ticket gate, the user cannot use the ticket medium. Therefore, the automatic ticket gate 1 according to the present embodiment has a configuration that enables the ticket gate processing by the ticket medium when the user wishes to perform the ticket gate processing by the ticket medium.

[Face information registration process]
Hereinafter, an example of the procedure of the face information registration process executed by the control unit 21 or the like of the registration terminal device 2 will be described with reference to the flowchart of FIG. In FIG. 5, S101, S102, ... Indicates a processing procedure number (step number).

When the user (registrant) who wishes to register operates the registration terminal device 2 and inputs his / her own user ID and the face information registration instruction, the control unit 21 receives the registration instruction in step S101. .. At this time, the face information registration screen is displayed on the display unit 13. After that, when the face information of the registrant is acquired from the face information acquisition unit 18 (S102), the authentication data generation unit 212 of the control unit 21 associates the face information with the user ID and the registration date. (Authentication information) is generated (S103). After that, the data transmission unit 213 of the control unit 21 transmits the generated authentication data to the station server 3 in order to make it available to all the automatic ticket gates 1 of all the stations 8 under the control of the center device 4. (S104).

In the station server 3, when the control unit 31 of the station server 3 receives the authentication data (S105), it stores it in the storage unit 32 (S106), and then transmits it to the center device 4 (S106).

Further, in the center device 4, when the control unit 41 of the center device 4 receives the authentication data (S108), it stores it in the storage unit 42 (S109). After that, the control unit 41 transmits the authentication data to the other station servers 3 other than the station server 3 that has transmitted the authentication data among the station servers 3 of all the stations 8 under the jurisdiction of the center device 4 (S110). ). In addition, each station server 3 transmits the received authentication data to the automatic ticket gate 1 so that it can be used for the face recognition process in the automatic ticket gate 1.

[Ticket processing]
Next, using the flowchart of FIG. 6, an example of the ticket gate processing method of the present invention will be described together with the procedure of the ticket gate processing executed in the automatic ticket gate 1. In FIG. 6, S201, S202, ... Indicates a processing procedure number (step number). The following ticket gate processing is based on a face authentication process using a user's face image and a medium authentication process using IC ticket information of an IC ticket (an example of a ticket medium) possessed by the user. This is an example of a process for determining whether to allow or prohibit the user from passing through the ticket gate passage 6 of the automatic ticket gate 1.

When the user advances toward the ticket gate passage 6 of the automatic ticket gate 1, the face information (feature amount of the face image) of the user is acquired by the face feature amount acquisition unit 182 before the user enters the ticket gate passage 6. Is done (S200). Specifically, the imaging unit 181 images the user's face image, and the face feature amount acquisition unit 182 extracts the facial feature amount reflected in the face image as the face information.

When the feature amount is extracted, in step S201, the control unit 11 performs a process of collating the feature amount with the authentication data. Specifically, the control unit 11 sequentially collates the feature amount with the authentication data of a plurality of persons stored in the authentication data storage unit 121.

In the next step S202, the control unit 11 (face recognition processing unit 113) performs the face recognition processing of the user. For example, the control unit 11 determines whether or not the degree of matching with the extracted feature amount is equal to or higher than the reference value for each of the plurality of registered authentication data stored in the authentication data storage unit 121. Perform the processing to be performed. In other words, the control unit 11 determines whether or not the authentication data including the authentication feature amount whose degree of coincidence with the extracted feature amount is equal to or higher than the reference value exists in the authentication data storage unit 121. The reference value is, for example, 85%.

When it is determined that the authentication data including the authentication feature amount whose matching degree is equal to or higher than the reference value exists (Yes in S202), the control unit 11 (face recognition processing unit 113) determines that the user is the person himself / herself. Authenticate.

In the next step S203, the control unit 11 (face recognition processing unit 113) registers the user's authentication information in the authentication information storage unit 122.

In the next step S204, the control unit 11 (determination processing unit 114) determines whether or not the IC ticket information has been read by the IC card reading unit 16.

When it is determined in step S204 that the IC ticket information has been read (Yes in S204), in step S205, the control unit 11 (media authentication processing unit 112) has read the IC boarding by the IC card reading unit 16. The medium authentication process of the IC ticket is performed using the ticket information. For example, the control unit 11 determines whether or not the IC ticket is appropriate (whether or not to authenticate) based on the information on the expiration date and the charged amount included in the IC ticket information. Perform media authentication processing.

When the IC ticket is appropriate and the IC ticket is authenticated (Yes in S205), the control unit 11 (reading processing unit 111) includes the ticket gate record in the IC ticket information of the IC ticket. Give information. For example, the control unit 11 (reading processing unit 111) writes an admission record (ticket gate record) in the IC ticket information.

In the next step S206, the control unit 11 deletes the user's authentication information from the authentication information storage unit 122. As a result, the authentication history (for example, admission record) obtained by the user's face recognition process is deleted.

In the next step S207, the control unit 11 (traffic control unit 115) permits the user to pass through the ticket gate passage 6. Then, the control unit 11 (gate processing unit 116) opens the gate 15 (S207). As a result, the user can pass through the automatic ticket gate 1.

On the other hand, if it is determined in step S202 that there is no authentication data including the authentication feature amount whose matching degree is equal to or higher than the reference value (No in S202), in step S208, the control unit 11 (determination processing unit 114) ) Determines whether or not the IC ticket information has been read by the IC card reading unit 16.

When it is determined in step S208 that the IC ticket information has been read (Yes in S208), the process proceeds to step S205, and as described above, the control unit 11 (media authentication processing unit 112) is the IC card reading unit 16. The medium authentication process of the IC ticket is performed using the IC ticket information read by. For example, when a user who has not registered face information uses an IC ticket, this process is executed.

When it is determined in step S208 that the IC ticket information has not been read (No in S208), the control unit 11 closes the gate 15 (S209) and issues a message indicating that the passage is impassable (prohibited). Notify the user (S210).

If it is determined in step S204 that the IC ticket information has not been read (No in S204), the process proceeds to step S207, and as described above, the control unit 11 (face recognition processing unit 113) moves to step S207. After authenticating that the user is the person himself / herself, the control unit 11 (gate processing unit 116) opens the gate 15 (S207). For example, when the user who has registered the face information does not use a ticket medium such as an IC ticket, this process is executed.

Further, in step S205, if the IC ticket is not appropriate (illegal) and the IC ticket is not authenticated (No in S205), the process proceeds to step S211 and the control unit 11 authenticates the user's authentication information. It is deleted from the information storage unit 122, and the process proceeds to step S209. In step S209, as described above, the control unit 11 closes the gate 15 (S209) and notifies the user of a message indicating that the passage is impassable (prohibited) (S210). As a result, the user can recognize that the face has been authenticated but the IC ticket has not been authenticated.

As described above, since the above-mentioned ticket gate processing is performed in the automatic ticket gate 1 of the station affairs system 100 according to the present embodiment, face information is registered in advance and face recognition processing is performed at the time of ticket gate processing. Even if the user who consents to the above uses a ticket medium such as an IC ticket, the ticket gate processing using the ticket medium is prioritized. Therefore, the user can pass through the ticket gate passage 6 using the ticket medium regardless of the face recognition process. In addition, the user can pass through the ticket gate passage 6 by face recognition processing when he / she does not intend to use the ticket medium or does not have the ticket medium. Therefore, the convenience of the user for the automatic ticket gate 1 is improved.

When a user who enters the station yard from the ticket gate by the above-mentioned process enters the station premises from the station yard to the outside of the ticket gate, for example, the following process may be performed in addition to the above-mentioned process. For example, the control unit 11 (face recognition processing unit 113) acquires an admission record from the user's authentication information in addition to the face recognition processing to authenticate the user. Further, the control unit 11 (media authentication processing unit 112) acquires an admission record from the IC ticket information and authenticates the IC ticket. Here, when the user passes (enters) the automatic ticket gate 1 using the IC ticket, the authentication information (entrance record, etc.) is deleted. Therefore, when the user participates, face authentication is performed. It will not be authenticated in the processing, but will be authenticated by the IC ticket.

The present invention is not limited to the above-described embodiment, and may be in the form shown below.

As another embodiment, for example, in the determination process of step S204 in the above-mentioned ticket gate processing, the control unit 11 (determination processing unit 114) determines whether or not the IC ticket information has been read by the IC card reading unit 16. The period may be preset. For example, in the determination processing unit 114, the face recognition processing unit 113 starts the user's face recognition process (the imaging unit 181 starts capturing the user's face image, and the face information acquisition unit 18 starts the user's face information. The determination process is performed until a predetermined time elapses after the determination is performed. As a result, the traffic control unit 115 receives the IC ticket by the reading processing unit 111 for a predetermined period after the face recognition processing is performed (for example, after the face information acquisition unit 18 acquires the user's face information). When the information is not acquired, the user is permitted or prohibited to pass through the ticket gate passage 6 based only on the result of the face recognition process.

Further, for example, in the determination processing unit 114, the face recognition processing unit 113 starts the user's face recognition process (the imaging unit 181 starts capturing the user's face image, and the face information acquisition unit 18 starts the user's face. After the information is acquired), the determination process is performed until the user passes the predetermined position. The predetermined position is set, for example, in the middle of the ticket gate passage 6, and the sensor 20 (see FIG. 4) for detecting the passage of the user is provided at the predetermined position. As a result, when the user passes the predetermined position after the face recognition process is performed (for example, after the face information acquisition unit 18 acquires the user's face information), the traffic control unit 115 causes the user to pass the predetermined position. Allows or prohibits the user from passing through the ticket gate 6 based only on the result of the face recognition process.

In the above-described embodiment, in step S205 in the above-mentioned ticket gate processing, after the user is authenticated by the face authentication process (S202), the IC ticket is not appropriate and the IC ticket is not authenticated. In the case (No of S205), the gate 15 is closed and the user is prohibited from passing through the ticket gate passage 6. As another embodiment, for example, as shown in FIG. 7, when the IC ticket is not appropriate and the IC ticket is not authenticated (No in S205), the control unit 11 (notification processing unit 117) can be used. A message indicating that the user has been authenticated by the face authentication process (for example, "face authentication completed") may be output (S212), and then the control unit 11 (gate processing unit 116) may open the gate 15 (S207). ). The message may include a message that the IC ticket has not been authenticated (for example, "IC ticket error"). The control unit 11 (notification processing unit 117) outputs at least one of a message indicating that the IC ticket has been authenticated by the face authentication process and a message indicating that the IC ticket has not been authenticated.

As another embodiment, the control unit 11 (determination processing unit 114) may determine whether or not the user intends to use the ticket medium based on the operation of the user. Specifically, the control unit 11 (an example of the operation information acquisition unit of the present invention) analyzes the image of the user captured by the image pickup unit 181 and acquires the operation information of the user. The control unit 11 (determination processing unit 114) sequentially collates the operation pattern specified from the acquired operation information with each of the plurality of preset basic operation patterns, and the degree of matching is a predetermined reference value. It is determined whether or not the above basic operation pattern exists. That is, the control unit 11 (determination processing unit 114) determines whether or not the degree of coincidence between the acquired operation pattern and the basic operation pattern is equal to or greater than the reference value. Here, the reference value is a threshold value that can be evaluated as being able to reliably determine that the user's action is an action representing the use of the ticket medium, that is, an action of attempting to use the ticket medium in the determination process. Is. The basic operation pattern is, for example, an operation in which a user approaching the automatic ticket gate 1 takes out a ticket medium with his right hand, a reading unit (IC card reading unit 16, QR code reading unit 17, etc.) of the automatic ticket gate 1 for taking out the ticket medium. ) Or the operation of inserting into the ticket slot.

When it is determined that the user's action is an action representing the use of the ticket medium, for example, the face recognition processing unit 113 does not execute the face recognition process (for example, the processes of S200 to S203 in FIG. 6). It may be configured to execute the medium authentication process. Further, when the user's action is determined to represent the use of the ticket medium after the face recognition process is performed (for example, after the face information acquisition unit 18 acquires the user's face information). The control unit 11 may execute a process (S206 of FIG. 6) of deleting the authentication information of the face recognition process by the face recognition processing unit 113.

That is, the traffic control unit 115 determines that the user's operation specified from the operation information acquired by the control unit 11 (an example of the operation information acquisition unit of the present invention) is an operation representing the use of the ticket medium. If so, it is determined whether to allow or prohibit the user from passing through the ticket gate based on the authentication result of the medium authentication process, while specifying from the operation information acquired by the control unit 11. When it is determined that the user's action is not an action representing the use of the ticket medium, the user is allowed or prohibited from passing through the ticket gate based on the authentication result of the face recognition process. You may decide.

As another embodiment, a part or all of the processing units included in the control unit 11 of the automatic ticket gate 1 may be included in the control unit 31 of the station server 3. For example, the face recognition processing unit 113 included in the control unit 11 of the automatic ticket gate 1 may be included in the control unit 31 of the station server 3, and the station server 3 may execute the face recognition processing. In this case, the authentication data storage unit 121 and the authentication information storage unit 122 included in the storage unit 12 of the automatic ticket gate 1 may be included in the storage unit 32 of the station server 3. For example, when the automatic ticket gate 1 acquires the face information of the user by the face information acquisition unit 18, the automatic ticket gate 1 transmits the face information to the station server 3. When the control unit 31 of the station server 3 acquires (receives) the face information, the control unit 31 performs the face recognition process based on the face information and the authentication data stored in the authentication data storage unit 121 of the storage unit 32. conduct. The station server 3 transmits the authentication result of the face recognition process to the automatic ticket gate 1.

Further, the media authentication processing unit 112 included in the control unit 11 of the automatic ticket gate 1 may be included in the control unit 31 of the station server 3, and the station server 3 may execute the media authentication processing. For example, the automatic ticket gate 1 transmits the IC ticket information read by the IC card reading unit 16 to the station server 3. When the control unit 31 of the station server 3 acquires (receives) the IC ticket information, the control unit 31 performs the medium authentication process of the IC ticket using the IC ticket information. The station server 3 transmits the authentication result of the medium authentication process to the automatic ticket gate 1.

The station server 3 determines whether to allow or prohibit the user from passing through the ticket gate passage 6 based on the authentication result of the face recognition process and the authentication result of the medium authentication process. The determination result may be transmitted to the automatic ticket gate 1. In this case, the automatic ticket gate 1 opens or closes the gate 15 based on the determination result.

As described above, various processes executed by the automatic ticket gate 1 shown in FIG. 3 are realized not only by one automatic ticket gate 1 but also by a system that operates in cooperation with another one or a plurality of computers. May be done.

1: Automatic ticket gate 2: Registration terminal device 3: Station server 4: Center device 6: Ticket gate passage 8: Station 11: Control unit 12: Storage unit 15: Gate 16: IC card reader unit 17: QR code reader unit 18: Face information acquisition unit 100: Station service system 111: Reading processing unit 112: Media authentication processing unit 113: Face authentication processing unit 114: Judgment processing unit 115: Traffic control unit 116: Gate processing unit 117: Notification processing unit 121: For authentication Data storage unit 122: Authentication information storage unit 181: Imaging unit 182: Face feature amount acquisition unit

Claims (9)

A face information acquisition unit that acquires the face information of the person to be authenticated, which is used in the face recognition process for determining whether or not to authenticate the person to be authenticated based on the face information of the person to be authenticated.
After the face information is acquired by the face information acquisition unit, the ticket information acquisition unit capable of acquiring the ticket information of the ticket medium used by the authenticated person, and the ticket information acquisition unit.
After the face information is acquired by the face information acquisition unit, a medium authentication process for determining whether or not to authenticate the ticket medium can be executed based on the ticket information acquired by the ticket information acquisition unit. Possible media authentication processing unit and
When the ticket medium is authenticated by the medium authentication process after the face information is acquired by the face information acquisition unit, a traffic control unit that allows the person to be authenticated to pass through the ticket gate passage.
With
When the ticket medium is authenticated by the medium authentication process after the person to be authenticated is authenticated by the face authentication process, the traffic control unit adds ticket gate information including a ticket gate record to the ticket information. When the person to be authenticated is allowed to pass through the ticket gate, and the person to be authenticated is not acquired by the ticket information acquisition unit after the person to be authenticated is authenticated by the face authentication process, the person to be authenticated is not acquired. An automatic ticket gate that registers authentication information indicating that the user has been authenticated in the authentication information storage unit and allows the person to be authenticated to pass through the ticket gate passage. When the person to be authenticated is not authenticated by the face authentication process and the ticket medium is authenticated by the medium authentication process, the traffic control unit adds ticket gate information including a ticket gate record to the ticket information. Allows the person to be authenticated to pass through the ticket gate,
The automatic ticket gate according to claim 1. When said person to be authenticated is authenticated, registered authentication information indicating that the person to be authenticated is authenticated in the authentication information storage section by the face authentication process,
When the ticket medium is authenticated by the medium authentication process after the person to be authenticated is authenticated by the face recognition process, the authentication information is deleted from the authentication information storage unit, and the ticket information includes a ticket gate record. Give ticket gate information,
The automatic ticket gate according to claim 1. When the ticket medium is not authenticated by the medium authentication process after the authenticated person is authenticated by the face authentication process, the traffic control unit prohibits the authenticated person from passing through the ticket gate passage. do,
The automatic ticket gate according to claim 1. When the ticket medium is not authenticated by the medium authentication process after the authenticated person is authenticated by the face authentication process, the traffic control unit permits the authenticated person to pass through the ticket gate passage. death,
Further, an output unit that outputs at least one of information indicating that the person to be authenticated has been authenticated by the face recognition process and information indicating that the ticket medium has not been authenticated by the medium authentication process is provided. Prepare, prepare
The automatic ticket gate according to claim 1. When the ticket information is not acquired by the ticket information acquisition unit for a predetermined period after the face information is acquired by the face information acquisition unit, the traffic control unit is based on the authentication result of the face authentication process. To determine whether the person to be authenticated is allowed or prohibited from passing through the ticket gate.
The automatic ticket gate according to claim 1. When the person to be authenticated passes through a predetermined position in the ticket gate after the face information is acquired by the face information acquisition unit, the traffic control unit uses the authentication result of the face recognition process as a basis. Determine whether the person to be authenticated is allowed or prohibited from passing through the ticket gate.
The automatic ticket gate according to claim 1. A step of acquiring the face information of the person to be authenticated used in the face recognition process for determining whether or not to authenticate the person to be authenticated based on the face information of the person to be authenticated.
After the face information is acquired, a step capable of acquiring the ticket information of the ticket medium used by the authenticated person, and
A step capable of executing a medium authentication process for determining whether or not to authenticate the ticket medium based on the ticket information acquired after the face information is acquired, and
When the ticket medium is authenticated by the medium authentication process after the face information is acquired, the step of permitting the person to be authenticated to pass through the ticket gate passage.
When the ticket medium is authenticated by the medium authentication process after the authenticated person is authenticated by the face authentication process, the ticket gate information including the ticket gate record is added to the ticket information, and the authenticated person is given the ticket gate. When the ticket information is not acquired after the person to be authenticated is authenticated by the face authentication process, the authentication information indicating that the person to be authenticated has been authenticated is used as the authentication information. The step of registering in the storage unit and allowing the authenticated person to pass through the ticket gate,
Ticket gate processing method including. A step of acquiring the face information of the person to be authenticated used in the face recognition process for determining whether or not to authenticate the person to be authenticated based on the face information of the person to be authenticated.
After the face information is acquired, a step capable of acquiring the ticket information of the ticket medium used by the authenticated person, and
A step capable of executing a medium authentication process for determining whether or not to authenticate the ticket medium based on the ticket information acquired after the face information is acquired, and
When the ticket medium is authenticated by the medium authentication process after the face information is acquired, the step of permitting the person to be authenticated to pass through the ticket gate passage.
When the ticket medium is authenticated by the medium authentication process after the authenticated person is authenticated by the face authentication process, the ticket gate information including the ticket gate record is added to the ticket information, and the authenticated person is given the ticket gate. When the ticket information is not acquired after the person to be authenticated is authenticated by the face authentication process, the authentication information indicating that the person to be authenticated has been authenticated is used as the authentication information. The step of registering in the storage unit and allowing the authenticated person to pass through the ticket gate,
A program that lets your computer run.

Images