JP7844950B2 - Gate device, traffic control method, and traffic control program - Google Patents

Description

This invention relates to a technology for preventing unauthorized processing of passengers' tickets at gates, regardless of the type of ticket used.

Conventionally, automatic ticket gates installed at train station ticket gates have been configured to determine whether a user is allowed to pass through the gate using either ticket information recorded on the user's ticket medium (contactless IC ticket, optically readable ticket, magnetic ticket) or facial recognition (see Patent Document 1). The automatic ticket gate described in Patent Document 1 has a configuration that prevents users from passing through the gate based solely on facial recognition, against their will.

Specifically, the capture of the user's face and the authentication using the captured facial image are performed before the user's ticket medium reaches a position where it can be presented to the automatic ticket gate (a position where it can be inserted or held up). The automatic ticket gate described in Patent Document 1 determines whether the user has presented the ticket medium even if the authentication using the facial image is successful. The automatic ticket gate is configured to determine whether the user is allowed to pass through the ticket gate passage based on the ticket information recorded on the ticket medium when the user presents it.

Japanese Patent Publication No. 2019-159795

However, even when users wish to use a physical ticket, they sometimes forget to present it to the automatic ticket gate and enter the ticket gate area. This can result in the user's eligibility being determined by facial recognition. In particular, users who regularly use facial recognition were more likely to forget to present their physical ticket.

The purpose of this invention is to provide a technology that prevents the determination of whether or not a user is permitted to pass through a passageway based on facial image authentication, against the will of the user who wishes to use the medium.

The gate device of this invention is configured as follows to achieve the above objective.

This gate device comprises an imaging unit, a media information reading unit, a first determination unit, a second determination unit, an output unit, and a decision unit. The imaging unit captures the face of a user entering the passageway. The media information reading unit receives the media presented by the user and reads the media information recorded on it. The first determination unit determines whether to allow the user to pass through the passageway based on the facial image captured by the imaging unit. The second determination unit determines whether to allow the user to pass through the passageway based on the media information read from the media by the media information reading unit. The output unit outputs a reminder to the user if they have forgotten to present their media after the imaging unit has captured the face of a user entering the passageway. The decision unit determines whether to allow the user to pass through the passageway based on the determination result of the first determination unit, if the media information reading unit has not read media information from the media when the user reaches the entry detection position set in the passageway.

In this configuration, when a user wishes to enter a passageway using a medium, it is possible to suppress the determination of whether or not they are allowed to pass based on facial image authentication.

Furthermore, for example, the decision-making unit of this gate device, when a user reaches the entry detection position set in the passageway, will determine whether to allow the user to pass through the passageway based on the determination result from the second determination unit, provided that the media information reading unit has read media information from the media.

Furthermore, for example, when a user reaches the entry detection position set in the passageway, the decision unit of this gate device reads media information from the media using the media information reading unit. If the second determination unit determines that passage through the passageway should not be permitted, it then decides whether to permit the user to pass through the passageway based on the determination result of the first determination unit.

Furthermore, for example, if the first determination unit determines that passage through the passage is not permitted, the output unit of this gate device will output a warning that includes this determination result.

Furthermore, for example, if the first determination unit determines that passage through the passage is permitted, the output unit of this gate device will output a warning that includes this determination result.

Furthermore, for example, the output unit of this gate device displays a warning message on the display unit.

This invention prevents the determination of whether or not a user is permitted to pass through a passageway based on facial recognition, against the will of the user who wishes to use the medium.

Figure 1 is an illustrative diagram of an automatic ticket gate according to Configuration Example 1. Figure 2 is a block diagram showing the configuration of the automatic ticket gate in Configuration Example 1. Figure 3 is a block diagram showing the configuration of the central server in Configuration Example 1. Figure 4 shows the processing pattern in Configuration Example 1. Figure 5 shows the processing pattern in Configuration Example 1. Figure 6 is an illustrative diagram of the process for entering the automatic ticket gate in Configuration Example 1. Figure 7 is an illustrative diagram of the process for entering an automatic ticket gate in Configuration Example 1. Figure 8 is an illustrative diagram of the process for entering the automatic ticket gate in Configuration Example 1. Figure 9 is an illustrative diagram of the process for entering an automatic ticket gate in Configuration Example 1. Figure 10 is an illustrative diagram of the process of entering an automatic ticket gate in Configuration Example 1. Figure 11 is a flowchart showing the processing flow of an automatic ticket gate in an example of operation. Figure 12 is a flowchart showing the processing flow of an automatic ticket gate in operation. Figure 13 is an illustrative diagram of the process of entering an automatic ticket gate in the modified example 1. Figures 14(A) and 14(B) are illustrative diagrams of the display unit of the automatic ticket gate according to Modification Example 2.

The following describes embodiments for carrying out the present invention with reference to several figures.

<1. Application Example 1>
First, an example to which the present invention is applied will be explained using Figure 1. Here, we will explain an example in which a user 30 enters the station premises using a ticket medium 300, in this case a contactless IC ticket. Figure 1 is an image diagram of an automatic ticket gate 1 and a station system.

Each station in the railway network is equipped with an automatic ticket gate 1, ticket vending machines, fare adjustment machines, and other station equipment (not shown in the illustration). A center server 5 is also installed at the central control center. The automatic ticket gate 1 comprises a ticket processing unit 11, an imaging unit 12, a user detection unit 14, and a display unit 17.

The ticket processing unit 11 reads the information stored on the ticket medium 300 (contactless IC ticket) held by the user 30 when it is held over the medium. The imaging unit 12 captures the face of the user using the automatic ticket gate 1. The user detection unit 14 detects the user passing through the ticket gate passage of the automatic ticket gate 1. The display unit 17 displays information indicating whether passage through the automatic ticket gate 1 is permitted, or whether the ticket information stored on the ticket medium is usable.

At each station, the station equipment, such as automatic ticket gates 1 and ticket vending machines, is connected via a network such as a LAN. At least one unit of station equipment, such as automatic ticket gates 1 and ticket vending machines, is installed at each station. Furthermore, these station equipment units are connected to a central server 5 via a network 6, such as a dedicated line or a public line. The entire system, including the equipment connected via this network 6, constitutes the station system.

Automatic ticket gate 1 is installed at the ticket gates of stations, as is well known, and processes tickets for users entering the station premises and users exiting the station premises.

User 30 possesses a ticket medium 300 (contactless IC ticket). The ticket medium 300 stores ticket information. This ticket information may be for a commuter pass or a regular ticket where a fare is incurred for each use of the railway. Furthermore, the center server 5 stores ticket information linked to the ticket medium 300. This allows User 30 to board the train using the ticket information registered in the ticket medium 300.

For example, if the ticket medium 300 is an SF card, the ticket information includes an identification number IDi that identifies the ticket medium 300, and entry/exit history information, which is a history of ticket gate processing using the ticket medium 300. Furthermore, the ticket medium 300 is charged with value used for settling fares for railway and other transportation services, and this is registered, for example, as a remaining balance. This identification number IDi is a unique identification number that cannot be rewritten for the ticket medium 300. Note that this identification number IDi may also be a manufacturing number (IDm).

Furthermore, if the ticket medium 300 is a commuter pass, the ticket information (commuter pass information) includes an identification number IDi that identifies the ticket medium 300, a commuter pass ID that identifies the commuter pass, information on the usable section indicating the section for which the ticket was issued for the ticket medium 300, information on the validity period of the commuter pass, and entry/exit history information, which is the history of ticket gate processing using this contactless IC ticket.

The automatic ticket gate 1 reads the ticket information on the ticket medium 300 to determine the expiration date and whether it is a commuter pass valid for travel within the valid section, or a regular ticket for which a fare is incurred each time the train is used.

Here, we will explain assuming that user 30's facial recognition information is stored on the central server 5, and that user 30 has authorized facial recognition for ticket gate access. However, in this instance, user 30 will use a ticket medium 300 to pass through the gate.

User 30 approaches the automatic ticket gate 1. The imaging unit 12 captures a picture of user 30's face. Based on this, the automatic ticket gate 1 generates a facial image indicating whether user 30 is eligible to enter. The automatic ticket gate 1 transmits this facial image to the central server 5. The central server 5 uses the facial image to determine whether authentication is possible (hereinafter, the authentication result). The central server 5 transmits the authentication result to the automatic ticket gate 1.

In this case, the automatic ticket gate 1 will withhold opening and closing the gate door according to the authentication result.

User 30 holds the ticket medium 300 over the ticket processing unit 11 of the automatic ticket gate 1. The ticket processing unit 11 reads the ticket information from the ticket medium 300. The automatic ticket gate 1 determines that the ticket information is valid. The user detection unit 14 of the automatic ticket gate 1 detects that user 30 has passed through the ticket gate passage.

Based on this, the automatic ticket gate 1 determines that the user 30 is entering based on the ticket information on the ticket medium 300 they possess.

Furthermore, after the imaging unit 12 captures the user's face 30, the display unit 17 displays a message indicating that "face recognition is OK" and a warning about whether or not to hold up the ticket medium 300. Specifically, if face recognition of the user 30 is successful, the display unit 17 displays a message such as, "If you are entering with the ticket medium 300, please hold up the ticket medium 300."

This configuration prevents the system from determining whether a user 30 is allowed to pass through a passageway based solely on facial recognition, even if they forget to present their ticket 300. In other words, it improves user convenience.

<2. Configuration Example 1>
Figure 1 is an image diagram of the automatic ticket gate in Configuration Example 1. Figure 2 is a block diagram showing the configuration of the automatic ticket gate in Configuration Example 1. Figure 3 is a block diagram showing the configuration of the center server in Configuration Example 1. Figure 4 is a diagram showing the processing pattern in Configuration Example 1. Figure 5 is a diagram showing the processing pattern in Configuration Example 1. Figure 6 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 7 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 8 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 9 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1. Figure 10 is an image diagram of the process of entering the automatic ticket gate in Configuration Example 1.

Based on the station system configuration shown in Figure 1 above, Figures 2 and 3 will be used to explain a more specific configuration example.

(Configuration of automatic ticket gate 1 and central server 5)
First, Figure 2 shows the configuration of the automatic ticket gate 1. The automatic ticket gate 1 comprises a control unit 10, a ticket processing unit 11, an imaging unit 12, a determination unit 13, a user detection unit 14, a door opening/closing unit 15, an output unit 16, a display unit 17, a determination unit 18, and a communication unit 19. The automatic ticket gate 1 corresponds to the "gate device" in the present invention. The ticket medium 300 shown below is, for example, an IC ticket. However, the ticket medium 300 is not limited to an IC ticket, but may also be a two-dimensional code, a magnetic card, etc.

The control unit 10 controls the operation of the automatic ticket gate unit 1.

As is well known, the ticket processing unit 11 is configured to read ticket information regardless of the type of ticket medium. Ticket mediums include, for example, contactless IC cards and 2D codes. The ticket processing unit 11 includes an IC reader/writer for reading ticket information stored on the ticket medium, and a camera for reading 2D codes, etc.

Furthermore, the ticket processing unit 11 includes a wireless communication unit that performs short-range wireless communication with the IC chip on the ticket medium 300. This wireless communication unit repeatedly performs polling to request responses from wireless communication terminals located within the wireless communication area. By doing so, the ticket processing unit 11 detects objects approaching the wireless communication area based on whether the wireless communication processing unit has received a response to the polling.

The imaging unit 12 is a camera that captures images of the user 30 approaching the automatic ticket gate 1. More specifically, it captures the user's face. This allows the imaging unit 12 to generate a facial image for use in facial recognition to pass through the automatic ticket gate 1. The detailed structure will be described later.

The determination unit 13 comprises a first determination unit 131 and a second determination unit 132. The first determination unit 131 performs identity authentication using the facial image captured by the imaging unit 12 and determines whether to permit the user 30 to pass through the ticket gate. The second determination unit 132 determines whether to permit the user 30 to pass through the ticket gate based on the ticket information (corresponding to the media information of the present invention) read from the ticket medium 300 by the ticket processing unit 11. The ticket processing unit 11 corresponds to the "media information reading unit" of the present invention. The system determines whether the user 30 will pass through the automatic ticket gate 1 using facial recognition or using the ticket medium. A detailed structure will be described later.

The user detection unit 14 uses multiple sensors positioned along the ticket gate passage to repeatedly detect the user's position within the passage at regular intervals, thereby tracking the user's movement within the passage.

The user detection unit 14 defines the entry detection position (the line used to determine whether a user is ticketless) as shown below. This entry detection position is used to determine whether user 30 enters the automatic ticket gate 1 using facial recognition. When user 30 enters the automatic ticket gate 1 using facial recognition, they do not use a ticket medium. In this case, the user detection unit 14 detects whether user 30 has held up the ticket medium 300 before reaching the entry detection position. If user 30 has not held up the ticket medium 300 before reaching the entry detection position, the user detection unit 14 outputs the detection result to the determination unit 13 (first determination unit 131) to determine that passage is via facial recognition.

The door opening/closing unit 15 opens and closes the gate door located on the exit side of the ticket gate passage for the user 30, based on the determination result of whether or not the user 30 who has entered the ticket gate passage is allowed to pass through.

The output unit 16 outputs a warning message reminding the user 30 to present their ticket after the imaging unit 12 has captured an image of the user's face as they enter the passageway. Furthermore, the output unit 16 emits a warning sound when it determines that the user 30 entering the ticket gate passageway should not be permitted to pass through.

The display unit 17 is located on the exit side of the ticket gate passage for users entering the passage. When a user 30 passes through the automatic ticket gate 1 using facial recognition, the display unit 17 displays their facial image. Furthermore, when a user 30 passes through the automatic ticket gate 1 using a ticket medium, the display unit 17 displays the pass-through determination result. Further details will be described later.

The decision unit 18, upon the user 30 reaching the entry detection position set in the ticket gate passage, determines whether to allow the user 30 to pass through the ticket gate passage based on the determination result from the first determination unit 131, if the ticket processing unit 11 has not yet read the media information from the ticket medium 300.

The communications unit 19 controls data communication between the station's ticket vending machines and the central server 5.

Next, using Figure 3, we will explain the main configuration of the center server 5 and an overview of the processing flow. Figure 3 is a block diagram showing the configuration of the center server 5 in Configuration Example 1.

The center server 5 comprises a control unit 51, a storage unit 52, a face image determination unit 53, and a communication unit 54. The control unit 51 controls the operation of the center server 5 main unit. The storage unit 52 stores face images captured of users, and determination images used to determine whether these face images belong to the user themselves.

The facial image determination unit 53 compares the facial image captured by the automatic ticket gate 1 with the determination image stored in the memory unit 52. This determination image is not limited to user 30; it includes facial images of multiple registered individuals when using facial recognition.

The face image determination unit 53 determines whether the user's face image is recognizable by following the procedure below. First, the face image determination unit 53 compares the face image with multiple recognition images stored in the memory unit 52. More specifically, the face image determination unit 53 extracts feature quantities from the user's face image, and determines that the user's face recognition is valid if the degree of matching of these feature quantities is above a threshold. This threshold can be arbitrarily determined, for example, 85%.

Furthermore, if the user's (30) face image is not registered in the central server's storage unit (52), the face image determination unit (53) determines that the image is unregistered and that face authentication is unsuccessful.

The communication unit 54 controls communication between the automatic ticket gates 1 at each station via the network 6.

Using the configuration described above, the processing patterns of the automatic ticket gate 1 using Figures 4 and 5 will be explained. First, Figure 4 shows a processing pattern where the user 30's facial image is registered and the user possesses a ticket medium. In this case, the user 30 intends to enter the automatic ticket gate 1 using the ticket medium 300.

Figure 4(1) shows a pattern where facial recognition fails, but the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition is NG. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reaches the entry detection position. Based on the determination result of the second determination unit 132, the decision unit 18 determines whether passage through the ticket gate is permitted. That is, the second determination unit 132 of the automatic ticket gate 1 approves the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays that the use of the ticket medium is OK.

Figure 4(2) shows a pattern where facial recognition is successful, but the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is successful. As a result, the output unit 16 outputs a message to the display unit 17 instructing the user to "Facial recognition is successful. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reached the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays a message indicating that the ticket medium is not valid for entry.

Figure 4(3) shows a pattern where facial recognition is unregistered and the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition is unregistered. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 approves the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays that the use of the ticket medium is OK.

Figure 4(4) shows a pattern where facial recognition is unregistered and the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is unregistered. The second determination unit 132 reads the ticket information when the ticket medium 300 is held over the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held over the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays that the use of the ticket medium is rejected.

Figure 4(5) shows a pattern where facial recognition is invalid and the ticket medium 300 is usable. The first determination unit 131 determines that facial recognition is invalid. As a result, the output unit 16 outputs a message to the display unit 17 instructing that "Facial recognition is invalid. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reaches the entry detection position. As a result, the decision unit 18 determines whether or not passage through the ticket gate passage is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 approves the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays that the ticket medium is valid for entry.

Figure 4(6) shows the case where facial recognition is invalid and the ticket medium 300 is unusable. The first determination unit 131 determines that facial recognition is invalid. As a result, the output unit 16 outputs a message to the display unit 17 instructing that "Facial recognition is invalid. If you wish to pass through using a ticket, please hold up your ticket." The display unit 17 displays the message. The second determination unit 132 reads the ticket information when the ticket medium 300 is held up to the ticket processing unit 11. The user detection unit 14 detects that the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reaches the entry detection position, and the decision unit 18 determines whether or not passage through the ticket gate is permitted based on the determination result of the second determination unit 132. That is, the second determination unit 132 of the automatic ticket gate 1 rejects the use of the ticket medium. The display unit 17 of the automatic ticket gate 1 displays a message indicating that the ticket medium is not valid for entry.

Next, Figure 5 shows a processing pattern where the user 30's facial image is registered, and the user does not possess a ticket medium 300 (i.e., the user is not intended to use a ticket medium for entry into the automatic ticket gate 1). In this case, the user 30 intends to enter the automatic ticket gate 1 via facial recognition.

Figure 5(1) shows a pattern where facial recognition is successful. The first determination unit 131 determines that facial recognition is successful. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not perform the reading of the ticket medium. The first determination unit 131 of the automatic ticket gate 1 approves the ticketing via facial recognition. The display unit 17 of the automatic ticket gate 1 displays that ticketing via facial recognition is successful. The center server 5 updates the ticket information associated with the facial image generated by the imaging unit 12 to the entry status.

Figure 5(2) shows a pattern where the facial image is not registered. The first determination unit 131 determines that the facial recognition is not registered. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not perform the reading of the ticket medium. The first determination unit 131 of the automatic ticket gate 1 rejects the ticketing attempt using facial recognition. The display unit 17 of the automatic ticket gate 1 displays a message indicating that passage is not permitted.

Figure 5(3) shows a pattern where the facial image is invalid. The first determination unit 131 determines that facial recognition is invalid. The user detection unit 14 detects that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position. Based on this, the decision unit 18 determines whether passage through the ticket gate is permitted based on the determination result of the first determination unit 131. Therefore, the second determination unit 132 does not attempt to read the ticket medium. The first determination unit 131 of the automatic ticket gate 1 rejects the ticketing attempt using facial recognition. The display unit 17 of the automatic ticket gate 1 displays that facial recognition is invalid and passage is not permitted.

(Image of 30 users entering through an automatic ticket gate)
Figures 6, 7, 8, 9, and 10 illustrate the process of a user 30 entering the automatic ticket gate 1.

Figure 6 shows an example where user 30 enters the automatic ticket gate 1 using the ticket medium 300, even though user 30's facial recognition is either NG or unregistered. Figure 6 represents the state shown in Figures 4(1), (3), and (5) above, where the ticket medium 300 is valid. The display unit 17 displays "Passing through using a ticket" and "Passing through OK."

Figure 7 shows an example where user 30 enters the automatic ticket gate 1 using the ticket medium 300, after facial recognition of user 30 has been successful. Figure 7 also shows the situation described in Figure 4 (2) above, where the ticket medium 300 is invalid. The display unit 17 displays a message indicating that "the ticket is invalid" and "passage is not permitted."

Figure 8 shows an example where user 30 enters the automatic ticket gate 1 using a ticket medium 300, with user 30's facial recognition being unregistered or invalid. Figure 8 represents the state shown in Figure 4(4) and (6) above, where the ticket medium 300 is invalid. The display unit 17 displays a message indicating "The ticket is invalid" and "Entry is not permitted."

Figure 9 shows an example where user 30 enters the automatic ticket gate 1 using facial recognition, with user 30's facial recognition enabled. Figure 9 represents the state shown in Figure 5 (1) above. First, the display unit 17 displays "Passage is possible with facial recognition" and "If using a ticket, please hold up your ticket." Next, if user 30 does not hold up the ticket medium 300 before reaching the entry detection position, the display unit 17 displays the facial image and "Passage is OK with facial recognition" and "Passage is OK."

Figure 10 shows an example where user 30 enters the automatic ticket gate 1 using facial recognition, even though user 30's facial recognition is unregistered or invalid. Figure 10 represents the state shown in Figures 5(2) and (3) above. First, the display unit 17 displays a message indicating that "facial recognition is invalid or unregistered" and "if using a ticket, please hold up your ticket." Next, if user 30 does not hold up the ticket medium 300 before reaching the entry detection position, the display unit 17 displays a message indicating that "entry is not permitted."

<3. Example of Operation>
Figure 11 is a flowchart showing the process when user 30 enters the automatic ticket gate 1. Figure 11 shows an overview of the process when user 30 enters using facial recognition and the ticket medium 300.

The imaging unit 12 acquires a facial image of the user 30. The automatic ticket gate 1 transmits this facial image to the central server 5 via the communication unit 19. The facial image determination unit 53 of the central server 5 determines whether this facial image is valid (S101).

If the facial image determination unit 53 determines that the facial image is valid (S101: Yes), it transmits this determination result to the automatic ticket gate 1. The first determination unit 131 determines that facial recognition is OK. Next, the ticket processing unit 11 reads the ticket information from the ticket medium 300. The second determination unit 132 determines whether the ticket information is valid. The decision unit 18 determines whether the authentication method is a ticket or facial recognition (S102).

If the second determination unit 132 determines that the ticket information is valid and that the user 30 has held the ticket medium 300 over the ticket processing unit 11 before reaching the entry detection position, the decision unit 18 determines whether passage through the ticket gate is permitted based on the second determination unit 132 (S102: Authentication by ticket medium 300). If authentication by ticket medium 300 is successful, the display unit 17 displays "OK for ticket gate entry" (S103a).

If authentication using the ticket medium 300 fails, the system displays "Ticket Gate NG" (S103b), and the process described in step S109 below is performed. That is, the process shown in Figure 4 (2) is carried out.

The door opening/closing mechanism 15 of the automatic ticket gate 1 opens the gate door, allowing the user 30 to pass through (S104).

If the system determines that the ticket medium 300 was not held up to the ticket processing unit 11 before the user 30 reached the entry detection position, the decision unit 18 determines whether passage through the ticket gate is permitted using the second determination unit 132 (S102: facial recognition authentication). The display unit 17 displays "OK" for facial recognition authentication (S103c). Afterward, the automatic ticket gate 1 executes step S104.

If the facial image determination unit 53 determines that the facial image is invalid and unregistered (S101: No.), it transmits this determination result to the automatic ticket gate 1. The ticket processing unit 11 determines whether the ticket medium 300 has been held up to the ticket processing unit 11 (S105). More specifically, it determines whether the ticket medium 300 was held up to the ticket processing unit 11 before the user 30 reached the entry detection position.

If the ticket processing unit 11 determines that the ticket medium 300 has been presented (S105: Yes), the second determination unit 132 determines whether the ticket information is valid (S106).

If the second determination unit 132 determines that the ticket information is valid (S106: Yes), the display unit 17 displays "OK" for ticket gate entry (S107). Then, the automatic ticket gate 1 executes step S104.

If the second determination unit 132 determines that the ticket information is invalid (S106: No), the display unit 17 displays that passage is not permitted (S108). The door opening/closing unit 15 of the automatic ticket gate 1 closes the gate door (S109).

If the ticket processing unit 11 determines that the ticket medium 300 was not scanned (S105: No), the display unit 17 displays that facial recognition failed (S110). Subsequently, the automatic ticket gate 1 executes step S109.

Figure 12 is a flowchart showing the process after the automatic ticket gate 1 determines whether to permit entry. Figure 12 is executed after the process shown in Figure 11, more specifically, when the user 30 passes through the automatic ticket gate 1.

The determination unit 13 deletes the information entered via facial image and the information entered via ticket medium, according to the authentication result (S141). This allows for more accurate authentication processing for subsequent users.

As described above, the automatic ticket gate 1 can accurately perform the ticketing process even when the user 30 possesses both facial recognition and the ticket medium 300 as authentication methods. In other words, users can use the automatic ticket gate 1 by their intended method, improving convenience. To put it another way, it prevents the determination of whether or not a user can pass through the gate based on facial image authentication against their will, even if they prefer to use a ticket medium.

Furthermore, the above configuration shows an example where the ticket medium 300 is a contactless IC card. However, it is not limited to contactless IC cards; it may also be a 2D code, magnetic card, etc.

The above configuration shows a setup in which the face image is displayed on the display unit 17 during facial recognition. However, a configuration in which the face image is hidden is also acceptable from a privacy perspective.

<4. Variation 1>
Next, the automatic ticket gate according to Modification Example 1 will be described with reference to the figure. Modification Example 1 differs from Configuration Example 1 in the processing when a passenger mistakenly holds the ticket medium 300 over the ticket processing unit 11, even though passage is possible through facial recognition. The other configurations are the same as those of the automatic ticket gate 1 in Configuration Example 1, and the explanation of the similar parts will be omitted.

As shown in Figure 13, user 30 is allowed to pass through using facial recognition. However, user 30 mistakenly holds an invalid ticket medium 300 up to the ticket processing unit 11. As a result, the second determination unit 132 determines that the ticket medium 300 is invalid. However, the decision unit 18 determines that user 30 mistakenly held up the ticket medium 300 and permits passage based on facial recognition authenticated by the first determination unit 131.

In this case, the decision unit 18 should determine whether user 30 mistakenly held up the ticket medium 300 based on user 30's facial recognition history, frequency and tendencies of using the ticket medium 300, etc. For example, this can be used as a criterion for determining whether user 30 mistakenly held up the ticket medium 300, even though user 30 has been continuously using facial recognition.

With this configuration, authentication can be performed according to the user's intentions. Specifically, if a user does not wish to use a physical ticket, their access to the passage can be determined through facial recognition. In other words, user convenience is improved.

<5. Variation 2>
Next, the automatic ticket gate according to Modification Example 2 will be described with reference to the figure. Modification Example 2 differs from Configuration Example 1 in the method of displaying the authentication result shown by the display unit 17. The other configurations are the same as those of the automatic ticket gate 1 in Configuration Example 1, and the explanation of the similar parts will be omitted.

The display unit 17 displays the expiration date of the facial image when facial recognition is performed. More specifically, as shown in Figure 14(A), the display unit 17 displays a message indicating that facial recognition is required for passage, and the expiration date of the facial image. The user 30 can easily recognize the update date of the facial image by checking this expiration date. Furthermore, the display unit 17 may display a message prompting the user to update their facial image.

Furthermore, as shown in Figure 14(B), the background color of the display unit 17 may be changed when the expiration date is approaching. More specifically, this background color may be orange if the expiration date is within one month, yellow if the expiration date is within three months, etc.

In the above configuration, the display unit 17 displays the expiration date. However, the output unit 16 may also be configured to output a warning sound. This warning sound should output the expiration date according to its pitch and volume.

The above configuration was described using an automatic ticket gate located within a train station as an example. However, the configuration is not limited to automatic ticket gates. For example, the gate device of the present invention can be applied to devices that can use facial recognition and media-based authentication in combination, such as entrance and exit gates in theme parks or security gates in offices.

Furthermore, this invention is not limited to the above examples, and in the implementation stage, the components can be modified and implemented without departing from the gist of the invention. Also, various inventions can be formed by appropriately combining the multiple components disclosed in the above examples. For example, some components may be deleted from all the components shown in the above examples. Moreover, components from different examples may be appropriately combined.

Furthermore, the correspondence between the configuration of this invention and the configuration described above can be described as follows:
<Note>
The gate device (1) comprises an imaging unit (12), a media information reading unit (11), a first determination unit (131), a second determination unit (132), an output unit (16), and a decision unit (18). The imaging unit (12) captures the face of a user entering the passageway. The media information reading unit (11) receives the media presented by the user and reads the media information recorded on that media. The first determination unit (131) determines whether to allow the user to pass through the passageway based on the face image captured by the imaging unit (12). The second determination unit (132) determines whether to allow the user to pass through the passageway based on the media information read from the media by the media information reading unit (11). The output unit (16) outputs a reminder to the user to present their media after the imaging unit (12) has captured the face of a user entering the passageway. When a user reaches an entry detection position set in the passageway, if the media information reading unit (11) has not read media information from the media, the decision unit (18) decides whether to allow the user to pass through the passageway based on the determination result from the first determination unit (131).

1...Automatic ticket gate 5...Center server 6...Network 10...Control unit 11...Ticket processing unit 12...Imaging unit 13...Determination unit 14...User detection unit 15...Door opening/closing unit 16...Output unit 17...Display unit 18...Decision unit 19...Communication unit 30...User 51...Control unit 52...Storage unit 53...Face image determination unit 54...Communication unit 131...First determination unit 132...Second determination unit 300...Ticket medium

Claims (7)

An imaging unit that captures the faces of users entering the passageway,
A media information reading unit that receives the media presented by the user and reads the media information recorded on that media,
A first determination unit determines whether to permit the user to pass through the passage based on the facial image captured by the imaging unit,
A second determination unit determines whether to permit the user to pass through the passage based on the media information read from the media by the media information reading unit,
After the imaging unit captures the face of a user entering the passageway, the output unit outputs a reminder that the medium has been forgotten.
The system includes a determination unit that, when the user reaches the entry detection position set in the passage, if the media information reading unit has not read media information from the media, determines whether to allow the user to pass through the passage based on the determination result of the first determination unit ,
The output unit is a gate device that outputs the warning, including the determination result, when the first determination unit determines that passage through the passage is permitted . The gate device according to claim 1, wherein the determination unit, when the user reaches the entry detection position set in the passage, determines whether to permit the user to pass through the passage based on the determination result of the second determination unit, if the media information reading unit has read media information from the media. The gate device according to claim 1, wherein, when the user reaches the entry detection position set in the passage, the media information reading unit reads media information from the medium, and the second determination unit determines that passage through the passage should not be permitted, the determination unit decides whether to permit the user to pass through the passage based on the determination result of the first determination unit. The gate device according to any one of claims 1 to 3, wherein the output unit outputs the warning, including the determination result, when the first determination unit determines that passage through the passage is not permitted. The gate device according to any one of claims 1 to 4, wherein the output unit causes the warning to be displayed on the display unit. An imaging unit that captures the faces of users entering the passageway,
A media information reading unit that receives the media presented by the user and reads the media information recorded on that media,
A first determination step involves determining whether to permit a user to pass through a passageway based on the user's facial image captured by the imaging unit as the user enters the passageway,
A second determination step involves determining whether to permit the user to pass through the passage based on the media information read from the media presented by the user in the media information reading unit,
After the imaging unit captures the face of a user entering the passageway, an output step is performed to output a reminder that the medium has been forgotten.
When the user reaches the entry detection position set in the passage, if the media information reading unit has not read media information from the media, the computer performs a decision step to determine whether to allow the user to pass through the passage based on the determination result of the first determination step .
The traffic control method is a method in which, if the first determination step determines that passage through the passage is permitted, the first determination step determines that the warning including the determination result is output . An imaging unit that captures the faces of users entering the passageway,
A media information reading unit that receives the media presented by the user and reads the media information recorded on that media,
A first determination step involves determining whether to permit a user to pass through a passageway based on the user's facial image captured by the imaging unit as the user enters the passageway,
A second determination step involves determining whether to permit the user to pass through the passage based on the media information read from the media presented by the user in the media information reading unit,
After the imaging unit captures the face of a user entering the passageway, an output step is performed to output a reminder that the medium has been forgotten.
When the user reaches the entry detection position set in the passage, if the media information reading unit has not read media information from the media, the computer is instructed to perform a decision step to determine whether to allow the user to pass through the passage based on the determination result of the first determination step .
The traffic control program is a traffic control program in which, if the first determination step determines that passage through the passage is permitted, it outputs the warning including the determination result .