JP7516276B2 - Control device, control method, and program - Google Patents

Description

Embodiments of the present invention relate to a control device, a control method, and a program.

There are known ticket gates that capture an image of the face of a entrant attempting to enter a facility, perform facial recognition processing based on the captured facial image, and determine whether or not the entrant can pass based on the results of the facial recognition, as well as ticket gates that, in addition to facial recognition processing, determine whether or not the entrant can pass based on information read from an IC ticket or two-dimensional code that the entrant holds up over a reader. However, in a system that can perform both facial recognition and authentication based on an IC ticket or two-dimensional code on the same entrant, there are cases in which the ability to pass is determined based on authentication that is not intended by the entrant, and this point has not been fully considered.

JP 2019-159795 A JP 2019-079264 A JP 2020-021358 A

The problem that this invention aims to solve is to provide a control device, a control method, and a program that can perform control that reflects the user's intentions.

The control device of the embodiment has a reading unit, a detection unit, a camera, and a control unit. The reading unit reads information from a medium optically or by wireless communication. The detection unit detects a user present at a first position determined based on a relative positional relationship with the reading unit. The camera captures an image of the user's face when the detection unit detects a user. When the detection unit detects a user, the control unit executes a first control to restrict the reading of information by the reading unit and to control an appliance based on the image captured by the camera, and when the reading unit reads information, the control unit executes a second control to restrict appliance control using the image captured by the camera and to control the appliance based on the information read by the reading unit.

FIG. 1 is a diagram showing an example of a control system 1 according to an embodiment. FIG. 2 is a top view of the automated ticket gate 300 according to the embodiment. FIG. 3 is a configuration diagram of an automatic ticket gate 300 focusing on a control unit 320 of the embodiment. FIG. 6 is a diagram showing the configuration of a DB server device 600 according to the embodiment. FIG. 6 is a diagram showing an example of the contents of a ticket DB 651 according to an embodiment. FIG. 6 is a diagram showing an example of the contents of a settlement DB 652 in the embodiment. 11 is a flowchart showing the flow of processing by a face authentication determination processing unit 325A of the automated ticket gate 300 of the embodiment. 11 is a flowchart showing the flow of processing by a medium determination processing unit 325B of the automated ticket gate 300 of the embodiment. 11 is a flowchart showing the flow of processing by a passage completion processing unit 325C of the automated ticket gate 300 according to the embodiment. 11A and 11B are diagrams illustrating an example of a transition of information registered in a previous determination result 353 according to an embodiment. FIG. 2 is a diagram for explaining a use case 1 of the automatic ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 2 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 3 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 4 of the automated ticket gate 300 of the embodiment. FIG. 11 is a diagram for explaining use case 5 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 6 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 7 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 8 of the automated ticket gate 300 of the embodiment. FIG. 13 is a diagram for explaining use case 9 of the automated ticket gate 300 of the embodiment. FIG. 10 is a diagram for explaining a use case 10 of the automated ticket gate 300 of the embodiment. FIG. 11 is a diagram for explaining a use case 11 of the automatic ticket gate 300 of the embodiment. FIG. 2 is a top view of an automated ticket gate 300A according to an embodiment. FIG. 3 is a configuration diagram of an automatic ticket gate 300B focusing on a control unit 320A of an embodiment.

The control device, control method, and program of the embodiment will be described below with reference to the drawings.

[First embodiment]
1 is a diagram illustrating an example of a control system 1 according to an embodiment. The control system 1 includes, for example, one or more user terminal devices 100, one or more ticket issuing machines 200, one or more automated ticket gates 300, and a DB server device 600.

One or more user terminal devices 100, one or more ticket issuing machines 200, and one or more automated ticket gates 300 are connected to the DB server device 600 via a network NW. The network NW includes, for example, the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), a provider device, a wireless base station, etc.

The automated ticket gate 300 is installed, for example, at a railway facility, and allows or prohibits passage of a user based on the result of the determination of whether or not the user should pass through. The automated ticket gate 300 is an example of a control device. Without being limited to this, the control device may be a device installed at the entrance to amusement parks, movie theaters, and other facilities, and controls the equipment based on the result of the determination of whether or not entry to these facilities is permitted.

The automated ticket gate 300 can perform, for example, a process of authenticating a user's face to determine the user's authority (hereinafter referred to as face authentication determination process), and a process of determining a user's authority based on information read from a medium held by the user (hereinafter referred to as medium determination process).

Media used in the medium determination process include, for example, the user terminal device 100, a ticket printed on a print medium such as paper, an IC card, a magnetic ticket, etc. In the medium determination process, the automated ticket gate 300 optically reads information, for example, from a two-dimensional code displayed on the user terminal device 100 or a two-dimensional code printed on a print medium. Without being limited to this, the automated ticket gate 300 may read information from an IC card by wireless communication, or may magnetically read information from a magnetic ticket. In this embodiment, an example of optically reading information from a two-dimensional code printed on a ticket, which is a print medium, is described.

For example, predetermined identification information is encoded in the two-dimensional code. The predetermined identification information includes a ticket ID that identifies each ticket, a user ID that identifies each user, and the like. The two-dimensional code may also include information indicating the validity of the ticket, information indicating the status of the ticket (before entry, already entered, etc.), information indicating the charge balance, and the like. If the medium is an IC card, the IC card may store information similar to the information encoded in the two-dimensional code.

The user terminal device 100 is a communication terminal owned by the user, such as a smartphone, tablet terminal, or personal computer. The user uses the user terminal device 100 to register in advance in the DB server device 600 information required to use the face recognition judgment process of the automated ticket gate 300. The user terminal device 100 also receives information for displaying a two-dimensional code from the DB server device 600 and displays it on its own display. Note that the user terminal device 100 may be separate devices each having these functions, and may include, for example, a device having only the function of executing the registration process for face recognition and a device having only the function of displaying the two-dimensional code.

For example, the user terminal device 100 acquires information regarding various registrations from the user (hereinafter referred to as various registration information) and transmits the acquired various registration information to the DB server device 600. The various registration information includes, for example, the registration face image data described below and information indicating the purchase conditions for the ticket.

For example, the user terminal device 100 captures an image of the user's face using its own camera, and transmits the data of the captured image of the user's face (hereinafter referred to as the registered face image) to the DB server device 600 as part of various registration information. Note that the registered face image is not limited to an image captured by the camera of the user terminal device 100, but may be an image for a passport photo prepared in advance or other photographic images. In addition, the user terminal device 100 uses an operation unit provided therein to accept specification of ticket purchase conditions from the user. The ticket purchase conditions include, for example, the type of ticket to be purchased, the section for which the ticket is to be used, the period for which the ticket is to be used, and instructions for purchasing the ticket.

The DB server device 600 registers, for example, feature amount data indicating the facial features of the registrant in the database. In addition, when a passenger ticket is purchased based on the passenger ticket purchase conditions, the DB server device 600 generates validity information indicating the range of use available to the user based on the passenger ticket purchase conditions, and registers record information in which the validity information is associated with the feature amount data in the database. The validity information is an example of authority information indicating the authority given to the registrant.

Furthermore, the DB server device 600 registers record information in the database that associates identification information (hereinafter referred to as a ticket ID) that identifies a registrant or authority information with the authority information. The ticket ID is, for example, identification information that identifies a user (hereinafter referred to as a user ID) or identification information assigned to each ticket by the DB server device 600 at the time the ticket is purchased. It is not limited to this, and may be identification information of a registrant that exists before the ticket is purchased, such as identification information of a user's railway IC card or a credit card number.

The ticket issuing machine 200 is installed, for example, in a railway facility and issues train tickets. A user may use the ticket issuing machine 200 to register information required for using the face authentication judgment process of the automated ticket gate 300 in the DB server device 600. For example, the ticket issuing machine 200 is equipped with a camera for capturing an image of the user's face, and the image of the user's face captured by the camera is registered in the DB server device 600. The ticket issuing machine 200 also receives information for displaying a two-dimensional code from the DB server device 600 and prints the two-dimensional code on a print medium. Note that the process for registering various information in the DB server device 600 is similar to the process by the user terminal device 100, and therefore a detailed description thereof will be omitted.

[Automatic ticket gate 300]
FIG. 2 is a view of the automatic ticket gate 300 seen from above. The automatic ticket gate 300 includes a master unit 310 and a slave unit 330. The master unit 310 and the slave unit 330 are housings that form one passage. For example, the master unit 310 and the slave unit 330 are arranged opposite each other to form a passage 390 that connects a first area and a second area that are partitioned from each other. For example, the first area may be outside the station and the second area may be inside the station, or vice versa. The passage 390 is a one-way street in the traveling direction a that goes from the first area to the second area. The master unit 310 and the slave unit 330 are wirelessly connected by LAN communication or short-range communication, or may be connected via a cable.

The master unit 310 includes, for example, an optical system reader unit 311, an upper display unit 312, a front display unit 313, a passage sensor 314, a door unit 317, a face authentication start sensor 319, and a control unit 320. The slave unit 330 includes, for example, a face authentication camera 331 and a door unit 337.

The optical system reader unit 311 outputs image data captured by the camera to the control unit 320. For example, when a passenger holds up a ticket, the optical system reader unit 311 captures the code image displayed on the ticket. The control unit 320 performs a predetermined image processing on the captured code image to obtain the information encoded in the code image. For example, the optical system reader unit 311 is installed such that the reader surface is slightly further back in the traveling direction a of the passage 390 than the detection line L1 by the face authentication start sensor 319. Note that the optical system reader unit 311 may be in the same position as the detection line L1 in the traveling direction a.

An optical system reader illumination unit 311A is mounted on the top surface of the optical system reader unit 311. The optical system reader illumination unit 311A is controlled by the control unit 320 to emit blue light when the optical system reader unit 311 is in a usable state, and emit red light when the optical system reader unit 311 is in a non-usable state.

When the optical system reader illumination unit 311A receives an instruction from the control unit 320 to stop reading information, it switches its appearance state compared to when there is no such instruction. For example, the control unit 320 causes the optical system reader unit 311 to stop reading information while the face authentication determination process is being executed. The optical system reader illumination unit 311A is controlled by the control unit 320 to emit blue light when there is no instruction to stop reading, and emit red light when there is an instruction to stop reading.

The top display unit 312 is installed on the top surface of the main unit 310 and displays, for example, the status of the automated ticket gate 300 and the results of information processing by the control unit 320.

The front display unit 313 displays marks, figures, characters, etc. that indicate whether or not passage is possible in the traveling direction a. The display content of the front display unit 313 or whether or not to display is determined by the control unit 320.

The passage sensor 314 includes, for example, a number of passage sensors 314-1 to 314-4 provided on the side of the main unit 310 facing the aisle. The passage sensors 314 detect users at their respective positions within the aisle 390. The control unit 320 (please change this if there is another appropriate configuration) recognizes the position of the user within the aisle 390, that the user has left the aisle 390, that the user has completed passing through the aisle 390, etc., based on the transition of the detection results of each passage sensor 314. The passage sensor 314 is realized, for example, by an infrared sensor, an optical sensor, a light-emitting element, etc. The passage sensor 314 may detect users within the aisle in cooperation with a passage sensor provided on the opposing slave unit 330.

The door units 317 and 337 are devices that regulate the passage of users entering in the travel direction a. The door units 317 and 337 include, for example, a plate-shaped door body and a motor that rotates the door body. For example, the control unit 320 controls the door units 317 and 337 to a closed state when prohibiting the user from passing through, and controls the door units 317 and 337 to an open state when allowing the user to pass through.

The facial authentication start sensor 319 is installed at the front end of the passage 390 in the travel direction a, and detects users present on the detection line L1. The facial authentication start sensor 319 detects users passing through the detection line L1 one by one. The facial authentication start sensor 319 outputs the detection result to the control unit 320. The facial authentication start sensor 319 is realized by, for example, an infrared sensor or an optical sensor. The facial authentication start sensor 319 may detect users present on the detection line L1 in cooperation with a sensor provided on the opposing slave unit 330.

The detection line L1 is determined based on the relative positional relationship with the optical system reader unit 311. For example, the detection line L1 is a position further back than the reading line L2 in the traveling direction a. The reading line L2 is a position assumed as the position of the user when holding the medium over the optical system reader unit 311. The reading line L2 is, for example, a position in front of the position of the optical system reader unit 311 in the traveling direction a by the average arm length of the user. Not limited to this, the distance between the detection line L1 and the reading line L2 may be longer than the distance at which the medium can be held over the optical system reader unit 311 unless the person has very long hands. By doing this, many people enter the passage 390 while stretching their hands out in front of them and holding the medium over the optical system reader unit 31, so that they reach the reading line L2 before passing the detection line L1, and for users who intend to use the medium, the medium determination process can be performed before the face authentication determination process.

The facial recognition camera 331 includes a solid-state image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The facial recognition camera 331 captures an image of the face of a user passing through the passage 390 in the travel direction a, and transmits the captured image data to the control unit 320 via the slave unit 330. For example, the facial recognition camera 331 is installed at a height and angle that captures an image of a predetermined range equivalent to the height of the user's face (for example, a range of 140 to 180 cm from the ground of the passage 390).

The face recognition camera 331 is installed, for example, at the center of the slave 330 in the traveling direction a, and at a position further back in the traveling direction a than the optical system reader unit 311.

The control unit 320 is set, for example, to an operation mode that allows the passage of users entering in the travel direction a (for example, a mode that only allows entry into the station premises). Without being limited to this, the control unit 320 may be set to a mode that only allows exit to the outside of the station premises.

For example, if a user is detected by the face authentication start sensor 319 before information is read from the medium by the optical system reader unit 311, the control unit 320 determines that the user intends to pass through using face authentication, and executes face authentication determination processing and restricts the medium determination processing. On the other hand, if information is read from the medium by the optical system reader unit 311 before the user is detected by the face authentication start sensor 319, the control unit 320 determines that the user intends to pass through using the medium, and executes the medium determination processing and restricts the face authentication determination processing. Details will be described later.

Figure 3 is a configuration diagram of the automated ticket gate 300, focusing on the control unit 320. In addition to the components described above, the control unit 320 is also connected to a communication unit 340 and a memory unit 350. Note that the illustration of the wireless communication connection between the master unit 310 and slave unit 330 is simplified.

The communication unit 340 includes a communication interface such as a NIC. The communication unit 340 communicates with the DB server device 600 via a communication network such as a LAN under the control of the control unit 320. The storage unit 350 is realized by, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), or a HDD (Hard Disk Drive). In addition to storing the programs executed by the processor, the storage unit 350 also stores station information 351 including identification information for each station, a fare table 352 including fare information for each section, a previous determination result 353, a face recognition start number of people 354, and valid ticket counter information 355. Details of the previous determination result 353, the face recognition start number of people 354, and valid ticket counter information 355 will be described later.

The control unit 320 includes, for example, a first image processing unit 321, a communication processing unit 322, a second image processing unit 323, a reader control unit 324, an entrance/exit processing unit 325, a door control unit 326, and an output control unit 327. Some or all of these functional units are realized by, for example, a processor such as a CPU (Central Processing Unit) executing a program (software) stored in the storage unit 350. In addition, some or all of the functions of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in a storage device such as an HDD or flash memory in advance, or may be stored in a removable storage medium such as a DVD or CD-ROM, and installed by mounting the storage medium in a drive device.

The first image processing unit 321 performs a predetermined image processing on the captured image captured by the face recognition camera 331. For example, the first image processing unit 321 calculates feature amount data (hereinafter referred to as first feature amount data) indicating the facial features included in the captured image captured by the face recognition camera 331.

The first image processing unit 321 performs, for example, an extraction process that extracts a still image from a video captured by the facial recognition camera 331, a face detection process that detects a face by identifying facial feature points (positions of the eyes, nose, mouth, etc.) from the extracted still image, a target image detection process that detects an image in which the detected face is looking at (hereinafter referred to as a target image for facial recognition), a best shot selection process that selects from the target images for facial recognition the best image that is considered to contain the user's features in the most appropriate manner based on predetermined conditions determined for each angle and size of the detected face, and a feature calculation process that calculates the feature amounts of the detected face to obtain first feature amount data of the user.

The communication processing unit 322 uses the communication unit 340 to transmit the first feature data calculated by the first image processing unit 321 to the DB server device 600 via the network NW. On the other hand, the communication processing unit 322 uses the communication unit 340 to receive the results of the face recognition processing and validity information transmitted from the DB server device 600 via the network NW and output them to the entrance/exit processing unit 325.

The second image processing unit 323 acquires information encoded in the code image by performing image processing on the code image captured by the optical system reader unit 311. For example, the second image processing unit 323 acquires a passenger ticket ID from the two-dimensional code on the passenger ticket.

The reader control unit 324 controls the optical system reader unit 311. For example, when an instruction is given to restrict the reading process by the optical system reader unit 311, the reader control unit 324 stops the reading process by the optical system reader unit 311. When an instruction to stop is given, the optical system reader unit 311 switches its appearance by, for example, stopping light emission.

The entrance/exit processing unit 325 executes a pass determination process to determine whether or not a person can pass based on information received from the DB server device 600 (the results of the face authentication process and validity information). The pass determination process includes the face authentication determination process and the medium determination process described above. The entrance/exit processing unit 325 includes, for example, a face authentication determination processing unit 325A, a medium determination processing unit 325B, and a pass completion processing unit 325C. The face authentication determination processing unit 325A executes the face authentication determination process. The medium determination processing unit 325B executes the medium determination process.

The face authentication judgment processing unit 325A and the medium judgment processing unit 325B store the result of the pass judgment process in the previous judgment result 353 of the storage unit 350. For example, if the face authentication judgment processing determines that the user is allowed to pass, the face authentication judgment processing unit 325A registers the previous judgment OK information [face authentication] in the previous judgment result 353. The judgment result may be registered in any manner, and may be registered by writing the type of information itself, or by setting a flag assigned to each previous judgment information. Similarly, if the medium judgment processing unit 325B determines that the user is allowed to pass in the medium judgment processing, it registers the previous judgment OK information [medium] in the previous judgment result 353. The previous judgment result 353 is erased by the passage completion processing unit 325C when a predetermined condition is satisfied.

The face authentication determination processing unit 325A counts the number of users detected by the face authentication start sensor 319, and registers information indicating the counted number of people D in the face authentication start number of people 354. Note that the face authentication start number of people 354 is erased by the passage completion processing unit 325C when a predetermined condition is satisfied.

Next, we will explain an example of processing by the face authentication determination processing unit 325A.

The face authentication determination processing unit 325A determines whether or not an execution condition for executing the face authentication determination process is satisfied, and executes the face authentication determination process if the execution condition is satisfied. The execution condition for the face authentication determination process may be, for example,
(A1) A user is detected by the face authentication start sensor 319;
(A2-1) There is no previous OK information [medium], or
(A2-2) Even if there is previous judgment OK information [medium], this includes the fact that the user is the second or subsequent user detected by the face authentication start sensor 319 since the previous judgment OK information [medium] was registered.

In other words, when conditions A1 and A2-1 are satisfied, or when conditions A1 and A2-2 are satisfied, the execution condition for the face authentication judgment process is satisfied. Condition A2-1 can be rephrased as: no user has entered passage 390; there is no previous judgment OK information in previous judgment result 353; even if a user has entered passage 390, that user has been permitted to pass by the face authentication judgment process; or previous judgment result 353 is previous judgment OK information [face authentication]. Condition A2-2 can be rephrased as: a user who has previously entered passage 390 has been permitted to pass by the medium judgment process, and a user who is about to enter passage 390 afterwards does not hold a medium over the optical system reader unit 311 before being detected by the face authentication start sensor 319.

As described above, if the user intends to use facial recognition (i.e., if the user does not intend to use a medium), the medium is not held over the optical system reader unit 311, and therefore the medium determination process is not executed. This corresponds to a case where the user is detected by the facial recognition start sensor 319 and there is no previous determination OK information [medium], and this satisfies conditions A1 and A2-1. Therefore, if conditions A1 and A2-1 are satisfied, the facial recognition determination processing unit 325A determines that the user intends to use facial recognition, and can execute the facial recognition determination process.

In addition, when there is previous judgment OK information [medium], the user who is first detected by the face authentication start sensor 319 after the previous judgment OK information [medium] is registered is a user who intends to use the medium, and corresponds to the case where a user who has used the medium is detected by the face authentication start sensor 319. In this case, conditions A2-1 and A2-2 are not satisfied, so the face authentication judgment process is not executed. This makes it possible to avoid a situation in which face authentication is executed for a user who intends to use the medium.

Furthermore, even if there is previous judgment OK information [medium], the second or subsequent user detected by the face authentication start sensor 319 after the previous judgment OK information [medium] was registered is a user who intends to use face authentication, and corresponds to a case in which the face authentication start sensor 319 detects another user who intends to use face authentication after the user who intends to use the medium. In this case, since conditions A1 and A2-2 are satisfied, the face authentication judgment processing unit 325A can execute the face authentication judgment process. In this way, even if multiple users enter the passage 390 in succession, the passage judgment process can be executed according to the users' intentions.

If it is determined that the execution conditions for the face authentication determination process described above are met, the face authentication determination processing unit 325A restricts the reading of information by the optical system reader unit 311 and determines whether the user can pass based on the face image captured by the face authentication camera 331. Any method may be used to restrict the reading of information by the optical system reader unit 311, and for example, the face authentication determination processing unit 325A may cause the optical system reader unit 311 to stop the reading process, may instruct the optical system reader unit 311 not to output the read information to the medium determination processing unit 325B, or may instruct the medium determination processing unit 325B not to execute the medium determination process based on the information input from the optical system reader unit 311. Hereinafter, restricting the reading of information by the optical system reader unit 311 may be referred to as restricting the reading of information from the medium.

For example, when the face authentication processing unit 325A authenticates that the user is the same person as the registered person through face authentication processing of the user based on the captured image captured by the face authentication camera 331, the face authentication processing unit 325A determines whether or not the user can pass based on the authority (here, authority regarding railway use) given to the registered person. Specifically, the face authentication processing unit 325A determines whether or not the user can pass based on the information indicating the ticket validity, the information indicating the ticket status, the charge balance, etc. received from the DB server device 600. For example, in the entry processing, the face authentication processing unit 325A allows entry if the entry station is included in the usage section included in the ticket validity and the ticket status is unused. For example, in the exit processing, the face authentication processing unit 325A allows exit if the ticket status indicates that the user has entered and the fare from the entry station to the exit station can be settled with the charge balance.

Next, we will explain an example of processing by the medium determination processing unit 325B.

The medium determination processing unit 325B determines whether or not an execution condition for executing the medium determination process is satisfied, and executes the medium determination process if the execution condition is satisfied. The execution condition for the medium determination process may be, for example,
(B1) The face authentication determination process has not been started;
(B2) The optical system reader unit 311 reads information from the medium.

Note that conditions B1 and B2 can be rephrased as "the optical system reader unit 311 reads information from the medium before the user is detected by the face authentication start sensor 319."

As described above, the detection line L1 by the face authentication start sensor 319 is set further back in the traveling direction a than the reading line L2 where the medium is held over the optical system reader unit 311. Therefore, when a user intends to use a medium, the medium determination processing unit 325B can execute the medium determination processing prior to the face authentication determination processing. Therefore, when the user intends to use a medium, conditions B1 and B2 are satisfied, and the medium determination processing unit 325B can execute the medium determination processing. Note that by executing the medium determination processing prior to the face authentication determination processing, it is possible to avoid a situation in which the medium determination processing cannot be executed depending on the results of the face authentication determination processing.

When it is determined that the execution conditions for the medium determination process are met, the medium determination processing unit 325B restricts the face authentication determination process based on the face image captured by the face authentication camera 331, and determines whether the user can pass based on the information read by the optical system reader unit 311. Any method may be used to restrict the face authentication determination process based on the face image captured by the face authentication camera 331, and the medium determination processing unit 325B may, for example, cause the face authentication camera 331 to stop capturing images, instruct the face authentication camera 331 not to output the captured image to the face authentication determination processing unit 325A, or instruct the face authentication determination processing unit 325A not to execute the face authentication determination process based on the image input from the face authentication camera 331. Hereinafter, restricting the face authentication determination process based on the face image captured by the face authentication camera 331 may be referred to as restricting the acceptance of the face authentication camera 331.

For example, the medium determination processing unit 325B transmits the ticket ID read by the optical reader unit 311 to the DB server device 600, receives information linked to the ticket ID (e.g., information indicating the validity of the ticket, information indicating the status of the ticket, charge balance, etc.) from the DB server device 600, and determines whether the user can pass based on the received information. For example, in the entry process, the medium determination processing unit 325B allows entry if the entry station is included in the usage section included in the ticket validity and the ticket status is unused. For example, in the exit process, the medium determination processing unit 325B allows exit if the ticket status indicates that the ticket has been entered and the fare from the entry station to the exit station can be settled with the charge balance.

The passage completion processing unit 325C determines where the user is in the passage 390 based on the output from the passage sensor 314. For example, if the passage completion processing unit 325C detects the user by the passage sensor 314-3, it determines that the user has arrived in front of the door units 317 and 337. For example, if the passage completion processing unit 325C detects the user by the passage sensor 314-4, it determines that the user has passed through the passage 390.

The passage completion processing unit 325C determines whether to control the doors 317, 337 to an open state or a closed state based on the genuine note counter C. The genuine note counter is the number of times that the face authentication determination processing unit 325A or the medium determination processing unit 325B has determined that passage is permitted. In other words, the genuine note counter is the number of users passing through the passage 390, and when the genuine note counter C=0, it means that there are no users in the passage 390.

When the face authentication determination processing unit 325A and the medium determination processing unit 325B determine that passage is permitted, they increment the genuine note counter C by +1 and register it in the genuine note counter information 355. When the genuine note counter C=0 when the user arrives in front of the door unit 317, 337, the passage completion processing unit 325C controls the door unit 317, 337 to the closed state. On the other hand, when the genuine note counter C>0 when the user arrives in front of the door unit 317, 337, the passage completion processing unit 325C controls the door unit 317, 337 to the open state.

When the passage completion processing unit 325C determines that a user who is permitted to pass has passed through the passage 390, it subtracts -1 from the genuine note counter C. For example, if the passage sensor 314-4 detects a user after it has determined that the doors 317 and 337 should be controlled to be open, the passage completion processing unit 325C subtracts -1 from the genuine note counter C and updates the genuine note counter information 355.

When it is determined that the doors 317, 337 should be controlled to the closed state, the passage completion processing unit 325C determines whether the user has left the front side of the passage 390 in the travel direction a. For example, when none of the passage sensors 314 detect the user, it is determined that the user has left. In this case, the passage completion processing unit 325C resets all settings. For example, the passage completion processing unit 325C erases all information in the previous determination result 353, the number of people at the start of face authentication 354, and the genuine ticket counter information 355, lifts the restrictions on the face authentication determination process based on the face image captured by the face authentication camera 331, and lifts the restrictions on reading information by the optical system reader unit 311.

The door control unit 326 is a restriction mechanism that restricts passage through the passage 390, and operates the door units 317, 337 in response to a door control signal output from the entrance/exit processing unit 325. The control by the door control unit 326 is an example of "controlling equipment." Note that "controlling equipment" is not limited to this, and may include, for example, outputting a specified image to a display unit or outputting a specified sound from a speaker.

Controlling the door sections 317 and 337 based on the results of the facial recognition process is an example of a first control for controlling the device based on a facial image captured by the facial recognition camera 331, and controlling the door sections 317 and 337 based on the results of the medium determination process is an example of a second control for controlling the device based on information read by the optical system reader section 311.

The output control unit 327 controls the optical system reader illumination unit 311A, the top display unit 312, and the front display unit 313 to output predetermined information. For example, if the reading of information by the optical system reader unit 311 is restricted, the output control unit 327 causes the optical system reader illumination unit 311A and the top display unit 312 to display information indicating that the optical system reader unit 311 is unavailable.

[DB server device 600]
4 is a configuration diagram of the DB server device 600. The DB server device 600 includes, for example, a communication unit 610, a control unit 630, and a storage unit 650. The communication unit 610 includes, for example, a communication interface such as a NIC. The communication unit 610 communicates with the user terminal device 100, the ticket issuing machine 200, and the automated ticket gate 300 via a communication network such as the Internet under the control of the control unit 630. The storage unit 650 is realized by, for example, a RAM, a ROM, a HDD, etc. The storage unit 650 stores programs executed by the processor, as well as a ticket DB 651, a fare adjustment DB 652, etc.

The control unit 630 includes, for example, a data management unit 631, an image processing unit 632, a face recognition processing unit 633, a search unit 634, a settlement processing unit 635, and a result processing unit 636. Some or all of these functional units are realized by, for example, a processor such as a CPU executing a program (software) stored in the storage unit 650. In addition, some or all of the functions of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory, or may be stored in a removable storage medium such as a DVD or CD-ROM, and installed by inserting the storage medium into a drive device.

The data management unit 631 receives information transmitted from the user terminal device 100, the ticket issuing machine 200, and the automated ticket gate 300 via the network NW using the communication unit 610. For example, the data management unit 631 stores various registration information received from the user terminal device 100 or the ticket issuing machine 200, information indicating the passage determination result received from the automated ticket gate 300, information indicating the result of image processing by the image processing unit 632, etc. as part of the ticket DB 651 and settlement DB 652 of the memory unit 650.

For example, the data management unit 631 registers in the database record information in which authority information indicating the authority given to the registrant is associated with both a ticket ID that identifies the registrant or the authority information, and feature data indicating the facial features of the registrant (hereinafter referred to as second feature data).

Figure 5 is a diagram showing an example of the contents of the ticket DB 651. The ticket DB 651 is record information that associates, for example, a user ID with facial features, ticket validity, ticket status, and a ticket ID. The user ID is identification information that identifies each user. The user ID is, for example, information assigned by the DB server device 600, and is information transmitted from the user terminal device 100 together with various information to identify the user. The facial features are, for example, second feature data generated by the image processing unit 632 based on registered face image data included in various registration information from the user terminal device 100 or the ticket issuing machine 200.

The ticket validity is an example of information indicating the authority given to a user, and is information indicating the validity of the ticket. The ticket validity includes, for example, the type of ticket (information indicating whether it is a one-day pass or a commuter pass), information indicating the railway section in which the ticket can be used, the date and time when the ticket was purchased (purchase date and time), and the ticket expiration date. The ticket validity is information based on the ticket purchase conditions contained in various registration information from the user terminal device 100 or the ticket issuing machine 200.

The ticket status is information that indicates the status of rail travel using a user's ticket. The ticket status includes, for example, a state in which the ticket is not being used (unused), a state in which the ticket is inside a station (entry), a state in which the ticket is leaving a station (exit), identification information of the station from which the ticket was entered, and identification information of the station from which the ticket was exited. The ticket status is information that is updated by the data management unit 631.

Figure 6 is a diagram showing an example of the contents of the settlement DB 652. The settlement DB 652 is record information that associates, for example, a user ID with a charge balance, credit information, and personal attribute information. The credit information and personal attribute information are part of the various registered information received from the user terminal device 100 or the ticket issuing machine 200. The credit information is information related to the credit card used to settle the ticket. The personal attribute information includes, for example, the user's name, gender, age, etc. The charge balance is the balance of charged electronic money, for example, the balance after settling the fare used. The charge balance is information updated by the settlement processing unit 635.

The image processing unit 632 performs a predetermined image processing on the registered face image data received from the user terminal device 100 or the ticket issuing machine 200, and calculates the second feature amount data. The calculated second feature amount data is registered in the ticket DB 651 by the data management unit 631. Note that the method for calculating the second feature amount data by the image processing unit 632 and the method for calculating the first feature amount data by the automated ticket gate 300 may be the same method.

When the facial recognition processing unit 633 receives the facial features (first feature data) of a passerby from the automated ticket gate 300, it refers to the ticket DB 651 in the storage unit 650 and performs facial recognition processing to prove that the passerby is the same person as the registered person. For example, the facial recognition processing unit 633 calculates a matching score for each registered person that indicates the degree of similarity between the second feature data of all registered people registered in the ticket DB 651 and the first feature data of the user of the automated ticket gate 300, and determines which registered people are recognized as the same person as the user based on the calculated matching score. Without being limited to this, the facial recognition processing unit 633 may calculate the feature data using any method commonly used in facial recognition processing.

The search unit 634, for example, searches the memory unit 650 based on the processing result by the face recognition processing unit 633, and obtains, as a search result, information associated with a registered person who is recognized as the same person as the user by the face recognition processing. The search unit 634 then transmits the information associated with the registered person obtained by the search to the automated ticket gate 300 via the network NW using the communication unit 610.

For example, if the facial recognition process determines that the user is the same person as one of the registered users, the search unit 634 reads information indicating the validity of the ticket and information indicating the ticket status from the ticket DB 651 based on the user ID of the registered user, and transmits them to the automated ticket gate 300 that transmitted the first feature data. On the other hand, if the facial recognition process determines that the user is not the same person as one of the registered users, the search unit 634 transmits information indicating that the user was not recognized as the same person as the registered user by facial recognition to the automated ticket gate 300 that transmitted the first feature data.

On the other hand, when a ticket is used, the search unit 634 may search for validity information, etc., using the ticket ID as a key. For example, the search unit 634 reads out information indicating the ticket validity and information indicating the ticket status associated with the ticket ID from the ticket DB 651 based on the ticket ID received from the automated ticket gate 300 via the network NW. The result processing unit 636 transmits the search results read out by the search unit 634 to the automated ticket gate 300 that transmitted the ticket ID.

The settlement processing unit 635 executes a ticket purchase process based on information indicating the ticket purchase conditions received from the user terminal device 100 or the ticket issuing machine 200. The ticket purchase process includes, for example, a settlement process for settling the fare of the ticket according to the purchase conditions, and a process for updating the ticket DB 651 based on information indicating the validity of the purchased ticket.

When the settlement processing unit 635 receives information indicating the passage determination result from the automated ticket gate 300, it may refer to the settlement DB 652 and execute settlement processing to settle the fare used by the user. For example, based on information indicating that exit has been permitted and identification information of the station from which exit has been permitted, the settlement processing unit 635 refers to the ticket status in the ticket DB 651, calculates the fare from the station of entry to the station from which exit has been permitted, and subtracts the calculated fare from the charge balance. When specified by the user, the settlement processing unit 635 may execute settlement processing based on credit information.

Furthermore, when information indicating the passage judgment result is received from the automated ticket gate 300, the data management unit 631 updates the ticket status contained in the ticket DB 651 based on the passage judgment result. For example, when entry is permitted, the data management unit 631 rewrites the ticket status from a state in which the ticket is not used (unused) to information including a state in which the ticket has entered the station premises (entry) and identification information of the entry station. Furthermore, when exit is permitted, the data management unit 631 rewrites the ticket status from a state in which the ticket has entered the station premises (entry) to information including a state in which the ticket has left the station premises (exit) and identification information of the exit station.

[flowchart]
7 is a flowchart showing the flow of processing by the face authentication determination processing unit 325A of the automatic ticket gate 300. First, the face authentication determination processing unit 325A determines whether or not a user is detected by the face authentication start sensor 319 (step S101). When a user is detected by the face authentication start sensor 319, the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 (step S103). Next, the face authentication determination processing unit 325A determines whether or not acceptance of the face authentication camera 331 is permitted (step S105), and when acceptance of the face authentication camera 331 is not permitted, the face authentication determination processing is not executed (step S107), and the processing is terminated. In step S107, the output control unit 327 may cause the upper display unit 312 to display the fact that the face authentication determination processing is not executed.

On the other hand, if the reception of the face recognition camera 331 is permitted, the face recognition judgment processing unit 325A judges whether the previous judgment OK information [medium] is registered in the judgment result information 353 (step S109). If the previous judgment OK information [medium] is not registered in the judgment result information 353, the face recognition judgment processing unit 325A judges that the execution condition of the face recognition judgment process is satisfied, executes the face recognition judgment process (step S111), and notifies the medium judgment processing unit 325B that the face recognition judgment process is being executed (step S113). For example, the face recognition judgment processing unit 325A transmits an image captured by the face recognition camera 331 to the DB server device 600 and receives information according to the result of the face recognition from the DB server device 600. The face recognition judgment processing unit 325A judges whether to allow the user to pass based on the received information. Note that, upon receiving a notice that the face recognition judgment process is being executed, the medium judgment processing unit 325B executes a process of restricting the reading of information from the medium.

If it is determined by the facial authentication judgment process in step S111 that passage is permitted (step S115-YES), the facial authentication judgment processing unit 325A increments the genuine note counter C in the genuine note counter information 355 in the memory unit 350 by +1 (step S117), and registers previous judgment OK information [facial recognition] in the previous judgment result 353 (step S119). Then, the facial authentication judgment processing unit 325A notifies the medium judgment processing unit 325B that the facial authentication judgment process has ended (step S121). Note that, upon receiving the notification that the facial authentication judgment process has ended, the medium judgment processing unit 325B lifts the restriction on reading information from the medium.

On the other hand, if the facial recognition judgment process in step S111 determines that passage is to be prohibited (step S115-NO), the facial recognition judgment processing unit 325A restricts the reading of information from the medium (step S123) and also restricts acceptance by the facial recognition camera 331 (step S125).

Returning to step S109, if the previous judgment OK information [medium] is registered in the judgment result information 353, the face authentication judgment processing unit 325A judges whether the user detected by the face authentication start sensor 319 is the second or subsequent user since the previous judgment OK information [medium] was registered (step S127). For example, if the number of people D registered in the face authentication start number of people 354 is 2 or more, the face authentication judgment processing unit 325A proceeds to step S111 and executes face authentication judgment processing. On the other hand, if the number of people D registered in the face authentication start number of people 354 is < 2, the face authentication judgment processing unit 325A does not execute face authentication judgment processing (step S107) and ends the processing.

Figure 8 is a flowchart showing the flow of processing by the medium determination processing unit 325B of the automated ticket gate 300. First, the medium determination processing unit 325B determines whether or not the face authentication determination processing is being executed (step S201). For example, if a notification that the face authentication determination processing is being executed is received from the face authentication determination processing unit 325A, the medium determination processing unit 325B restricts the reading of information from the medium (step S203) and ends the processing.

On the other hand, if the facial authentication judgment processing unit 325A is not currently executing the facial authentication judgment processing, the medium judgment processing unit 325B allows the optical system reader unit 311 to read information from the medium (step S205). Cases where the facial authentication judgment processing is not currently executing include, for example, a case where a notification that the facial authentication judgment processing is currently being executed has not been received from the facial authentication judgment processing unit 325A, or a case where a notification that the facial authentication judgment processing has ended has been received from the facial authentication judgment processing unit 325A.

Then, it is determined whether the optical system reader unit 311 has read information from the medium (step S207). If the optical system reader unit 311 has not read information from the medium, the process returns to step S201 and is repeated. On the other hand, if the optical system reader unit 311 has read information from the medium, the medium determination processing unit 325B restricts the acceptance of information by the face recognition camera 331 (step S209) and executes the medium determination process (step S211).

If the medium determination process in step S211 determines that passage is permitted (step S213-YES), the medium determination processing unit 325B adds +1 to the good note counter C in the good note counter information 355 in the memory unit 350 (step S215), and registers the previous determination OK information [medium] in the previous determination result 353 (step S217).

On the other hand, if the medium determination process in step S211 determines that passage is to be prohibited (step S213-NO), the medium determination processing unit 325B restricts the reading of information from the medium (step S219) and also restricts acceptance by the face recognition camera 331 (step S221).

Figure 9 is a flowchart showing the flow of processing by the passage completion processing unit 325C of the automated ticket gate 300. The passage completion processing unit 325C determines whether or not the user has arrived immediately before the gate unit 317, 337 based on the detection result by the passage sensor 314 (step S301).

When it is detected that the user has arrived just before the door unit 317, 337, the passage completion processing unit 325C judges whether the genuine note counter C registered in the genuine note counter information 355 is equal to 0 (step S303). When the genuine note counter C is equal to 0, the passage completion processing unit 325C controls the door unit 317, 337 to a closed state (step S305). Then, based on the detection result by the passage sensor 314, the passage completion processing unit 325C judges whether the user has left the passage 390 (step S307). When it is detected that the user has left the passage 390, the passage completion processing unit 325C resets everything (step S309).

On the other hand, if the genuine note counter C is not 0 in step S303, the passage completion processing unit 325C controls the doors 317, 337 to an open state (step S311). Then, the passage completion processing unit 325C determines whether the user has passed through the passage 390 based on the detection result by the passage sensor 314 (step S313). If it is detected that the user has passed through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter C registered in the genuine note counter information 355 (step S315).

Next, if the genuine note counter C registered in the genuine note counter information 355 is not 0, the passage completion processing unit 325C returns to step S301 and repeats the process. On the other hand, if the genuine note counter C registered in the genuine note counter information 355 is 0, the passage completion processing unit 325C erases the information of the previous determination result 353 (step S319).

Figure 10 is a diagram showing an example of the transition of information registered in the previous judgment result 353. When the control system 1 is started, the previous judgment result 353 is in a state (S1) in which no information is registered. From this state (S1), if passage is permitted in the face recognition judgment process, the state changes to a state (S2) in which previous judgment OK information [face recognition] is registered, and if passage is permitted in the medium judgment process, the state changes to a state (S3) in which previous judgment OK information [medium] is registered.

When the previous judgment OK information [face recognition] is registered (S2), if passage is permitted in the medium judgment process, the previous judgment OK information [medium] is registered (S3), and when the previous judgment OK information [medium] is registered (S3), if passage is permitted in the face recognition judgment process, the previous judgment OK information [face recognition] is registered (S2).

When the user has passed through the passage 390 and the valid ticket counter C is equal to 0 in the state where the previous judgment OK information [face recognition] has been registered (S2) or the previous judgment OK information [medium] has been registered (S3), or when it has been determined in any judgment process that passage is prohibited, the previous judgment result 353 will be in a state where no information has been registered (S1).

[Use case 1]
11 is a diagram for explaining use case 1 of the automated ticket gate 300. This use case 1 is an example in which one user passes through and it is determined in the face authentication determination process that the user P is permitted to pass through.

(C1-1) First, when user P enters passage 390, (C1-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the number of people to start face authentication 354 and determines whether the conditions for executing the face authentication determination process are met. In this example, since no previous OK determination information has been registered, the face authentication determination processing unit 325A determines that the conditions for executing the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C1-3) If the facial recognition judgment process determines that passage is permitted, the facial recognition judgment processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous judgment OK information [facial recognition] in the previous judgment result 353. In response to this, the medium judgment processing unit 325B permits the reading process by the optical reader unit 311. Then, when it is detected that user Q has arrived just before the door units 317 and 337, the genuine note counter C is > 0, so the door control unit 326 controls the door units 317 and 337 to the open state.

(C1-4) Then, when it is detected that user P has completed passing through passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter, updating the genuine note counter C to 0, and erasing all information from the previous determination result 353.

[Use case 2]
12 is a diagram for explaining use case 2 of the automated ticket gate 300. Use case 2 is an example in which one user passes through and it is determined in the face authentication determination process that user P is to be prohibited from passing through.

(C2-1) First, when user P enters passage 390, (C2-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous determination OK information has not been registered, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C2-3) If the facial authentication judgment process determines that passage is prohibited, the facial authentication judgment processing unit 325A restricts reading by the optical reader unit 311 and restricts acceptance by the facial authentication camera 331. Furthermore, since the genuine note counter is not incremented and genuine note counter C remains at 0, when it is detected that user P has arrived just before the door units 317, 337, the door control unit 326 controls the door units 317, 337 to a closed state. (C2-4) Then, when the passage sensor 314 detects that user P has left the passage 390, the passage completion processing unit 325C resets the previous judgment result 353 and the genuine note counter information 355.

[Use case 3]
13 is a diagram for explaining use case 3 of the automated ticket gate 300. This use case 3 is an example in which one user passes through and it is determined in the medium determination process that user P is permitted to pass through.

(C3-1) Before entering the passage 390 (before the face authentication start sensor 319 detects user P), user P holds a medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be allowed to pass, the medium determination processing unit 325B adds +1 to the genuine note counter, updating the genuine note counter C to 1, and previous determination OK information [medium] is registered in the previous determination result 353.

(C3-2) Next, the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User P is the first person to pass after the previous judgment OK information [medium] was registered, and since the number of people D registered in the face authentication start number of people 354 is D=1, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are not met and does not execute the face authentication determination process.

(C3-3) User P continues down passage 390, and when passage sensor 314 detects that user P has arrived just before door units 317, 337, door control unit 326 controls door units 317, 337 to the open state because genuine note counter C>0. (C3-4) Then, when passage sensor 314 detects that user P has completed passing through passage 390, passage completion processing unit 325C subtracts -1 from the genuine note counter, and because genuine note counter C=0, erases the information of previous determination result 353.

[Use case 4]
14 is a diagram for explaining use case 4 of the automated ticket gate 300. Use case 4 is an example in which one user passes through and it is determined in the medium determination process that user P is to be prohibited from passing through.

(C4-1) Before entering the passage 390, user P holds a medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be prohibited from passing through, the medium determination processing unit 325B restricts reading by the optical reader unit 311 and also restricts acceptance by the face authentication camera 331.

(C4-2) User P continues down passage 390, and when passage sensor 314 detects that user P has arrived just before door units 317, 337, door control unit 326 controls door units 317, 337 to the closed state because genuine ticket counter C = 0. Therefore, user P turns back down passage 390 and leaves passage 390. (C4-3) Then, when passage sensor 314 detects that user P has left passage 390, passage completion processing unit 325C resets all restrictions on reading information from media by optical reader unit 311, restrictions on reception by face recognition camera 331, etc.

[Use case 5]
15 is a diagram for explaining use case 5 of the automated ticket gate 300. Use case 5 is an example in which two users pass through, and the first user P is permitted to pass through by the face authentication determination process, and the second user Q is permitted to pass through by the medium determination process.

(C5-1) First, when user P enters passage 390, (C5-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the conditions for executing the face authentication determination process are met. In this example, since the previous determination OK information has not been registered, the face authentication determination processing unit 325A determines that the conditions for executing the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C5-3) If the facial authentication determination process determines that user P should be allowed to pass, the facial authentication determination processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous determination OK information [facial authentication] in the previous determination result 353. Then, the medium determination processing unit 325B permits reading by the optical system reader unit 311.

On the other hand, before entering the passage 390 (before the face authentication start sensor 319 detects user Q), user Q holds the medium over the optical reader unit 311. This causes the medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user Q should be allowed to pass, the medium determination processing unit 325B adds +1 to the genuine note counter, updating the genuine note counter C to 2, and the previous determination result 353 is overwritten with previous determination OK information [medium].

(C5-4) Then, when it is detected that user P has arrived just before door unit 317, 337, since genuine note counter C>0, door control unit 326 controls door units 317, 337 to the open state. After that, when passage sensor 314 detects that user P has completed passing through passage 390, passage completion processing unit 325C subtracts -1 from the genuine note counter, and genuine note counter C is updated to 1.

Next, the face authentication start sensor 319 detects user Q, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A refers to the face authentication start number of people 354 and checks the number of people detected by the face authentication start sensor 319. User Q is the first user after the previous judgment OK information [medium] has been registered, and since the number of people D registered in the face authentication start number 354 is 1, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are not met and does not execute the face authentication determination process.

When it is detected that user Q has arrived just before door section 317, 337, since genuine note counter C>0, door control section 326 controls door section 317, 337 to the open state. Then, passage completion processing section 325C subtracts -1 from the genuine note counter, updating genuine note counter C to 0. Therefore, passage completion processing section 325C erases the information of the previous judgment result 353.

[Use case 6]
16 is a diagram for explaining use case 6 of the automated ticket gate 300. Use case 6 is an example in which two users pass through, and the first user P is permitted to pass through by the face authentication determination process, and the second user Q is also permitted to pass through by the face authentication determination process.

(C6-1) First, when user P enters passage 390, (C6-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous determination OK information has not been registered, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C6-3) If the facial authentication determination process determines that user P should be allowed to pass, the facial authentication determination processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous determination OK information [facial authentication] in the previous determination result 353. Then, the medium determination processing unit 325B permits reading by the optical system reader unit 311.

Next, when user Q enters passage 390, the face authentication start sensor 319 detects user Q, and the face authentication determination processing unit 325A adds +1 to the number of people to start face authentication 354 and determines whether the conditions for executing the face authentication determination process are met. In this example, since the previous determination OK information [face authentication] is registered, the face authentication determination processing unit 325A determines that the conditions for executing the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C6-4) Then, when it is detected that user P has arrived just before door units 317, 337, since genuine note counter C>0, door control unit 326 controls door units 317, 337 to the open state. After that, when passage sensor 314 detects that user P has completed passing through passage 390, passage completion processing unit 325C subtracts -1 from the genuine note counter, updating genuine note counter C to 0. Therefore, passage completion processing unit 325C erases the information of previous determination result 353.

Next, if the face authentication judgment process for user Q determines that passage is permitted, the face authentication judgment processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registering previous judgment OK information [face authentication] in the previous judgment result 353. In response to this, the medium judgment processing unit 325B permits reading by the optical reader unit 311. Then, when it is detected that user Q has arrived just before the door units 317 and 337, the genuine note counter C>0, so the door control unit 326 controls the door units 317 and 337 to an open state. After that, when the passage sensor 314 detects that user Q has completed passage through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter, updating the genuine note counter C to 0. Therefore, the passage completion processing unit 325C erases the information in the previous judgment result 353.

[Use case 7]
17 is a diagram for explaining use case 7 of the automated ticket gate 300. Use case 7 is an example in which two users pass through, and the first user P is permitted to pass through by the medium determination process, and the second user Q is permitted to pass through by the face authentication determination process.

(C7-1) Before entering the passage 390 (before the face authentication start sensor 319 detects user P), user P holds a medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be allowed to pass, the medium determination processing unit 325B adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous determination OK information [medium] in the previous determination result 353.

(C7-2) Next, the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User P is the first person to pass after the previous judgment OK information [medium] has been registered, and since the number of people D registered in the face authentication start number of people 354 is D=1, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are not met and does not execute the face authentication determination process.

(C7-3) User P continues to proceed down passage 390, and when passage sensor 314 detects that user P has arrived just before door units 317 and 337, door control unit 326 controls door units 317 and 337 to the open state because genuine note counter C>0.

Meanwhile, the face authentication start sensor 319 detects user Q, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User Q is the second person to pass after the previous judgment OK information [medium] was registered, and since the number of people D registered in the face authentication start number of people 354 is D=2, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are met and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C7-4) Then, when the passage sensor 314 detects that user P has completed passing through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter. Since the genuine note counter C=0, the passage completion processing unit 325C erases the information of the previous determination result 353.

Next, if the face authentication judgment process for user Q determines that passage is permitted, the face authentication judgment processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registering previous judgment OK information [face authentication] in the previous judgment result 353. In response to this, the medium judgment processing unit 325B permits reading by the optical reader unit 311. Then, when it is detected that user Q has arrived just before the doors 317 and 337, the genuine note counter C>0, so the door control unit 326 controls the doors 317 and 337 to an open state. After that, when the passage sensor 314 detects that user Q has completed passage through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter, so that the genuine note counter C=0. Therefore, the passage completion processing unit 325C erases the information in the previous judgment result 353.

[Use case 8]
18 is a diagram for explaining use case 8 of the automated ticket gate 300. Use case 8 is an example of a case in which two users pass through, and the first user P is permitted to pass through by the medium determination process, and the second user Q is prohibited from passing through by the face authentication determination process.

(C8-1) Before entering the passage 390 (before the face authentication start sensor 319 detects user P), user P holds a medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be allowed to pass, the medium determination processing unit 325B adds +1 to the genuine note counter, updating the genuine note counter C to 1, and previous determination OK information [medium] is registered in the previous determination result 353.

(C8-2) Next, the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User P is the first person to pass after the previous judgment OK information [medium] has been registered, and since the number of people D registered in the face authentication start number of people 354 is 1, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are not met and does not execute the face authentication determination process.

(C8-3) User P continues to proceed down passage 390, and when passage sensor 314 detects that user P has arrived just before door units 317 and 337, door control unit 326 controls door units 317 and 337 to the open state because genuine note counter C>0.

Meanwhile, the face authentication start sensor 319 detects user Q, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User Q is the second person to pass after the previous judgment OK information [medium] was registered, and since the number of people D registered in the face authentication start number of people 354 is D=2, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are met and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C8-4) Then, when the passage sensor 314 detects that user P has completed passing through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter. Since the genuine note counter C=0, the passage completion processing unit 325C erases the information of the previous determination result 353.

Next, if it is determined in the face authentication determination process that user Q is to be prohibited from passing, the face authentication determination processing unit 325A restricts reading by the optical reader unit 311 and restricts acceptance by the face authentication camera 331. Furthermore, since the genuine note counter is not incremented and genuine note counter C=0, when it is detected that user Q has arrived just before the doors 317, 337, the door control unit 326 controls the doors 317, 337 to a closed state. Then, when the passage sensor 314 detects that user P has left the passage 390, the passage completion processing unit 325C resets the previous determination result 353 and the genuine note counter information 355.

[Use case 9]
19 is a diagram for explaining use case 9 of the automated ticket gate 300. Use case 9 is an example of a case in which two users pass through, and the first user P is permitted to pass through by the medium determination process, while the second user Q is prohibited from passing through by the medium determination process.

(C9-1) Before entering the passage 390 (before the face authentication start sensor 319 detects user P), user P holds a medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be allowed to pass, the medium determination processing unit 325B adds +1 to the genuine note counter, updating the genuine note counter C to 1, and previous determination OK information [medium] is registered in the previous determination result 353.

(C9-2) Next, the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous judgment OK information [medium] has been registered, the face authentication determination processing unit 325A checks the number of people detected by the face authentication start sensor 319. User P is the first person to pass after the previous judgment OK information [medium] has been registered, and since the number of people D registered in the face authentication start number of people 354 is 1, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are not met and does not execute the face authentication determination process.

(C9-3) User P continues to proceed down passage 390, and when passage sensor 314 detects that user P has arrived just before door units 317 and 337, door control unit 326 controls door units 317 and 337 to the open state because genuine note counter C>0.

Next, before entering passage 390, user Q holds the medium over the optical reader unit 311. This causes a medium determination process to be executed based on the information read by the optical reader unit 311. If the medium determination process determines that user P should be prohibited from passing through, the medium determination processing unit 325B restricts reading by the optical reader unit 311 and also restricts acceptance by the face authentication camera 331.

(C9-4) Then, when the passage sensor 314 detects that user P has completed passing through the passage 390, the passage completion processing unit 325C subtracts -1 from the genuine note counter. Since the genuine note counter C=0, the passage completion processing unit 325C erases the information of the previous determination result 353.

Next, user Q continues down passage 390, and when the passage sensor 314 detects that user Q has arrived just before the doors 317, 337, the door control unit 326 controls the doors 317, 337 to the closed state because the genuine ticket counter C = 0. Therefore, user P goes back down passage 390 and leaves passage 390. Then, when the passage sensor 314 detects that user Q has left passage 390, the passage completion processing unit 325C resets all restrictions on reading information from the medium by the optical reader unit 311, restrictions on reception by the face recognition camera 331, etc.

[Use Case 10]
20 is a diagram for explaining a use case 10 of the automated ticket gate 300. This use case 10 is an example of a case where two users pass through, in which a first user P is permitted to pass through by the face authentication determination process, and a second user Q is prohibited from passing through by the face authentication determination process.

(C10-1) First, when user P enters passage 390, (C10-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the conditions for executing the face authentication determination process are met. In this example, since the previous determination OK information has not been registered, the face authentication determination processing unit 325A determines that the conditions for executing the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C10-3) If the facial authentication determination process determines that user P should be allowed to pass, the facial authentication determination processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous determination OK information [facial authentication] in the previous determination result 353. Then, the medium determination processing unit 325B permits reading by the optical system reader unit 311.

Next, when user Q enters passage 390, the face authentication start sensor 319 detects user Q, and the face authentication determination processing unit 325A adds +1 to the number of people to start face authentication 354 and determines whether the conditions for executing the face authentication determination process are met. In this example, since the previous determination OK information [face authentication] is registered, the face authentication determination processing unit 325A determines that the conditions for executing the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C10-4) Then, when it is detected that user P has arrived just before door units 317, 337, genuine note counter C>0, so door control unit 326 controls door units 317, 337 to the open state. After that, when passage sensor 314 detects that user P has completed passing through passage 390, passage completion processing unit 325C subtracts -1 from the genuine note counter, so that genuine note counter C=0. Therefore, passage completion processing unit 325C erases the information of previous determination result 353.

Next, if it is determined in the face authentication determination process that user Q is prohibited from passing, the face authentication determination processing unit 325A restricts reading by the optical reader unit 311 and restricts acceptance by the face authentication camera 331. Furthermore, since the genuine note counter is not incremented and genuine note counter C=0, when it is detected that user Q has arrived just before the doors 317, 337, the door control unit 326 controls the doors 317, 337 to a closed state. Then, when the passage sensor 314 detects that user P has left the passage 390, the passage completion processing unit 325C resets all of the previous determination result 353, genuine note counter information 355, restrictions on the process of reading information from the medium by the optical reader unit 311, and restrictions on acceptance by the face authentication camera 331.

[Use Case 11]
21 is a diagram for explaining use case 11 of the automated ticket gate 300. This use case 11 is an example of a case where two users pass through, in which the first user P is permitted to pass through by the face authentication determination process, and the second user Q is prohibited from passing through by the medium determination process.

(C11-1) First, when user P enters passage 390, (C11-2) the face authentication start sensor 319 detects user P, and the face authentication determination processing unit 325A adds +1 to the face authentication start number of people 354 and determines whether the execution conditions for the face authentication determination process are met. In this example, since the previous determination OK information has not been registered, the face authentication determination processing unit 325A determines that the execution conditions for the face authentication determination process are met, and executes the face authentication determination process. Accordingly, the medium determination processing unit 325B restricts reading by the optical system reader unit 311.

(C11-3) If the facial authentication determination process determines that user P should be allowed to pass, the facial authentication determination processing unit 325A adds +1 to the genuine note counter, updating the genuine note counter C to 1, and registers previous determination OK information [facial authentication] in the previous determination result 353. Then, the medium determination processing unit 325B permits reading by the optical system reader unit 311.

Next, before entering the passage 390 (before the facial authentication start sensor 319 detects user P), user Q holds the medium over the optical system reader unit 311. This causes a medium determination process to be executed based on the information read by the optical system reader unit 311. If the medium determination process determines that user P should be prohibited from passing through, the medium determination processing unit 325B restricts reading by the optical system reader unit 311 and also restricts acceptance by the facial authentication camera 331.

(C11-4) Then, when it is detected that user P has arrived just before door units 317, 337, genuine note counter C>0, so door control unit 326 controls door units 317, 337 to the open state. After that, when passage sensor 314 detects that user P has completed passing through passage 390, passage completion processing unit 325C subtracts -1 from the genuine note counter, so that genuine note counter C=0. Therefore, passage completion processing unit 325C erases the information of previous determination result 353.

Next, user Q continues down passage 390, and when the passage sensor 314 detects that user Q has arrived just before the doors 317, 337, the door control unit 326 controls the doors 317, 337 to the closed state because the genuine ticket counter C = 0. Therefore, user P goes back down passage 390 and leaves passage 390. Then, when the passage sensor 314 detects that user Q has left passage 390, the passage completion processing unit 325C resets all restrictions on reading information from the medium by the optical reader unit 311, restrictions on reception by the face recognition camera 331, etc.

According to the first embodiment described above, it is possible to determine whether or not to allow passage for both users who wish to use face authentication and users who wish to use a medium, and it is also possible to prevent two valid tickets from being used by each user. In this way, it is possible to execute control according to the user's intentions.

In addition, without this embodiment, the face of a user entering the passageway of the ticket gate is captured by the camera regardless of the user's intention, and it is therefore not possible to know in advance whether the user wants to pass through using face recognition or a medium. This means that there is a possibility that the determination process will be carried out in a way that is different from the user's intention, leading to a situation in which two genuine tickets are consumed when passage is permitted by both authentications, or passage is prohibited by the unintended authentication. The embodiment described above can solve this problem.

As shown in FIG. 2 above, an example has been described in which the detection line L1 by the face authentication start sensor 319 is located in front of the optical system reader unit 311 in the traveling direction a, or in the same position as the optical system reader unit 311, but this is not limited to the example. For example, the detection line L1 may be located at a position a predetermined distance or more behind the optical system reader unit 311 in the traveling direction a.

Figure 22 is a view of the automated ticket gate 300A from above. The detection line L1 of the face authentication start sensor 319A is a distance K1 behind the reference position L3 of the optical system reader unit 311 in the travel direction a. This distance K1 is a distance at which, for example, a user standing on the detection line L1 cannot hold a medium over the optical system reader unit 311 even if the user places their hand behind their body. Distance K1 may be a distance at which a user cannot hold a medium over the optical system reader unit 311 unless the user has very long hands. By doing this, even if the user bends their hand and tries to hold the medium over the optical system reader unit 311 behind their own back, the medium determination process can be executed before the face authentication determination process.

[Second embodiment]
In the above, it has been explained that previous judgment OK information is registered in the previous judgment result 353, but in addition to this, previous judgment NG information may be registered. For example, when the face authentication judgment processing unit 325A judges that the passage of the user is prohibited by the face authentication judgment process, it registers previous judgment NG information [face authentication] in the previous judgment result 353. Also, when the medium judgment processing unit 325B judges that the passage of the user is prohibited in the medium judgment process, it registers previous judgment NG information [medium] in the previous judgment result 353.

The execution conditions for the face recognition determination process are further set as follows:
(A3) The information may include that the previous judgment NG information [face recognition] or the previous judgment NG information [medium] is not registered.

In addition, the execution conditions of the medium determination process are further set as follows:
(B3) The information may include that the previous judgment NG information [face recognition] or the previous judgment NG information [medium] is not registered.

This makes it possible to prevent the face recognition determination process and the medium determination process from being executed when it has been determined that passage is prohibited.

Furthermore, the second embodiment can achieve the same effects as the first embodiment.

According to at least one of the embodiments described above, a reading unit that reads information from a medium optically or by wireless communication, a detection unit that detects a user present at a first position determined based on a relative positional relationship with the reading unit, a camera that captures an image of the user's face when the user is detected by the detection unit, and a control unit that, when the user is detected by the detection unit, restricts the reading of information by the reading unit and executes a first control for controlling an equipment based on the image captured by the camera, and, when the reading unit reads information, restricts equipment control using the image captured by the camera and executes a second control for controlling the equipment based on the information read by the reading unit, thereby making it possible to execute control according to the user's intentions.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are within the scope of the invention and its equivalents as set forth in the claims, as well as the scope and gist of the invention.

For example, a part of the processing performed by the automated ticket gate 300 may be installed in the DB server device 600. Similarly, a part of the processing performed by the DB server device 600 may be installed in the automated ticket gate 300. For example, the automated ticket gate 300 may be equipped with the face recognition processing unit 633, search unit 634, ticket DB 651, etc. of the DB server device 600, and may perform face recognition processing and database search processing based on the first feature amount data. Furthermore, the automated ticket gate 300 may transmit image data captured by its own face recognition camera 331 directly to the DB server device 600, and the DB server device 600 may generate the first feature amount data. Furthermore, the passage determination processing performed by the automated ticket gate 300 may be performed by the DB server device 600.

The automated ticket gate 300 may have a configuration for permitting or prohibiting the passage of users entering in the travel direction a described above, as well as a configuration for permitting or prohibiting the passage of users entering in the travel direction b from the second area to the first area. In this case, the mode may be fixed to determine the passage of either the travel direction a or the travel direction b, or the mode may be switched for each user depending on the user entering.

As mentioned above, the automated ticket gate 300 may read information from an IC card via wireless communication, and an example of such a configuration will be described below. Figure 23 is a configuration diagram of the automated ticket gate 300B, focusing on the control unit 320.

The automatic ticket gate 300B differs from the automatic ticket gate 300 in that it has a wireless reader unit 315 instead of the optical reader unit 311, but otherwise has the same configuration. The wireless reader unit 315 includes a reader/writer 315A and an encoding/decoding unit 315B. The reader/writer 315A communicates with an IC card held over its reader face. The reader/writer 315A has, for example, an antenna, and performs wireless communication with the IC card using a frequency band in the ISM (Industry Science Medical) band such as 13.56 [MHz]. The encoding/decoding unit 315B decodes (decodes) the encoded information (for example, information indicating a ticket ID) read from the IC card by the reader/writer 315A, and outputs it to the entrance/exit processing unit 325. In addition, the encoding/decoding unit 315B may encrypt information instructed by the entrance/exit processing unit 325 and output it to the reader/writer 315A, and the reader/writer 315A may write the information input from the encoding/decoding unit 315B to the IC card.

1...control system, 100...user terminal device, 200...ticket issuing machine, 300...automatic ticket gate, 310...master device, 311...optical system reader unit, 312...upper display unit, 313...front display unit, 314...passing sensor, 317...door unit, 319...face recognition start sensor, 320...control unit, 330...slaves, 331...face recognition camera, 337...door unit, 600...DB server device, 610...communication unit, 630...control unit, 631...data management unit, 632...image processing unit, 633...face recognition processing unit, 634...search unit, 635...payment processing unit, 650...storage unit

Claims (9)

a reading unit that reads information from the medium optically or by wireless communication;
a detection unit that detects a user present at a first position determined based on a relative positional relationship with the reading unit;
a camera that captures an image of a face of a user when the user is detected by the detection unit;
a control unit that, when a user is detected by the detection unit, restricts the reading of information by the reading unit and executes a first control for controlling an equipment based on an image captured by the camera, and, when the reading unit reads information, restricts equipment control using the image captured by the camera and executes a second control for controlling the equipment based on the information read by the reading unit;
A control device comprising: The first position is a position further inward in a direction in which users pass than a second position, which is a predetermined position for a user to hold a medium over the reading unit, or a third position where the reading unit is provided.
The control device according to claim 1 . The control unit causes the reading unit to stop reading information while the first control is being executed,
When an instruction to stop reading information is received from the control unit, the reading unit switches an appearance state compared to a case where the instruction is not received.
3. The control device according to claim 1 or 2. when the second control is executed, the control unit does not execute the first control on the user who is first detected by the detection unit after the second control is executed.
The control device according to claim 3. When the second control is executed, the control unit executes the first control on a second or subsequent user detected by the detection unit after the second control is executed.
The control device according to claim 3 or 4. The control unit is
When the user is detected by the detection unit and a positive result is not obtained in the determination process based on the information read by the reading unit, the first control is executed;
when a user is detected by the detection unit, a positive result is obtained in a determination process based on the information read by the reading unit, and a first user is detected by the detection unit since the positive result was obtained in the determination process based on the information read by the reading unit, the first control is not executed for the first user,
when a user is detected by the detection unit, a positive result is obtained in a determination process based on the information read by the reading unit, and a second or more users are detected by the detection unit from the time when a positive result is obtained in the determination process based on the information read by the reading unit, the first control is executed for the second or more users.
A control device according to any one of claims 3 to 5. The control unit is
If a positive result is obtained in the determination process based on the image captured by the camera, or if a positive result is obtained in the determination process based on the information read by the reading unit, increment a genuine note counter by 1;
When the user passes through a device that restricts passage through the passage, one is subtracted from the genuine bill counter.
If the genuine ticket counter is zero, a device for restricting the passage of the user through the passage is controlled to restrict the passage of the user.
A control device according to any one of claims 1 to 6. A control device including a reading unit that reads information from a medium optically or by wireless communication, a detection unit that detects a user present at a first position determined based on a relative positional relationship with the reading unit, and a camera that captures an image of the face of the user when the user is detected by the detection unit,
when the detection unit detects a user present at a first position, the detection unit restricts reading by the reading unit and executes a first control for controlling a device based on an image captured by the camera;
when the reading unit reads the information, restricting device control using the image captured by the camera, and executing a second control for controlling the device based on the read information.
Control methods. A computer of a control device including a reading unit that reads information from a medium optically or by wireless communication, a detection unit that detects a user present at a first position determined based on a relative positional relationship with the reading unit, and a camera that captures an image of the face of the user when the user is detected by the detection unit,
when a user at a first position is detected, restricting reading of a reading unit that reads information from a medium optically or by wireless communication, and executing a first control for controlling the device based on an image captured by a camera that captures an image of the face of the user at the first position;
when the reading unit reads the information, restricting device control using the image captured by the camera and executing a second control for controlling the device based on the read information;
program.

Images