JP7636286B2 - Identity Verification System - Google Patents

Description

The present invention generally relates to identity verification technology.

In recent years, as the shift to cashless transactions and operational reforms have reduced the workload of counter employees, efforts are being made to improve efficiency by promoting self-service counter operations. In addition, in order to prevent long-standing problems such as money laundering, the flow of funds to terrorist organizations, and fraudulent transactions, new online identity verification methods have been established through legal reform, and there is a demand to improve the efficiency of identity verification using photo identification documents, which was previously carried out at the counter.

As an example of conventional technology that is expected to improve business efficiency, Patent Document 1 discloses an automatic transaction system that uses two-dimensional codes to conduct transactions. The automatic transaction system disclosed in Patent Document 1 is a system that aims to shorten transaction time by simplifying input operations that are repeated every time a transaction is made by using a two-dimensional code generated from data manually entered by the customer.

JP 2005-346129 A

According to the above-mentioned conventional example, it is possible to shorten the transaction time for transactions in which the same amount is transferred monthly. However, this conventional technology has the problem that it can only handle specific fixed-amount transactions and cannot improve the efficiency of counter operations that handle a variety of transactions.

The objective of the present invention is to solve the above problems, that is, to provide an identity verification system that streamlines counter operations that handle a variety of transactions.

In order to solve the above problem, the present invention provides an identity verification system for performing a series of transaction procedures including identity verification , the system comprising: an input information management unit that manages reception information including personal information of a user and transaction information related to a transaction desired by the user by linking the reception information to identification information based on information input by the user, and transmits first code data including the identification information to a mobile terminal operable by the user who input the information; a reception terminal that, as a reception procedure based on the user's visit to a store, reads the first code data from a mobile terminal operable by the user if the user who is a store visitor has completed the information input, and provides second code data including identification information newly assigned to the user, which is code data for connecting to a site where the information input is performed, when the user has not completed the information input, and prompts the user to input the information by reading the second code data by the mobile terminal; an identity verification device that performs identity verification of the visitor who has completed the reception procedure ; a transaction counter terminal capable of executing a predetermined transaction through operation by a counter clerk; and an automated transaction device capable of executing a specific transaction through operation by the visitor . and an identity verification control unit that is communicatively connected to the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction machine, and the input information management unit and controls the identity verification device, wherein the identity verification device reads the first code data from the mobile terminal of the store visitor , reads first confirmation information and second confirmation information from an identity verification document provided by the store visitor, photographs the store visitor to obtain a facial image, determines the authenticity of the identity verification document by analyzing the first confirmation information, and confirms that the owner of the identity verification document is the store visitor by verifying a match between the second confirmation information and the facial image using a facial recognition algorithm, and when identity verification by the identity verification device is successful, the identity verification control unit transfers the reception information corresponding to the first code data read from the mobile terminal of the store visitor and at least a portion of the information used in identity verification by the identity verification device to at least one of the transaction counter terminal or the automated transaction machine, depending on the content of the transaction indicated by the transaction information included in the reception information .

The present invention can improve the efficiency of counter operations that handle a variety of transactions.

1 is a diagram illustrating an example of a connection configuration of an identity verification system according to an embodiment of the present invention. 2 is a diagram showing an example of the internal configuration of a personal identification device 200. FIG. 10 is a flowchart showing an example of a processing procedure of an overall process in the present embodiment. 13 is a flowchart showing a detailed example of a procedure of a reception process. 13 is a flowchart showing a detailed example of a processing procedure of information input processing. 13 is a flowchart showing a detailed example of a procedure for identity verification processing; 13 is a flowchart showing a detailed example of a processing procedure of a transaction process. FIG. 13 is a diagram showing a screen display example (part 1) of a mobile terminal 180. FIG. 13 is a diagram showing a second example of a screen display of the mobile terminal 180. FIG. 13 is a diagram showing a screen display example (part 3) of the mobile terminal 180. FIG. 13 is a diagram showing a screen display example (part 4) of the mobile terminal 180. 4A and 4B are diagrams illustrating examples of screen displays on a reception terminal 110. FIG. 13 is a diagram showing a screen display example (part 1) of the personal identification device 200. FIG. 13 is a diagram showing a second example of a screen display of the personal identification device 200.

In the following description, an "interface apparatus" may refer to one or more interface devices. The one or more interface devices may be at least one of the following:
One or more I/O (Input/Output) interface devices. The I/O interface devices are interface devices to at least one of the I/O devices and a remote display computer. The I/O interface device to the display computer may be a communications interface device. The at least one I/O device is a user interface device, and may be, for example, any of input devices such as a keyboard and a pointing device, and output devices such as a display device.
One or more communication interface devices. The one or more communication interface devices may be one or more homogeneous communication interface devices (e.g., one or more NICs (Network Interface Cards)) or two or more heterogeneous communication interface devices (e.g., a NIC and an HBA (Host Bus Adapter)).

In the following description, "memory" is an example of one or more storage devices, and is one or more memory devices. The memory may be a volatile memory device or a non-volatile memory device, and is typically a primary memory device.

In the following description, a "persistent storage device" is an example of one or more storage devices, and refers to one or more persistent storage devices. A persistent storage device is typically a non-volatile storage device (e.g., an auxiliary storage device), and specifically, for example, a hard disk drive (HDD), a solid state drive (SSD), a non-volatile memory express (NVME) drive, or a storage class memory (SCM).

In the following description, the "storage device" may be at least one of the above-mentioned memories or persistent storage devices.

In the following description, a "processor" may refer to one or more processor devices. The at least one processor device may typically be a microprocessor device such as a CPU (Central Processing Unit), but may also be other types of processor devices such as a GPU (Graphics Processing Unit). The at least one processor device may be a single-core or multi-core. The at least one processor device may be a processor core. The at least one processor device may also be a broader processor device such as a circuit that is a collection of gate arrays written in a hardware description language that performs some or all of the processing (e.g., an FPGA (Field-Programmable Gate Array), a CPLD (Complex Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit)).

The following describes in detail the embodiment of the present invention with reference to the drawings.

An example of an outline of an embodiment is as follows. That is, the identity verification system is an identity verification system that performs a series of transaction procedures including identity verification, and includes a reception terminal that receives a user who wishes to make a transaction, an identity verification device that performs identity verification of the user that is received at the reception terminal, that the user is the subject of the transaction based on at least determining the authenticity of the identity verification document and authenticating that the owner of the document is the user, a transaction counter terminal that can execute the transaction through operation by a counter clerk, an automated transaction machine that can execute the transaction through operation by the user, and an identification information generating device that uniquely identifies the user or the transaction desired by the user. and an identification information generating unit that transmits the identification information to a mobile terminal that can be operated by a user, and an identification information generating unit that is communicatively connected to the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction machine, and the identification information generating unit and controls the identity verification device, wherein the identity verification device executes the identity verification of the user accepted by the reception terminal using the identification information read from the mobile terminal or input by the user, and when identity verification is successful at the identity verification device, the identity verification control unit notifies the user whether the transaction can be executed at the transaction counter terminal or the automated transaction machine. In addition, in the identity verification system, the identification information may be a unique identification number, as well as a two-dimensional code indicating information including the identification number. In addition, in the identity verification system, the identity verification control unit may deliver information required for identity verification, together with the result of identity verification at the identity verification device, to a configuration other than the identity verification device in the identity verification system. In the personal identification system, the personal identification device may include an object photographing unit that photographs the personal identification document and the mobile terminal as objects, a face photographing unit that photographs the face of the user, and a control unit that compares the image of the document photographed by the object photographing unit with the identification information acquired from the image of the mobile terminal photographed by the object photographing unit to perform a determination of authenticity of the personal identification document, and compares the image of the document with the face photographed by the face photographing unit to authenticate that the owner of the document is the user. In the personal identification system, the personal identification device may further include a display operation unit that allows the user to perform an operation for personal identification. In the personal identification system, the personal identification device may perform biometric authentication by authenticating multiple patterns of the face images photographed by the face photographing unit using a biometric authentication algorithm, in addition to determining the authenticity of the personal identification document and authenticating that the owner of the document is the user. In the identity verification system, the mobile terminal may be a mobile terminal owned by the user or a mobile terminal provided at the counter, and may be a smartphone, a tablet terminal, or a mobile phone. In the identity verification system, the identity verification control unit may be built into the identity verification device. In the identity verification system, the identity verification device may be built into the automated transaction device. According to the identity verification system configured as above, by using a two-dimensional code or an identification number that can identify the customer, identity verification results can be handed over between devices, making it possible to make most of the counter operations self-service, thereby improving the efficiency of counter operations that handle various transactions.

Figure 1 shows an example of the connection configuration of an identity verification system according to one embodiment of the present invention.

In FIG. 1, a store 100 is provided with a reception terminal 110, a transaction counter terminal 120, an automated transaction machine 130, a router 140, an identity verification control unit 190, and an identity verification device 200. Each of the reception terminal 110, the transaction counter terminal 120, the automated transaction machine 130, the identity verification control unit 190, and the identity verification device 200 is realized, for example, by a device having an interface device, a storage device, and a processor connected thereto. In addition, at least one of the reception terminal 110, the transaction counter terminal 120, the automated transaction machine 130, the identity verification control unit 190, and the identity verification device 200 may be configured to have an input device that receives input from a customer and a display device that outputs information, or the input device and the display device may be integrated. In addition, the input device and the display device may be user interface devices.

The identity verification device 200 and the reception terminal 110 are installed in a store 100 (e.g., a head office or branch office of a financial institution) and are controlled by an identity verification control unit 190. The identity verification control unit 190 is connected to a server 160 via a router 140 connected by a wired LAN (Local Area Network) or WiFi (registered trademark) of an in-house network. The transaction counter terminal 120 and the automated transaction device 130 are also installed in the store 100 and connected to the server 160 via a router 140 connected by a wired LAN of an in-house network.

When a customer (principal) makes a reservation and inputs information in advance, the customer connects the customer's mobile terminal 180 to the server 160 using the network 170 (e.g., WiFi or a mobile phone network) and inputs the transaction details, personal information permission, and personal information to the server 160 via the mobile terminal 180, thereby reserving the transaction date and time at the store 100 to the server 160 via the mobile terminal 180. After the reservation is completed, the server 160 generates a personal identification number (No.) that identifies the person who made the reservation and a two-dimensional code that encodes the personal identification number, and sends an email containing the generated personal identification number and two-dimensional code to the email address included in the personal information input by the customer. In this way, the server 160 registers the transaction details, personal information permission, and personal information, and registers reservation information (including, for example, information indicating the reservation of the transaction date and time), and the information is managed by the server 160, for example, linked to the generated personal identification number. The "identification number (No.)" referred to in this paragraph may be an identification number that identifies the customer himself or herself, or an identification number that identifies a reservation made by the customer. In either case, it is sufficient that at least the customer (the person himself) can be identified from the identification number. "Personal information" includes, for example, an email address, but may include other types of information (e.g., name, address, date of birth) instead of or in addition to an email address. In this example, the identification number and the two-dimensional code encoding the identification number are notified to the customer by email, but other notification methods (e.g., notification by email following SMS (Short Message Service)) may be adopted instead of or in addition to email.

After entering the store, if the customer has made an advance reservation, the customer displays the two-dimensional code written in the email on the screen of the mobile terminal 180 and has the two-dimensional code read by the barcode reader of the reception terminal 110. If the customer has not made an advance reservation, the customer moves to the reception terminal 110 installed in the store 100 and has the barcode reader (e.g., an app for reading two-dimensional codes) of the customer's mobile terminal 180 read the two-dimensional code displayed on the reception terminal 110. If the customer does not use his or her own mobile terminal 180, the customer borrows a mobile terminal 180 from the store 100 and performs the above process using the borrowed mobile terminal 180.

If there is an advance reservation, based on the reading of the two-dimensional code by the reception terminal 110, the predetermined reception information that triggers the start of identity verification for the transaction reserved in advance is transferred from the reception terminal 110 that read the two-dimensional code to the server 160 and the transaction window terminal 120 via the identity verification control unit 190. If there is no advance reservation, the mobile terminal 180 is connected to the identity verification control unit 190 using either WiFi, USB (Universal Serial Bus), or Bluetooth (registered trademark), and the transaction details, personal information permission, and personal information are input to the access destination according to the URL (Uniform Resource Locator) represented by the two-dimensional code read by the mobile terminal 180, and the reception information including the information is transferred to the server 160. If the access destination is the server 160, the transaction details, personal information permission, and personal information are input from the mobile terminal 180 to the server 160. The "reception information" referred to in this paragraph may include, for example, personal identification information (number), transaction details, personal information permission, and personal information, and at least some of this information may be information read from the two-dimensional code.

When the transaction details, personal information permission, and personal information are input to the server 160, if identity verification is required from the server 160, the server 160 transmits to the mobile terminal 180 a call guide for the customer (e.g., a call and guide informing the customer that identity verification is required), along with a two-dimensional code that identifies the customer (e.g., a two-dimensional code containing information including the identity number obtained based on the reception information) and the identity number (e.g., the identity number obtained based on the reception information). The customer has the identity verification device 200 read the two-dimensional code displayed on the mobile terminal 180, and performs a self-operation on the identity verification device 200 by the customer. In response to the operation, the identity verification device 200 captures an image of the identity verification document (e.g., the front and back of the document) and the customer's face. In this way, an image that is part of the information required for identity verification, such as an image of the identity verification document (e.g., the front and back of the document) or an image of the customer's face, is obtained. If the identity verification device 200 is unable to read the two-dimensional code, it will accept manual input of the identity number displayed on the mobile terminal 180 from the customer.

When the identity verification device 200 completes the acquisition of information necessary for identity verification (e.g., including identity verification documents and photographed images of the face), it transfers the information to the mobile terminal 180. The mobile terminal 180 displays the information received, allowing the individual to verify the information acquired by the identity verification device 200 (information necessary for identity verification). If the individual verifies the information and finds no problems, the individual notifies the identity verification device 200 of completion via (or not via) the mobile terminal 180. When the identity verification device 200 receives the completion notification, it transfers the fact that the verification has been completed and the information necessary for identity verification (information that the individual has confirmed to be satisfactory (e.g., including photographed images)) to the transaction counter terminal 120. The counter clerk then makes a comprehensive judgment based on the information received and displayed by the transaction counter terminal 120 (e.g., the fact that the verification has been completed and the information necessary for identity verification). If the result of the overall assessment is normal (for example, if the transaction counter terminal 120 receives input from the counter clerk indicating that the result of the overall assessment is "normal"), the transaction counter terminal 120 transmits to the mobile terminal 180 a two-dimensional code that identifies the customer and a personal identification number, along with a call guide to call the person to the transaction counter terminal 120 or the automated transaction device 130. For example, the information required for identity verification may include the personal identification number, transaction details, personal information permission, and at least a portion of the personal information, and therefore may include, for example, an email address. In this case, the transaction counter terminal 120 may send an email to the email address containing the call guide, the two-dimensional code, and the personal identification number.

When a transaction is required at the counter, the customer performs the transaction via the transaction counter terminal 120 operated by the counter clerk. Also, when a transaction can be performed using the automated transaction device 130, the customer can have the automated transaction device 130 read the two-dimensional code displayed on the mobile terminal 180 and perform the transaction by self-operation. If the automated transaction device 130 cannot read the two-dimensional code, the customer manually enters the customer identification number displayed on the mobile terminal 180 into the automated transaction device 130.

After completing the transaction, the customer leaves store 100. If the customer borrowed a mobile terminal 180 from store 100, the customer returns the mobile terminal 180 and confirms that the personal information has been completely deleted.

Figure 2 is a diagram showing an example of the internal configuration of the identity verification device 200. The identity verification device 200 has operation and display functions, and is a device that a user (typically a customer) operates to verify the identity of the user. As shown in Figure 2, the identity verification device 200 includes a control unit 201, an IO control unit 202, a power supply unit 203, a display operation unit 210, an operator display operation unit 211, a front photographing unit 212, a back photographing unit 213, a face photographing unit 214, a front illumination unit 215, a back illumination unit 216, a non-contact IC reading unit 217, an audio output unit 218, and an audio input unit 219.

The control unit 201 has a wired connection terminal such as USB or HDMI (High-Definition Multimedia Interface) (registered trademark) and a wireless connection terminal such as Bluetooth, and is connected to the identity verification control unit 190 via USB or Bluetooth. The display operation unit 210 is connected to the control unit 201 and includes a display unit that displays guidance and an operation unit that has a touch panel function for operation. The display operation unit 210 allows the user (the customer himself) to perform touch operations on the operation unit by instructions such as the display of a guidance screen on the operation unit and voice output from the voice output unit 218. The display operation unit 210 can ensure security by making it difficult for anyone other than the operator to see by installing a privacy film. In addition, if the display operation unit 210 is an air touch operation display, in addition to the displayed guidance screen, operation buttons are displayed in the air, making it possible to operate cleanly without directly touching the screen. In addition, operation can be performed through voice recognition by inputting voice related to the operation into the microphone of the voice input unit 219, in which case operation can be performed cleanly without directly touching the screen, etc.

In the identity verification device 200 shown in FIG. 2, the authenticity determination process of the identity verification document described later is performed, for example, as follows. That is, a guide (see FIG. 13) is displayed on the display unit (e.g., screen) of the display operation unit 210. The customer follows the guide and places the identity verification document with the front side facing the photographing unit. The identity verification document is assumed to be, for example, a driver's license, and may be a document with a photograph of the person. The front photographing unit 212 connected to the control unit 201 photographs the front side of the identity verification document with the illumination of the front illumination unit 215 controlled by the IO control unit 202 capable of irradiating multiple light sources, and the illumination of the transmission light source of the back illumination unit 216 controlled by the IO control unit 202 capable of irradiating multiple light sources. The front illumination unit 215 and the back illumination unit 216 can each be equipped with a light source of visible light and special light (e.g., ultraviolet light for emitting special paint, or transmitted light for photographing a see-through image) as multiple light sources. In photographing the front side of the identification document, the front photographing unit 212 photographs a plurality of types of images using the above-mentioned visible light and special light, and in authenticity determination, these plurality of types of photographed images are compared with each other, so that highly accurate authenticity determination can be performed. For example, in photographing the front side of the identification document, the front photographing unit 212 may photograph a photographed image of the watermark using a light source for transmission of the back illumination unit 216, and in authenticity determination, the photographed image of the watermark may be analyzed to perform highly accurate authenticity determination. In photographing the back side, the back photographing unit 213 connected to the control unit 201 can photograph the identification document with the illumination of the back illumination unit 216 capable of irradiating a plurality of light sources, without the customer having to turn the identification document over, while the identification document is placed. By photographing the identification document as described above, the front photographing unit 212 and the back photographing unit 213 can photograph both sides of the identification document without the customer having to turn the identification document over at a predetermined placement location in the identification device 200. In addition to the light source for photographing, the backside illumination unit 216 is equipped with an ultraviolet light source (UV-C) for the purpose of sterilization, and can sterilize the upper surface of the front side photographing unit 212 while performing the identity verification process. The contactless IC information mounted on the identity verification document can also be read by the contactless IC reading unit 217 controlled by the IO control unit 202 while the identity verification document is placed in the front side photographing state. In addition, to read the contactless IC information, it may be necessary to input a personal identification number depending on the identity verification document, but the personal identification number can be input using a software key displayed on the display operation unit 210. As described above, the control unit 201 can obtain information necessary for authenticating and judging the identity verification document (information necessary for identity verification (including, for example, the photographed image)) by using the images of the front and back sides of the identity verification document and the character information and contactless IC information recognized from these images.

In addition to determining the authenticity of the identification document, the identity verification process also uses face recognition technology to verify that the customer is the actual owner of the identification document. For face recognition, the image of the document captured during the authenticity verification of the identification document and the image captured by the face capture unit 214 connected to the control unit 201 are authenticated using a face recognition algorithm installed in the identity verification control unit 190 (or identity verification device 200), thereby verifying that the customer is the actual owner of the identification document.

Furthermore, in this embodiment, biometric authentication may be performed in the identity verification process. For biometric authentication, for example, multiple patterns of face images are captured by the face capture unit 214, and authentication is performed using a biometric authentication algorithm installed in the identity verification control unit 190 (or identity verification device 200), thereby preventing impersonation.

The identity verification device 200 may be equipped with a direct touch operation display or an air touch operation display. When the identity verification device 200 is equipped with an air touch operation display, operation buttons are projected into the air using holography technology, making it possible to operate without touching the screen. The identity verification device 200 starts the identity verification process by having the user (customer) direct the screen of the mobile terminal 180 to the front photographing unit 212 or the back photographing unit 213 to read the two-dimensional code according to instructions such as the guide screen displayed on the display operation unit 210 and the voice output from the voice output unit 218. When reading an identity verification document, the front side is placed downward and an image is taken. In addition, according to instructions such as the guide screen displayed on the display operation unit 210 and the voice output from the voice output unit 218, an image of the user's face is taken with the face photographing unit 214, to confirm that the owner is the owner and that the user has not been impersonated. In addition, the identity verification device 200 may be equipped with an operator display operation unit 211 on the back, and the operator can check the captured image and received information.

In addition, in the overall system (identification system) including the identity verification device according to this embodiment, the connection form of each component is not limited to the examples shown in Figures 1 and 2, and various connection configurations can be adopted, as listed below. The respective connection configurations listed below can be combined as appropriate.

For example, in the overall system according to this embodiment, the reception terminal 110 and the router 140 may be connected so as to be able to communicate directly with each other.

In addition, the overall system according to this embodiment is not limited to the function corresponding to the identity verification control unit 190 being implemented in an independent device as shown in FIG. 1, but may be configured, for example, so that the function corresponding to the identity verification control unit 190 is built into the identity verification device 200.

When the function corresponding to the identity verification control unit 190 is built into the identity verification device 200, for example, the identity verification device 200 and the router 140 may be connected so as to be able to directly communicate with each other. In this case, the connection between the identity verification device 200 and the router 140 may be made using any of a wired LAN, WiFi, USB, Bluetooth, etc.

In addition, the overall system according to this embodiment is not limited to the personal identification device 200 being implemented as an independent device, and may be configured such that the functionality equivalent to the personal identification device 200 is built into the automated transaction device 130.

When the function equivalent to the identity verification device 200 is built into the automated transaction device 130, for example, the mobile terminal 180 and the automated transaction device 130 may be connected so as to be able to directly communicate with each other. In this case, the connection between the mobile terminal 180 and the automated transaction device 130 may be made using any of a wired LAN, WiFi, USB, Bluetooth, etc.

Figure 3 is a flowchart showing an example of a processing procedure for a series of processes for performing a specified transaction based on customer identity verification, as an example of the overall processing procedure in this embodiment. This is a flowchart for explaining the details of some of the processes shown in Figures 4 to 7 and Figure 3. Figures 8 to 11 are diagrams showing screen display examples (No. 1 to No. 4) of the mobile terminal 180. The individual contents will be described later, but the mobile terminal 180 that displays the screen display examples of Figures 8 to 11 may be any of a smartphone, tablet terminal, and mobile phone. Figure 12 is a diagram showing an example of a screen display of the reception terminal 110. Figures 13 to 14 are diagrams showing examples of screen display of the identity verification device 200. A series of processes for performing a specified transaction will be explained using this flow diagram and screen display examples.

As shown in FIG. 3, first, a customer enters the store 100 (S101), and reception processing is mainly performed by the reception terminal 110 (S102).

FIG. 4 is a flowchart showing a detailed example of the procedure of the reception process. According to FIG. 4, the process branches depending on whether the reception terminal 110 is installed in the store 100 (S201). If the store 100 does not have the reception terminal 110 (NO in S201), the store 100 lends the mobile terminal 180 with a unique reception number to the customer (S202), and the reception process ends. On the other hand, if the store 100 has the reception terminal 110, the process branches depending on whether information has been input and a reservation has been made in advance in the server 160 (S203). As a specific process in S203, for example, the reception terminal 110 displays a message asking the customer whether information has been input and a reservation has been made in advance, and a judgment is made depending on the content of the customer's response to the display. If information has not been input and a reservation has not been made in advance (NO in S203), the reception terminal 110 displays a two-dimensional code (a two-dimensional code including a personal identification number (No.) assigned to the customer) as shown in FIG. 12 (S204). FIG. 12 is a diagram showing an example of a screen display on the reception terminal 110. FIG. 12 shows an example of a screen display displayed on the display operation unit 111 (e.g., a touch operation display) of the reception terminal 110 when a personal identification number is issued, and a two-dimensional code including information including the personal identification number assigned to the customer is displayed and the reading of the code is instructed. In response to the display of S204, the customer operates the mobile terminal 180 to read the two-dimensional code displayed on the reception terminal 110 (S205), and the reception process is terminated. Also, if information input and reservation have been made in advance in S203 (YES in S203), the customer operates the mobile terminal 180 to display on the mobile terminal 180 the two-dimensional code (see FIG. 8) received at the time of advance information input and reservation (S206). FIG. 8 is a diagram showing an example of a screen display (part 1) of the mobile terminal 180. FIG. 8 shows an example of the screen display of the mobile terminal 180 when the advance information input and reservation are completed, in which the two-dimensional code received at the time of reservation is displayed, and an instruction is given to have the reception terminal read the two-dimensional code when reception begins. After S206, when the barcode reader of the reception terminal 110 reads the two-dimensional code (S207), the reception process ends.

As shown in FIG. 3, after the reception process (S102), an information input process is performed between the mobile terminal 180 and the server 160 (S103). The information input process is a process that is mainly executed by the reception terminal 110 and the mobile terminal 180.

Figure 5 is a flowchart showing an example of a detailed processing procedure for the information input process. According to Figure 5, first, it is confirmed whether or not information has been input in advance (pre-input) and whether or not a reservation has been made (S301).

If there is no advance information input or reservation in S301 (NO in S301), the customer inputs information such as transaction details (see FIG. 9), personal information permission, and personal information to the access destination according to the URL indicated by the two-dimensional code read by the mobile terminal 180 lent at the reception desk or the mobile terminal 180 brought by the customer (S302). FIG. 9 is a diagram showing an example of a screen display of the mobile terminal 180 (part 2). FIG. 9 shows an example of a screen display of the mobile terminal 180 when the two-dimensional code is read and connected to the access destination when there is no advance reservation, and the customer is requested to select the purpose of the visit (transaction details). After the information is input in S302, it is confirmed whether or not there is a server 160 other than the access destination (S303). If there is a server 160 other than the access destination (YES in S303), the information input in S302 is transferred to the server 160 (S304), and the information input process ends. If there is no server 160 other than the access destination (for example, the access destination is server 160) (NO in S303), the information input process ends.

Also, if advance information input and reservation have been made in S301 (YES in S301), the information has already been transferred to the server 160, so there is no need to perform additional information input, and the information input process ends.

As shown in FIG. 3, after the information input process (S103), the identity verification process is performed (S104). The identity verification process is a process that is executed mainly by the identity verification device 200.

FIG. 6 is a flowchart showing an example of a detailed processing procedure of the identity verification process. According to FIG. 6, first, whether identity verification is required is confirmed (S401). If identity verification is not required (NO in S401), the identity verification device 200 (control unit 201) transfers a confirmation completion notice and information (e.g., reception information) to the transaction window terminal 120 (S410). If identity verification is required (YES in S401), the device waits for a call (S402) and periodically determines whether a call will be made (S403). If a call is made after waiting (YES in S403), the customer displays a two-dimensional code and an identity identification number on the mobile terminal 180 (see FIG. 10) (S404). FIG. 10 is a diagram showing an example (part 3) of a screen display on the mobile terminal 180. FIG. 10 shows an example of a screen display during identity verification, instructing the reception terminal 110 (which may be read as identity verification device 200) to input the information required for identity verification (reading a two-dimensional code or entering a personal identification number (No.)). When the customer reads the two-dimensional code or manually enters the personal identification number as displayed in S404, the identity verification device 200 starts identity verification (S405).

When identity verification begins, the customer places the identity verification document to be used for certification on the identity verification device 200 in accordance with the screen of the identity verification device 200 (see FIG. 13). FIG. 13 is a diagram showing an example of a screen display (part 1) of the identity verification device 200. When identity verification begins, the display operation unit 210 of the identity verification device 200 displays a guide display as shown in FIG. 13, thereby urging the customer to perform an operation to place the identity verification document in a predetermined place on the identity verification device 200. When the identity verification document is placed in a predetermined place on the identity verification device 200, the identity verification device 200 acquires information from an integrated circuit (IC) of the identity verification document (e.g., a passport or a driver's license), reads images of the front and back of the identity verification document, and takes a photograph of the face of the customer, determines the authenticity, and acquires auxiliary information for authenticity, information indicating that the owner is the person in question, and information that can confirm that the person has not been impersonated (S406). Here, if the mobile terminal 180 is a loaned mobile terminal, information entered into the mobile terminal 180 (e.g., a manually entered personal identification number) is transferred to the personal identification device 200 (S407). In S407, the personal identification device 200 may display the acquired information each time a predetermined type of information is acquired (e.g., when the front and back images of the personal identification document are read), to have the customer (the person) check the accuracy and visibility of the information (see FIG. 14), and proceed to the next process of S408 if the customer answers "OK". FIG. 14 is a diagram showing a screen display example (part 2) of the personal identification device 200. At the start of personal identification, the display operation unit 210 of the personal identification device 200 displays a guide display as shown in FIG. 14, thereby displaying the contents of the transaction desired by the customer, an image of the personal identification document, etc., and the customer checks these displayed contents, and if there is no problem, touches "Next" to proceed to the process of S408. The screen display as shown in FIG. 14 may also be displayed on the operator display operation unit 211 of the personal identification device 200.

After the processes of S405 to S407, when the personal identification device 200 has acquired all the information necessary for personal identification, the personal identification device 200 transfers the information (for example, at least part of the information read from the IC of the personal identification document, the front and back images of the personal identification document, the photographed face image of the person, the information indicating the authenticity judgment result, the auxiliary information of authenticity, the information indicating the owner is the person himself, and the information that can confirm that the person has not been impersonated) to the mobile terminal 180 (S408). Next, the customer himself confirms the information received by the mobile terminal 180 (S409). The confirmation result (judgment result) in S409 is notified to the personal identification device 200 (control unit 201) by the customer inputting the corresponding judgment result into the mobile terminal 180. If it is judged that there is a problem in S409 (NG in S409), the personal identification device 200 returns to S404 and repeats the process. On the other hand, if it is determined in S409 that there is no problem (OK in S409), the mobile terminal 180 notifies the identity verification device 200 of completion, and the completion of the verification and the information necessary for the identity verification (including, for example, an image) are transferred from the mobile terminal 180 or the identity verification device 200 to the transaction counter terminal 120 (S410). At this time, the completion of the identity verification and the information necessary for the identity verification may also be transferred to a device other than the transaction counter terminal 120 (for example, the automated transaction device 130 or the server 160). Then, based on the information and image received by the transaction counter terminal 120, the counter clerk makes a comprehensive judgment to determine the final judgment result in the identity verification process (S411), and the identity verification process ends.

As shown in FIG. 3, after the identity verification process (S104) is completed, the transaction process is performed (S105). The transaction process is carried out by the mobile terminal 180, identity verification device 200, transaction counter terminal 120, automated transaction device 130, etc., executing corresponding processes in response to various operations by the customer.

FIG. 7 is a flowchart showing a detailed example of the processing procedure of the transaction process. According to FIG. 7, first, the customer waits until he is called (S501). If the result of the above-mentioned overall judgment by the teller (S411 in FIG. 6) is normal, a call guide is given to the customer (YES in S502), and the two-dimensional code and the personal identification number (No.) are displayed on the mobile terminal 180 (see FIG. 11) (S503). FIG. 11 is a diagram showing an example of a screen display of the mobile terminal 180 (part 4). FIG. 11 shows an example of a call guide for a customer when a transaction is possible at the automated transaction device 130. The call guide display may inform the customer of whether the transaction is possible at the automated transaction device 130 or at the counter where the transaction counter terminal 120 is installed. Also, if it is determined that the transaction is not possible, a call guide may be given to the customer to come to the counter. That is, depending on the content of the call guide display in S503, the progress of the subsequent transaction branches as shown in S3804 and S3805. In addition, the branch destination of S3804 and S3805 is determined by the identity verification control unit 190, but the control unit 201 of the identity verification device 200 may act on its behalf. Specifically, a branch is made in S504 as to whether the transaction is possible or not, and if the transaction is impossible (NO in S504), the person at the counter explains the reason why the transaction is impossible at the transaction counter (S505), and the transaction process is terminated. If the transaction is possible (YES in S504), a branch is made in S506 as to whether the transaction is to be performed at the counter (transaction counter terminal 120) or the automated transaction device 130. If the transaction counter terminal 120 is used in the transaction ("Counter" in S506), the transaction is executed through the operation of the transaction counter terminal 120 by the person at the counter (S507). If the automated transaction machine 130 is used in the transaction ("automated transaction machine" in S506), the automated transaction machine 130 reads the two-dimensional code displayed on the mobile terminal 180 (or receives the manual input of the personal identification number (No.)) (S508), and the transaction is executed using the automated transaction machine 130 (S509). After the transaction is completed in S507 or S509, the customer leaves the store, but before leaving, it is confirmed whether the customer borrowed the mobile terminal 180 at the store 100 (S510). If the customer borrowed the mobile terminal 180 (YES in S510), the customer returns the mobile terminal 180 (S511), and after confirming that the personal information has been completely deleted from the mobile terminal 180 (S512), the customer leaves the store (S106 in FIG. 3). On the other hand, if the customer has not borrowed the mobile terminal 180 (NO in S510), the customer leaves the store (S106 in FIG. 3).

According to the above-described embodiment, the identity verification system of the present invention can be summarized as follows.

A part (e.g., most) of store operations (typically counter operations) will be replaced by self-operation performed by customers themselves and information exchange using two-dimensional codes, replacing the traditional work performed by store staff, resulting in a reduction in store operations and increased efficiency. That is, in addition to identity verification using identification documents, such as obtaining information from a contactless IC, determining authenticity using an image of the document's face, and having customers verify their identity using facial recognition technology using an image of their appearance, by handing over processing including transactions within each store using a two-dimensional code or specific number displayed on a mobile device, it is possible to increase the efficiency of counter operations that handle a variety of transactions.

For example, when there is a reception terminal 110 and an advance reservation has been made, the customer has registered in advance in the server 160 the transaction details, personal information permission, and at least a portion of the personal information. The customer's personal identification number (number) and a two-dimensional code containing information representing that number are sent from the server 160 to the customer's mobile terminal 180. The reception terminal 110 reads the two-dimensional code displayed on the mobile terminal 180 (or accepts manual input of the number from the customer). As a result, the store recognizes the visit of the customer identified from the number, and then performs process X. Process X includes, for example, the following:
The mobile terminal 180 displays the two-dimensional code and the customer identification number (No.). Specifically, for example, the customer waits for a call for identity verification as necessary, and is called through the customer's mobile terminal 180 (or by other means such as an in-store announcement). In response to the call, the mobile terminal 180 displays the two-dimensional code and the number.
The identity verification device 200 reads the two-dimensional code displayed on the mobile terminal 180 (or accepts the customer's manual input of the identity number (No.)) and acquires a photographed image (obtaining a photographed image by photographing at least one of the identity verification document and the customer's face). The identity verification device 200 may also acquire IC information (read information from the IC of the identity verification document).
- Information necessary for identity verification is transferred to the transaction counter terminal 120. "Information necessary for identity verification" may include an identity identification number (No.), acquired information, and reception information. "Acquired information" is information including, for example, the identity verification document or the photographed image of the customer's face itself, and information obtained by converting the photographed image of the identity verification document into text using the OCR (Optical Character Recognition/Reader) function of the identity verification device 200 or the identity verification control unit 190. "Reception information" is information including, for example, transaction details, personal information permission, and at least a portion of the personal information already registered in the server 160.
The information required for identity verification is displayed on the transaction counter terminal 120, and the counter clerk makes a comprehensive judgment (for example, whether the acquired information matches the received information).

After identity verification is complete, the identity verification control unit 190 not only notifies the user that identity verification has been completed, but also passes on the information necessary for identity verification (e.g., facial authentication information) to other devices in the identity verification system, thereby making it possible to confirm that the person who has come to the receiving device (e.g., the automated transaction device 130) is the person in question, and thus preventing impersonation. Furthermore, in places where multiple transactions and procedures are carried out, such as government offices, once identity verification is completed, the results and the information necessary for identity verification can be shared, allowing for so-called "horizontal cooperation." This means that the customer's desired transaction or procedure can be provided without having to re-confirm identity verification for each transaction or procedure, which is expected to reduce the burden on the customer and the counter.

Also, for example, when there is a reception terminal 110 and no prior reservation, the personal identification number (number) represented by the two-dimensional code displayed on the reception terminal 110 and read by the mobile terminal 180 (or the number displayed on the reception terminal 110 and manually entered into the mobile terminal 180) is sent to the server 160, and the transaction details, personal information permission, and at least a portion of the personal information are entered into the server 160 via the mobile terminal 180, and as a result, the number is linked to the reception information (transaction details, personal information permission, and at least a portion of the personal information) and registered in the server 160. Then, the above-mentioned process X is performed.

For example, if there is no reception terminal 110, the store 100 lends the mobile terminal 180 to the customer. In this case, the number assigned to the mobile terminal 180 corresponds to the number that identifies the customer. This mobile terminal 180 accepts input of transaction details, personal information permission, and personal information from the customer, and transmits reception information including these and the number of this mobile terminal 180 to the server 160. As a result, the number is linked to the reception information and registered in the server 160. Then, the above-mentioned process X is performed. After process X, the personal information, etc. input to this mobile terminal 180 is erased when the customer leaves the store.

Although one embodiment of the present invention has been described above, this is merely an example for the purpose of explaining the present invention, and is not intended to limit the scope of the present invention to only this embodiment. The present invention can also be implemented in various other forms. For example, USB, Bluetooth, and Wi-Fi are each examples of communication methods, and other types of communication methods may be used in place of at least one of these.

REFERENCE SIGNS LIST 100 Store 110 Reception terminal 120 Transaction window terminal 130 Automatic transaction device 140 Router 160 Server 170 Network 180 Mobile terminal 190 Personal identification control unit 200 Personal identification device

Claims (8)

An identity verification system for carrying out a series of transaction procedures including identity verification,
an input information management unit that manages reception information including personal information of the user and transaction information related to a transaction desired by the user by linking the reception information to identification information based on information input by the user, and transmits first code data including the identification information to a mobile terminal operable by the user who input the information;
a reception terminal which, as a reception procedure based on the user's visit to a store, reads the first code data from a mobile terminal which the user can operate if the user has already input the information, and, if the user has not yet input the information, provides second code data which is code data for connecting to a site where the information is input and includes newly assigned identification information corresponding to the user, and prompts the user to input the information by reading the second code data with the mobile terminal;
an identity verification device for verifying the identity of the customer who has completed the reception procedure ;
a transaction counter terminal capable of executing a predetermined transaction through operation by a teller;
an automated transaction device capable of executing a specific transaction by operation of the customer ;
an identity verification control unit that is communicably connected to the reception terminal, the identity verification device, the transaction counter terminal, the automated transaction device, and the input information management unit and controls the identity verification device;
Equipped with
The identity verification device includes:
reading the first code data from the mobile terminal of the customer , reading first confirmation information and second confirmation information from an identity verification document provided by the customer, photographing the customer to obtain a facial image;
determining the authenticity of the identification document by analyzing the first verification information, and verifying that the owner of the identification document is the customer by verifying that the second verification information matches the facial image using a facial recognition algorithm;
The identity verification control unit, when identity verification by the identity verification device is successful, transfers the reception information corresponding to the first code data read from the customer's mobile terminal and at least a portion of the information used in identity verification by the identity verification device to at least one of the transaction counter terminal or the automated transaction device, depending on the content of the transaction indicated by the transaction information included in the reception information . 2. The personal identification system according to claim 1, wherein the identification information can be a unique identification number or a two-dimensional code showing information including the identification number. The personal identification system according to claim 1, characterized in that the personal identification control unit transfers the result of the personal identification in the personal identification device, together with information required for the personal identification, to a component within the personal identification system other than the personal identification device. The personal identification system according to claim 1 , wherein the personal identification device further comprises a display operation unit that enables the user to perform operations for personal identification. The identity verification system according to claim 1, characterized in that the identity verification device performs biometric authentication by authenticating multiple patterns of the facial images of the customer using a biometric authentication algorithm, in addition to determining the authenticity of the identity verification document and confirming that the owner of the document is the customer. 2. The identity verification system according to claim 1, wherein the mobile terminal is a mobile terminal owned by the user or a mobile terminal loaned to the user at a counter, and is a smartphone, a tablet terminal, or a mobile phone. The personal identification system according to claim 1 , wherein the personal identification control unit is built into the personal identification device. 2. The personal identification system according to claim 1, wherein the personal identification device is built into the automated transaction device.

Images