JP7613079B2 - Authenticity determination device and program - Google Patents

Description

The present invention relates to an authenticity determination device and a program therefor.

When opening an account at a financial institution, identification such as a driver's license is required to verify the individual's identity, but there has been an increase in cases where ID cards are forged to open accounts under the guise of a different person for criminal purposes such as special fraud.

At a typical financial institution, the user visits the institution and submits their ID card, and the financial institution then uses the submitted ID card to verify the user's identity in person. In this case, the ID card can be carefully observed, and any abnormalities can be detected by the feel of the card. In addition, recent ID cards are equipped with an IC function, so checking the IC allows for more reliable identity verification.

Patent document 1 also describes an authenticity determination device that determines the authenticity of an ID card from an image of the ID card face captured by a scanner, and it is also possible to determine the authenticity of an ID card by reading a submitted ID card with a scanner.

JP 2011-34535 A

Recently, online financial institutions such as online banks have become common. Some of these types of financial institutions verify the identity of the customer by taking a picture of the face of the ID card with a camera on a smartphone or other device and sending the image to the financial institution.

In this case, identity verification is done only by image and not face-to-face, so there is a need for ingenuity in detecting counterfeits. For example, if a counterfeit is committed by pasting a fake face image printed on a commercially available printer in the face image section of an ID card, the counterfeit may not be detectable from the image on the card alone.

To detect such counterfeits, there are cases where an image showing the thickness of the ID card is required to be submitted, but if the printed matter affixed to the fake ID card is thin, it is difficult to detect the counterfeit even with the above image.

The present invention has been made in consideration of the above problems, and aims to provide an authenticity determination device etc. that can suitably determine the authenticity of identification cards.

The first invention for solving the above-mentioned problems is an authenticity determination device for an identification card on which character information and a user's facial image are formed, the authenticity determination device having an authenticity determination means for using the image of the identification card to determine authenticity by comparing user attributes obtained from the facial image with user attributes obtained from the character information, the user attributes being an estimated age of the user at the time of manufacture of the identification card, and the authenticity determination device further having a display means for displaying the probability that, for a user whose estimated age at the time of manufacture of the identification card is obtained from the facial image, the actual age at the time of manufacture of the identification card is the estimated age at the time of manufacture of the identification card obtained from the character information .

In this invention, the authenticity of an ID card is determined using the facial image and text information on the ID card. In the case of a genuine ID card, the user attributes estimated from the facial image match well with the user attributes obtained from the text information, and if the facial image or text information is forged, these user attributes will not match. Therefore, in this invention, it is possible to determine the authenticity of an ID card using the facial image and text information, and even if a forgery is made by printing a fake facial image on a thin printed material and pasting it in the facial image field of the ID card, the forgery can be detected.

As a user attribute, the estimated age of the user at the time of production of the identification card can be used, and the estimated age can be obtained from a facial image or text information, and authenticity can be suitably determined by comparing the estimated age and the text information.

The character information is, for example, the user's date of birth and the expiration date of the identification card. The authenticity determination means can determine a date that is a predetermined period back from the expiration date of the identification card as the date of manufacture of the identification card, obtain an estimated age of the user at the time of manufacture of the identification card using the user's date of birth, determine an estimated age of the user estimated from the face image as the estimated age of the user at the time of manufacture of the identification card, and compare the estimated age obtained using the user's date of birth with the estimated age of the user estimated from the face image.
The expiration date of the identification card may be set to a predetermined period from the time of manufacture of the identification card, in which case the expiration date of the identification card and the user's date of birth can be used to calculate the estimated age of the user at the time of manufacture of the identification card. In other words, since the time of manufacture of the identification card can be identified by subtracting the above-mentioned predetermined period from the expiration date of the identification card, the estimated age of the user at the time of manufacture of the identification card can be obtained using the user's date of birth formed on the identification card. By comparing this estimated age with the estimated age of the user at the time of manufacture of the identification card obtained from the face image, it is possible to suitably detect counterfeiting of the face image and character information of the identification card.

In addition, in the first invention, the above probability or the like can be presented to the person in charge as reference information, thereby assisting the person in making decisions such as whether or not to accept the user's application.

It is desirable that the authenticity determining device has a receiving means for receiving an image of the identification card from a user terminal.
This makes it possible to construct an authenticity determination system using a network, which determines authenticity using an image of an identification card sent from a user terminal.

A second invention is a program for causing a computer to function as an authenticity determination device for an identification card on which text information and a user's facial image are formed, the authenticity determination device having an authenticity determination means for using the image of the identification card to determine authenticity by comparing user attributes obtained from the facial image with user attributes obtained from the character information, the user attributes being the estimated age of the user at the time of manufacture of the identification card, and the authenticity determination device further having a display means for displaying the probability that, for a user whose estimated age at the time of manufacture of the identification card is obtained from the facial image, the actual age at the time of manufacture of the identification card is the estimated age at the time of manufacture of the identification card obtained from the character information .

The present invention provides an authenticity determination device that can effectively determine the authenticity of an identification card.

FIG. 1 shows an authenticity determination system 1. FIG. 2 is a diagram showing the hardware configuration of an authenticity determination device 3. FIG. 2 is a diagram showing the hardware configuration of a user terminal 5. FIG. 1 shows an ID card 10. FIG. 2 is a diagram showing the functional configuration of an authenticity determination device 3. 1 is a flowchart showing the flow of an authenticity determining method. An example of the ID card 10 photography screen. FIG. 13 is a diagram for explaining an authenticity determination method. FIG. 13 is a diagram showing age compatibility rate 334, etc.

The following describes in detail a preferred embodiment of the present invention with reference to the drawings.

(1. Authenticity Determination System 1)
1 is a diagram showing an authenticity determination system 1 having an authenticity determination device 3 according to an embodiment of the present invention. The authenticity determination system 1 is configured by connecting the authenticity determination device 3 and a user terminal 5 via a network so that they can communicate with each other. In the authenticity determination system 1, a captured image of a user's ID card 10 (an image of the ID card 10) is transmitted from the user terminal 5 to the authenticity determination device 3, and the authenticity determination device 3 determines the authenticity of the ID card 10 from the captured image.

Figure 2 is a diagram showing the hardware configuration of the authenticity determination device 3. The authenticity determination device 3 can be realized by a computer configured by connecting a control unit 31, a memory unit 32, a display unit 33, an input unit 34, a communication unit 35, etc. via a bus or the like. However, the authenticity determination device 3 is not limited to this, and various configurations can be used as appropriate.

The control unit 31 is composed of a CPU, ROM, RAM, etc. The CPU loads programs related to the processing of the authenticity determination device 3 stored in storage media such as the memory unit 32 and ROM into a work area on the RAM and executes them. The ROM is a non-volatile memory, and permanently stores programs such as the boot program and BIOS, as well as data. The RAM is a volatile memory, and temporarily stores programs and data loaded from the memory unit 32, ROM, etc., and also has a work area that the control unit 31 uses to perform various processes.

The storage unit 32 is a hard disk drive, solid state drive, flash memory, etc., and stores the programs executed by the authenticity determination device 3 during the processing described below, data necessary for program execution, the OS, etc. These programs and data are read and executed by the control unit 31 as necessary.

The display unit 33 has a display device such as a liquid crystal panel, and displays various display screens related to the processing of the authenticity determination device 3.
The input unit 34 is an input device such as a touch panel, a keyboard, a mouse, or a numeric keypad, and outputs input data to the control unit 31.
The communication unit 35 is a communication interface that mediates communication with the user terminal 5 and the like via a network.

The user terminal 5 is a camera-equipped terminal carried by the user, which takes a picture of the ID card 10 and transmits the captured image to the authenticity determination device 3. As the user terminal 5, for example, a mobile terminal such as a smartphone or a tablet terminal is used.

Figure 3 is a diagram showing the hardware configuration of the user terminal 5. As shown in Figure 3, the user terminal 5 is configured by connecting a control unit 51, a memory unit 52, a display unit 53, an input unit 54, a communication unit 55, a camera 56, an audio input/output unit 57, etc., via a bus or the like. However, this is not limited to this, and various configurations can be used as appropriate.

The control unit 51, the memory unit 52, and the communication unit 55 are substantially the same as the control unit 31, the memory unit 32, and the communication unit 35 described above. The display unit 53 has a display device such as a liquid crystal panel, and a touch panel is provided as the input unit 54 for inputting data to the user terminal 5. The audio input/output unit 57 includes a microphone and a speaker used for audio input and output.

Camera 56 is an area camera that is composed of an optical lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), an A/D (Analog/Digital) converter, etc. Camera 56 photoelectrically converts the subject image input through the optical lens using the imaging element to generate an analog image signal. The A/D converter then converts the analog image signal into digital image data.

(2. ID Card 10)
In this embodiment, the ID card 10 is an identity card that is the subject of authentication. An identity card is a medium used for identity verification by financial institutions, mobile phone carriers, etc., and is, for example, a driver's license, a My Number card, a residence card, a special permanent resident card, etc.

Figure 4 is a diagram showing an overview of ID card 10, and shows a schematic example of the face of ID card 10. ID card 10 is formed by printing, in predetermined positions on a roughly rectangular card substrate, a facial image 18 of the card holder, and text information such as the card holder's name 12, date of birth 13, address 14, and the issue number 16 and expiration date 17 of ID card 10.

(3. Functions of Authenticity Determination Device 3)
5 is a diagram showing a functional configuration of the authenticity determination device 3. The authenticity determination device 3 includes a receiving means 301, an authenticity determination means 302, a display means 303, and the like.

The receiving means 301 is a means by which the control unit 31 of the authenticity determination device 3 receives a captured image of the ID card 10 from the user terminal 5 via the communication unit 35.

The authenticity determination means 302 uses the photographed image of the ID card 10 received by the control unit 31 of the authenticity determination device 3 from the user terminal 5 to determine the authenticity of the ID card 10. In this embodiment, the estimated age of the user at the time of manufacture of the ID card 10 obtained from the character information of the ID card 10 is compared with the estimated age of the user at the time of manufacture of the ID card 10 obtained from the face image 18, the details of which will be described later.

The display means 303 displays the probability that the actual age at the time of manufacture of the ID card 10 of a user whose estimated age at the time of manufacture of the ID card 10 was obtained from the face image 18 by the control unit 31 of the authenticity determination device 3 is the estimated age at the time of manufacture of the ID card 10 obtained from the text information. Details of this probability etc. will be described later.

(4. Authenticity Determination Method)
Fig. 6 is a flowchart showing the flow of the authenticity determination method executed by the authenticity determination system 1. S1 to S2 in Fig. 6 are processes executed by the control unit 51 of the user terminal 5 by controlling each unit of the user terminal 5, and S3 to S7 are processes executed by the control unit 31 of the authenticity determination device 3 by controlling each unit of the authenticity determination device 3.

In this embodiment, the user first operates the user terminal 5 to launch a dedicated application program that is pre-stored in the memory unit 52. The user terminal 5 then displays a menu screen (not shown) on the display unit 53, and starts the camera 56 in accordance with the user's selection on the menu screen to capture an image of the face of the ID card 10 (S1).

Figure 7 shows an example of the screen for capturing an ID card 10 at this time. In this embodiment, when the camera is started, instructions are displayed on the display unit 53 of the user terminal 5 to prompt the user to place the ID card 10 within a specified frame 531, and then the ID card 10 is captured.

When the user terminal 5 photographs the ID card 10, it transmits the photographed image to the authenticity determination device 3 (S2). When the authenticity determination device 3 receives the photographed image of the ID card 10 (S3), it uses the photographed image to determine the authenticity of the ID card 10 (S4).

In this embodiment, authenticity is determined by comparing user attributes obtained from the face image 18 in the captured image with user attributes obtained from text information such as the date of birth 13 and expiration date 17 in the captured image. Text information such as the date of birth 13 and expiration date 17 can be obtained by using AI (artificial intelligence) technology or the like to perform known OCR (optical character recognition) processing on the areas of the date of birth 13, expiration date 17, etc. in the captured image. User attributes are information about a user, and in this embodiment, in particular, the user attributes are compared between the estimated age of the user at the time of manufacture of the ID card 10, which is estimated from the face image 18, and the estimated age of the user at the time of manufacture of the ID card 10, which is estimated from the date of birth 13 and expiration date 17.

In S4, as shown in FIG. 8(a), the authenticity determination device 3 estimates the user's age at the time the facial image 18 was captured from the facial image 18, and sets this as the user's estimated age at the time the ID card 10 was manufactured (hereinafter, sometimes referred to as the facial recognition age). To estimate the age from the facial image 18, known face detection and age estimation techniques using AI or the like can be used. In addition, although there is a slight time lag between the manufacturing of the ID card 10 and the capturing of the facial image 18, this time lag does not pose a particular problem because the comparison of estimated ages described below does not require a strict match of the estimated ages.

The authenticity determination device 3 also uses the fact that the expiration date 17 of the ID card 10 is set to a predetermined period (e.g., 10 years) from the time of manufacture of the ID card 10, and identifies the date that is the predetermined period back from the expiration date 17 as the time of manufacture of the ID card 10, as shown in FIG. 8(b). Then, from the time of manufacture of the ID card 10 and the date of birth 13, the user's age at the time of manufacture of the ID card 10 is calculated, and this is regarded as the estimated age of the user at the time of manufacture of the ID card 10 (hereinafter sometimes referred to as the character recognition age).

The authenticity determination device 3 compares the estimated ages (character recognition age and face recognition age) obtained as described above. More specifically, the difference between these ages is evaluated based on the age matching rate 334 of the character recognition age shown in FIG. 9.

In FIG. 9, reference numeral 331 indicates the facial recognition age. The estimated age of the user estimated as the facial recognition age 331 has a discrepancy with the actual age of the user (at the time the facial image 18 was captured, i.e., at the time the ID card 10 was manufactured) due to errors in the age estimation technology, and reference numeral 332 is the age matching rate distribution that represents this discrepancy.

The age matching rate distribution 332 shows the distribution of the probability (age matching rate) of the actual age of a person whose face recognition age 331 has been estimated, and can be determined in advance depending on the accuracy of the age estimation technology used. The age matching rate distribution 332 is usually a normal distribution centered on the face recognition age 331, and in the example of FIG. 9, the probability that the actual age of a person whose face recognition age 331 is 26 is 20 is 2%.

The age matching rate 334 of the character recognition age indicates a value (probability) corresponding to the character recognition age 333 in the probability distribution indicated by the age matching rate distribution 332. In other words, the age matching rate 334 of the character recognition age indicates the probability that the actual age of the user whose face recognition age 331 has been estimated is the character recognition age 333, and is 0.5% in the example of FIG. 9. The age matching rate 334 makes it possible to evaluate the difference between the face recognition age 331 and the character recognition age 333.

In this embodiment, if the age matching rate 334 of the character recognition age exceeds a predetermined value, the ID card 10 is deemed to be genuine (S5; YES), and the authenticity determination process is completed. In this embodiment, the above authenticity determination is performed as identity verification when opening an account at a financial institution on the Internet, and after the authenticity determination process, the authenticity determination device 3 registers the user information (such as name 12 and date of birth 13) on the face of the ID card 10 obtained from a photographed image of the ID card 10 as application information required for account opening (S6), and stores the user information in the memory unit 52.

On the other hand, if the age matching rate 334 of the character recognition age is equal to or lower than a predetermined value, the authenticity determination device 3 determines that the ID card 10 is not genuine, i.e., that it is likely to be a fake ID card 10 in which at least one of the facial image 18, date of birth 13, and expiration date 17 has been forged (S5; NO), and displays the reference information shown in Figure 9 (facial recognition age 331, age matching rate distribution 332, character recognition age 333, age matching rate 334 of character recognition age, etc.) including the age matching rate 334 of the character recognition age on the display unit 33 (S7).

The person in charge can refer to the age matching rate 334 of the character recognition age displayed on the display unit 33 and decide whether to accept the application for opening an account. If necessary, the person in charge can also make inquiries to the user who sent the photographed image.

If the person in charge decides not to accept the application, he/she will contact the user by, for example, sending a message from the authenticity determination device 3 to the user terminal 5 to that effect. If the person in charge decides to accept the application, the authenticity determination device 3 can register user information on the face of the ID card 10, as in S6 above.

In this embodiment, the difference between the character recognition age 333 and the face recognition age 331 is evaluated using the age match rate 334, but the evaluation method is not limited to this. For example, it is also possible to evaluate using the difference between the character recognition age 333 and the face recognition age 331, and if the age difference is less than a predetermined value, the ID card 10 is deemed to be genuine, and if it is equal to or greater than the predetermined value, the ID card 10 is deemed to be inauthentic.

If it is determined that the ID card 10 is not genuine, the age difference value may be displayed on the display unit 33 of the authenticity determination device 3 to provide reference information for the person in charge when deciding whether to accept the application, or, as described above, it is also possible to display the age compatibility rate 334, etc. Also, if the expiration date 17 has expired (the expiration date 17 is a date and time in the past), it is also possible to have the display unit 33 display a warning to that effect.

As described above, in this embodiment, the authenticity of the ID card 10 is determined using the facial image 18, date of birth 13, and expiration date 17 of the ID card 10. In the case of a genuine ID card 10, the facial recognition age 331 estimated from the facial image 18 and the character recognition age 333 obtained from the date of birth 13 and expiration date 17 match well, and if the facial image 18, date of birth 13, and expiration date 17 are forged, these ages will not match. Therefore, in this embodiment, it is possible to suitably determine the authenticity of the ID card 10 by comparing the facial recognition age 331 and the character recognition age 333, and even if a forgery is performed by printing a fake facial image on a thin printed material and pasting it in the facial image 18 column of the ID card 10, the forgery can be detected.

In addition, the results of age estimation from face image 18 and obtaining text information by OCR processing of ID card 10 are relatively little affected by the shooting conditions of ID card 10, so the method of this embodiment has the advantage that the judgment accuracy is less likely to decrease depending on the shooting conditions of ID card 10.

More specifically, in the authenticity determination of this embodiment, the expiration date 17 of the ID card 10 is set to a predetermined period from the time of manufacture of the ID card 10, and the expiration date 17 of the ID card 10 and the user's date of birth 13 can be used to calculate the character recognition age 333.

In other words, the time of manufacture of the ID card 10 can be identified by subtracting the above-mentioned predetermined period from the expiration date 17 of the ID card, so the character recognition age 333 can be obtained using the user's date of birth 13 formed on the ID card 10. By comparing this character recognition age 333 with the face recognition age 331, it is possible to effectively detect counterfeiting of the face image 18, date of birth 13, or expiration date 17 of the ID card 10.

The authenticity determination device 3 also displays the age matching rate 334 of the character recognition age shown in FIG. 9, thereby providing the person in charge with reference information to use when deciding whether to accept the application, thereby assisting the person in making the decision.

Furthermore, the authenticity determination device 3 of this embodiment performs authenticity determination using a photographed image of the ID card 10 transmitted from the user terminal 5, thereby enabling an authenticity determination system 1 consisting of the authenticity determination device 3 and the user terminal 5 to be constructed using a network.

However, the present invention is not limited to the above-described embodiment. For example, in this embodiment, authenticity determination is performed as identity verification when opening an account, but the application scenario or purpose of the authenticity determination in this embodiment is not particularly limited.

In this embodiment, authenticity is determined using a captured image sent from the user terminal 5, but even if the ID card 10 of a user who visits a store, etc. is read by a scanner, authenticity can also be determined from the image.

In addition, in this embodiment, the manufacturing time of the ID card 10 is determined from the expiration date 17 of the ID card 10, but if the issue date of the ID card 10 is formed as text information on the ID card 10, it is also possible to use the issue date as the manufacturing time of the ID card 10.

In this embodiment, the user's estimated age at the time of manufacture of the ID card 10 is compared as a user attribute, but the user attributes to be compared are not limited to this. For example, if the gender of the card holder is recorded as text information on the ID card 10, this gender may be compared with the gender estimated from the face image 18.

The above describes preferred embodiments of the present invention with reference to the attached drawings, but the present invention is not limited to these examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally fall within the technical scope of the present invention.

1: Authenticity determination system 3: Authenticity determination device 5: User terminal 10: ID card 13: Date of birth 17: Expiration date 18: Face image 301: Receiving means 302: Authenticity determination means 303: Display means 331: Face recognition age 332: Age matching rate distribution 333: Character recognition age 334: Age matching rate

Claims (5)

An apparatus for determining authenticity of an identification card on which character information and a user's face image are formed,
an authenticity determination means for determining authenticity by using an image of the identification card and comparing a user attribute obtained from the face image with a user attribute obtained from the character information ;
The user attribute is an estimated age of the user at the time of production of the identification card,
The authenticity determination device further comprises a display means for displaying the probability that, for a user whose estimated age at the time of production of the identification card is obtained from the facial image, the actual age at the time of production of the identification card is the estimated age at the time of production of the identification card obtained from the character information . 2. The authenticity determining device according to claim 1 , wherein the character information is a user's date of birth and an expiration date of the identification card. The authenticity determining means includes:
determining a date that is a predetermined period prior to the expiration date of the identification card as the date of manufacture of the identification card, and calculating an estimated age of the user at the date of manufacture of the identification card using the user's date of birth;
The estimated age of the user estimated from the face image is set as the estimated age of the user at the time of production of the identification card;
3. The authenticity determining device according to claim 2 , further comprising a step of comparing an estimated age of the user calculated using the user's date of birth with an estimated age of the user estimated from the face image. 4. The authenticity determining device according to claim 1 , further comprising a receiving means for receiving an image of the identification card from a user terminal. Computer,
An apparatus for determining authenticity of an identification card on which character information and a user's face image are formed,
an authenticity determination means for determining authenticity by using an image of the identification card and comparing a user attribute obtained from the face image with a user attribute obtained from the character information ;
The user attribute is an estimated age of the user at the time of production of the identification card,
A program for functioning as an authenticity determination device further having a display means for displaying the probability that, for a user whose estimated age at the time of production of the identification card is obtained from the facial image, the actual age at the time of production of the identification card is the estimated age at the time of production of the identification card obtained from the character information .

Images