JP7596820B2 - Identification method, information processing device, and identification program - Google Patents

Description

The present invention relates to a technology for identifying candidates corresponding to biometric information.

Biometric authentication is a technology that uses biometric information such as face, veins, fingerprints, and palm prints to identify an individual. Biometric authentication using biometric information makes it difficult for the person being authenticated to impersonate another person, and the person being authenticated can be authenticated without having to show their hands. Due to this high level of security and convenience, biometric authentication for identifying individuals is becoming widespread.

For example, in palm vein authentication, which uses palm veins as biometric information, the vein information of the person to be authenticated is compared with the vein information of multiple people who have been registered in advance. Therefore, if the number of vein information of registered people becomes huge, the authentication process takes a long time. Therefore, to ensure practical authentication accuracy and speed, the upper limit on the number of people who can be registered is often set at around 10,000.

When performing palm vein authentication for a number of registered users that exceeds the upper limit, hybrid authentication technology is used that combines palm vein authentication with other authentication technologies. For example, in hybrid authentication technology that uses key information, the person to be authenticated inputs key information such as their ID or date of birth, which narrows down the large number of registered users to one or more registered users. Palm vein authentication can be performed in a short time by comparing the vein information obtained from the person to be authenticated with the vein information of the small number of narrowed down registered users.

In relation to biometric authentication, a fuel supply system is known that simplifies and streamlines the setting of work information for fuel supply work (see, for example, Patent Document 1). In this fuel supply system, personal authentication is performed using the worker's own biometric information, and default work information for the fuel supply work to be performed is automatically created based on work result information of fuel supply work already performed by the worker.

JP 2019-210030 A

In the conventional hybrid authentication technology described above, the task of inputting key information such as ID and date of birth is a burden on the person to be authenticated, compromising convenience and operability.

Note that this problem is not limited to palm vein authentication, but occurs in biometric authentication using a variety of biometric information.

In one aspect, the present invention aims to reduce the burden on the person to be authenticated when identifying the person using biometric information.

In one proposal, the computer performs the following steps:

The computer identifies one or more candidates associated with the identified vehicle number from an image of the vehicle number plate. When the computer receives the biometric information, it identifies a candidate that corresponds to the biometric information from among the identified one or more candidates.

According to one aspect, it is possible to reduce the burden on the person to be authenticated when identifying the person using biometric information.

FIG. 2 is a functional configuration diagram of an information processing device. 13 is a flowchart of a candidate specification process. FIG. 1 is a configuration diagram of a biometric authentication system. FIG. 2 is a functional configuration diagram of a vehicle number acquisition device. FIG. 2 is a functional configuration diagram of a biometric authentication terminal device. FIG. 2 is a functional configuration diagram of a biometric authentication server. FIG. 4 is a flowchart of a vehicle number acquisition process. 13 is a flowchart of an authentication control process. 13 is a flowchart of a biometric authentication process. FIG. 2 is a hardware configuration diagram of an information processing device.

The following describes the embodiment in detail with reference to the drawings.

FIG. 1 shows an example of the functional configuration of an information processing device according to an embodiment. The information processing device 101 in FIG. 1 includes a first identification unit 111 and a second identification unit 112.

Figure 2 is a flowchart showing an example of a candidate identification process performed by the information processing device 101 of Figure 1. First, the first identification unit 111 identifies one or more candidates associated with the identified vehicle number from an image of a vehicle number plate (step 201). Next, when the second identification unit 112 receives biometric information, it identifies a candidate corresponding to the biometric information from among the identified one or more candidates (step 202).

The information processing device 101 in FIG. 1 can reduce the burden on the person to be authenticated when identifying the person using biometric information.

Figure 3 shows an example of the configuration of a biometric authentication system including the information processing device 101 of Figure 1. The biometric authentication system of Figure 3 includes an imaging device 301, a vehicle number acquisition device 302, biometric authentication terminal devices 303-1 to 303-3, payment devices 304-1 to 304-3, and a biometric authentication server 305. The biometric authentication server 305 corresponds to the information processing device 101 of Figure 1.

The imaging device 301 is connected to the vehicle number acquisition device 302, and the payment devices 304-i (i = 1 to 3) are connected to the biometric authentication terminal device 303-i. The biometric authentication terminal device 303-i communicates with the vehicle number acquisition device 302 via a communication network 311, and communicates with the biometric authentication server 305 via a communication network 312. The communication networks 311 and 312 are, for example, a LAN (Local Area Network) or a WAN (Wide Area Network).

The imaging device 301, the vehicle number acquisition device 302, the biometric authentication terminal device 303-i, and the payment device 304-i are installed in an environment where a vehicle in which a user who is the subject of authentication is riding is present. The user is either the driver or a passenger other than the driver. The environment where the vehicle is present corresponds to, for example, a service station that provides services such as refueling and car washing, a parking lot, a drive-through store, etc.

By using the biometric authentication system shown in Figure 3, businesses that provide membership-based services can provide services such as payment processing to members at service stations, parking lots, drive-through stores, etc.

In the case of a service station, the imaging device 301 and the vehicle number acquisition device 302 are installed, for example, at the entrance of the service station, and the biometric authentication terminal device 303-i and the payment device 304-i are installed, for example, at a predetermined location within the service station. The biometric authentication terminal device 303-i and the payment device 304-i may be installed at each fuel pump.

In the case of a parking lot, the imaging device 301 and the vehicle number acquisition device 302 are installed, for example, at the entrance of the parking lot, and the biometric authentication terminal device 303-i and the payment device 304-i are installed, for example, at the exit of the parking lot.

In the case of a drive-through store, the image capture device 301 and the vehicle number acquisition device 302 are installed, for example, at the entrance of the store, and the biometric authentication terminal device 303-i and the payment device 304-i are installed, for example, at the window where orders are accepted.

The imaging device 301 is a camera having an imaging element such as a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). Each time a vehicle enters the monitored area, the imaging device 301 captures an image of the vehicle registration number plate attached to the vehicle and outputs the image of the number plate to the vehicle number acquisition device 302. The number plate attached to the vehicle is an example of a vehicle number plate, and the vehicle registration number is an example of a vehicle number. Information such as the vehicle shape and body color may be acquired from the image captured by the imaging device 301 and used to identify candidates by the first identification unit 111.

Figure 4 shows an example of the functional configuration of the vehicle number acquisition device 302 in Figure 3. The vehicle number acquisition device 302 in Figure 4 includes an acquisition unit 411, a number generation unit 412, a list generation unit 413, and a communication unit 414. The communication unit 414 communicates with the biometric authentication terminal device 303-i via the communication network 311.

The acquisition unit 411 operates the imaging device 301 to acquire images of license plates output from the imaging device 301. When multiple vehicles enter the monitored area, images of each of the multiple vehicles are output in sequence from the imaging device 301.

The number generation unit 412 performs character recognition on each acquired image and extracts the vehicle number appearing in the image. The extracted vehicle number includes numbers and non-numeric characters. If the license plate image is clear, the number generation unit 412 can extract the complete vehicle number from the image recognition results.

However, the image of the license plate may be blurred due to factors such as the image quality or angle of view of the imaging device 301, the effects of external light, and objects attached to the license plate. When character recognition is performed on a blurred image, part of the vehicle number shown in the image may not be recognized and may be missing.

If the image is unclear and part of the vehicle number is missing, the number generation unit 412 uses multiple recognition candidates for the missing characters as complementary characters and generates multiple vehicle numbers by replacing the missing characters with the multiple complementary characters. In this case, multiple vehicle numbers are generated from the recognition results of one image.

The number generation unit 412 can also generate a vehicle number using a wildcard instead of a supplementary character. In this case, the number generation unit 412 replaces missing characters with a wildcard to generate one vehicle number including a wildcard. Note that the wildcard here may be, for example, a digit (or character) that is temporarily used for number generation when the vehicle number is unclear. As described below, the wildcard may be updated later by the user inputting characters on the operation unit 511.

The list generation unit 413 generates a vehicle number list including vehicle numbers extracted or generated from one or more images acquired within a specified period. The vehicle number list includes one or more vehicle numbers. The list generation unit 413 transmits the generated vehicle number list to the biometric authentication terminal device 303-i via the communication unit 414. Each time a vehicle enters the monitored area, the vehicle number list is updated based on the image of the vehicle.

Figure 5 shows an example of the functional configuration of the biometric authentication terminal device 303-i in Figure 3. The biometric authentication terminal device 303-i in Figure 5 includes an operation unit 511, a display unit 512, a vein sensor 513, a touch panel 514, a communication unit 515, a control unit 516, a reception unit 517, an acquisition unit 518, and an instruction unit 519. The communication unit 515 communicates with the vehicle number acquisition device 302 via the communication network 311, and with the biometric authentication server 305 via the communication network 312.

The user inputs information into the biometric authentication terminal device 303-i using the operation unit 511. The display unit 512 displays on the screen the operation procedure/operation guidance/processing status of the palm vein authentication authentication process, the authentication result, and the operation procedure/operation guidance/processing status of the payment process.

The user uses the touch panel 514 to select an item to transition to the next screen from the displayed operation procedure/operation guidance/processing status of the authentication process, authentication result, operation procedure/operation guidance/processing status of the payment process, etc. The vein sensor 513 acquires vein information as information about the veins of the user's palm. The vein information of the user includes vein information of one or both hands. Palm vein information is an example of biometric information.

The control unit 516 functions as a hardware control unit that controls the hardware, and operates the operation unit 511, the display unit 512, the vein sensor 513, the touch panel 514, and the communication unit 515. The reception unit 517 receives the vehicle number list received by the communication unit 515 from the vehicle number acquisition device 302.

If any vehicle number in the received vehicle number list contains a wildcard, the reception unit 517 instructs the user to input characters corresponding to the wildcard via the display unit 512. The user inputs characters using the operation unit 511, and the reception unit 517 replaces the wildcard with the input characters to generate a complete vehicle number. The reception unit 517 then updates the vehicle number list by replacing the vehicle number containing the wildcard with the generated vehicle number.

The reception unit 517 transmits the received vehicle number list or the updated vehicle number list to the biometric authentication server 305 via the communication unit 515. The acquisition unit 518 acquires the palm vein information of the user from the vein sensor 513 and transmits it to the biometric authentication server 305 via the communication unit 515.

The instruction unit 519 instructs the payment device 304-i to perform payment processing based on the authentication result received from the biometric authentication server 305, and the payment device 304-i performs the instructed payment processing. The authentication result includes identification information of the registrant identified by palm vein authentication. The authentication result may also include the name of the identified registrant, payment information such as a credit card, etc.

In the case of a service station, the payment device 304-i performs a process of settling the fees for services such as gasoline and car washes, for example. In the case of a parking lot, the payment device 304-i performs a process of settling the parking fee, for example. In the case of a drive-through store, the payment device 304-i performs a process of settling the price of ordered products, for example. If the authentication result includes payment information such as credit card information, the payment is made using the credit card or the like indicated by the payment information.

Figure 6 shows an example of the functional configuration of the biometric authentication server 305 in Figure 3. The biometric authentication server 305 in Figure 6 includes a reception unit 611, an acquisition unit 612, an authentication unit 613, a communication unit 614, and a storage unit 615. The acquisition unit 612 and the authentication unit 613 correspond to the first identification unit 111 and the second identification unit 112, respectively, in Figure 1.

The communication unit 614 communicates with the biometric authentication terminal device 303-i via the communication network 312. The storage unit 615 stores a database 621 that associates vehicle numbers with registrants. A registrant is, for example, a member who has subscribed to a membership service.

Figure 7 shows an example of the database 621 in Figure 6. Each entry in the database 621 in Figure 7 includes an ID, a vehicle number N1, a vehicle number N2, a vehicle number N3, and registered vein information. The ID, the vehicle number N1, the vehicle number N2, the vehicle number N3, and the registered vein information are associated with each other.

The ID is the identification information of the registrant, and vehicle number N1 to vehicle number N3 represent the vehicle numbers of vehicles in which the registrant may ride as a driver or a user other than the driver. One or more vehicle numbers can be associated with one registrant's ID. The number of vehicle numbers associated with one registrant's ID may be four or more.

By registering the vehicle numbers of vehicles in which a registrant may ride in association with the registrant, it is possible to easily extract a registrant corresponding to the vehicle number of a vehicle in which a user is riding. A registrant registered in database 621 is an example of a candidate associated with a vehicle number.

Registered vein information represents palm vein information obtained from the hand of a registrant at the time of registration. Only one piece of registered vein information can be associated with one registrant's ID. One piece of registered vein information includes vein information from one or both hands. Registered biometric information corresponding to one registrant's ID can include any biometric information that can be obtained from the same registrant. Registered vein information is an example of registered biometric information.

For example, the vehicle number N1 of the registrant identified by the ID "0003" is the same as the vehicle number N1 of the registrant identified by the ID "0004". In this way, in the database 621 of FIG. 7, it is possible to associate multiple registrants with one vehicle number. Examples of cases in which multiple registrants use the same vehicle include a family member using a personal car, an employee using a company car, car sharing, rental cars, etc.

Registered persons who are members of a membership service can register or delete vehicle numbers at any time. Businesses that provide membership services can also register or delete vehicle numbers at any time. The registrant's vehicle number N3, indicated by the ID "0003", represents the vehicle number of a rental car that the registrant registered at his or her travel destination.

The reception unit 611 receives the vehicle number list received by the communication unit 614 from the biometric authentication terminal device 303-i, and stores it in the storage unit 615 as the vehicle number list 622. The reception unit 611 also receives the user's vein information received by the communication unit 614 from the biometric authentication terminal device 303-i, and stores it in the storage unit 615 as the vein information 623.

The acquisition unit 612 refers to the database 621 to identify the IDs of one or more registered persons associated with each vehicle number included in the vehicle number list 622, and acquires the registered vein information associated with the identified IDs from the database 621. The one or more registered persons associated with each vehicle number are people who may be in the vehicle indicated by the vehicle number, either as a driver or as a user other than the driver.

The authentication unit 613 performs authentication processing to compare one or more pieces of registered vein information obtained from the database 621 with the vein information 623, and identifies the registrant corresponding to the vein information 623 based on the comparison result. This makes it possible to identify the registrant corresponding to the user from among the many registrants registered in the database 621.

In the authentication process, the authentication unit 613 calculates the similarity between the vein information 623 and each registered vein information, and identifies the registered vein information whose similarity meets a criterion. For example, the criterion may be the maximum similarity. However, this embodiment is not limited to this. The authentication unit 613 then determines that the registrant indicated by the ID associated with the identified registered vein information is the user who provided the vein information 623.

The authentication unit 613 generates an authentication result 624 including the ID of the identified registrant and stores it in the storage unit 615. The authentication unit 613 then transmits the authentication result 624 to the biometric authentication terminal device 303-i via the communication unit 614.

According to the biometric authentication system of FIG. 3, the vehicle number read from the license plate image is used as key information to narrow down the registered persons corresponding to the person to be authenticated, and from the narrowed down registered persons, the person to be authenticated is uniquely identified by palm vein authentication. The vehicle number used to narrow down the registered persons is obtained contactlessly, without the person to be authenticated being aware of it, so the person to be authenticated does not need to input the vehicle number. This reduces the burden on the person to be authenticated, and makes it possible to narrow down the persons to be authenticated from a large number of registered persons without compromising convenience and operability.

When multiple people use the same vehicle, such as a personal car, company car, car sharing, rental car, etc., it is difficult to identify the person to be authenticated using only the vehicle number. Therefore, by performing palm vein authentication using the registered vein information of registrants narrowed down by the vehicle number, it is possible to uniquely identify the person to be authenticated even when multiple people use the same vehicle. This makes it possible to provide personalized services, such as payment processing, to the identified person to be authenticated.

Even if part of the vehicle number cannot be recognized because the license plate image is unclear, it is possible to generate a vehicle number that can be used to narrow down the list of registrants by replacing the unrecognized characters with complementary characters or wild cards. This makes it possible to narrow down the list of registrants even if part of the vehicle number cannot be recognized. In addition, a decrease in the accuracy of reading the vehicle number can be compensated for by highly accurate palm vein authentication, preventing a decrease in authentication accuracy.

By generating a vehicle number list that includes vehicle numbers extracted or generated from multiple images, even if multiple vehicles enter a monitored area, all registered users using those vehicles can be extracted as targets for authentication processing.

In the biometric authentication system of FIG. 3, multiple imaging devices 301 may be provided, and multiple vehicle number acquisition devices 302 may be provided. When multiple imaging devices 301 and multiple vehicle number acquisition devices 302 are provided, multiple vehicle number lists 622 are generated, and these vehicle number lists 622 are integrated, for example, by the acquisition unit 612 of the biometric authentication server 305.

The number of biometric authentication terminal devices 303-i is not limited to three, and may be one, two, four or more. Similarly, the number of payment devices 304-i may be one, two, four or more. Instead of the payment device 304-i, a device that provides a different service to the user may be provided.

Any two of the vehicle number acquisition device 302, the biometric authentication terminal device 303-i, and the biometric authentication server 305 may be integrated and implemented as a single device. For example, the vehicle number acquisition device 302 and the biometric authentication terminal device 303-i may be integrated, the vehicle number acquisition device 302 and the biometric authentication server 305 may be integrated, or the biometric authentication terminal device 303-i and the biometric authentication server 305 may be integrated. All of the vehicle number acquisition device 302, the biometric authentication terminal device 303-i, and the biometric authentication server 305 may be integrated and implemented as a single device.

For example, if the functions of the vehicle number acquisition device 302 are incorporated into each biometric authentication terminal device 303-i, an imaging device 301 is provided for each biometric authentication terminal device 303-i. In this case, the imaging device 301 captures an image of only one vehicle parked in front of the biometric authentication terminal device 303-i, and the biometric authentication terminal device 303-i generates a vehicle number list that includes only the vehicle number of that vehicle. Therefore, the biometric authentication server 305 can narrow down the registrants using a single vehicle number list.

Instead of acquiring the vehicle number list from the vehicle number acquisition device 302, the biometric authentication terminal device 303-i may have the user input the vehicle number. This allows the user to be identified reliably.

The biometric authentication server 305 may perform authentication processing using other biometric authentication methods besides palm vein authentication. As other biometric authentication methods, face authentication, fingerprint authentication, palm print authentication, etc., or a combination of these can be used. The other biometric authentication methods may be authentication technologies that identify individuals using physical or behavioral characteristics other than palm vein, face, fingerprint, and palm print.

When other biometric authentication is used, the biometric authentication terminal device 303-i includes a different biometric sensor instead of the vein sensor 513, acquires the user's biometric information, and transmits it to the biometric authentication server 305. The database 621 of the biometric authentication server 305 includes the different registered biometric information instead of the registered vein information. The authentication unit 613 performs authentication processing to compare one or more pieces of registered biometric information acquired from the database 621 with the user's biometric information, and identifies the registered person corresponding to the biometric information based on the comparison result.

Figure 8 is a flowchart showing an example of the vehicle number acquisition process performed by the vehicle number acquisition device 302 in Figure 4. First, the acquisition unit 411 acquires an image of the license plate from the imaging device 301 (step 801).

Next, the number generation unit 412 performs character recognition on the acquired image (step 802) and checks whether the vehicle number shown in the image has been recognized (step 803). If all characters contained in the vehicle number have been recognized (step 803, YES), the number generation unit 412 extracts the vehicle number from the image recognition results (step 804).

On the other hand, if some characters in the vehicle number are not recognized (step 803, NO), the number generation unit 412 generates a vehicle number using complementary characters or a wildcard (step 807). When complementary characters are used, the number generation unit 412 generates multiple vehicle numbers by replacing each of the unrecognized characters with multiple complementary characters. When a wildcard is used, the number generation unit 412 generates one vehicle number by replacing each of the unrecognized characters with a wildcard.

Next, the list generation unit 413 generates a vehicle number list including the vehicle numbers extracted or generated from one or more images acquired within a predetermined period (step 805). The list generation unit 413 then transmits the generated vehicle number list to the biometric authentication terminal device 303-i via the communication unit 414.

Next, the acquisition unit 411 checks whether an image of the next vehicle has been output from the imaging device 301 (step 806). If an image of the next vehicle has been output (step 806, YES), the vehicle number acquisition device 302 repeats the processing from step 801 onwards. This updates the vehicle number list. If an image of the next vehicle has not been output (step 806, NO), the vehicle number acquisition device 302 ends the processing.

Figure 9 is a flowchart showing an example of authentication control processing performed by the biometric authentication terminal device 303-i in Figure 5. For example, the authentication control processing in Figure 9 is started when the user presses the biometric authentication start button displayed on the screen of the display unit 512.

First, the communication unit 515 receives the vehicle number list from the vehicle number acquisition device 302, and the reception unit 517 receives the received vehicle number list (step 901). The reception unit 517 then checks whether any vehicle number in the received vehicle number list contains a wildcard (step 902).

If any of the vehicle numbers contains a wildcard (step 902, YES), the reception unit 517 instructs the user to input characters corresponding to the wildcard, and the user inputs the characters (step 903). The reception unit 517 then replaces the wildcard contained in the vehicle number with the input characters to generate a complete vehicle number and update the vehicle number list.

Next, the acquisition unit 518 acquires the vein information of the user's palm from the vein sensor 513 (step 904), and the communication unit 515 transmits the vehicle number list and the user's vein information to the biometric authentication server 305 (step 905).

Next, the communication unit 515 receives the authentication result from the biometric authentication server 305 (step 906), and the display unit 512 displays the information of the registrant included in the received authentication result on the screen (step 907). The information of the registrant may include ID, name, payment information such as credit card, etc.

The instruction unit 519 then transfers the information of the registrant indicated by the authentication result to the payment device 304-i, and instructs the payment device 304-i to perform payment processing (step 908). The payment device 304-i then performs the instructed payment processing.

Figure 10 is a flowchart showing an example of biometric authentication processing performed by the biometric authentication server 305 in Figure 6. First, the communication unit 614 receives the vehicle number list and the user's vein information from the biometric authentication terminal device 303-i (step 1001). The reception unit 611 then receives the received vehicle number list and stores it in the memory unit 615 as the vehicle number list 622, and receives the received user's vein information and stores it in the memory unit 615 as vein information 623.

Next, the acquisition unit 612 refers to the database 621 to identify the IDs of one or more registered persons associated with each vehicle number included in the vehicle number list 622 (step 1002). Then, the acquisition unit 612 acquires the registered vein information associated with the identified ID from the database 621 (step 1003).

The authentication unit 613 then performs an authentication process to compare one or more pieces of registered vein information obtained from the database 621 with the vein information 623, and identifies the registered person corresponding to the vein information 623 based on the comparison result (step 1004). The authentication unit 613 then generates an authentication result 624 including information on the identified registered person, and the communication unit 614 transmits the authentication result 624 to the biometric authentication terminal device 303-i (step 1005).

The configuration of the information processing device 101 in FIG. 1 is merely an example, and some components may be omitted or modified depending on the application or conditions of the information processing device 101.

The configuration of the biometric authentication system in FIG. 3 is merely an example, and some of the components may be omitted or changed depending on the use or conditions of the biometric authentication system. The configurations of the vehicle number acquisition device 302 in FIG. 4, the biometric authentication terminal device 303-i in FIG. 5, and the biometric authentication server 305 in FIG. 6 are merely examples, and some of the components may be omitted or changed depending on the use or conditions of the biometric authentication system. For example, the database 621 in FIG. 6 may be stored in a device external to the biometric authentication server 305. In this case, the biometric authentication server 305 acquires the database 621 from the external device and stores it in the memory unit 615.

The flowcharts in Figures 2 and 9 to 10 are merely examples, and some processing may be omitted or changed depending on the configuration or conditions of the information processing device 101 or the biometric authentication system.

The database 621 shown in FIG. 7 is merely an example, and the entries in the database 621 change depending on the registrant and the vehicle used by the registrant.

Figure 11 shows an example of the hardware configuration of an information processing device used as the information processing device 101 in Figure 1, the vehicle number acquisition device 302 in Figure 4, the biometric authentication terminal device 303-i in Figure 5, and the biometric authentication server 305 in Figure 6.

The information processing device in FIG. 11 includes a CPU (Central Processing Unit) 1101, a memory 1102, an input device 1103, an output device 1104, an auxiliary storage device 1105, a media drive device 1106, and a network connection device 1107. These components are hardware and are connected to each other via a bus 1108. When the information processing device is a biometric authentication terminal device 303-i, the vein sensor 513 and touch panel 514 in FIG. 5 may be connected to the bus 1108.

The memory 1102 is, for example, a semiconductor memory such as a read only memory (ROM), a random access memory (RAM), or a flash memory, and stores programs and data used in processing. The memory 1102 may operate as the storage unit 615 in FIG. 6.

The CPU 1101, for example, operates as the first identification unit 111 and the second identification unit 112 in FIG. 1 by executing a program using the memory 1102. The CPU 1101 also operates as the acquisition unit 411, the number generation unit 412, and the list generation unit 413 in FIG. 4 by executing a program using the memory 1102.

The CPU 1101 also operates as the control unit 516, reception unit 517, acquisition unit 518, and instruction unit 519 in FIG. 5 by executing a program using the memory 1102. The CPU 1101 also operates as the reception unit 611, acquisition unit 612, and authentication unit 613 in FIG. 6 by executing a program using the memory 1102.

The input device 1103 is, for example, a keyboard, a pointing device, etc., and is used to input instructions or information from a user or operator. The input device 1103 may operate as the operation unit 511 in FIG. 5.

The output device 1104 is, for example, a display device, a printer, etc., and is used to output inquiries or instructions to a user or an operator, and processing results. The output device 1104 may operate as the display unit 512 in FIG. 5.

The auxiliary storage device 1105 is, for example, a magnetic disk device, an optical disk device, a magneto-optical disk device, a tape device, or the like. The auxiliary storage device 1105 may be a hard disk drive or a flash memory. The information processing device can store programs and data in the auxiliary storage device 1105 and load them into the memory 1102 for use. The auxiliary storage device 1105 may operate as the storage unit 615 in FIG. 6.

The medium drive device 1106 drives the portable recording medium 1109 and accesses the recorded contents. The portable recording medium 1109 is a memory device, a flexible disk, an optical disk, a magneto-optical disk, etc. The portable recording medium 1109 may be a CD-ROM (Compact Disk Read Only Memory), a DVD (Digital Versatile Disk), a USB (Universal Serial Bus) memory, etc. The operator can store programs and data in the portable recording medium 1109 and load them into the memory 1102 for use.

In this way, the computer-readable recording medium that stores the program and data used in the processing is a physical recording medium such as memory 1102, auxiliary storage device 1105, or portable recording medium 1109. The recording medium may be non-transitory.

The network connection device 1107 is a communication interface circuit that is connected to the communication network 311 or the communication network 312 and performs data conversion associated with communication. The information processing device receives programs and data from an external device via the network connection device 1107 and can load them into the memory 1102 for use. The network connection device 1107 may operate as the communication unit 414 in FIG. 4, the communication unit 515 in FIG. 5, or the communication unit 614 in FIG. 6.

As the payment device 304-i in FIG. 3, an information processing device similar to that in FIG. 11 is used. Note that the information processing device does not need to include all of the components in FIG. 11, and some components may be omitted depending on the use or conditions of the information processing device. For example, if the information processing device is the vehicle number acquisition device 302 or the biometric authentication server 305, the input device 1103 and the output device 1104 may be omitted. If the portable recording medium 1109 is not used, the medium drive device 1106 may be omitted.

Although the disclosed embodiments and their advantages have been described in detail, it will be understood that those skilled in the art may make various modifications, additions, and omissions without departing from the scope of the present invention as expressly set forth in the claims.

The following supplementary notes are further disclosed regarding the embodiment described with reference to FIGS.
(Appendix 1)
Identifying one or more candidates associated with the identified vehicle number from an image of the vehicle number plate;
When the biometric information is received, a candidate corresponding to the biometric information is identified from the identified one or more candidates.
A method for identifying a target object, the method comprising the steps of:
(Appendix 2)
The process of identifying the one or more candidates includes a process of acquiring registered biometric information of the one or more candidates from a database;
The identification method described in Appendix 1, characterized in that the process of identifying a candidate corresponding to the biometric information includes a process of identifying a candidate corresponding to the biometric information based on a comparison result between the acquired registered biometric information of the one or more candidates and the accepted biometric information.
(Appendix 3)
The database includes registered biometric information of one or more candidates associated with each of a plurality of vehicle numbers;
The identification method described in Appendix 2, characterized in that the process of obtaining registered biometric information of the one or more candidates from the database includes a process of obtaining registered biometric information of one or more candidates associated with an identified vehicle number among the multiple vehicle numbers.
(Appendix 4)
The identification method described in any one of appendices 1 to 3, characterized in that when identifying the one or more candidates, if multiple vehicle numbers are identified from the image recognition results, the method includes a process of identifying one or more candidates corresponding to each of the identified multiple vehicle numbers.
(Appendix 5)
The identification method described in any one of Appendices 1 to 4, characterized in that when identifying the one or more candidates, multiple images each depicting a multiple vehicle are received, the method includes a process of identifying one or more candidates associated with the multiple vehicle numbers identified from the recognition results of the multiple images.
(Appendix 6)
The identification method described in any one of Appendices 1 to 5, characterized in that the one or more candidates associated with the identified vehicle number are at least one of a driver or a user other than the driver who may be a person who is likely to ride in the vehicle indicated by the identified vehicle number.
(Appendix 7)
The identification method according to any one of claims 1 to 6, wherein the received biometric information is palm vein information.
(Appendix 8)
A first identification unit that identifies one or more candidates associated with the identified vehicle number from an image of a vehicle number plate;
a second identification unit that, when receiving biometric information, identifies a candidate corresponding to the biometric information from among the identified one or more candidates;
An information processing device comprising:
(Appendix 9)
The first identification unit acquires registered biometric information of the one or more candidates from a database,
The information processing device described in Appendix 8, characterized in that the second identification unit identifies a candidate corresponding to the biometric information based on a comparison result between the acquired registered biometric information of the one or more candidates and the accepted biometric information.
(Appendix 10)
The database includes registered biometric information of one or more candidates associated with each of a plurality of vehicle numbers;
The information processing device described in Appendix 9, characterized in that the first identification unit acquires registered biometric information of one or more candidates associated with an identified vehicle number among the multiple vehicle numbers.
(Appendix 11)
The information processing device described in any one of Appendices 8 to 10, characterized in that when identifying the one or more candidates, if multiple vehicle numbers are identified from the image recognition results, the first identification unit identifies one or more candidates corresponding to each of the identified multiple vehicle numbers.
(Appendix 12)
The information processing device described in any one of Appendices 8 to 11, characterized in that when the first identification unit receives multiple images of multiple vehicles respectively when identifying the one or more candidates, it identifies one or more candidates associated with the multiple vehicle numbers identified from the recognition results of the multiple images.
(Appendix 13)
An information processing device described in any one of Appendices 8 to 12, characterized in that the one or more candidates associated with the identified vehicle number are at least one of a driver or a user other than the driver who may be a person who is likely to ride in the vehicle indicated by the identified vehicle number.
(Appendix 14)
14. The information processing device according to claim 8, wherein the received biometric information is information regarding palm veins.
(Appendix 15)
Identifying one or more candidates associated with the identified vehicle number from an image of the vehicle number plate;
When the biometric information is received, a candidate corresponding to the biometric information is identified from the identified one or more candidates.
A specific program for causing a computer to execute a process.
(Appendix 16)
The process of identifying the one or more candidates includes a process of acquiring registered biometric information of the one or more candidates from a database;
The identification program described in Appendix 15, characterized in that the process of identifying a candidate corresponding to the biometric information includes a process of identifying a candidate corresponding to the biometric information based on a comparison result between the acquired registered biometric information of the one or more candidates and the accepted biometric information.
(Appendix 17)
The database includes registered biometric information of one or more candidates associated with each of a plurality of vehicle numbers;
The specific program described in Appendix 16, characterized in that the process of obtaining registered biometric information of the one or more candidates from the database includes a process of obtaining registered biometric information of one or more candidates associated with an identified vehicle number among the multiple vehicle numbers.
(Appendix 18)
The identification program described in any one of Appendices 15 to 17, characterized in that when identifying the one or more candidates, if multiple vehicle numbers are identified from the image recognition results, the identification program causes the computer to execute a process of identifying one or more candidates associated with each of the identified multiple vehicle numbers.
(Appendix 19)
The identification program described in any one of Appendices 15 to 18 is characterized in that, when identifying the one or more candidates, the identification program causes the computer to execute a process of identifying one or more candidates associated with the multiple vehicle numbers identified from the recognition results of the multiple images when multiple images of multiple vehicles are received.
(Appendix 20)
A identification program described in any one of Appendices 15 to 19, characterized in that the one or more candidates associated with the identified vehicle number are at least one of a driver or a user other than the driver who may be a person who is likely to ride in the vehicle indicated by the identified vehicle number.
(Appendix 21)
The specific program according to any one of appendices 15 to 20, wherein the received biometric information is information regarding palm veins.

REFERENCE SIGNS LIST 101 Information processing device 111 First identification unit 112 Second identification unit 301 Imaging device 302 Vehicle number acquisition device 303-1 to 303-3 Biometric authentication terminal device 304-1 to 304-3 Payment device 305 Biometric authentication server 311, 312 Communication network 411, 518, 612 Acquisition unit 412 Number generation unit 413 List generation unit 414, 515, 614 Communication unit 511 Operation unit 512 Display unit 513 Vein sensor 514 Touch panel 516 Control unit 517, 611 Reception unit 519 Instruction unit 613 Authentication unit 615 Storage unit 621 Database 622 Vehicle number list 623 Vein information 624 Authentication result 1101 CPU
1102 Memory 1103 Input device 1104 Output device 1105 Auxiliary storage device 1106 Media drive device 1107 Network connection device 1108 Bus 1109 Portable recording medium

Claims (7)

Identifying one or more candidates associated with the identified vehicle number from an image of the vehicle number plate;
When the biometric information is received, a candidate corresponding to the biometric information is identified from the identified one or more candidates.
The computer executes the process ,
The identification method is characterized in that, in the process of identifying the one or more candidates, if multiple vehicle numbers are generated from a single vehicle number plate as a result of the image recognition, the identification method includes a process of identifying one or more candidates corresponding to each of the multiple vehicle numbers . The process of identifying the one or more candidates includes a process of acquiring registered biometric information of the one or more candidates from a database;
The identification method according to claim 1, characterized in that the process of identifying a candidate corresponding to the biometric information includes a process of identifying a candidate corresponding to the biometric information based on a comparison result between the acquired registered biometric information of the one or more candidates and the accepted biometric information. The database includes registered biometric information of one or more candidates associated with each of a plurality of vehicle numbers;
The identification method described in claim 2, characterized in that the process of obtaining registered biometric information of the one or more candidates from the database includes a process of obtaining registered biometric information of one or more candidates associated with an identified vehicle number from among the multiple vehicle numbers included in the database . The identification method described in any one of claims 1 to 3, characterized in that when identifying the one or more candidates, if multiple images each depicting a multiple vehicle are received, a process of identifying one or more candidates associated with the multiple vehicle numbers identified from the recognition results of the multiple images is included. The identification method described in any one of claims 1 to 4, characterized in that the one or more candidates associated with the identified vehicle number are at least one of a driver or a user other than the driver who may be a person who is likely to ride in the vehicle indicated by the identified vehicle number. A first identification unit that identifies one or more candidates associated with the identified vehicle number from an image of a vehicle number plate;
a second identification unit that, when receiving biometric information, identifies a candidate corresponding to the biometric information from among the identified one or more candidates;
Equipped with
When a plurality of vehicle numbers are generated from a single vehicle number plate as a result of the image recognition, the first identification unit identifies one or a plurality of candidates associated with each of the plurality of vehicle numbers.
23. An information processing apparatus comprising: Identifying one or more candidates associated with the identified vehicle number from an image of the vehicle number plate;
When the biometric information is received, a candidate corresponding to the biometric information is identified from the identified one or more candidates.
The process is executed by a computer ,
In the process of identifying the one or more candidates, when a plurality of vehicle numbers are generated from a number plate of one of the vehicles as a result of the recognition of the image, a process of identifying one or more candidates associated with each of the plurality of vehicle numbers is included.
A specific program characterized by :

Images