JP7104291B2 - Information processing system, information processing method, program - Google Patents

Description

The present invention relates to an information processing system, an information processing method, and a program.

In recent years, so-called telework, in which workers work from home instead of going to the office, is performed. Compared to working in the office, telework prevents leakage of confidential information and workers' labor. Difficult to manage time. Therefore, using the face image registered in advance, it is confirmed whether the person reflected in the camera provided in the PC etc. is the person himself / herself, and the time when "attendance" or "spoofing" occurs depending on the result, and the trail during that time. A system for recording camera images and screenshots has been developed.

In such a system, it is required to analyze the face image and accurately determine whether the person is the person or another person, but in an environment close to the shooting conditions of the registered face image, false detection can be suppressed to a low level. In an environment with different shooting conditions, it is often determined that the person is another person even though he / she is the person himself / herself. In order to reduce such false detections, it is necessary to perform authentication using a face image taken in the same environment as the work place, which is troublesome for the user.

In Patent Document 1, in order to reduce the false exclusion rate of the person against secular variation and variation in input information at the time of authentication, when the similarity at the time of collation is within a predetermined update range in advance, the registered information (dictionary) ) Is disclosed.

Japanese Unexamined Patent Publication No. 2004-157602

However, the technique disclosed in Patent Document 1 updates the registered image to a better one when the person is recognized as the person himself / herself, and when the environment or appearance is replaced by a misrecognized environment or appearance, the face image is used. It is necessary to retake the picture.

Therefore, an object of the present invention is to reduce the false rejection rate in the authentication process using an image .

Another object of the present invention is to suppress an increase in the tolerance rate for others in the authentication process using an image .

The information processing system of the present invention uses a reception means that accepts a selection of whether to register an image that is determined to be spoofed as a result of authentication using a pre-registered authentication image as an authentication image, and the reception means. When the selection to be registered as an authentication image is accepted, the image is provided with a registration means for registering the image as an authentication image.

According to the present invention, it is possible to reduce the false rejection rate in the authentication process using an image .

Further, in the authentication process using an image, it is possible to suppress an increase in the allowance rate for others.

It is a figure which shows an example of the system configuration of the telework management system. It is a block diagram which shows an example of the hardware composition of the information processing apparatus applicable to the management server 101, the teleworker PC111, and the administrator PC121. It is a flowchart which shows an example of the registration process of an image for authentication. It is a flowchart which shows an example of the invalidation processing of an image for authentication. It is a figure which shows an example of the registration screen of the image for authentication.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of a system configuration of the telework management system (information processing system) of the present invention.

The telework management system 100 is configured such that one or a plurality of management servers 101, one or a plurality of teleworker PCs 111, and one or a plurality of administrator PCs 121 are connected via the Internet 130.

The management server 101 is a server that centrally manages information on the presence / absence status of the teleworker, information on working hours, etc. as telework information, and is constructed on the service environment network 104.

When the teleworker PC 111 and the administrator PC 121 are connected to the management server 101 by an authentication process using an account ID and a password, and the management server 101 receives telework information from the teleworker PC 111, the management server 101 Store in the database. When there is a request for acquisition of telework information from the administrator PC 121, the necessary telework information is retrieved from the database of the management server 101.

The teleworker PC111 accepts applications (declarations) from the teleworker whether they are working or not, and detects the status of the teleworker's presence, absence, spoofing, peeping, etc. from the video captured by the connected imaging device. It is a terminal to do. Information that exists on the home network 110 and indicates whether it is working or not, information indicating the presence / absence status, etc. is created by a dedicated application, and is created by a dedicated application, and is created via the router 112, the Internet 130, and the management server 101 via the router 103. Will be sent to.

Attendance is a state in which it is determined that the person in the picture is the person in the teleworker by comparing the face image of the person in the teleworker registered in advance with the face of the person in the captured image. ..

Leaving a seat is a state in which no person is shown in the captured image.

Spoofing is a state in which it is determined that a third party other than the teleworker is shown as a result of collating the face image of the teleworker himself / herself registered in advance with the face of the person appearing in the captured image. ..

Peeping is a state in which the teleworker himself and another person are shown in the captured image.

The face image registered in advance may be one or a plurality of images, but images taken from various angles and images taken in various brightness environments are registered. By doing so, it is possible to reduce the probability of false detection (false rejection rate) in which the person is determined to be another person (impersonation) even though he / she is the person himself / herself.

The administrator PC 121 is a terminal for confirming telework information, exists on the in-house network 120, uses a web management console (operates on a web browser) to confirm telework information, and uses a router 122 and the Internet. It connects to the management server 101 via the 130 and the router 103.

FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing device applicable to the management server 101, the teleworker PC 111, and the administrator PC 121 according to the embodiment of the present invention. Since each device has the same configuration, the same reference numerals will be used for description.

As shown in FIG. 2, the information processing device includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a storage device 204, and an input controller 205 via the system bus 200. A voice input controller 206, a video controller 207, a memory controller 208, and a communication I / F controller 209 are connected.

The CPU 201 comprehensively controls each device and controller connected to the system bus 200.

The ROM 202 or the storage device 204 is a control program executed by the CPU 201, such as a BIOS (Basic Input / Output System) or an OS (Operating System), a computer-readable and executable program for realizing the information processing method, and various necessary programs. Holds data (including data table).

The RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 202 or the storage device 204 into the RAM 203 and executing the loaded program.

The input controller 205 controls the input from the input device 210. Examples of the input device 210 include a pointing device such as a keyboard, a touch panel, and a mouse.

When the input device 210 is a touch panel, the user can give various instructions by pressing (touching with a finger or the like) the icon, the cursor, or the button displayed on the touch panel.

Further, the touch panel may be a touch panel such as a multi-touch screen that can detect the position touched by a plurality of fingers.

When the microphone / speaker 211 operates as a microphone function, the voice input controller 206 can control the voice input from the microphone / speaker 211 and recognize the voice input from the microphone / speaker 211. Further, when the microphone / speaker 211 operates as a speaker function, the voice input controller 206 can control the voice output to the microphone / speaker 211 and output the voice to the microphone / speaker 211.

The video controller 207 controls the display on an external output device such as the display 212. The display shall include the display of a notebook computer integrated with the main body. The external output device is not limited to the display, and may be, for example, a projector. Further, as a device capable of accepting the above-mentioned touch operation, an input device 210 is provided.

The video controller 207 can control a video memory (VRAM) for performing display control, can use a part of the RAM 203 as a video memory area, or can provide a dedicated video memory separately. It is possible.

In the present invention, the first video memory area used for display when the user normally uses the information processing device and the display content of the first video memory area when a predetermined screen is displayed are superimposed. It has a second video memory area used for display. The video memory area is not limited to two, and it is possible to have a plurality of video memory areas as long as the resources of the information processing apparatus allow.

The memory controller 208 controls access to the external memory 213. External memory is connected to an external storage device (hard disk), flexible disk (FD), or PCMCIA card slot that stores boot programs, various applications, font data, user files, edit files, various data, etc. via an adapter. Compact flash (registered trademark) memory and the like can be used.

The communication I / F controller 209 connects to and communicates with an external device via the network 214, and executes communication control processing on the network. For example, communication using TCP / IP, a telephone line such as ISDN, and communication using a 3G line of a mobile phone are possible.

The storage device 204 is a medium for permanently storing information, and its form is not limited to a storage device such as a hard disk. For example, it may be a medium such as SSD (Solid State Drive).

It can also be used as a temporary memory area during various processes performed by the communication terminal in the present embodiment.

The CPU 201 enables display on the display 212 by, for example, executing an outline font expansion (rasterization) process in the display information area in the RAM 203. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the display 212.

Next, the process executed by the telework management system in the present embodiment will be described with reference to the flowcharts of FIGS. 3 and 4.

The flowchart of FIG. 3 is a flowchart showing a process of registering an image determined as spoofing as an image of the person in the administrator terminal 121.

In step S301, the CPU 201 of the administrator terminal 121 displays the trail image determined to be spoofing on the screen, and accepts the input (selection) of the processing method.

Specifically, the screen shown in FIG. 5A is displayed, and selection of normal (indicating that it is an image of the person) or fraudulent (indicating that it is an image of a third party other than the person) is accepted. In addition, it may be possible to accept the selection of hold (to the effect that the determination of whether the person is the person or a third party is held).

In step S302, the CPU 201 of the administrator terminal 121 determines whether the processing method input (selected) in step S301 is normal, illegal, or on hold.

When the selection of the fact that it is fraudulent (the image of a third party other than the person himself / herself) is accepted (step S302: fraudulent), the process proceeds to step S303.

When the selection of the fact that it is normal (the image of the person himself / herself) is accepted (step S302: normal), the process proceeds to step S304.

When the selection of the fact that it is on hold (to the effect that the determination of whether it is the person or a third party is put on hold) is accepted (step S302: hold), the process of this flowchart ends.

In step S303, the CPU 201 of the administrator terminal 121 processes the trail image to be processed as an image of a third party other than the teleworker himself, and ends the processing of this flowchart.

In step S304, the CPU 201 of the administrator terminal 121 processes the trail image to be processed as the image of the teleworker himself / herself, and whether or not the face image needs to be registered (the face image is used as the face image of the person for authentication). Whether to register or not) is accepted.

When the selection to register is accepted (step S304: TRUE), the process proceeds to step S306.

When the selection of not registering is accepted (step S304: FALSE), the process of this flowchart ends.

In step S305, the CPU 201 of the administrator terminal 121 determines whether or not the instruction to register the face image has been received from the administrator.

When the instruction to register is received (step S305: TRUE), the process proceeds to step S306.

When the instruction not to register is received (step S305: FALSE), the process of this flowchart ends.

In step S306, the CPU 201 of the administrator terminal 121 displays a list of images taken during the time zone determined to be spoofing (from the detection of spoofing to the change to another state), and lists the images. Accepts the selection of the image to be registered from the displayed images.

In step S307, the CPU 201 of the administrator terminal 121 accepts the selection in step S306 and registers the image for which the registration instruction has been received.

Then, the processing of this flowchart ends.

Next, with reference to FIG. 5, the process shown in the flowchart of FIG. 3 (process of registering an image determined as spoofing as an image of the person himself / herself) will be described.

The screen shown in FIG. 5A is an example of a screen displaying an image determined as spoofing. The screen shown in FIG. 5 is a screen displayed when the administrator logs in to the management server 101 via the administrator terminal 121 and gives an instruction to execute the audit process.

As shown in FIG. 5 (A), the image 501 determined as spoofing, the information 502 (account, name, etc.) about the teleworker, and the time zone 503 when spoofing occurred (transition to another state after spoofing is detected). 504 of images taken during the time when spoofing occurred, buttons for accepting input of processing contents (normal (face image) button 505, normal button 506, fraudulent button 507, cancel button 508) ) Is displayed.

Through the screen shown in FIG. 5A, the administrator terminal 121 accepts the selection (input) of the processing method for the displayed trail image from the administrator.

Specifically, the processing content is accepted by accepting the pressing of the buttons (normal (face image) button 505, normal button 506, illegal button 507, cancel button 508) that accept the input of the processing content.

In the flowchart of FIG. 3, when the fact that it is normal is input, the process of accepting the necessity of registering the face image is performed, but in the example of FIG. 5 (A), the normal (face image) button 505 is pressed. When pressed, both the input indicating that the image is normal and the input indicating that the face image needs to be registered are input.

FIG. 5B is a screen displayed when the normal (face image) button 505 is pressed in FIG. 5A (in the flowchart of FIG. 3, it is a screen displayed in the process of S306). ..

As shown in FIG. 5 (B), the face images taken during the time when the spoofing occurred are displayed in a list, and the check boxes 509 and the check boxes 509 for selecting the face images to be registered are checked. A registration button 510 that accepts an instruction to register a face image and a cancel button 511 that accepts an instruction to cancel the registration of a face image are displayed.

When the press of the registration button 510 is accepted, the selected face image is registered as an authentication image in the process of step S307.

In this way, the face image taken during the time period from the occurrence of spoofing to the transition to another state can be said to be an image of the same person because the state has not changed. Therefore, it is highly necessary to be able to register the face images taken in the time zone collectively, and by being able to register them collectively, it is possible to efficiently register the face images.

By the above processing, in addition to the face image registered in advance, an image determined by the administrator to be the person himself / herself from the images determined to be spoofed can be added to the face image for personal authentication. Therefore, it is possible to determine that the person is the person even if the angle and appearance have been previously determined to be another person, and it is possible to reduce the false rejection rate.

In addition, since it is possible to register a face image taken during work, it is possible to eliminate the trouble of creating various conditions and environments for registering an authentication image.

Next, a process of invalidating the registered face image will be described with reference to FIG.

The process of FIG. 4 identifies a face image having a low contribution (should not be used for authentication) from the registered face image according to the usage status of the image, and does not use the face image for authentication. It is a process to make it.

In step S401, the CPU 201 of the management server 101 collects the degree of contribution for each image registered as the image for authentication.

In step S402, the CPU 201 of the management server 101 calculates the overall contribution by multiplying the contribution collected in step S402 by coefficients that take various factors into consideration.

For example, the overall contribution is calculated in consideration of the number of times the image has been used, the time and frequency (whether it has been used in the last month or not for more than one month).

In addition, when calculating the overall contribution, position information (where the image was taken, where the image was when working) and time information (whether it was a morning photo or a daytime photo). It may be taken into consideration (whether it is a night photograph, etc.). This makes it possible to keep the face image, which is often used in a specific place or time zone, valid without invalidating it.

In addition, appearance such as lighting conditions, face orientation, presence / absence of makeup, and wearing glasses may be taken into consideration. By considering these conditions, in normal cases such as images that are often used under specific lighting conditions, images that are often used for specific face orientations, and images that are often used when wearing glasses. It is possible to keep images that are often used under certain conditions, although they are used infrequently, without invalidating them.

Regardless of which method is used, it is sufficient that the registered face images can be classified into those that are frequently used and those that are rarely used, and images that are not used can be identified.

In step S403, the CPU 201 of the management server 101 invalidates (or deletes) an image having a low contribution degree so that it will not be used in future authentication, based on the contribution degree calculated in step S402.

As a method of selecting the images to be invalidated, for example, 50 images may be valid in descending order of contribution and the rest may be invalidated.

In this way, by the process shown in the flowchart of FIG. 3, images taken in various environments can be registered as authentication images, but if the number of registered face images increases, it is another person. In addition, the probability of determining that the person is the person (other person's tolerance rate) increases. Therefore, as in the process shown in the flowchart of FIG. 4, among the registered face images, those that satisfy the conditions are controlled not to be used for authentication (invalidation, suspension of use, image itself). By deleting), it is possible to suppress the increase in the tolerance rate for others.

The present invention can be implemented as, for example, a system, an apparatus, a method, a program, a recording medium, or the like. Specifically, it may be applied to a system composed of a plurality of devices, or may be applied to a device composed of one device.

Further, the program in the present invention is a program in which a computer can execute the processing methods of the flowcharts shown in FIGS. 3 and 4, and the storage medium of the present invention is a program in which the computer can execute the processing methods in FIGS. 3 and 4. Is remembered. The program in the present invention may be a program for each processing method of each of the devices of FIGS. 3 and 4.

As described above, the recording medium on which the program that realizes the function of the above-described embodiment is recorded is supplied to the system or the device, and the computer (or CPU or MPU) of the system or the device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disc or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or the device, the system or the device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which each of the above-described embodiments and modifications thereof are combined are also included in the present invention.

101 Management server 111 Teleworker PC
121 Administrator's PC

Claims (7)

Using the authentication image registered in advance, a determination means for determining whether the person included in the captured image is the person related to the authentication image, and
When the determination means determines that the person included in the captured image is not the person related to the authentication image, the receptionist accepts an instruction as to whether or not to additionally register the captured image as the authentication image. Means and
A registration means for additionally registering an image for which an instruction to additionally register is received by the reception means as an authentication image, and
Among the authentication images registered by the registration means, the authentication image used for determining whether the person included in the image taken by the determination means is the person related to the pre-registered authentication image is determined in advance. Specific means to specify based on the usage situation in a specific environment with the number of sheets specified as the upper limit,
With
The determination means is characterized in that, using the authentication image specified by the specific means , it is determined whether or not the person included in the captured image is the person related to the pre-registered authentication image. Information processing system. The information processing system according to claim 1, wherein the usage status in the specific environment includes either a usage status at a specific position or a usage status at a specific time zone. The information processing system according to claim 1 or 2 , wherein the usage status includes any one of the number of times, the time, and the frequency in which the authentication image is used. Further provided with a display means for displaying an image determined that the person included in the captured image is not the person related to the authentication image.
The information processing system according to any one of claims 1 to 3 , wherein the receiving means registers the image displayed by the display means as an authentication image or accepts a selection. The display means is further characterized in that the image captured during a time zone in which it is determined that the person included in the captured image is not the person related to the authentication image is displayed.
The information processing system according to claim 4, wherein the reception means further accepts selection of an image to be registered as an authentication image among the images displayed by the display means. A determination step in which the determination means of the information processing system uses a pre-registered authentication image to determine whether the person included in the captured image is the person related to the authentication image.
When the receiving means of the information information system determines by the determination step that the person included in the captured image is not the person related to the authentication image, the captured image is additionally registered as the authentication image. The reception process that accepts instructions on whether or not to do it,
A registration step in which the registration means of the information processing system additionally registers an image that has received an instruction to additionally register in the reception process as an authentication image.
The identification means of the information processing system determines whether the person included in the image taken by the determination step among the authentication images registered by the registration step is the person related to the pre-registered authentication image. A specific process that specifies the authentication image used for the above based on the usage status in a specific environment up to a predetermined number of images, and
With
The determination step is characterized in that, using the authentication image specified by the specific step , it is determined whether or not the person included in the captured image is the person related to the pre-registered authentication image. Information processing method. A program for causing a computer to function as each means of the information processing system according to any one of claims 1 to 5 .

Images