JP7460054B2 - Verify System - Google Patents

Description

Concerning a verification system used in data input work.

There are a large number of documents on the market that consist of characters that have not been converted into text data (analog data characters), and in order to record or process character information, it is essential to convert the characters into text data. For this reason, a service that undertakes the conversion of character information consisting of analog data into accurate text data has been established as a business under the name "Data Input."

As part of the data input process, text data is acquired using an OCR device (optical character recognition device) based on the image data to be verified, and then the correctness of the text data acquired by the OCR device is confirmed (verification). A method is adopted in which this is done by humans. In other words, the data of the image to be verified and the text data obtained by the OCR device are displayed side by side on one screen, and the verification operator visually compares them and corrects the text data if there are any errors. be. The accuracy of text data conversion using OCR equipment is high at over 90% (excluding when the target is handwritten characters). However, since data input services require text data that is 100% identical to analog data, with the current technology, it is unlikely that visual verification by a verification operator will become unnecessary.

In data entry services, in order to avoid leakage of information to be verified, a strategy is adopted in which data entry targets such as slips are divided by item (items such as name, date of birth, product name, etc.). This is a method of passing the divided items to the verification operator without informing them of the type of item.

As a result of dividing the verification targets in this way, it is possible to select verification targets such as only those with the same attributes (types of characters such as numbers, alphabets, and kanji) or only those with the same number of digits. Verification work has varying degrees of difficulty depending on the target to be verified. For example, it is easier to work when the number of digits in a character is small. In addition, since there are fewer types of numbers, it is easier to work with them than with alphabets or kanji. Another feature of the alphabet is that even people from English-speaking countries can work with it. As a result of dividing the verification process, it has become possible to distribute the verification targets according to the abilities of the verification workers.

It can be said that the number of people who can engage in verification work has expanded significantly with the development of information networks such as the Internet. The data to be verified can be sent to the operator via an information network such as the Internet. For this reason, it is no longer necessary to carry out verification work by having a copy (printed on paper) to be verified on hand, as was the case in the past. Additionally, the verification worker can send the data of the work results to the administrator using the information network. The administrator can store such data and manage the work of verification workers. Furthermore, the location and time for performing the verification work can be selected to suit the operator's convenience.

By dividing the verification target, it is now possible to distribute the verification targets according to character attributes and number of digits, so even those with low verification ability can easily identify items whose attributes are numerical and have a small number of digits. They can become workers by targeting them.

Patent Document 1 describes a system that improves the efficiency of the data input work as described above regarding the method of displaying the verification target.

Patent No. 6294554

The objective of this application is to provide a system that utilizes the aforementioned background technology in data entry to determine the characteristics of the work of a verification worker.

It is an object of the present invention to provide a system that can target verification objects according to the characteristics of the work of the verification worker as a result of determining the characteristics of the work of the verification worker. Another object of the present invention is to provide a system that evaluates verification work according to the characteristics of the work. Another object of the present invention is to provide a system that can assign points to verification work according to the characteristics of the work. Another challenge is to expand work opportunities for people with disabilities by making it possible to work in ways that suit the characteristics of their disabilities.

(1) A verification system comprising a first verification by a first worker and a second verification by a second worker, in which in the first verification, character image data consisting of image information obtained from a verification target is compared with recognized text data obtained from the character image data to obtain first text data, and the first text data is obtained by maintaining data in the recognized text data that matches the character image data as is, and correcting data in the recognized text data that does not match the character image data so that they match; and in the second verification, the character image data is compared with the first text data to obtain second text data, and the second text data is obtained by maintaining data in the first text data that matches the character image data as is, and correcting data in the first text data that does not match the character image data so that they match; and the second verification is provided by comparing the character image data with the first text data to obtain second text data, and the second text data is obtained by maintaining data in the first text data that matches the character image data as is, and correcting data in the first text data that does not match the character image data so that they match; and the second text data is text data to be verified. The problem is solved by a verification system comprising a worker characteristic determination means for obtaining correctness information of the first text data and determining characteristics of the work of the first worker from the correctness information of the first text data.
(2) The problem is solved by the verification system described in (1), characterized in that information on the first worker's loss of concentration is obtained from the correct/incorrect information, and the characteristics of the first worker's work are judged based on the information on loss of concentration.
(3) The problem is solved by the verification system described in (1), which is characterized in that the correct/incorrect information is used to obtain information about characters that are easily confused by the first worker, and the characteristics of the first worker's work are determined based on the information about the characters that are easily confused.
(4) The problem is solved by a verification system according to any one of (1) to (3), characterized in that the verification system includes a work guideline determination means that is obtained according to the worker characteristics determined by the worker characteristic determination means.
(5) The problem is solved by a verification system described in any of (1) to (3), which is characterized in that it has a predetermined appropriate number of verification tasks or appropriate target information according to the characteristics of the worker, and a means for changing the appropriate number or targets of the verification tasks using the worker characteristic information determined by the worker characteristic determination means.
(6) The problem is solved by a verifying system according to any one of (1) to (3), characterized in that it includes a means for evaluating the worker characteristics determined by the worker characteristic determining means.
(7) The problem is solved by a verification system described in any of (1) to (6), characterized in that the system includes a means for acquiring information on the number of correct decisions made by the first worker from the correct/incorrect information, and a means for scoring the verification work using predetermined score information for each verification target and the information on the number of correct decisions made by the first worker.

Primary text data is text data obtained as a result of entry work. The correctness of the primary text data is determined through a secondary verification operation, that is, a verification operation in a narrow sense. If a verification worker in a narrow sense compares the text data obtained as a result of the entry work and the corresponding image data and determines that they do not match, the primary text data is determined to be "incorrect." "Correctness information of the primary text data" refers to information on the date and time when the primary verification operator made such an incorrect answer, and information on the target character for which the incorrect answer was given.

Loss of concentration information refers to information regarding the length of time that concentration can be maintained during the verification work, information regarding the time of day that concentration can be maintained and the relationship with the weather, etc.

Work guidelines refer to guidelines such as the time zone, duration, environment, and work target suitable for verification work.

By predetermining an appropriate number of verification tasks or targets for each worker according to the characteristics of the verification worker, efficient verification tasks can be achieved. Furthermore, it would be even more desirable if such provisions could be changed according to the characteristics of the worker, since this would allow for adaptation to the actual situation.

By adapting the evaluation method for verifying workers to suit their characteristics, it is possible to increase the verifying workers' motivation to work, which in turn leads to improved accuracy of the verification work results.

By determining the compensation for verification workers' work based on the characteristics of the worker, it is expected that the number of verification workers will increase.

It is possible to provide a system that can target verification targets according to the work characteristics of the worker. This makes it possible to raise or lower the level of verification targets, and to avoid verification targets that are deemed unsuitable based on their characteristics. This makes it possible to increase job opportunities for individuals with unique characteristics. It also makes it possible to maintain and increase motivation to work.

It is possible to provide a system that evaluates verification work according to the worker's work characteristics. This makes it possible to specifically grasp the improvement or decline in the worker's ability, and to specifically grasp the issues that need to be resolved in order to further improve the worker's work ability. This leads to training of workers, which improves their abilities as a result, and further increases the number of verification workers.

The "characteristics" mentioned here include the characteristics of people with disabilities due to their disabilities. For example, a person may be good at doing the same task for long periods of time, but have trouble building interpersonal relationships. People with these characteristics are suitable for verification work. Verification work can be made into a job by having the worker perform the work only in places and times when the work can be done without contact with other people. Another characteristic is, for example, that as long as the user can maintain concentration, he or she can perform accurate verification work, but the time that the user can maintain concentration is short. For people with such characteristics, by setting their working hours so that they take breaks in small chunks, they can make verification work their job. By being able to work in a way that suits the characteristics of their disability in this way, it is possible to expand employment opportunities for people with disabilities.

1 shows a hardware configuration of an administrator terminal according to a first embodiment. 1 shows the configuration of a verify system according to a first embodiment. 1 shows a flow of a verify operation in the first embodiment. 1 shows an overview of a system according to a first embodiment. 2 shows a work start program of Example 1. 3 shows a work status recording program according to the first embodiment. An example of work status information according to the first embodiment is shown. 3 shows a program for determining when concentration has been lost in the first embodiment. 13 shows an example of the avoidance information according to the first embodiment. 2 shows a work plan recording program according to the first embodiment. A verification target determination program 1 according to worker characteristics according to a second embodiment is shown. 11 shows a verification target determination program 2 according to an operator characteristic according to a second embodiment. 11 shows a verification target determination program 3 according to an operator characteristic of the second embodiment. An example of evaluation criteria according to worker characteristics in Example 3 is shown. Examples of points according to the object of verification are shown below. A point information acquisition program of Example 5 is shown.

Examples 1 to 5 will be described as preferred embodiments of the present invention.
In the first embodiment, the worker characteristics are determined based on the concentration loss information. The worker's work characteristics determined by the worker characteristic determining means are used to determine the work guideline for the worker.
In the second embodiment, the worker characteristics are used as a means for changing an appropriate work target or an appropriate amount of work that is predetermined for the worker.
In the third embodiment, the operator characteristics are used as a means for evaluating the operator.
In the fourth embodiment, the operator characteristics are determined based on information regarding characters that the operator is likely to make mistakes with.
In the fifth embodiment, a system for acquiring point information according to the work of a worker will be described.

In the description of Examples 1 to 5, the contents common to each example are explained in Example 1, and the explanations are omitted in Examples 2 to 5.

The meanings of terms used in this specification are as follows.

“Target document” refers to a document that is to be verified. All documents with text on them, such as product purchase orders, customer lists, withholding tax slips, etc., are eligible.

"Verification subject" refers to the object to be verified. For example, if the target document is a product purchase order, the verification subjects are the product name, product number, product unit price, order quantity, order date, etc., listed on the purchase order.

"Character image data" refers to the image data of the characters to be verified.

"Recognized text data" refers to text data of characters obtained by analyzing and recognizing the character data to be verified. "Recognized text data" is obtained, for example, using an OCR device.

“Item” refers to each item to be verified. For example, the information includes name, date of birth, My Number, product name, product number, product name, product number, product unit price, number of orders, and date of order.

"Character attributes" are the types of characters to be verified, such as "kanji/kana", "alphanumeric symbols", and "numbers".

"Verify" means to confirm the contents of text data.

“Verification worker” refers to a person who performs input to confirm data contents. In the specification, the term "verification worker" is used in two ways: "verification worker (in a broad sense)" and "verification worker (in a narrow sense)." There are two types of "verification workers (in a broad sense)": "primary verification workers" and "secondary verification workers." The "first verification" performed by the "first verification worker" is also referred to as "entry." The "secondary verification" performed by the "secondary verification worker" is also referred to as "verification (in a narrow sense)."

"Basic information on the verification target" is basic information for identifying the verification target, such as the slip on which the verification target is written and information on the person requesting the verification work.

"Clicking" refers to an operation of pressing and releasing a button on a pointing device or the like that moves a mouse cursor on a PC screen.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

FIG. 1 shows the hardware configuration of the administrator terminal 1. As shown in FIG. The administrator terminal 1 includes a control section 2 for controlling the entire system, as shown in FIG. An input device 6, a display device 7, a communication control device 8, and a storage device 10 are connected to the control section 2 via a bus line 9 such as a data bus.

The control unit 2 includes a CPU 3, a ROM 4, and a RAM 5. The CPU 3 performs various information processing and control according to programs stored in various storage units such as the ROM 4 and a storage device. The ROM 4 is a read-only memory in which various programs and data for the CPU 3 to perform various controls and calculations are stored in advance. The RAM 5 is a random access memory used by the CPU 3 as a working memory. In this RAM 5, various areas can be secured for performing various processes according to this embodiment.

The input device 6 is provided with a keyboard, a mouse, a touch panel, etc. (not shown). The keyboard is provided with various keys such as keys for inputting characters, a numeric keypad for inputting numbers, function keys for executing various functions, cursor keys, etc. The mouse is a pointing device, and is an input device that specifies a corresponding function by clicking on a key or icon displayed on the display device 7. The touch panel is an input device that is provided on the surface of the display device 7, and identifies the user's touch position corresponding to the various operation keys displayed on the screen of the display device 7, and accepts input of the operation keys displayed corresponding to the touch position.

The display device 7 may be a CRT or LCD display. This display device displays the results of input from the keyboard or mouse, as well as image information.

The communication control device 8 is a control device for establishing a network connection between the administrator terminal 1 and various external electronic devices such as other personal computers. The communication control device 8 is capable of accessing the administrator terminal 1 from these various external electronic devices, and can input search condition statements from the external electronic devices.

The storage device 10 is composed of a readable/writable storage medium and a drive for reading and writing various information such as programs and data from the storage medium. A hard disk is primarily used as the storage medium for this storage device 10. The storage device 10 has a data storage unit 11, a program storage unit 12, and other storage units (not shown) (for example, storage units for backing up programs, data, etc. stored in the storage device 10). The data storage unit 11 stores data required by the system in this embodiment, as described below. The program storage unit 12 stores various processing programs in this embodiment, as described below.

The administrator terminal 1 of this embodiment can be configured not only as a computer system, but also as a LAN server, a computer communication host, a computer system connected to the Internet, etc. It is also possible to distribute functions to each device on the network and have the same configuration as the administrator terminal 1 over the entire network.

As shown in Figure 2, the verification system consists of an administrator's computer, an entry worker's (primary verification worker) computer, and a verification worker's (secondary verification worker) computer connected to a network or LAN, etc. connected by an information and communication network. The verification system can be configured not only by a computer system but also by a LAN server, a computer communication host, a computer system connected to the Internet, and the like.

As shown in FIG. 1, the storage device 10 includes a data storage section 11 and a program storage section 12 .
The data storage unit 11 includes:
(a) a worker information recording device;
(b) a recording device to be verified;
(c) a work status information recording device;
(d) worker characteristic information recording device;
(e) a device for recording objectionable information;
(f) a work plan information recording device;
(g) an evaluation criteria recorder;
(h) Equipped with a point recording device according to the object to be verified.
The program storage unit 12 includes:
(i) Work start processing;
(j) Work status record processing,
(k) processing for determining when concentration is lost;
(l) Work plan record processing;
(m) Verification target determination process;
(n) Point information acquisition process.

(a) The worker information recording device records basic information about the verifying worker (such as address, name, sex, age, and other characteristics). It also records the verification work that has been performed so far.

(b) The verification target recording device records basic information of the verification target (requester information, target document, verification delivery time, other characteristics, etc.). Also, character attributes for each item of the target document are described. Also, character image data and recognized text data used for verification work are recorded.

(c) The work status information recording device records the work status information obtained by the work status recording process program (h) shown in FIG. 6. The work status information is shown in FIG. 7.

(d) The worker characteristic information recording device records the worker characteristic information determined from the work situation information recorded in the (c) work situation information recording device. One of the worker characteristic information is the worker characteristic regarding the time of loss of concentration obtained by the (i) program for determining the time of loss of concentration.

(e) The avoidance information recording device records information listing avoidance matters according to worker characteristics. The avoidance information is illustrated in FIG.

(f) The work plan information recording device records information about the work plan for the verification work performed by the verifying worker. For example, the work plan information obtained by the work plan recording processing program (j) shown in FIG. 10 is recorded.

(g) The evaluation criteria recording device lists evaluation criteria according to the characteristics of the workers. Examples of evaluation criteria according to the characteristics of the workers are shown in FIG. 14.

(h) The points recording device according to the verification target lists the points according to the verification work. The points according to the verification work are illustrated in FIG. 15.

(i) The work start processing program is a program for causing the computer to execute the work start function of the primary verification, and is processed by the CPU of the administrator's computer. The work start processing program is illustrated in FIG.

(j) The work status recording processing program is a program for causing a computer to execute the work status recording function, and is processed by the CPU of the administrator's computer. An example of the work status recording processing program is shown in FIG. 6.

(k) The loss of concentration determination processing program is a program for causing the computer to execute the function of determining loss of concentration, and is processed by the CPU of the administrator's computer. The processing program for determining when concentration is lost is illustrated in FIG.

(l) The work plan recording processing program is a program for causing a computer to execute a work plan recording function, and is processed by the CPU of the administrator's computer. The work plan record processing program is illustrated in FIG.

(m) The verification target determination processing program according to the operator characteristics is a program for causing a computer to execute a verification target determination function according to the operator characteristics, and is processed by the CPU of the administrator's computer. Examples of the verification target determination processing program according to the operator characteristics are shown in Figures 11, 12, and 13.

(n) The point information acquisition processing program is a program for causing a computer to execute a point information acquisition function, and is processed by the CPU of the administrator's computer. is illustrated in FIG.

The flow of verification work will be explained with reference to FIG. As will be described later in S2 and S4, verification is performed in two stages: by an entry worker and by a (narrowly defined) verification worker. The work performed by both of them is verification work (in a broad sense), and both workers can be said to be verification workers (in a broad sense). Therefore, the verification work performed by the entry worker will be referred to as the primary verification work, and the entry worker will be referred to as the primary verification worker. Further, for the same purpose, the verification work performed by a verification worker (in a narrow sense) is referred to as a secondary verification work, and the verification worker (in a narrow sense) is referred to as a secondary verification worker.

S1: The administrator displays target data for the primary verification work on the verification work screen performed by the primary verification worker.
The administrator converts the characters to be verified into image data and records them as character image data a in the verification target recording device (b). The administrator obtains recognized text data b from character image data a using OCR and records it in the verification target recording device (b). The administrator displays the character image data a and the recognized text data b side by side on the work display of the primary verification worker's computer.

S2: The first verification worker performs the first verification work. The first verification worker compares the character image data a with the recognized text data b, and if the character image data a and the recognized text data b are identical, the first verification worker leaves the recognized text data b unchanged, but if the character image data a and the recognized text data b are different, the first verification worker changes the recognized text data b to text data b' so that it is the same as the character image data a, and records the unedited recognized text data b and the changed text data b' in the work status information recording device (c) as the results of the first verification work.

S3: The administrator displays the target data for the second verification operation on the verification operation screen to be performed by the second verification operator.
The manager displays the text data (b and b') recorded in the work status information recording device (c) as a result of the first verification work as text data c, together with the character image data a recorded in the verification target recording device (b), on the work display of the computer of the second verification worker.

S4: The secondary verification worker performs the secondary verification work. The secondary verification worker compares the character image data a and the text data c, and if the character image data a and the text data c are identical, the secondary verification worker leaves the text data c unchanged, but if the character image data a and the text data b are different, the secondary verification worker changes the text data c to text data c' so that it is the same as the character image data a, and records the unchanged text data c and the changed text data c' in the work status information recording device (c) as the results of the secondary verification work.

S5: If the character image data a and the text data b are different, the second verification operator records in the work status information recording layer (c) that there was an error in the first verification work.

S6: The administrator records the text data (c and c') recorded in the work status information recording device (c) as a result of the second verification work as text data d.
Verification work is completed.

In addition, in Fig. 3, the explanation was made as if the operations were performed in the order of S1, S2, S3, S4, S5, and S6 for one verification target, but in reality, there are hundreds of operations shown in S1 to S2. A number of operations such as this are performed and recorded as the results of the first verification operation, and after that, the operations shown in S3 to S6 are similarly performed several hundred operations at intervals and recorded as the results of the second verification operation. It is done in this order.

An overview of the verify system of the first embodiment will be explained with reference to FIG.
The administrator of the verification system stocks a large number of verification workers who perform verification work, and acquires and records information on each verification worker (S7). Additionally, the administrator obtains and records information to be verified (S8).

The administrator instructs the first verification worker to perform the first verification work. The first verification worker performs the verification work using a system managed by the administrator. The first verification work is performed as shown in S1 to S2 in Figure 3. When the first verification worker starts the verification work (S9), the first verification work start program (Figure 5) functions. When the first verification work starts, the work status recording program (Figure 6) functions, and the work status is acquired and recorded (S10).

The administrator instructs the secondary verification worker to perform the secondary verification work. The secondary verification worker performs verification work using the system managed by the administrator. The second verify operation is performed as shown in S3 to S6 in FIG. 3. In the second verification work, the correctness information of the work result of the first verification work is acquired and recorded (S5 in FIG. 3, S11 in FIG. 4).

The characteristics of the worker are determined and recorded based on the information recorded in the work situation recording device (c) (S12). An example of worker characteristics is characteristics related to loss of concentration (FIG. 8). Another example of worker characteristics is information regarding characters that workers tend to make mistakes. The worker characteristics are used when creating a work plan (S13) and as a basis for determining which verification target is appropriate for the worker (S14). Specifically, it is as follows.

In creating the work plan (S13), as shown in FIGS. 9 and 10. List "avoidances" from the viewpoint of concentration duration and correct answer rate, and make it impossible to plan tasks that fall under the avoidance matters.

When determining the appropriate verification target for the worker (S14), if the worker's correct answer rate increases, it is determined that the verification worker's ability has improved, and the level of the verification target is increased (Fig. 11, 12). When the correct answer rate becomes low, it is determined that the verification worker's ability has decreased, and the level of the verification target is lowered (FIG. 13).

The verification work start program will be explained with reference to FIG. In each of the following embodiments, the main body of program processing is the CPU of the administrator's computer. The verification worker sends information to start the verification work to the administrator computer via an information communication network such as the Internet. The CPU of the administrator computer receives information (instruction) to start work (S15). The CPU refers to the (f) work plan information recording device in the storage device and determines whether there is a work plan (S16). If there is no work plan, the work is started (S20). If there is a work plan, it is determined whether the instruction to start work matches the work plan (S17). That is, for example, it is determined whether the work time matches the work plan. If the instruction to start the work matches the work plan, the work is started (S20). If the instruction to start work does not match the work plan, a warning is given (S18). Specifically, for example, the reason why the work plan does not match is listed and requests are made for improvements to make it match. After calling the worker's attention, the CPU confirms the worker's intention as to whether or not to change the work plan (S19). Specifically, for example, a selection screen asking whether to change the work plan is displayed and the worker's answer is obtained. If the worker chooses not to change the work plan, the work starts (S20). If the worker selects to change the work plan, for example, a screen for changing the work is displayed, and the worker changes the work plan (omitted). The CPU checks again whether the work plan matches (S17), and if it matches, starts the work (S20). When the verification operation starts, the CPU records this fact and the program ends.

The work status recording program for the first verification work will be described with reference to FIG. 6. When the CPU acquires work start information (S21), it stores the date and time when the work started in the (c) work status information recording device of the storage device (S22). When the first verification is performed, the contents of the verification and the verification date and time are stored as verification information in the (c) work status information recording device (S23). When the work is completed, the CPU acquires work completion information from the worker (S25). The CPU records the work completion date and time (S26).

FIG. 7 shows an example of recorded work status information.
The "verification target number", "character image data a", and "recognition text data b" are information recorded in the verification target recording layer (b).
The "start date and time", "entry date and time", and "entry result c" are recorded by the work status recording program of the first verification work.
The "time required for entry" is calculated for each verification target from the "start date and time" and the "entry date and time" by time calculation software (not shown).

"Verification result d" is recorded when the work status of the second verification work is recorded (Fig. 3, S6). When the second verification work records that there was an error in the first verification work (Fig. 3, S5), the "c (incorrect) → d (correct)" data and "Entry correct" data in the table in Fig. 7 are filled in. The "c (incorrect) → d (correct)" data shows what characters the first verification worker made a mistake with and how.

The program for determining when concentration is lost will be explained with reference to FIG. (c) The CPU searches for incorrect answers from the information recorded in the work status information recording device in order from the oldest information, and obtains the oldest incorrect answer information (S27).

The CPU (c) acquires the wrong answer information of the wrong answer that occurred after the wrong answer acquired in S27 from the information recorded in the work status information recording device (S28). The CPU obtains the elapsed time between S27 and S28 (S29). The CPU determines whether the elapsed time obtained in S29 is within 2 seconds (S30). If the elapsed time is less than 2 seconds, the error is recorded in the (c) work status information recording device as a "need for attention" because the errors have continued in a short period of time (S31). Repeat S28 to S30.

If the elapsed time obtained in S29 exceeds 2 seconds, the CPU determines whether the item recorded as "needing attention" has been recorded three or more times (S26). If it has been recorded as "Caution required" three or more times, the CPU determines that the worker has lost concentration (S33), and records the time at which it was determined in the d) worker characteristic information recording device (S34). The CPU records the concentration duration in d) the worker characteristic information recording device (S35).

Identify avoidance matters according to worker characteristics and (e) record them in the avoidance matter information recording device. The avoidance items are as illustrated in FIG. 9 . For example, if the duration of concentration is N minutes, it is a matter of avoidance that the work time continues for more than N minutes. For example, if the worker has a work characteristic in which the correct answer rate is less than 80% from N o'clock to M, setting the work time from N o'clock to M o'clock should be avoided. Further, for example, if the worker has a work characteristic that he is not good at inputting symbols, it is important to avoid setting a verification target that includes symbols. For example, if a worker has a work characteristic that makes many incorrect answers on days when the atmospheric pressure is low, starting work on days when the atmospheric pressure is low is a matter to be avoided. Further, for example, if a worker has a work characteristic in which he or she often makes incorrect answers when working in a place where there are people around, starting work in a place where there are people around is a matter to be avoided.

The work plan recording program will be described with reference to FIG. 10. When creating a work plan, it is determined whether the contents to be set correspond to the avoided items (S36). The avoidance is recorded in the work plan information recording device (f) (S38). Work plans are mainly set by managers. In some cases, work plans are planned by workers.

An example in which worker characteristics are used as a means for changing an appropriate work target or an appropriate amount of work predetermined for a worker will be described.

The verification target determination program 1 according to the operator characteristics will be described with reference to FIG. 11.) This is an example of a case where the appropriate target for the operator, as determined in advance, is "four-digit numbers." The verifying operator has gained a certain amount of verification experience over a certain period of time, and as a result, has become able to make correct judgments with very high accuracy for "four-digit numbers." Therefore, it is determined whether the accuracy rate for four-digit "numbers" is higher than 99% for 1000 consecutive times (S39). If it is high, the level of the target that can be verified is raised, and six-digit "numbers" are added to the targets that can be verified (S40).

When workers improve their level of verification through their own experience and efforts, it gives them confidence and leads to higher wages. This in turn increases motivation to work, creating a virtuous cycle.

The verification target determination program 2 according to worker characteristics will be explained with reference to FIG. This is an example where the appropriate work target predetermined by the worker is "an eight-digit number." If a high correct answer rate is obtained for "8-digit number", the attribute level can be raised from "number" to "alphanumeric" mixed with "English". Therefore, it is determined whether or not the correct answer rate for "8-digit number" is higher than 99% for 1000 consecutive times (S41). If it is high, the attribute "alphanumeric characters" is added to the objects that can be verified (S42).

The verification target determination program 3 according to the worker characteristics will be described with reference to FIG. 13. This is an example of a case where the worker's ability has deteriorated, but the predetermined appropriate task target for the worker was "four-digit alphanumeric symbols." It is determined whether the correct answer rate for 1000 consecutive attempts for "four-digit alphanumeric symbols" is lower than 97% (S43). If it is lower, the level of the verifiable target is lowered, and the attribute "alphanumeric symbols" is removed from the verifiable targets (S44). If the number of incorrect answers increases, the verification work will no longer be viable as work, so the appropriate task target level for such a worker is lowered and the workload is also reduced.

With reference to FIG. 14, an example (Example 3) in which worker characteristics are used as a means for evaluating workers will be described. As shown in FIG. 14, evaluation criteria according to the worker characteristics are patterned and determined in advance, and the worker characteristics are grasped by the verify system according to the present application, and the worker is evaluated according to the worker characteristics. Specifically, such evaluations are periodically communicated to the worker via the Internet.

For example, in the case of a worker who has the characteristic of being "good at continuing the same task," it is considered relatively easy to increase the time for which the task can be continued without making incorrect answers. Therefore, for example, in order to instill confidence in a worker who has the characteristic of being ``good at continuing the same task,'' as shown in the table, the subject of evaluation is the length of time without making an incorrect answer. In other words, on a five-point scale from A to E, where A is the best, if the time without incorrect answers increases by 8 minutes, the score is A, and if the time without incorrect answers increases by 6 minutes, the score is B. , if the time without wrong answers increases by 4 minutes, the grade will be C, if the time without wrong answers increases by 3 minutes, the grade will be D, and if the time without wrong answers increases by 1 minute, the grade will be E. .

For example, in the case of a worker who has the characteristic of having a short concentration time, the evaluation target is not to require a very long work time, but to increase the number of incorrect answers within a short time. By doing so, you can give workers confidence. In other words, on a five-point scale from A to E, where A is the best, if there are zero incorrect answers in 8 minutes, the score is A, if there is one incorrect answer in 8 minutes, the score is B, and if there is no incorrect answer in 8 minutes, the score is B. If there are 2 incorrect answers, a C rating will be given, if there are 3 incorrect answers within 8 minutes, a D rating will be given, and if there are 4 incorrect answers within 8 minutes, an E rating will be given.

For example, in the case of a worker who has the characteristic of "having difficulty distinguishing between the numbers 3 and 8," it is thought that the rate of correct answers will rise dramatically if such a weakness is eliminated, so by making "whether or not the number 3 is answered incorrectly" the evaluation target is expected to produce effective results. That is, on a five-point scale from A to E, with A being the best, if there are zero incorrect answers to the number 3 out of 100 verification targets, the evaluation will be A; if there are one to three incorrect answers to the number 3 out of 100 verification targets, the evaluation will be B; if there are four to six incorrect answers to the number 3 out of 100 verification targets, the evaluation will be C; if there are seven to nine incorrect answers to the number 3 out of 100 verification targets, the evaluation will be D; and if there are ten to thirteen incorrect answers to the number 3 out of 100 verification targets, the evaluation will be E.

In the fourth embodiment, the worker characteristics are determined based on information regarding characters that the worker is likely to make mistakes. (c) Based on the data of “c (incorrect) → d (correct)” of the work situation information (Fig. 7) recorded in the work situation information recording device (Fig. 1), the first verification worker Data is accumulated from the perspective of how mistakes were made.

Assume that the data accumulated in "c (incorrect) → d (correct)" indicates that, for example, a certain worker has a high frequency of incorrectly determining "7" as "1". The operator is notified that ``7'' is frequently mistakenly judged as ``1,'' and cautioned to avoid making such mistakes.

For example, the following is a case where the three numbers "9," "6," and "3" are frequently entered by mistake. These three numbers have in common that they are entered with the ring finger on the numeric keypad, which is a keyboard for entering numbers, so the worker is notified and alerted that they need to be careful when entering them with the ring finger.

In the fifth embodiment, a system for acquiring point information according to the work of a worker will be described. Points are set in advance according to the object to be verified, and (h) are recorded in a point recording device (FIG. 1) according to the object to be verified.

FIG. 15 illustrates points depending on the verification target. Points are set from the following viewpoints. If the accuracy of converting text data by the OCR device is high, the points will be set low because the verification operator will need to make fewer corrections to the text data, and if the accuracy of converting text data by the OCR device is low, the points will be set low. set high. From this point of view, for example, if the target to be verified is print, if it consists only of numbers, then 1 point per verified target, if it consists of a mixture of English and numbers, 2 points per verified target, and if it consists of only numbers, 2 points per verified target, hiragana, katakana and kanji. In the case that the verification target includes the following items (in the case of Japanese), 3 points will be awarded for each verification target. Also, for example, if the target to be verified is handwritten characters, if it consists only of numbers, 1.5 points per target to be verified, if it consists of a mixture of English and numbers, .3 points per target to be verified, hiragana, katakana, kanji. (in the case of Japanese), it is set as 6 points per verification target.

The point information acquisition program will be explained (FIG. 16). The CPU acquires work completion information from the worker (S45). (c) The CPU acquires and records the time required for the work based on the information recorded in the work status information recording device (S46). The CPU (c) acquires verification target information for the work based on the information recorded in the work status information recording device (S47). (c) Based on the information recorded in the work status information recording device, the CPU acquires the number of correct decisions made by the worker during the work (S48). (h) The CPU acquires the points corresponding to the verification target acquired in S47 based on the information recorded in the point recording device according to the verification target, and multiplies these points by the number of items acquired in S48. The value obtained by multiplying is recorded in the (c) work status information recording device as point information for the work (S49). The recorded points can then be communicated to the operator by various means. For example, it is displayed on the worker's work screen when the work is completed. It is also displayed on the work screen according to the worker's request.

When the work is training to improve the worker's ability, the point information of the work is used as an index representing the worker's ability. By knowing the key points, workers can use this as an opportunity to improve their abilities. Further, if the work is the labor of a worker, the point information is converted into money and used as the worker's wage. When workers know the key points, it leads to an increase in their motivation to work.

Claims (3)

A verification work characteristic determination system that acquires text data corresponding to characters of analog data from characters of analog data , and determines work characteristics of correctness confirmation work performed on the text data. ,
primary text data acquisition means for acquiring primary text data recorded by a primary worker;
a secondary text data acquisition means for acquiring secondary text data recorded by a secondary worker;
A verify work characteristic judgment system comprising a worker characteristic judgment means for judging the worker characteristics of a primary worker,
The primary text data acquisition means includes:
Character image data consisting of image information acquired from characters of analog data and recognized text data acquired from the character image data are compared,
obtaining the recognized text data that is determined to match the character image data as primary text data;
obtaining the recognized text data that is determined not to match the character image data as primary text data after being corrected to match the character image data;
The second text data acquisition means includes :
the character image data and the primary text data are compared;
Of the primary text data, that which is determined to match the character image data is obtained as secondary text data;
modifying the primary text data that is determined not to match the character image data to match the character image data and acquiring it as secondary text data;
The worker characteristic determining means includes :
For those of the primary text data that are determined to match the character image data by the secondary text data acquisition means.
It is determined that the correct confirmation of errors was made by the primary worker,
It is determined that the primary worker has erroneously confirmed the authenticity of the primary text data that is determined not to match the character image data;
It is determined that the primary worker's incorrect confirmation of correctness is caused by the primary worker's loss of concentration, and the worker's characteristics are determined based on information regarding the time, environment, or work object at which the loss of concentration occurred. is determined,
Provide guidelines regarding the appropriate time period or duration of work for the primary worker,
A verify work characteristic judgment system comprising a work guideline judgment means that makes a judgment according to the time when the loss of concentration occurs. The verification work characteristic determination system according to claim 1,
guidelines regarding the environment suitable for the work of the primary workers,
A verification work characteristic judgment system characterized by comprising a work guideline judgment means for making a judgment according to the environment in which loss of concentration has occurred. 2. The verify task characteristic determination system according to claim 1,
A guideline regarding a work object suitable for the work of the first worker,
A verify task characteristic judgment system comprising a task guideline judgment means for making a judgment according to a task subject where concentration loss has occurred.

Images