JP6357871B2 - Information collection method, information collection system, and computer program - Google Patents

Description

  The present invention relates to a technique for collecting information written on a sheet or the like.

  Conventionally, in order to apply for a service or a product, it is often performed that an applicant inputs information into a predetermined form and submits the information to a provider. The questionnaire is conducted in the same way.

  Further, in recent years, web technology is often used for exchanging information in a form. For example, the provider prepares in advance a web page for inputting a name, an address, and details of an order. The applicant accesses his / her web page by operating his / her personal computer or smartphone, inputs these items, and submits them to the provider.

  On the other hand, it is still performed that an applicant fills in a predetermined information by handwriting on a printed matter on which a form is printed and submits it to a provider. However, in recent years, computer technology is often used in handling written information.

  According to the technique described in Patent Document 1, when entry data is entered in the entry field of an unfilled form electronic document, the file name is recorded in the file name area and the first form electronic document is generated. It is printed and stamped to create the original. The document acquisition unit acquires the second form electronic document from the image in the file name area of the original image data generated by reading the original. The collation unit collates the original image data and the second form electronic document. If they match, the entry data of the second form electronic document is registered in the database, and the stamp image of the original image data is stored in the second form electronic document. The original form electronic document is generated by being inserted.

  According to the technique described in Patent Document 2, the user first fills in a predetermined printed matter. The authentication system receives information entered by the user as data, and creates an electronic document based on the received entry information. Furthermore, the authentication system creates a code that identifies the created electronic document. Then, the authentication system attaches or affixes identification information for uniquely identifying the code and the created electronic document to the printed material as authentication information. Thereafter, for example, after performing a predetermined operation, the authentication system detects whether the printed material or the electronic document is falsified based on the authentication information attached to or attached to the printed material.

JP 2013-30096 JP 2004-54594 A

  By the way, the respondent may not only write the answer on the form but also modify a part of the form written on the form. Such modifications may not be desirable.

  However, according to the conventional technique, it is not easy to collectively perform a process of extracting written information from a sheet and a process in which information previously written on the sheet is modified.

  In view of such problems, an object of the present invention is to more easily perform extraction of writing information added to a sheet and detection of alteration of existing information previously written on the sheet.

Information collection method according to an embodiment of the present invention, the recording medium having one or more second region is a plurality of first area and the other area which is an area for adding writing information, Write a code indicating the first position for each of the first areas, the second position for each of the second areas, and the first characteristic of the marked image, and An access right is set for each of the images, and an image written in the same position as the first position indicated by the code included in the read image in the read image that is an image read from the recording medium Is extracted as additional information, and the extracted additional information is output in accordance with the access right set in the first region from which the additional information is extracted among the plurality of first regions, and the read image Before being included in the scanned image The difference between the second feature of the image indicated at the same position as the second position indicated in the code and the first feature corresponding to the second position indicated in the code is a predetermined value. When the range is exceeded, the second region at the second position is extracted as a modified region.

  Preferably, the recording medium is a sheet, the code is a two-dimensional barcode, the first area and the second area are provided on one surface of the recording medium, and the code is Mark it on the other side.

Information collection method according to another embodiment of the present invention, recording with the one or more second region is a plurality of first area and the other area which is an area for adding write information A code indicating the storage location of the feature data in which the first position for each of the first regions, the second position for each of the second regions, and the first feature of the recorded image is recorded on the medium. The access right is set for each of the plurality of first areas, and the feature data is acquired from the storage location indicated by the code included in the read image that is an image read from the recording medium. In the read image, an image written at the same position as the first position recorded in the feature data is extracted as additional information, and the extracted additional information is used as the plurality of first information. The additional information in the area of Output in accordance with the access right set in the first area, and the second image of the image recorded at the same position as the second position recorded in the feature data in the read image When the difference between the feature and the first feature corresponding to the second position indicated in the feature data exceeds a predetermined range, the second region at the second position is changed to the modified region. Extract as

  Preferably, the recording medium is a sheet, the code is a two-dimensional barcode, and the code is written on a surface of the recording medium on which the first area and the second area are provided. .

  Alternatively, when the image is not written at the same position as the first position indicated by the code included in the read image in the read image, the first position corresponding to the first position An area is extracted as an unfilled area.

  Alternatively, the read image is processed and output so as to indicate the extracted additional information, the modified area, and the unwritten area.

  Alternatively, the first feature is the number of dots constituting the image written in the second region, and the second feature is an image written at the same position as the second position. This is the number of dots that compose.

  According to the present invention, it is possible to more easily perform extraction of additional information written on a sheet and detection of alteration of existing information previously recorded on the sheet.

It is a figure which shows the example of the whole structure of a handwritten information collection system. 2 is a diagram illustrating an example of a hardware configuration of an image forming apparatus. FIG. It is a figure which shows the example of the hardware constitutions of a terminal device. It is a figure which shows the example of a functional structure of the terminal device implement | achieved by the program for reply. It is a figure which shows the example of a functional structure of the terminal device implement | achieved by the program for distribution check. It is a figure which shows the example of an application form. It is a figure which shows the example of a structure of an answer form data provision part. It is a figure which shows the example of the position of the object which comprises an application form. It is a figure which shows the example of an application form. It is a figure which shows the example of an application form. It is a figure which shows the example of the surface of an application form. It is a figure which shows the example of a structure of an answer paper check part. It is a figure which shows the example of a check result image. It is a flowchart which shows the example of the flow of the whole process in a terminal device. It is a flowchart which shows the example of the flow of a process of provision of an application form. It is a flowchart which shows the modification of the flow of a process of provision of an application form. It is a flowchart which shows the example of the flow of a process of an answer check. It is a flowchart which shows the example of the flow of a process of an answer check. It is a figure which shows the modification of the form of an entry column object and an entry prohibition column object. It is a figure which shows the example which conceals a part of application form.

  FIG. 1 is a diagram showing an example of the overall configuration of the handwriting information collection system 4. FIG. 2 is a diagram illustrating an example of a hardware configuration of the image forming apparatus 1A. FIG. 3 is a diagram illustrating an example of a hardware configuration of the terminal device 2A. FIG. 4 is a diagram illustrating an example of a functional configuration of the terminal device 2A realized by the answer program 2AP. FIG. 5 is a diagram illustrating an example of a functional configuration of the terminal device 2B realized by the distribution check program 2BP.

  The handwritten information collecting system 4 collects information written by a user with a pen on a sheet on which a form for answering a predetermined matter is printed. Hereinafter, this form is referred to as “answer form”, and the sheet on which the answer form is printed is referred to as “answer form”.

  As shown in FIG. 1, the handwriting information collection system 4 includes image forming apparatuses 1A and 1B, terminal apparatuses 2A and 2B, scanners 2K and 2L, a server 3, a communication line NW, and the like. These devices can communicate with each other via a communication line NW. As the communication line NW, the Internet, a local area network (LAN), a public line, a dedicated line, or the like is used.

  The image forming apparatus 1A, the terminal apparatus 2A, and the scanner 2K are operated by a user who provides information (that is, a respondent). On the other hand, the image forming apparatus 1B, the terminal apparatus 2B, and the scanner 2L are operated by a user who collects information.

  The image forming apparatus 1A is an image processing apparatus generally called a multifunction peripheral or MFP (Multi Function Peripherals), and is an apparatus in which functions such as a copy, a printer, a fax, and a scanner are integrated.

  As shown in FIG. 2, the image forming apparatus 1A includes a CPU (Central Processing Unit) 10a, a RAM (Random Access Memory) 10b, a ROM (Read Only Memory) 10c, an auxiliary storage device 10d, a touch panel display 10e, and an operation key panel 10f. , A NIC (Network Interface Card) 10g, a modem 10h, a scan unit 10i, an image processing unit 10j, a print unit 10k, and the like.

  The touch panel display 10e displays a screen showing a message for the user, a screen for the user to input a command or information, a screen showing a result of processing executed by the CPU 10a and the like. Further, the touch panel display 10e sends a signal indicating the touched position to the CPU 10a.

  The operation key panel 10f is a so-called hardware keyboard, and includes a numeric keypad, a start key, a stop key, a function key, and the like.

  The NIC 10g communicates with a device such as the terminal device 2A or the server 3 using a protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol).

  The modem 10h exchanges image data with a facsimile terminal using a protocol such as G3.

  The scan unit 10i reads an image written on a sheet set on a platen glass and generates image data.

  The image processing unit 10j performs processing such as resolution conversion, inclination correction, and top / bottom correction on the image data obtained by the NIC 10g, the modem 10h, or the scan unit 10i.

  In addition to the image read by the scan unit 10i, the print unit 10k appropriately processes an image received from another apparatus by the image processing unit 10j, and then prints it on a sheet.

  The ROM 10c or the auxiliary storage device 10d stores software for realizing the above-described functions such as copying.

  Programs or modules constituting these software are loaded into the RAM 10b as necessary and executed by the CPU 10a. A hard disk, SSD (Solid State Drive), or the like is used as the auxiliary storage device 10d.

  Similar to the image forming apparatus 1A, the image forming apparatus 1B is an image processing apparatus called a multifunction peripheral or MFP. Therefore, the image forming apparatus 1B is configured similarly to the image forming apparatus 1A.

  The terminal device 2A is a client for allowing a user to remotely receive various services provided by the image forming apparatus 1A. The terminal device 2A is used for entering information on an answer sheet.

  As the terminal device 2A, a personal computer, a tablet computer, a smartphone, or the like is used. Hereinafter, a case where a notebook personal computer is used as the terminal device 2A will be described as an example.

  As illustrated in FIG. 3, the terminal device 2A includes a CPU 20a, a RAM 20b, a ROM 20c, an auxiliary storage device 20d, a touch panel display 20e, a keyboard 20f, a pointing device 20g, a NIC 20h, and the like.

  The touch panel display 20e displays a screen for giving a message to the user, a screen showing a result of processing, a screen for the user to input a command, and the like. The touch panel display 20e detects the touched position and notifies the CPU 20a of the position.

  The keyboard 20f and the pointing device 20g are used by the user to input commands and conditions.

  The NIC 20h communicates with an apparatus such as the image forming apparatus 1A, the scanner 2K, or the server 3 using a protocol such as TCP / IP.

  The ROM 20c or the auxiliary storage device 20d stores an answer program 2AP in addition to drivers for the image forming apparatus 1A and the scanner 2K. These programs are loaded into the RAM 20b as necessary and executed by the CPU 20a. A hard disk or SSD is used as the auxiliary storage device 20d.

  According to the reply program 2AP, functions such as the reply form data acquisition unit 201, the print request unit 202, and the reply processing unit 203 illustrated in FIG. 4 are realized.

  The scanner 2K is used to scan an answer sheet on which information is handwritten. The scanner 2K communicates with the terminal device 2A via the communication line NW, but may communicate via a USB (Universal Serial Bus) cable or the like.

  Similarly to the terminal device 2A, the terminal device 2B is a computer such as a personal computer, a tablet computer, or a smartphone. Hereinafter, a case where a notebook personal computer is used as the terminal device 2B will be described as an example. Therefore, the hardware configuration of the terminal device 2B is the same as the hardware configuration of the terminal device 2A, as shown in FIG.

  However, the terminal device 2B performs a process of distributing an answer form and a process of verifying (checking) whether or not the contents handwritten on the answer sheet are incomplete. The terminal device 2B is used together with the image forming apparatus 1B and the scanner 2L. Therefore, the ROM or auxiliary storage device of the terminal device 2B stores a distribution check program 2BP, a driver of the image forming apparatus 1B, and a driver of the scanner 2L.

  According to the distribution check program 2BP, functions such as the answer form data providing unit 221 and the answer sheet check unit 222 shown in FIG. 5 are realized.

  The scanner 2L is used to scan the answer sheet that has been handwritten. The scanner 2L communicates with the terminal device 2B via the communication line NW, but may communicate via a USB cable or the like.

  The server 3 stores answer form data (feature data 66 to be described later) and provides this data upon request. A so-called server machine is used as the server 3. The server 3 may be realized by so-called cloud storage.

  Hereinafter, the function of each device of the handwriting information collection system 4 will be described by taking as an example a case where a customer Ux who wants to subscribe to the service provided by the company Cx performs a procedure for subscription.

[Outline]
The customer Ux mainly performs operations for subscription application by operating the terminal device 2A. On the other hand, an employee of company Cx performs an operation for accepting an application mainly by operating the terminal device 2B.

  The company Cx distributes an application form 50 (see FIG. 6) to the customer Ux as an answer form for subscribing to this service.

  The customer Ux prints the application form 50 on a sheet of paper and writes his / her name with a pen in a predetermined field. Further, the witness is handwritten with the name of the witness with a pen in a predetermined field. Then, an application form is submitted to the company Cx.

  The company Cx checks with the terminal device 2B whether the submitted application form is complete.

[Preparation and distribution of application form 50]
FIG. 6 is a diagram illustrating an example of the application form 50. FIG. 7 is a diagram illustrating an example of the configuration of the answer form data providing unit 221. FIG. 8 is a diagram illustrating an example of the positions of the objects constituting the application form 50. FIG. 9 is a diagram illustrating an example of the application form 5FA. FIG. 10 is a diagram illustrating an example of the application form 5FB.

  In the application form 50, as shown in FIG. 6, a word object 50T, an entry field object 50R, and an entry prohibition field object 50H are arranged.

  The word object 50T is a character string representing an English word. The entry field object 50R is a rectangular field for the customer Ux to write information with a pen. In the present embodiment, a rectangular blank field is used as the entry field object 50R. The entry prohibition column object 50H is a rectangular column in which the customer Ux is prohibited from writing information. In this example, a rectangular field on which some information is printed is used as the entry prohibition field object 50H.

  An image file 60 that is image data of the application form 50 is stored in advance in the auxiliary storage device of the terminal device 2B. As the format of the image file 60, for example, PDF (Portable Document Format) or TIFF (Tagged Image File Format) is used. In the example of FIG. 6, character strings are arranged in the first frame and the third frame, but neither character string is shown in the image file 60. These character strings are arranged by processing to be described later.

  The customer Ux transmits an electronic mail indicating that he / she wants to subscribe to a service provided by the company Cx to the company Cx by the terminal device 2A. It should be noted that predetermined items (in this example, one's name and the name of a witness) are written in this e-mail.

  When the company Cx receives this e-mail by the terminal device 2B, the answer form data providing unit 221 of the terminal device 2B executes the process of providing the application form 50 data to the customer Ux as follows.

  As shown in FIG. 7, the answer form data providing unit 221 includes a customization processing unit 231, an object detection unit 232, a feature data generation unit 233, a feature code generation unit 234, a first response form generation unit 235, and an upload processing unit 236. The storage location code generation unit 237, the second response form generation unit 238, the response form data transmission unit 239, and the like.

  The customization processing unit 231 reads the image file 60 from the auxiliary storage device. Then, the image file 60 is arranged so that the character strings of the name of the customer Ux and the name of the witness shown in the e-mail are respectively arranged in the first frame and the third frame in the application form 50. By updating, an answer form file 61 is generated.

  The object detection unit 232 detects the word object 50T, the entry field object 50R, and the entry prohibition field object 50H included in the application form 50 shown in the answer form file 61. The word object 50T can be detected by a known character recognition technique. The entry field object 50R and the entry prohibition field object 50H can be detected by specifying a rectangular frame by a known image recognition technique and determining whether or not there is an image such as a character.

  The object detection unit 232 detects the word object 50T and the entry field object 50R from the positions shown in FIG. The position indicated by the dotted line is the position of the word object 50T. The position indicated by the alternate long and short dash line is the position of the entry field object 50R. The position indicated by the two-dot chain line is the position of the entry prohibition column object 50H.

  The feature data generation unit 233 generates the feature data 66 when the object detection unit 232 detects the word object 50T or the like.

  The feature data 66 indicates the type (word object, entry field object, or entry inhibition field object) for each object. Further, the characteristics for each word object 50T and the position in the application form 50, the characteristics for each entry-prohibited column object 50H, the positions in the application form 50, and the positions for each entry field object 50R are shown.

  As a feature of the word object 50T, for example, the number or area of dots of a character string represented by the word object 50T is used. The ASCII code of each character represented by the word object 50T may be used. Alternatively, the bitmap of the word object 50T itself may be used as a feature.

  As a feature of the entry prohibition column object 50H, for example, the number of dots of an image arranged in the entry prohibition column object 50H is used. Alternatively, the bitmap itself in the entry prohibition column object 50H may be used as a feature.

  The feature code generation unit 234 generates a feature code 50C that is a two-dimensional barcode representing the feature data 66 generated by the feature data generation unit 233. A monochrome two-dimensional barcode may be used as the feature code 50C, but a color two-dimensional barcode is preferably used. As a color two-dimensional barcode technology, the technology described in Japanese Patent Application Laid-Open No. 2007-323632 or Japanese Patent Application Laid-Open No. 2010-191944 can be used.

  The first response form generation unit 235 generates a response form file 62 that is image data of a document in which the customized application form 50 is arranged on the first page and the feature code 50C is arranged on the second page.

  By the way, when duplex printing is performed using the answer form file 62, the application form 50 is printed on the front side of one sheet, and the feature code 50C is printed on the back side. Normally, if the size of the feature data 66 is large, the number of cells constituting the feature code 50C increases and the feature code 50C increases. If the feature code 50C is too large, the feature code 50C cannot be printed on the same side of the same sheet together with the application form 50. Therefore, the application form 50 and the feature code 50C are printed on separate surfaces.

  However, if the application form 50 and the feature code 50C are printed on different sides, both sides of the answer sheet must be scanned as will be described later. Depending on the specifications of the scanning device, it may be troublesome to scan both sides. Therefore, the upload processing unit 236, the storage location code generation unit 237, and the second answer form generation unit 238 perform the following processing.

  The upload processing unit 236 uploads the feature data 66 to the server 3. Then, storage location information (for example, URL (Uniform Resource Locator)) indicating the location where the feature data 66 is stored is acquired.

  The storage location code generation unit 237 generates a storage location code 50S that is a two-dimensional barcode representing storage location information. Since the storage location information is much smaller than the information indicated by the feature data 66, the number of cells constituting the storage location code 50S can be reduced. Therefore, the size of the storage location code 50S can be made smaller than that of the feature code 50C. A QR code (registered trademark) is used as the feature code 50C.

  The second answer form generation unit 238 generates an answer form file 63. The answer form file 63 is image data of a one-page document. On this page, an application form 50 is arranged, and a storage location code 50S is arranged at a position where none of the word object 50T, the entry field object 50R, and the entry prohibition field object 50H are arranged.

  The reply form data transmission unit 239 attaches the reply form file 62 or the reply form file 63 to the electronic mail and transmits it to the terminal device 2A.

  Which of the answer form file 62 and the answer form file 63 is generated may be specified by the customer Ux or an employee of the company Cx. Alternatively, both may be generated and provided to the customer Ux, and the customer Ux may decide which one to use.

  In the terminal device 2A, the answer form data acquisition unit 201 acquires the answer form file 62 or the answer form file 63 from the e-mail.

  Then, the print request unit 202 requests the image forming apparatus 1A to print the application form 50. At this time, the reply form file 62 or the reply form file 63 is transmitted to the image forming apparatus 1A. If the image forming apparatus 1A does not support the format of the answer form file 62 or the answer form file 63, the print request unit 202 converts this into PDL (Page Description Language) data corresponding to the image forming apparatus 1A. Convert and send.

  Then, the image forming apparatus 1A prints an image on a sheet based on the answer form file 62 or the answer form file 63. Thereby, an answer sheet is generated. When based on the reply form file 62, an application form 5FA as shown in FIG. 9 is obtained as a reply sheet. When based on the reply form file 63, an application form 5FB as shown in FIG. 10 is obtained as a reply sheet.

  An employee of company Cx may prepare application form 5FA or application form 5FB by image forming apparatus 1B and mail it to customer Ux.

[Application and reception desk]
FIG. 11 is a diagram illustrating an example of the surface of the application form 5FA. FIG. 12 is a diagram illustrating an example of the configuration of the answer sheet check unit 222. FIG. 13 is a diagram illustrating an example of the check result images 521 and 522.

  As shown in FIG. 11, the customer Ux has his / her name written in the second frame on the surface of the application form 5FA or the application form 5FB, and the witness's name is handwritten in the fourth frame. If you want to contact company Cx, you can write it in the fifth frame. When the application form 5FA is used, the scanner 2K is caused to read the surface of the application form 5FA. Thereby, an image file 671 of an image drawn on the surface of the application form 5FA is generated. On the other hand, when the application form 5FB is used, the scanner 2K is caused to read the front and back surfaces of the application form 5FB. Thereby, the image file 672 of the image drawn on the front surface of the application form 5FA and the image drawn on the back surface is generated. The image forming apparatus 1A may scan instead of the scanner 2K.

  The answer processing unit 203 of the terminal device 2A receives the image file 671 or the image file 672 from the scanner 2K, attaches this as answer data 68 to an electronic mail, and transmits it to the terminal device 2B. As a result, the answer written on the answer sheet is given to the company Cx.

  The customer Ux may mail the application form 5FA or the application form 5FB to the company Cx instead of sending the response data 68 by e-mail.

  In the terminal device 2B, the answer sheet check unit 222 checks whether or not the contents handwritten on the answer sheet (application forms 5FA, 5FB) are incomplete as follows.

  As shown in FIG. 12, the answer sheet check unit 222 includes an answer data acquisition unit 241, an object detection unit 242, a feature data decoding unit 243, a feature data download unit 244, a retouched image extraction unit 245, a modification information extraction unit 246, a check The result output processing unit 247 and the like are included.

  When the e-mail is transmitted from the terminal device 2A, the answer data acquisition unit 241 acquires the answer data 68 from the e-mail. However, when the application form 5FA or the application form 5FB is mailed, the employee of the company Cx generates the answer data 68 by causing the image forming apparatus 1B or the scanner 2L to scan it and input it to the terminal apparatus 2B. To do.

  The object detection unit 242 detects the word object 51T, the blank object 51E, the non-blank object 51F, the feature code 50C, and the storage location code 50S from the image indicated in the answer data 68.

  The word object 51T is a character string representing an English word, like the word object 50T. The blank object 51E is a rectangular blank. The non-blank object 51F is a rectangular field in which some image is shown. Only one of the feature code 50C and the storage location code 50S is detected.

  The feature data decoding unit 243 decodes the feature code 50C into the feature data 66 when the feature code 50C is detected from the answer data 68.

  When the storage location code 50S is detected from the answer data 68, the feature data download unit 244 downloads the feature data 66 from the server 3 based on storage location information (for example, URL) indicated in the storage location code 50S. .

  The retouched image extracting unit 245 adds an image (hereinafter, referred to as “application form 51”) added from the image on the front surface of the application form 5FA or the application form 5FB shown in the response data 68 (hereinafter referred to as “application form 51”). “Described image 50K”) is extracted as follows.

  The added image extraction unit 245 specifies the position of the entry field object 50R in the application form 50 based on the feature data 66 obtained by the feature data decoding unit 243 or the feature data download unit 244. The application form 51 is searched for an object at the same position as the specified position. If the searched object is a non-blank object 51F, an image arranged in the non-blank object 51F is detected as a retouched image 50K.

  By the way, the customer Ux may reply by changing (correcting or falsifying) parts other than the entry field object 50R. For example, the word object 50T may be rewritten or handwritten in the entry prohibition column object 50H. The modification information extraction unit 246 extracts such modification as follows.

  The modification information extraction unit 246 specifies the position of the word object 50T in the application form 50 based on the feature data 66 obtained by the feature data decoding unit 243 or the feature data download unit 244. A word object 51T located at the same position as the specified position is searched from the application form 51, and the characteristics of the word object 51T are calculated. The feature of the word object 50T shown in the feature data 66 is compared with the calculated feature. If they do not match, the word object 51T is extracted as modified. If they do not match, it is determined that the word object 51T has not been altered. If the difference between the two is within a certain range, it may be determined that no modification has been made.

  Further, the modification information extraction unit 246 specifies the position of the entry prohibition column object 50H in the application form 50 based on the feature data 66 obtained by the feature data decoding unit 243 or the feature data download unit 244. A column (blank object 51E or non-blank object 51F) at the same position as the specified position is searched from the application form 51, and the characteristics of the column are calculated. The feature of the entry prohibition column object 50H indicated in the feature data 66 is compared with the calculated feature. If the two do not match, the column is extracted as modified. If they do not match, it is determined that the field has not been altered. If the difference between the two is within a certain range, it may be determined that no modification has been made.

  The characteristics of the word object 51T and the non-blank object 51F included in the application form 51 may be calculated before the retouched image extraction unit 245 and the modification information extraction unit 246 execute processing.

  The check result output processing unit 247 outputs the extraction results by the retouched image extraction unit 245 and the modification information extraction unit 246 in the following form.

  For example, a check result image 521 as shown in FIG. 13A is displayed on the touch panel display or printed on the image forming apparatus 1B. The check result image 521 shows the retouched image 50K extracted by the retouched image extraction unit 245 and the column extracted by the modification information extraction unit 246 in a form different from other objects (for example, surrounded by a thick line). . Further, the blank object 51E from which the retouched image extraction unit 245 has not extracted the retouched image 50K (that is, a field that may be missing) is also represented in a different form from other objects. Instead of surrounding with a bold line, the color may be changed (for example, red).

  A check result image 522 as shown in FIG. 13B may be displayed on the touch panel display or may be printed on the image forming apparatus 1B. The check result image 522 includes only the retouched image 50K extracted by the retouched image extraction unit 245, the column extracted by the modification information extraction unit 246, and the blank object 51E from which the retouched image extraction unit 245 has not extracted the retouched image 50K. Shown extracted. The reason why each object is selected may be indicated by a balloon. Alternatively, the retouched image 50K may be colored in red, a field that may be filled in may be filled in with red, and a plurality of red diagonal lines may be drawn at places where the modification has been made.

  FIG. 14 is a flowchart illustrating an example of the overall processing flow in the terminal device 2B. FIG. 15 is a flowchart illustrating an example of the flow of processing for providing the application form 50. FIG. 16 is a flowchart showing a modification of the processing flow for providing the application form 50. FIG. 17 and FIG. 18 are flowcharts showing an example of the flow of answer check processing.

  Next, the overall processing flow of the terminal device 2B will be described with reference to the flowcharts of FIGS.

  Each time the terminal device 2B receives an input from the terminal device 2A or the like, the terminal device 2B performs processing as shown in FIG. 14 accordingly.

  When the terminal device 2B receives an e-mail indicating that the user wishes to subscribe to the service provided by the company Cx (Yes in # 11), the terminal device 2B provides the request source with an application form 50 for filling in predetermined items. (# 12). The procedure of this process is as shown in FIG.

  In FIG. 15, the terminal device 2B obtains conditions such as the name of each of the customer Ux and the witness in addition to the desired print surface (one side or both sides) of the answer sheet (# 701).

  The terminal device 2B places the acquired names of both persons on the application form 50 (# 702). The objects constituting the application form 50 are extracted, the characteristics of each object are calculated, and the characteristic data 66 is generated (# 703).

  If the desired print side is “both sides” (Yes in # 704), the terminal device 2B generates the feature code 50C (# 705). Then, document data (answer form file 62) in which the application form 50 is arranged on the first page (front surface) and the feature code 50C is arranged on the second page is generated and transmitted to the request source (# 706).

  On the other hand, if the desired print side is “single side” (No in # 704), the terminal device 2B uploads the feature data 66 to the server 3 (# 707), indicating the location where the feature data 66 is stored. A storage location code 50S is generated (# 708). Then, document data (answer form file 63) in which the application form 50 is arranged on the first page (front surface) and the storage location code 50S is arranged at a position where no object exists in the application form 50 is generated and transmitted to the request source. (# 709).

  In this way, the application form 50 is delivered to the request source as electronic data. When the application form 50 is delivered as a printed matter to the request source, the terminal device 2B may perform the process shown in FIG. 16 instead of the process shown in FIG.

  The processing in steps # 721 to # 725 and # 727 to # 728 in FIG. 16 is the same as that in the case of providing the application form 50 as electronic data, and steps # 701 to # 705 and # 707 to # 708 in FIG. As explained in.

  When the desired print side is “both sides” (Yes in # 724), the terminal device 2B sends an answer form file 62 to the image forming apparatus 1B to instruct to print the answer sheet (#). 726). Then, the image forming apparatus 1B performs printing based on the answer form file 62. Thereby, an application form 5FA (see FIG. 9) is obtained.

  On the other hand, if the desired print side is “single side” (No in # 724), the terminal device 2B sends an answer form file 63 to the image forming apparatus 1B to instruct to print the answer sheet. (# 729). Then, the image forming apparatus 1B performs printing based on the answer form file 63. Thereby, an application form 5FB (see FIG. 10) is obtained.

  The customer Ux writes necessary information on the application form 5FA or the application form 5FB, scans it, and converts it into response data 68 as electronic data. Then, the reply data 68 is attached to the e-mail and transmitted to the company Cx. Alternatively, the application form 5FA or the application form 5FB may be mailed to the company Cx.

  Returning to FIG. 14, when the terminal device 2B receives the reply e-mail (Yes in # 13), the process of verifying (checking) the application form 5FA or the application form 5FB is performed according to the procedure shown in FIGS. Execute (# 14).

  In FIG. 17 and FIG. 18, the terminal device 2B acquires the reply data 68 from this e-mail (# 751).

  If the image indicated by the response data 68 (particularly the image on the back of the application form 5FA) includes a color code, that is, the feature code 50C (Yes in # 752), the terminal device 2B uses the feature code 50C as the feature data 66. (# 753).

  On the other hand, when the QR code, that is, the storage location code 50S is included in the image indicated by the response data 68 (particularly, the image on the front surface of the application form 5FB) (No in # 752), the terminal device 2B uses the storage location code 50S. The feature data 66 is downloaded based on the URL indicated by (# 754).

  The terminal device 2B detects the object from the surface image indicated by the answer data 68, and calculates the characteristics of the word object 51T and the non-blank object 51F (# 755). Then, the feature indicated in the feature data 66 acquired in step # 753 or # 754 is compared with the feature calculated in step # 755 (# 756), and the added, unfilled, and modification are extracted as follows ( # 757 to # 764).

  The terminal device 2B has the entry field object 50R in the application form 50 (Yes in # 757), and if there is an image at the same position as the entry field object 50R in the application form 51 (# 758). Yes), the image is extracted as a retouched image 50K (# 759). If there is no image (No in # 758), the entry field object 50R is extracted as a field (unfilled field) that may be filled out (# 760).

  If there is a word object 50T and a word object 51T that are in the same position but have different features (Yes in # 761), the terminal device 2B extracts the word object 51T as modification information (# 762).

  When there is a non-entry column object 50H and a non-blank object 51F that are in the same position but have different features (Yes in # 763, Yes in # 764), this non-blank object 51F is extracted as modification information (# 765). ).

  Then, the terminal device 2B outputs the results extracted in steps # 760, # 762, and # 764 as a check result image 521 or a check result image 522 as shown in FIG. 13 (# 766).

  According to the present embodiment, it is easier to extract the added information written on the answer sheet, extract the modification of the existing information previously written on the answer sheet, and extract the column that seems to be missing. Can do.

  In the present embodiment, the presence / absence of modification is checked for each word object 50T or entry prohibition column object 50H, but the presence / absence of modification may be checked in other units. For example, the presence or absence of alteration may be checked for each character. Alternatively, the application form 50 may be divided into a plurality of blocks, and the presence or absence of modification may be checked for each block.

  FIG. 19 is a diagram showing a modification of the form of the entry field object 50R and the entry prohibition field object 50H. FIG. 20 is a diagram illustrating an example in which a part of the application form 50 is concealed.

  In this embodiment, the blank field in the application form 50 is the entry field object 50R, and the field in which some information is printed is the entry prohibition field object 50H. However, there is a case where it is operated so that the respondent adds information not only to the blank but also to a column where some information is printed. Therefore, the entry field object 50R and the entry prohibition field object 50H may be distinguished by changing the thickness of the frame as shown in FIG. Or you may distinguish by attaching | subjecting a different mark to a predetermined | prescribed corner | angular (for example, upper left corner) as shown in FIG.19 (B).

  The entry field may be represented by a ruled line instead of a frame. Therefore, the entry field object 50R may be defined by attaching a predetermined mark as shown in FIG. 19C so that the area including the ruled line can be detected as the entry field object 50R. Alternatively, an area from a ruled line up to a predetermined height may be detected as the entry field object 50R.

  It may be preferable to conceal a part of the content entered on the answer sheet. For example, it is assumed that a printed matter of a questionnaire form 50 'shown in FIG. 20A is distributed as an answer sheet, and an application form 51' shown in FIG. 20B is obtained. It is desirable that the contents entered in the second and third entry objects 50R can be viewed by only a few employees. Alternatively, it may be desirable for the entry field object 50R to have different employees who can view the contents.

Therefore, an access right is set in advance for each entry field object 50R. A mark corresponding to the access right may be attached to each entry field object 50R.
Then, in accordance with the access right given to the employee who wants to view the answer, a part of the entry field object 50R is concealed and output. For example, to the manager of the store that is the subject of this questionnaire, the entry field object 50R related to personal information is masked and output as shown in FIG. As shown in FIG. 20 (B), nothing is concealed and output to the employee who responds to the inquiry from the customer (so-called person in charge of the customer consultation room).

  The entry field object 50R may be concealed by superimposing rectangular images of the same color as the entered answer image. Alternatively, the entered answer image may be deleted, and a predetermined image (for example, an image of a character “Mal secret”) may be overlaid on the entry field object 50R to keep it secret.

  When the application form 51 ′ of FIG. 20 is output, the terminal device 2B adds the information to be concealed based on the access right of the user operating the terminal device 2B in step # 766 of the flowcharts of FIGS. An image 50K and a retouched image 50K that is not so are discriminated. Then, processing such as masking is performed on the retouched image 50K to be concealed as described above, and an application form 51 'is output.

  In the present embodiment, the feature data 66 is uploaded to the server 3, but a feature code 50C may be uploaded instead of the feature data 66.

  In the present embodiment, the terminal device 2A and the terminal device 2B exchange data by e-mail, but may exchange data via a web server.

  In the present embodiment, the function illustrated in FIG. 4 is realized by the terminal device 2A, but may be realized by the image forming apparatus 1A. Similarly, the function shown in FIG. 5 may be realized by the image forming apparatus 1B instead of the terminal device 2B.

  In the present embodiment, paper is used as the recording medium of the application form 50, but electronic paper may be used.

  In addition, the handwriting information collection system 4, the image forming apparatuses 1 </ b> A and 1 </ b> B, the terminal apparatuses 2 </ b> A and 2 </ b> B, the configuration of all or each part, the processing content, the processing order, the data configuration, and how to indicate the check results Can be changed as appropriate.

4 Handwritten information collection system (information collection system)
1A image forming apparatus (recording medium providing means)
2B terminal device (information collecting device, computer)
244 Feature Data Download Unit (Acquisition means)
245 Retouching information extracting unit (rewriting information extracting means)
246 Modification information extraction unit (modified area extraction means)
50C Feature code 50H Entry prohibited column object 50K Retouched image (retouch information)
50R entry field object 50S storage location code 50T word object 51 application form (read image)
66 Feature data

Claims (15)

On a recording medium having a plurality of first areas that are areas for adding information and one or more second areas that are other areas, a first position for each of the first areas; Write a code indicating the second position for each of the second areas and the first characteristic of the marked image, and set an access right for each of the plurality of first areas,
In the read image that is an image read from the recording medium, an image written at the same position as the first position indicated by the code included in the read image is extracted as additional information,
The extracted retouching information is output according to the access right set in the first region where the retouching information is extracted from the plurality of first regions,
A second feature of the image indicated at the same position as the second position indicated by the code included in the read image in the read image, and the second position indicated by the code When the difference from the first feature corresponding to the number exceeds a predetermined range, the second region at the second position is extracted as a modified region.
An information collecting method characterized by the above. Setting the access right by attaching a mark corresponding to a user permitted to view to each of the plurality of first areas;
The information collection method according to claim 1 . The recording medium is paper;
The code is a two-dimensional barcode,
The first area and the second area are provided on one side of the recording medium, and the code is written on the other side.
The information collection method according to claim 1 or 2 . On a recording medium having a plurality of first areas that are areas for adding information and one or more second areas that are other areas, a first position for each of the first areas; Write down the code indicating the storage location of the feature data that records the second position for each second region and the first feature of the marked image,
An access right is set for each of the plurality of first areas,
Obtaining the feature data from the storage location indicated by the code included in the read image that is an image read from the recording medium;
An image written in the same position as the first position recorded in the feature data in the read image is extracted as additional information,
The extracted retouching information is output according to the access right set in the first region where the retouching information is extracted from the plurality of first regions,
Corresponds to the second feature of the image indicated in the same position as the second location recorded in the feature data in the read image and the second location indicated in the feature data. When the difference from the first feature exceeds a predetermined range, the second region at the second position is extracted as a modified region.
An information collecting method characterized by the above. Setting the access right by attaching a mark corresponding to a user permitted to view to each of the plurality of first areas;
The information collection method according to claim 4 . The recording medium is paper;
The code is a two-dimensional barcode,
The code is written on the surface of the recording medium where the first region and the second region are present.
The information collection method according to claim 4 or 5 . The first region corresponding to the first position when the image is not written at the same position as the first position indicated by the code included in the read image in the read image. Extract as blank area,
Information collection method according to any one of claims 1 to 6. The read image is processed and output so as to indicate the extracted additional information, the modified region, and the unfilled region,
The information collection method according to claim 7 . The first feature is the number of dots constituting the image written in the second region,
The second feature is the number of dots constituting the image written at the same position as the second position.
Information collection method according to any one of claims 1 to 8. An area to which information is to be added and having a plurality of first areas each having an access right set and one or a plurality of second areas which are other areas; A recording medium providing means for providing a recording medium on which a code indicating the first position for each area, the second position for each second area, and the first characteristic of the marked image is provided;
Retouching information for extracting, as retouching information, an image written in the same position as the first position indicated by the code included in the read image in a read image that is an image read from the recording medium Extraction means;
A retouching information output means for outputting the retouching information extracted according to the access right set in the first region from which the retouching information is extracted from the plurality of first regions;
A second feature of the image indicated at the same position as the second position indicated by the code included in the read image in the read image, and the second position indicated by the code A modified region extracting means for extracting the second region at the second position as a modified region when a difference from the first feature corresponding to the second feature exceeds a predetermined range;
An information collection system characterized by comprising: An area to which information is to be added and having a plurality of first areas each having an access right set and one or a plurality of second areas which are other areas; There is provided a recording medium on which a code indicating a storage location of feature data in which a first position for each region, a second position for each second region, and a first feature of the recorded image are recorded is provided. Recording medium providing means;
Obtaining means for obtaining the feature data from the storage location indicated by the code included in the read image that is an image read from the recording medium;
A retouching information extracting means for extracting, as retouching information, an image written in the same position as the first position recorded in the feature data in the read image;
Outputting the retouched information according to the access right set in the first area from which the retouched information is extracted from among the plurality of first areas;
Corresponds to the second feature of the image indicated in the same position as the second location recorded in the feature data in the read image and the second location indicated in the feature data. When the difference between the first feature and the first feature exceeds a predetermined range, a retouching information extracting unit that extracts the second region at the second position as a modified region;
An information collection system characterized by comprising: In the plurality of first areas, the access right is set by adding a mark according to a user who is permitted to browse.
The information collection system according to claim 10 or 11 . On the computer,
An area to which information is to be added and having a plurality of first areas each having an access right set and one or a plurality of second areas which are other areas; A process for providing a recording medium on which a code indicating a first position for each of the areas, a second position for each of the second areas, and a first characteristic of the marked image;
A process of extracting an image written in the same position as the first position indicated by the code included in the read image in the read image, which is an image read from the recording medium, as additional information;
A process of outputting the extracted retouching information according to the access right set in the first region from which the retouching information is extracted from among the plurality of first regions;
A second feature of the image indicated at the same position as the second position indicated by the code included in the read image in the read image, and the second position indicated by the code A process of extracting the second region at the second position as a modified region when the difference from the first feature corresponding to the second feature exceeds a predetermined range;
A computer program for executing On the computer,
An area to which information is to be added and having a plurality of first areas each having an access right set and one or a plurality of second areas which are other areas; There is provided a recording medium on which a code indicating a storage location of feature data in which a first position for each region, a second position for each second region, and a first feature of the recorded image are recorded is provided. Processing,
Processing for obtaining the feature data from the storage location indicated by the code included in the read image that is an image read from the recording medium;
A process of extracting an image written at the same position as the first position recorded in the feature data in the read image as additional information;
A process of outputting the extracted retouching information according to the access right set in the first region from which the retouching information is extracted from among the plurality of first regions;
Corresponds to the second feature of the image indicated in the same position as the second location recorded in the feature data in the read image and the second location indicated in the feature data. When the difference between the first feature and the first feature exceeds a predetermined range, a process of extracting the second region at the second position as a modified region;
A computer program for executing In the one or more first areas, the access right is set by adding a mark according to a user who is permitted to browse.
The computer program according to claim 13 or claim 14 .

Images