JP6672666B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing device and a program.

  A structured document such as an HTML document is configured by describing the contents of individual elements represented in the document and the positions of those elements. For example, Patent Literature 1 discloses a technique for presenting a user with document data represented by a structured document.

JP 2005-04991 A

  Since the structured document is configured for each element, it is difficult to reflect a memo or the like added by a user at an arbitrary position of the printed document on which the structured document is printed in the structured document. Therefore, if memos or the like arbitrarily added by the user to the printed document can be reflected in the structured document, the convenience of the user is improved. For that purpose, it is necessary to associate the position of the additionally written information in the print document with the position in the structured document.

  An object of the present invention is to provide an information processing apparatus capable of associating element positions in a printed document on which a structured document is printed with element positions in the structured document.

An information processing apparatus according to claim 1, wherein a structured document acquisition unit that acquires a structured document including a plurality of elements, and a code that codes position information indicating a position in the structured document for each of the elements Coded position information generating means for generating coded position information, and a position for generating a document image with position information obtained by adding the coded position information for each element to a print document image for printing the structured document and information-added document image generating means, in response to a print instruction of the structured document by a user, and a print output means for printing out said-out with positional information document image to the printing unit, the position information-added document image printing By scanning the written medium, a scan image of the element including the information added by the user and the coding added to the element included in the document image with position information An acquisition unit that acquires the position information indicated by the location information, and a storage unit that stores the structured document including a plurality of scan images to which different pieces of information acquired by the acquisition unit are additionally written, Display means for selectively displaying any of the plurality of stored scan images for the same element indicated by the position information .

A program according to claim 2 of the present invention, comprising: a structured document acquisition unit for acquiring a structured document including a plurality of elements; and coded position information obtained by coding position information indicating a position in the structured document for each element. A document image with position information for generating a document image with position information in which the coded position information is added to each of the elements to a printing document image for printing the structured document. Generating means, print output means for causing a printing means to print out the document image with position information in response to a print instruction of the structured document by a user, and scanning a medium on which the document image with position information is printed A scan image of the element including the information added by the user, and the coded position information added to the element included in the document image with position information. An acquisition unit that acquires the position information, a storage unit that stores the structured document including a plurality of scan images to which different pieces of information acquired by the acquisition unit are added, and the acquired position information indicates A program for causing a computer to function as display means for selectively displaying any of the plurality of stored scan images for the same element .

According to the first and second aspects of the present invention, the positions of the elements in the printed document on which the structured document is printed and the positions of the elements in the structured document are associated with each other. A plurality of pieces of information added to the same element are stored, and the user can selectively display information from the plurality of pieces of stored information .

FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system according to an embodiment. FIG. 4 is a diagram illustrating an example of a manual document indicated by a structured document according to the embodiment. FIG. 3 is a functional block diagram illustrating an example of main functions implemented by the document management device according to the embodiment. FIG. 3 is a diagram illustrating an example of a document image with position information according to the embodiment. FIG. 4 is a diagram illustrating an example of a print document including handwritten information of a user according to the embodiment. FIG. 5 is a diagram illustrating a manual document represented by a structured document including a replacement image according to the embodiment. It is a flowchart which shows an example of the flow of the handwritten information replacement process which the information processing system which concerns on this embodiment performs. FIG. 5 is a diagram illustrating an example in which a manual document indicated by a structured document according to the embodiment is displayed in a tab.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system 1 according to the present embodiment. As shown in FIG. 1, the information processing system 1 according to the present embodiment includes a document management apparatus 10, a multifunction peripheral 20, a structured document database 30, and a terminal device 40.

  The document management device 10 is an information processing device such as a server, for example, and includes a control unit 11, a storage unit 12, and a communication unit 13. The units 11 to 13 are connected via a bus.

  The control unit 11 is, for example, a CPU or the like, and executes various types of information processing according to a program stored in the storage unit 12.

  The storage unit 12 is configured to include a memory element such as a ROM or a RAM, a hard disk, and the like. The storage unit 12 stores a program executed by the control unit 11 and various data. The storage unit 12 also operates as a work memory of the control unit 11.

  The communication unit 13 is a network interface such as a LAN card, for example, and transmits and receives information to and from the multifunction peripheral 20, the structured document database 30, and the terminal device 40 via communication means such as a LAN and a wireless communication network. I do.

  The MFP 20 includes a control unit 21, a storage unit 22, a communication unit 23, an image forming unit 24, and a scanner unit 25. The components 21 to 25 are connected via a bus. Note that the control unit 21, the storage unit 22, and the communication unit 23 may have the same configurations as the control unit 11, the storage unit 12, and the communication unit 13, respectively.

  The image forming unit 24 forms the image data input from the control unit 21 on a paper medium or the like. In the present embodiment, the control unit 21 outputs, for example, image data received from the document management device 20 to the image forming unit 24.

  The scanner unit 25 optically reads an image formed on a paper medium or the like and outputs the image to the control unit 21 as image data. In the present embodiment, the control unit 21 transmits image data input from, for example, the scanner unit 25 to the document management device 20.

  The structured document database 30 is a database server and stores a plurality of structured documents. The structured document includes a plurality of texts and information indicating a document structure. In the present embodiment, the structured document database stores HTML data such as an electronic manual as a structured document. FIG. 2 is a diagram illustrating an example of a manual document 100 represented by a structured document according to the present embodiment. The manual document as shown in FIG. 2 is displayed on the display unit of the terminal device 40. In the manual document, for example, a manual of a business or a product is described. Such a manual is described by a business manager or a product developer, and includes text indicating a heading (heading texts 110a, 110b, 110c, etc.) and text indicating the text of the heading (body texts 120a, 120b, etc.). Including. The heading may be configured to correspond to a hierarchical structure such as a chapter, a section, or a section. In the manual according to the present embodiment, a combination of a heading text indicating a heading and a body text indicating a main body of the heading is defined as one element. That is, in FIG. 2, for example, the headline text 110c and the body text 120b are elements of “1.1 (1)”. Although FIG. 2 shows one page of the manual document as an example, it is assumed that a document including a plurality of elements is described in a plurality of pages in the manual document. A manual document having such a document structure is stored in the structured document database as HTML data.

  The terminal device 40 is, for example, a personal computer or the like, a control unit that is a program control device such as a CPU that operates according to a program installed in the terminal device 40, a storage unit such as a ROM or a RAM, or a storage unit such as a hard disk drive. And a communication unit as a communication interface such as a network board, a display unit as a liquid crystal display, and an operation unit as a mouse, a keyboard, and the like. The terminal device 40 according to the present embodiment displays a document (such as the manual document shown in FIG. 2) indicated by the structured document stored in the structured document database 30 on the display unit, so that the user can input the manual document. Can be browsed.

  In this embodiment, the user uses a printed manual document. In this case, the user may add a memo or the like by hand to the printed manual document. In the present embodiment, the configuration is such that handwritten information such as a memo added by the user by handwriting can be reflected in the structured document.

  Hereinafter, functions executed by the document management apparatus 10 according to the present embodiment will be described. FIG. 3 is a functional block diagram illustrating an example of main functions realized by the document management device 10 according to the present embodiment. As shown in FIG. 3, the document management device functionally includes a structured document acquisition unit 50, a position information generation unit 51, a position information addition unit, a print output unit 52, a scan image acquisition unit 53, and an image analysis unit 54. , And a replacement unit 55. These functions are realized by the control unit 11 executing a program stored in the storage unit 12. This program is supplied to the document management apparatus via a computer-readable information storage medium such as an optical disk, a magnetic disk, a magnetic tape, a magneto-optical disk, or a flash memory, or via a communication means such as the Internet.

  The structured document acquisition unit 50 acquires a structured document stored in a structured document database.

  The position information generating unit 51 generates coded position information obtained by coding position information indicating the position of each element in the structured document based on the document structure of the structured document acquired by the structured document acquiring unit 50. Specifically, the position information generation unit 51 specifies the position information of each element in the structured document based on information (for example, a chapter, a section, or a section) indicating the document structure of the structured document. Then, the position information generating unit 51 codes position information of each element in the structured document to generate coded position information. The coded position information may be any coded information including computer-readable information such as a barcode and a QR code (registered trademark). In the present embodiment, the coded position information is described as a QR code. I do.

  The print output unit 52 generates a document image with position information in which coded position information is added to a print document image for printing a structured document according to a print instruction from a user. Then, the print output unit 52 causes the MFP 20 having the printing unit (here, the image forming unit 24) to print out the document image with position information. Specifically, the print output unit 52 generates a document image with position information in which each coded position information generated by the position information generation unit 51 is associated with a corresponding element, and outputs the document image to the multifunction device 20. FIG. 4 is a diagram illustrating an example of the document image 200 with position information according to the present embodiment. As shown in FIG. 4, a QR code image 210, which is coded position information, is added to the document image with position information 200 so as to be associated with each element. The QR code image 210 may be added for each page, or may be added for each heading such as a chapter, a section, or a section.

  When the MFP 20 receives the document image with position information output from the print output unit 52, the image forming unit 24 of the MFP 20 forms the document image with position information on a print medium such as paper. Then, the user additionally writes handwritten information such as a handwritten memo at an arbitrary position on the printed document image with position information (hereinafter, referred to as a print document). FIG. 5 is a diagram illustrating an example of a print document 300 including the user's handwritten information according to the present embodiment. As shown in FIG. 5, the print document 300 includes a memo 310 (“← pay attention to this work!”) Which is the user's handwritten information for the document described in the element “1.1 (1)”. ]) Has been added. Although the handwritten memo 310 is additionally written in the margin of the print document 300 in the print document 300 illustrated in FIG. 5, for example, the memo 310 may be additionally written over the document. The handwritten memo 310 may be a picture, a symbol, a stamp, or the like.

  Next, a process of using the printed document 300 including the user's handwritten information to reflect the handwritten information of the user in the structured document will be described. First, the scanner unit 25 of the MFP 20 scans the print document 300 including the user's handwritten information.

  The scan image acquisition unit 53 acquires a scan image of the print document 300 including the handwritten information of the user, which is scanned by the multifunction peripheral 20. The scan image obtaining unit 53 may obtain a scan image of one page of the print document 300 including the user's handwriting information, or obtain a scan image obtained by extracting only the elements including the user's handwriting information. May be.

  The image analysis unit 54 analyzes the scan image acquired by the scan image acquisition unit 53. Specifically, the image analysis unit 54 decodes the coded position information associated with the element including the user's handwritten information, and reads the position information indicating the position in the structured document.

  The replacement unit 55 replaces the element of the structured document described at the position indicated by the position information read by the image analysis unit 54 with a scan image (hereinafter, referred to as a replacement image) acquired by the scan image acquisition unit 53. . Note that the replacement unit 55 may replace the entire element with the replacement image, or may replace the body text of the element with the replacement image. The structured document replaced by the replacement unit 55 is stored in the structured document database.

  FIG. 6 is a diagram illustrating a manual document 100 represented by a structured document including a replacement image according to the present embodiment. The manual document 100 shown in FIG. 6 shows an example in which handwritten information (memo 310) included in the print document 300 shown in FIG. 5 is reflected in the structured document. As shown in FIG. 6, a replacement image 410 is displayed in the element of “1.1 (1)” in which the user has added the handwritten memo in the print document 300 shown in FIG. In this way, the element to which the user has added the handwritten information is displayed with the entire element replaced with the replacement image.

  Here, an example of the flow of the handwritten information replacement process executed by the information processing system 1 according to the present embodiment will be described with reference to the flowchart of FIG.

  First, a user operating the terminal device 40 issues a print instruction for a structured document stored in the structured document database.

  When the document management apparatus 10 receives a structured document print instruction from the terminal device 40 (S101), the structured document acquisition unit 50 of the document management apparatus 10 converts a structured document to be a print instruction target from the structured document database. It is acquired (S102).

  Then, based on the document structure of the structured document acquired in step S102, the position information generation unit 51 of the document management device 10 converts the coded position information obtained by coding the position information indicating the position of each element in the structured document. It is generated (S103).

  Then, the print output unit 52 of the document management apparatus 10 causes the coded position information corresponding to each element generated in the process S103 to be added to the print document image for printing the structured document that is the target of the print instruction. Then, a document image with position information is generated (S104).

  Then, the print output unit 52 of the document management apparatus 10 outputs the document image with position information generated in the processing S104 to the multi-function device 20 (S105).

  When the multifunction device 20 receives the document image with position information output from the print output unit 52 of the document management apparatus 10, the image forming unit 24 of the multifunction device 20 forms the document image with position information on a paper medium. The print document is printed out (S106).

  Here, the user adds a handwritten memo to an arbitrary portion of the print document.

  The scanner unit 25 of the multifunction device 20 scans a print document including a memo handwritten by the user (S107).

  The scan image scanned by the scanner unit 25 in the process S107 is output to the document management device 10 (S108).

  Then, the scan image acquisition unit 53 of the document management device 10 acquires the scan image output from the MFP 20 (S109). Here, the scan image acquisition unit 53 of the document management device 10 acquires a replacement image that is a scan image of an element to which a handwritten memo is added.

  Then, the image analysis unit 54 of the document management device 10 analyzes the replacement image acquired in the processing S109 (S110). The image analysis unit 54 of the document management device 10 decodes the coded position information included in the replacement image and reads the position information.

  Then, the replacement unit 55 of the document management device 10 replaces the element corresponding to the position in the structured document with the replacement image acquired in step S109 based on the position indicated by the position information read in step S110 (S111). ). Then, the replacement unit 55 of the document management device 10 stores the structured document including the replacement image in the structured document database, and ends the handwritten information replacement process.

  If the user wants to additionally write handwritten information on the element including the replacement image, a structured document including the replacement image may be formed on a paper medium and printed out. Then, the user only needs to add handwritten information to the print document including the replacement image. Subsequent handwritten information replacement processing may be performed as described above. Alternatively, a plurality of replacement images in which different handwritten information is added to the same element may be synthesized. As a result, handwritten information additionally written by the user in the same place a plurality of times can be reflected in the structured document.

  Further, when there are a plurality of replacement images in which different handwritten memos are added to the same element, a plurality of replacement images are displayed when displaying the document indicated by the structured document on the display unit of the terminal device 40. Any of the images may be displayed so as to be selectively displayed. For example, a plurality of replacement images may be displayed on a tab. FIG. 8 is a diagram illustrating an example in which the manual document 100 represented by the structured document according to the present embodiment is displayed as a tab. FIG. 8 illustrates an example in which a plurality of replacement images are tab-displayed in the element of “1.1 (1)”. Thus, the replacement image can be selectively displayed by selecting the tab. Thus, the tab may be increased each time a handwritten memo is added to the same element. At this time, the date and time when the replacement image is added may be managed, and the latest replacement image may be controlled to be displayed by default. Note that, when there are a plurality of replacement images for the same element, the present invention is not limited to an example in which the plurality of replacement images are tab-displayed. For example, each image may be reduced and displayed so that a plurality of replacement images are displayed in parallel.

  Note that the present invention is not limited to the above embodiment.

  For example, in the above-described embodiment, an example has been described in which the document management device 10 and the structured document database 30 are separate devices, but these may be integrated devices. That is, the structured document database 30 may be configured in the storage unit of the document management device 10.

  Further, in the above-described embodiment, the MFP 20 including the image forming unit 24 and the scanner unit 25 has been described as an example. However, the image forming apparatus including the image forming unit 24 and the scanner device including the scanner unit 25 are different. It may be configured as a separate body.

  Further, in the above embodiment, the example in which the document management device 10 and the terminal device 40 are separate devices has been described, but these may be an integrated device.

  REFERENCE SIGNS LIST 1 information processing system, 10 document management device, 11 and 21 control unit, 12, 22 storage unit, 13, 23 communication unit, 20 multifunction machine, 24 image forming unit, 25 scanner unit, 30 structured document database, 40 terminal device , 50 structured document acquisition section, 51 position information generation section, 52 print output section, 53 scan image acquisition section, 54 image analysis section, 55 replacement section, 100 manual document, 110a, 110b, 110c headline text, 120a, 120b body Text, 200 document image with position information, 300 printed document, 210 QR code image, 310 handwritten memo, 410 replacement image.

Claims (2)

Structured document acquisition means for acquiring a structured document including a plurality of elements;
Coded position information generating means for generating coded position information obtained by coding position information indicating a position in the structured document for each element,
A position-information-attached document image generating means for generating a position-information-attached document image in which the coded position information is added to each of the elements to a print document image for printing the structured document;
In response to a print instruction of the structured document by a user, and a print output means for printing out the position-out with information document image on a printing unit,
By scanning the medium on which the document image with position information is printed, a scan image of the element including information added by the user and the code added to the element included in the document image with position information Acquisition means for acquiring the position information indicated by the structured position information,
A storage unit that stores the structured document including a plurality of scan images to which different pieces of information obtained by the obtaining unit are additionally written,
Display means for displaying any of the stored plurality of scan images in a selectable manner for the same element indicated by the acquired position information,
An information processing apparatus comprising: Structured document acquisition means for acquiring a structured document composed of a plurality of elements,
Coded position information generating means for generating coded position information obtained by coding position information indicating a position in the structured document for each element;
A position-information-attached document image generating means for generating a position-information-attached document image in which the encoded position information is added to each of the elements to a print document image for printing the structured document;
Print output means for causing a print means to print out the document image with position information in response to a print instruction of the structured document by a user;
By scanning the medium on which the document image with position information is printed, a scan image of the element including information added by the user and the code added to the element included in the document image with position information Acquisition means for acquiring the position information indicated by the generalized position information,
Storage means for storing the structured document including a plurality of scan images to which different information obtained by the obtaining means is additionally written,
Display means for displaying any of the plurality of stored scan images in a selectable manner for the same element indicated by the acquired position information,
Program to make a computer function as a computer.

Images