JP4586679B2 - Information processing apparatus, information processing method, and computer program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing method, and a computer program. More specifically, the present invention relates to an information processing apparatus, an information processing method, and a computer program that can clearly set and determine a correspondence relationship with an attribute identifier set in each data area included in a document.

  In a configuration for managing a document in which various types of information are recorded, an attribute is assigned to a data area included in the document information, and each data is classified according to the attribute. As an example of disclosing such a document management configuration, for example, there is a configuration described in Patent Document 1. Hereinafter, as a specific example, a medical chart management system created by a doctor will be described. In recent years, with the promotion of an electronic medical chart system, many proposals have been made on the efficient input and management configuration of medical chart information. For example, the record information of the medical chart includes various types of information, and such information is required to be classified objectively. As one of the data classification methods, the SOAP method is known.

SOAP is code information associated with the following data, for example.
[S] is Subjective data, which is code information associated with subjective data directly provided by the patient.
[O] is objective data, which is code information associated with objective data acquired by a doctor or nurse.
[A] is Asset data, which is code information associated with judgment data of doctors and nurses.
[P] is Plan data, which is code information associated with data such as schedule information for diagnosis, treatment, or education.

  Such code information is set and managed as attribute information of each information recorded in the chart. For example, in the document 10 corresponding to the medical chart as shown in FIG. 1, the above-described code information 11 of [S], [O], [A], and [P] is provided as an attribute identifier that can be applied in advance to data classification. Are recorded on the right side of the document 10.

  The doctor who records the diagnostic information in the medical record, according to the category of the entered information, either the data area recorded by himself or the code information 11 of [S], [O], [A], [P] Is entered so that it is possible to determine which type of information is recorded.

  At a later date, these recording sheets are read by an image reading means such as a scanner, and stored in the database as text data by OCR processing of the recorded data. Furthermore, the connection line 12 that connects each area data and the code information 11 of [S], [O], [A], [P] is identified, and the attribute of each data area, that is, the attribute of text data (SOAP) Stored in the database.

  In this way, text data and image data of each area data are associated with the attribute identifier and data management is performed. By performing such data management, it is possible to objectively determine what kind of information is recorded in the medical record, and even when the doctor in charge is changed, information can be transmitted without error It becomes.

  In the example shown in FIG. 1, the information area data 15 is linked to [A] of the code information 11, and the text data or image data of the information area data 15 is associated with the attribute identifier [A] in the database. The stored area data 15 is the attachment data, and is interpreted as the judgment data of the doctor or nurse.

  However, the connection line 12 is recorded by the user himself / herself who records various information on paper, and the correspondence between each area data and the attribute identifier is accurately determined based on the connection line recorded by the user. It is often difficult to do. This determination process is executed as an image analysis process based on image data read by a scanner, for example.

For example, if there is a connecting line intersection 21 as shown in FIG. 1, the image analysis system may make an erroneous determination. Further, when the connecting line and the information area 15 intersect, the image analysis system may make an erroneous determination. In the example shown in the figure, the number of connecting lines is not large, but in an actual medical record description example, a large number of connecting lines may be recorded concentrated on some attribute identifiers. Accurate determination by analysis becomes difficult. In addition, if the connecting line to be connected by the user becomes long, a load is given to the user.
Japanese Patent Laid-Open No. 10-320492

  The present invention has been made in view of such a problem, and analyzes a connection line between a data area and an attribute identifier included in document information, and performs classification processing and management processing according to the attribute of each data area. An object of the present invention is to provide an information processing apparatus, an information processing method, and a computer program that enable accurate recording and analysis of connecting lines in a configuration to be performed and realize high-precision data management.

The first aspect of the present invention is:
An information processing device,
Attribute identifier adding means for determining an attribute identifier setting mode for recording a plurality of the same attribute identifiers at different document positions;
An output unit that prints or displays a document on which an attribute identifier is recorded in accordance with a determination mode of the attribute identifier adding unit;
There is an information processing apparatus characterized by having.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the attribute identifier adding means is configured to record the same attribute identifier on each of two different sides, three sides, or four sides of the document. It is the structure which performs the process which determines an aspect, It is characterized by the above-mentioned.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the attribute identifier adding means changes the attribute identifier type recorded in the vicinity of each information recording area in accordance with each information recording area included in the document. It is the structure which performs the process which determines an identifier setting aspect, It is characterized by the above-mentioned.

  Furthermore, in an embodiment of the information processing apparatus according to the present invention, the attribute identifier adding means changes the attribute identifier arrangement recorded in the vicinity of each information recording area in accordance with each information recording area included in the document. It is the structure which performs the process which determines an identifier setting aspect, It is characterized by the above-mentioned.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the attribute identifier adding means, according to each information recording area included in the document, the font size of the attribute identifier recorded in the vicinity of each information recording area, Or it is the structure which performs the process which determines the attribute identifier setting aspect which changed at least any one of the color or the kind.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the information processing apparatus further performs learning that includes a statistical process of a corresponding attribute of an information area based on a connection line between a recording information area and an attribute identifier. And the attribute identifier adding means is configured to execute processing for determining an attribute identifier setting mode based on a learning result in the learning means.

Furthermore, the second aspect of the present invention provides
An information processing device,
An information area included in image data in which the same attribute identifier is recorded at a different position on the document; a connection line extraction unit that extracts a connection line between the attribute identifier; a layout analysis unit that executes a layout analysis of the image data;
Each information area obtained as an analysis result of the layout analysis means, an attribute identifier connected by the connecting line, and an information area corresponding attribute determination means for determining an attribute of the information area;
There is an information processing apparatus characterized by having.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the information processing apparatus further associates the attribute information of each information area acquired by the information area corresponding attribute determining means with the information of each information area. And having a database to be stored.

  Furthermore, in an embodiment of the information processing apparatus of the present invention, the information processing apparatus further includes learning means for executing learning processing including statistical processing of attribute information of each information area stored in the database, and the learning And an attribute identifier adding means for executing a process for determining an attribute identifier setting mode based on a learning result in the means.

Furthermore, the third aspect of the present invention provides
An information processing method,
An attribute identifier adding step for determining an attribute identifier setting mode for recording a plurality of the same attribute identifiers at different document positions;
An output step of printing or displaying a document on which the attribute identifier is recorded according to the determination mode in the attribute identifier adding step;
There is an information processing method characterized by comprising:

  Furthermore, in an embodiment of the information processing method of the present invention, the attribute identifier adding step is an attribute identifier setting in which the same attribute identifier is recorded on each of two different sides, three sides, or four sides of the document. A process for determining an aspect is executed.

  Furthermore, in an embodiment of the information processing method of the present invention, the attribute identifier adding step includes an attribute in which the type of attribute identifier recorded in the vicinity of each information recording area is changed according to each information recording area included in the document. A process for determining an identifier setting mode is executed.

  Furthermore, in an embodiment of the information processing method of the present invention, the attribute identifier adding step includes an attribute in which an arrangement of attribute identifiers recorded in the vicinity of each information recording area is changed according to each information recording area included in the document. A process for determining an identifier setting mode is executed.

  Furthermore, in one embodiment of the information processing method of the present invention, the attribute identifier adding step includes, according to each information recording area included in the document, a font size of the attribute identifier recorded in the vicinity of each information recording area, Alternatively, a process for determining an attribute identifier setting mode in which at least one of a color and a type is changed is executed.

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further includes a learning process including a statistical process of a corresponding attribute of an information area based on a connection line between a recording information area and an attribute identifier. And the attribute identifier adding step performs a process of determining an attribute identifier setting mode based on a learning result in the learning step.

Furthermore, the fourth aspect of the present invention provides
An information processing method,
A connection line extracting step for extracting a connection line between the information area and the attribute identifier included in the image data in which the same attribute identifier is recorded at different positions on the document;
A layout analysis step for performing layout analysis of image data;
Each information area obtained as an analysis result in the layout analysis step, an attribute identifier connected by the connecting line, an information area corresponding attribute determination step for determining an attribute of the information area,
There is an information processing method characterized by comprising:

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further associates the attribute information of each information area acquired in the information area corresponding attribute determining step with the information of each information area. And storing in a database.

  Furthermore, in an embodiment of the information processing method of the present invention, the information processing method further includes a learning step of executing a learning process including a statistical process of attribute information of each information area stored in the database, and the learning And an attribute identifier adding step for executing processing for determining an attribute identifier setting mode based on the learning result in the step.

Furthermore, the fifth aspect of the present invention provides
A computer program that causes an information processing apparatus to execute document output processing;
An attribute identifier adding step for determining an attribute identifier setting mode for recording a plurality of the same attribute identifiers at different document positions;
An output step of printing or displaying a document on which the attribute identifier is recorded according to the determination mode in the attribute identifier adding step;
There is a computer program characterized by comprising:

Furthermore, the sixth aspect of the present invention provides
A computer program for causing an information processing apparatus to execute document analysis processing;
A connection line extracting step for extracting a connection line between the information area and the attribute identifier included in the image data in which the same attribute identifier is recorded at different positions on the document;
A layout analysis step for performing layout analysis of image data;
Each information area obtained as an analysis result in the layout analysis step, an attribute identifier connected by the connecting line, an information area corresponding attribute determination step for determining an attribute of the information area,
There is a computer program characterized by comprising:

  Note that the computer program of the present invention is a recording medium provided in a computer-readable format for a computer system capable of executing various program codes, for example, a recording medium such as a CD, FD, or MO. A computer program that can be provided by a medium or a communication medium such as a network. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the computer system.

  Other objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

  According to the configuration of the present invention, a document in which the same attribute identifier is recorded at a plurality of different positions is generated and output for a document on which information having various attributes is recorded. For each piece of recorded information at a certain position, it is possible to select an attribute identifier recording area at a position where it is easy to connect a connecting line, and record the connecting line connected to the attribute identifier at that position. As a result, it is possible to reduce the possibility that a plurality of connecting lines intersect and the possibility that a connecting line and an information area intersect, and execute the determination process of the correspondence between the information area and the attribute identifier by image analysis with higher accuracy. And accurate data management is realized. Further, the connecting line to be connected by the user is shortened, and the load on the user is reduced.

  Details of an information processing apparatus, an information processing method, and a computer program according to embodiments of the present invention will be described below with reference to the drawings.

[Example 1]
With reference to FIG. 2, the configuration and processing of an embodiment of the information processing apparatus of the present invention will be described. FIG. 2 is a diagram illustrating processing executed by the information processing apparatus according to the present invention, and is a block diagram illustrating processing executed by the information processing apparatus as individual blocks. The data processing executed by the information processing apparatus is executed by applying the hardware of the information processing apparatus and a computer program. The diagram shown in FIG. It is the block diagram shown as another block. A specific example of the hardware configuration of the information processing apparatus will be described later.

  Processing executed by the information processing apparatus of the present invention will be described with reference to the block diagram shown in FIG. The attribute identifier plural adding unit 101 determines the type and recording position of attribute identifier data to be recorded on the output document 110 output by the data output unit 102 and notifies the data output unit 102 of these.

  The attribute identifier is an identifier indicating an attribute set for the document 110 corresponding to information recorded by the user. Here, an example will be described in which the SOAP method is applied in which the document 110 is a chart sheet and the attribute set for each piece of recording information recorded on the chart is S, O, A, or P.

As described above, SOAP is code information associated with the following data, for example.
[S] is Subjective data, which is code information associated with subjective data directly provided by the patient.
[O] is objective data, which is code information associated with objective data acquired by a doctor or nurse.
[A] is Asset data, which is code information associated with judgment data of doctors and nurses.
[P] is Plan data, which is code information associated with data such as schedule information for diagnosis, treatment, or education.

  In the following description, an example in which a medical chart is a manuscript and SOAP is applied as an attribute identifier will be described. However, the present invention is not applicable only to a medical chart to which the SOAP method is applied, and other attribute identifiers are used. The present invention can be applied to various originals associated with the recording information of each area.

  The attribute identifier plural adding unit 101 determines the type and recording position of attribute identifier data to be recorded on the output document 110 output by the data output unit 102 and notifies the data output unit 102 of these. At this time, the same attribute identifier plural adding means 101 is set to record the same attribute identifier at different positions on the output document 110. For example, the same attribute identifier is recorded on each of two different sides, three sides, or four sides of the document.

  The data output means 102 prints out a predetermined original format, for example, a medical chart original in accordance with the medical chart format in this embodiment. In the output document 110, attribute identifiers are recorded according to the type and recording position of the attribute identifier data determined by the attribute identifier plural adding unit 101.

  As shown in the figure, a plurality of SOAP attribute identifiers are recorded and output on the output document 110 at different positions. In this example, the output document 110 shows an example in which three attribute identifier recording areas 111 to 113 are set.

  The user records various pieces of information on the output document 110 in which the same attribute identifier is recorded at a plurality of locations, and records a connecting line connecting each area of the recorded information and any of the attribute identifiers. . As shown in the completed manuscript 120, the user fills in various information on the manuscript and records a connecting line that connects each information recording area with an attribute identifier.

For example, in the information recording area 121, a connection line 122 that is connected to the attribute identifier [A] recorded in the attribute identifier recording area 111 is recorded, and the recording information in the information recording area 121 is [A], that is, Assessment. Shown to be data.
In the information recording area 123, a connection line 124 connected to the attribute identifier [O] recorded in the attribute identifier recording area 112 is recorded. The recording information in the information recording area 123 is [O], that is, Objective. Shown to be data.
In the information recording area 125, a connection line 126 connected to the attribute identifier [P] recorded in the attribute identifier recording area 112 is recorded. The recording information in the information recording area 125 is [P], that is, Plan. Shown to be data.
In the information recording area 127, a connection line 128 that is connected to the attribute identifier [A] recorded in the attribute identifier recording area 113 is recorded, and the recording information in the information recording area 127 is [A], that is, Assessment. Shown to be data.

  As described above, since the same attribute identifier is recorded in a plurality of different positions on the document, the user records a connection line with the attribute identifier of the attribute identifier recording area located closest to each information recording area. be able to. As a result, the possibility that the connecting lines intersect each other and the possibility that the connecting lines and the information areas intersect can be greatly reduced, and the correspondence between each information recording area and the attribute identifier can be clearly analyzed. Further, the connecting line to be connected by the user is shortened, and the load on the user is reduced.

  The process for analyzing the correspondence between each information recording area and the attribute identifier will be described. The completed manuscript 120 is read as image data by an image input unit 103 such as a scanner, and the connecting line extracting unit 104 executes a connecting line extraction process based on image analysis.

  The connecting line extracting unit 104 first acquires the position information of the attribute identifier in the scanned image acquired by the image input unit 103. The connecting line extraction unit 104 acquires information about the types of attribute identifiers recorded on the document in advance, and obtains the recorded positions of these attribute identifiers by analyzing the scanned image acquired by the image input unit 103. . Next, a line segment image as a connection line candidate is extracted, and only the line segment connected to the attribute identifier in the extracted line segment image is determined as a connection line and selected. This connection line information is output to the connection line designation attribute identifier determination unit 105.

  The connection line designation attribute identifier determination unit 105 determines the type of attribute identifier to which the connection line extracted by the connection line extraction unit 104 is connected. In this example, the attribute identifier is SOAP, and it is determined to which connection line each connection line is connected.

  Next, the layout analysis unit 106 performs a layout analysis of the completed document 120. The layout analysis in the layout analysis means 106 is executed as a process for analyzing the information area classification of the input image data, such as an area analysis of a character area, a photograph area, or the like. For example, as shown in FIG. 3, the information areas 1 to 7 and 131 to 137 included in the completed document 120 are determined.

  The information area correspondence attribute determination unit 107 determines the attribute of each information area included in the completed document 120 analyzed by the layout analysis unit 106. In this processing, each information area included in the completed manuscript 120 analyzed by the layout analysis unit 106 and the connection line connection attribute extracted by the connection line extraction unit 104 and determined by the connection line designation attribute identifier determination unit 105 are connected. It is executed based on identifier information (SOAP). That is, it is determined to which attribute identifier information (SOAP) each information area is connected by a connecting line, and the connected attribute identifier is determined as an attribute of the information area.

  For example, based on the example of the completed manuscript 120 shown in FIG. 3, correspondence data between information areas and attributes as shown in FIG. 4 is obtained. This correspondence data is stored in the database 108. The text data of each information area is converted into text by, for example, OCR (Optical Character Recognition), stored in the database 108, and the attribute identifier analyzed in the above process is used as attribute information corresponding to the text data. It may be set and stored in the database.

  As described above, in the configuration of the present invention, since a document in which the same attribute identifier is recorded at a plurality of different positions is output, the user can easily connect connecting lines for each piece of recorded information at various positions. By selecting an attribute identifier recording area, a connecting line connecting to the attribute identifier at the position can be recorded. As a result, it is possible to reduce the possibility that a plurality of connecting lines intersect and the possibility that a connecting line and an information area intersect, and execute the determination process of the correspondence between the information area and the attribute identifier by image analysis with higher accuracy. And accurate data management is realized. Further, the connecting line to be connected by the user is shortened, and the load on the user is reduced.

[Example 2]
Next, the configuration and processing of the information processing apparatus according to the second embodiment of the present invention will be described with reference to FIG. The difference between the second embodiment and the first embodiment described with reference to FIG. 2 is that the output original 110 used in the first embodiment is the printed output original 110, whereas the second embodiment is different. Then, as shown in FIG. 5, the same attribute identifier is added to a plurality of different positions using the display unit 210 of the information processing apparatus having a display such as a PC without using a printed document. The document 211 is configured to be displayed.

  In the first embodiment, the user is configured to record information on the printed output document 110. However, in the second embodiment, the user is configured to use a user input unit such as a keyboard of an information processing apparatus such as a PC. Enter the information and record the connection lines. This process is executed by applying the user input unit 203 to the document 211 displayed on the display unit 210 such as a PC.

  An input document 220 having information and connection lines input by applying the user input unit 203 is similar in data structure to the completed document 120 of the first embodiment, but is an information processing apparatus having a display unit 210. It is recorded as stored data. That is, in this embodiment, all processing is executed without performing print output.

  The connecting line extracting unit 204 executes a connecting line extracting process based on the image data of the input original 220 recorded in the information processing apparatus having the display unit 210. That is, in the present embodiment, the image input process to which the image input unit 103 of the first embodiment described with reference to FIG. 2 is applied is omitted. The connecting line extracting unit 204 first acquires the position information of the attribute identifier from the image data of the input document 220 stored in a storage unit such as a hard disk in the information processing apparatus. The connecting line extraction unit 204 acquires information about the types of attribute identifiers recorded on the document in advance, and obtains the positions where these attribute identifiers are recorded by analyzing the image data of the input document 220. Next, a line segment image as a connection line candidate is extracted, and only the line segment connected to the attribute identifier in the extracted line segment image is determined as a connection line and selected. This connection line information is output to the connection line designation attribute identifier determination unit 205.

  The connection line designation attribute identifier determination unit 205 determines the type of attribute identifier to which the connection line extracted by the connection line extraction unit 204 is connected. In this example, the attribute identifier is SOAP, and it is determined to which connection line each connection line is connected.

  Next, the layout analysis unit 206 performs a layout analysis of the image data of the input document 220 stored in a storage unit such as a hard disk in the information processing apparatus. For example, as described above with reference to FIG. 3, the information areas 1 to 7 and 131 to 137 included in the input document 220 are determined.

  The information area correspondence attribute determination unit 207 determines the attribute of each information area included in the input document 220 analyzed by the layout analysis unit 206. In this process, each information area included in the input document 220 analyzed by the layout analysis unit 206 and the connection line attributes extracted by the connection line extraction unit 204 and determined by the connection line designation attribute identifier determination unit 205 are connected. It is executed based on identifier information (SOAP). That is, it is determined to which attribute identifier information (SOAP) each information area is connected by a connecting line, and the connected attribute identifier is determined as an attribute of the information area.

  This result is the same as that in the first embodiment described above, and correspondence data between information areas and attributes as shown in FIG. 4 is obtained. This correspondence data is stored in the database 208. As described in the first embodiment, the text data of each information area is converted into text by, for example, OCR (Optical Character Recognition), stored in the database 208, and attribute information corresponding to the text data is as follows. The attribute identifier analyzed in the above process may be set and stored in the database.

  Next, the execution processing sequence of the information processing apparatus will be described with reference to the flowchart shown in FIG. The flowchart shown in FIG. 6 is a flowchart for explaining a processing sequence corresponding to the first embodiment and the second embodiment described above.

  First, in step S101, the type and recording position of an attribute identifier to be recorded on an output document scheduled to be printed or displayed are determined. In step S102, according to the type and recording position of the attribute identifier determined in step S101, a document on which the same attribute identifier is recorded at a plurality of different positions is printed out or output to a display.

  In step S103, the user records various information, and further enters or inputs a connecting line connecting the recorded information and the attribute identifier. In step S104, information and image data of the linked originals are input. This process is a scan process when the document is printed out, and an image data acquisition process from a storage unit such as a hard disk when the display output image is recorded.

  Next, in step S105, the position of the attribute identifier is extracted from the input image data, and in step S106, a line segment image that is a candidate for a connecting line is extracted. This process corresponds to the process of the connecting line extracting unit 104 in the configuration of the first embodiment shown in FIG. 2, and the connecting line extracting means 204 in the configuration of the second embodiment shown in FIG.

  Next, in step S107, a connection line that specifies an attribute identifier is extracted, and the correspondence between the attribute and the connection line is determined. This process corresponds to the process of the connecting line designation attribute identifier determining unit 105 in the configuration of the first embodiment shown in FIG. 2 and the process of the connecting line designation attribute identifier determining means 205 in the configuration of the second embodiment shown in FIG. In this example, the attribute identifier is SOAP, and it is determined to which connection line each connection line is connected.

  In step S108, the connecting line image is deleted from the document image on which information has been entered (input). This is a process executed as a pre-process of the layout analysis process in step S109, and is a process for accurately performing the layout analysis. In step S109, layout analysis of the document image on which information has been entered (input) is executed. This corresponds to the processing of the layout analysis means 106 in the configuration of the first embodiment shown in FIG. 2, and the layout analysis means 206 in the configuration of the second embodiment shown in FIG. Specifically, as described above with reference to FIG. 3, each information area included in the document is determined.

  Next, in step S110, the attribute associated by the connecting line is determined as the attribute of each information area. This corresponds to the processing of the information area correspondence attribute determining means 107 in the configuration of the first embodiment shown in FIG. 2, and corresponds to the processing of the information area correspondence attribute determining means 207 in the configuration of the second embodiment shown in FIG. This is a process for determining the attribute of each information area included in a completed (input) document.

  In this process, each information area included in the completed (inputted) document analyzed by the layout analysis unit, and the attribute identifier connected to each connection line extracted by the connection line extraction unit and determined by the connection line designation attribute identifier determination unit It is executed based on information (SOAP). That is, it is determined to which attribute identifier information (SOAP) each information area is connected by a connecting line, and the connected attribute identifier is determined as an attribute of the information area. Each information area corresponding attribute information obtained as a result is stored in the database. That is, for example, correspondence data between information areas and attributes described above with reference to FIG. 4 is acquired and stored in a database.

  As described above, in the configuration of the present invention, since the document in which the same attribute identifier is recorded at a plurality of different positions is output, the user can easily connect the connection lines for each piece of recorded information at various positions. It is possible to select a certain attribute identifier recording area and record a connecting line connecting to the attribute identifier at that position. As a result, it is possible to reduce the possibility that a plurality of connecting lines intersect and the possibility that a connecting line and an information area intersect, and execute the determination process of the correspondence between the information area and the attribute identifier by image analysis with higher accuracy. And accurate data management is realized. Further, the connecting line to be connected by the user is shortened, and the load on the user is reduced.

[Example 3]
Next, the configuration and processing of the information processing apparatus according to the third embodiment of the present invention will be described with reference to FIG. The third embodiment is different from the first embodiment described with reference to FIG. 2 in that an attribute identifier writing mode learning unit 301 is added. Other configurations are the same as those of the first embodiment.

  The attribute identifier writing mode learning unit 301 executes a process of changing the optimal writing position of the attribute identifier and the optimal writing mode by a learning process of analyzing the past information writing original stored in the database 108. The learning result is notified to the attribute identifier plural adding means 101. The attribute identifier plural adding unit 101 records the output document according to the optimum attribute identifier writing position and mode determined based on the past result data based on the learning result input from the attribute identifier writing mode learning unit 301. The position and mode of the attribute identifier to be determined are sequentially updated and determined. Since the processing in the other configuration is the same as that of the first embodiment, the description thereof is omitted.

  Note that the attribute identifier writing mode learning unit 301 can be added even when the display output is performed without performing the print output as in the second embodiment.

  An example of the position and mode of the attribute identifier determined by the attribute identifier writing mode learning unit 301 will be described with reference to FIGS.

  FIG. 8 shows three examples of the position and mode of the attribute identifier set for the output document. FIG. 8A shows an example in which the arrangement of attribute identifiers is changed. For example, most of the information recorded in the information area 411 by learning based on past data stored in the database is information linked to the attribute identifier S or O, while the information recorded in the information area 412 When statistics that most of the information are linked to the attribute identifier A or P are obtained, S and O are set as the attribute identifiers in the vicinity of the information area 411, and the attributes in the vicinity of the information area 412 are set. In this example, A and P are recorded as identifiers.

  FIG. 8B is an example in which the arrangement of attribute identifiers is changed as in FIG. For example, much of the information recorded in the information area 421 by learning based on past data stored in the database is information linked to the attribute identifier O, while much of the information recorded in the information area 422 However, when statistics indicating that the information is linked to the attribute identifier P is obtained, only the attribute identifier O recorded in the vicinity of the information area 421 is recorded close to the information area 421. Furthermore, in this example, only the attribute identifier P recorded in the vicinity of the information area 422 is set to be recorded close to the information area 422.

  FIG. 8C shows an example in which the font size of the attribute identifier is changed. For example, most of the information recorded in the information area 431 by learning based on past data stored in the database is information linked to the attribute identifier O, while much of the information recorded in the information area 432 However, when the statistic that the information is linked to the attribute identifier P is obtained, the font size of only the attribute identifier O recorded in the vicinity of the information area 431 is increased and recorded. Furthermore, in this example, the font size of only the attribute identifier P to be recorded in the vicinity of the information area 432 is set to be recorded with a larger font size.

  FIG. 9D shows an example in which the font color of the attribute identifier is changed. For example, most of the information recorded in the information area 441 by learning based on past data stored in the database is information linked to the attribute identifier O. On the other hand, much of the information recorded in the information area 442 However, when the statistic that the information is linked to the attribute identifier P is obtained, the font color of only the attribute identifier O recorded in the vicinity of the information area 441 is changed (for example, set to (red) and recorded. Furthermore, in this example, the font color of only the attribute identifier P recorded in the vicinity of the information area 442 is changed (for example, set to (red) and recorded.

  FIG. 9E shows an example in which the font type of the attribute identifier is changed. For example, much of the information recorded in the information area 451 by learning based on past data stored in the database is information linked to the attribute identifier O, while much of the information recorded in the information area 452 However, when the statistics that the information is linked to the attribute identifier P is obtained, the font type of only the attribute identifier O recorded in the vicinity of the information area 451 is changed and recorded. Furthermore, in this example, the font type of only the attribute identifier P recorded in the vicinity of the information area 452 is changed and recorded.

  As described above, the third embodiment executes a learning process based on statistical analysis based on past information recorded data accumulated in a database, sets the position and mode of an attribute identifier that allows a user to easily write a connection line, It has a configuration in which the document output is performed by sequentially updating the learning result.

  An execution processing sequence of the information processing apparatus according to the third embodiment will be described with reference to a flowchart illustrated in FIG. First, in step S201, the type and recording position of the attribute identifier to be recorded on the output document scheduled to be printed or displayed are determined based on the learning result. This is processing of the same attribute identifier plural adding unit 101 shown in FIG. 7 and is executed based on the learning result from the attribute identifier writing mode learning unit 301.

  The processes in steps S202 to S210 are executed as the same processes as the processes in steps S102 to S110 described above with reference to the flow of FIG.

  In step S211, statistics are taken regarding attribute identifiers linked to information areas stored in the database. In step S212, the attribute identifier position / mode change information is notified with reference to the statistical result. These processes are the processes of the attribute identifier writing mode learning unit 301 shown in FIG. 7. For example, various attribute identifier output modes as described with reference to FIGS. 8 and 9 are determined based on the learning results. Then, the same attribute identifier plural adding means 101 shown in FIG.

  At the time of the next document output, the attribute identifier plural adding unit 101 determines the type and recording position of the attribute identifier to be recorded on the output document based on the learning result notified from the attribute identifier writing mode learning unit 301 in step S201. To determine and output.

  According to the configuration of the third embodiment, statistical processing and learning processing based on accumulated data on which information writing and connection line writing have been performed are executed, and the optimal attribute identifier arrangement and output mode are determined based on the learning results. Thus, the output mode of the attribute identifier is sequentially updated and output in an optimal mode, and the output of the attribute identifier recording document that is easy for the user to use is realized.

  Finally, with reference to FIG. 11, a hardware configuration example of the information processing apparatus of the present invention will be described. The configuration illustrated in FIG. 11 is an information processing apparatus configured by a PC, for example, and illustrates a hardware configuration example including a data reading unit 531 such as a scanner and a data output unit 532 corresponding to a printer.

  A CPU (Central Processing Unit) 501 performs various data processing described in the above-described embodiments, that is, attribute identifier position, mode determination processing, connection line extraction based on image analysis, layout analysis processing, and attribute determination processing for each information region The control unit executes processes according to a computer program describing an execution sequence of each process.

  A ROM (Read Only Memory) 502 stores programs used by the CPU 501, calculation parameters, and the like. A RAM (Random Access Memory) 503 stores programs used in the execution of the CPU 501, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 504 including a CPU bus.

  The host bus 504 is connected to an external bus 506 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 505.

  A keyboard 508 and a pointing device 509 are input devices operated by the user. The display 510 includes a liquid crystal display device, a CRT (Cathode Ray Tube), or the like, and displays various information as text or image information.

  An HDD (Hard Disk Drive) 511 includes a hard disk, drives the hard disk, and records or reproduces a program executed by the CPU 501 and information. The hard disk stores input image data, information-recorded image data in which information is recorded by a user and a connection line is recorded, text data, and the like. Further, various computer programs such as various data processing programs are stored.

  The drive 512 reads data or a program recorded on a removable recording medium 521 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and the data or program is read out from the interface 507 and the external bus 506. , And supplied to the RAM 503 connected via the bridge 505 and the host bus 504. The removable recording medium 521 can also be used as a data recording area similar to a hard disk.

  The connection port 514 is a port for connecting the external connection device 522 and has a connection unit such as USB or IEEE1394. The connection port 514 is connected to the CPU 501 and the like via the interface 507, the external bus 506, the bridge 505, the host bus 504, and the like. The communication unit 515 is connected to a network and executes data communication processing with the outside. The data reading unit 531 executes document reading processing, and the data output unit 532 executes document data output processing.

  Note that the hardware configuration example of the information processing apparatus shown in FIG. 11 shows one example of the apparatus, and the information processing apparatus of the present invention is not limited to the configuration shown in FIG. Any configuration capable of executing the process may be used.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present invention. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims should be taken into consideration.

  The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run.

  For example, the program can be recorded in advance on a hard disk or ROM (Read Only Memory) as a recording medium. Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored (recorded). Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the removable recording medium as described above, or is wirelessly transferred from the download site to the computer, or is wired to the computer via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this manner and install it on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

  As described above, according to the configuration of the present invention, for a document on which information having various attributes is recorded, a document in which the same attribute identifier is recorded at a plurality of different positions is generated and output. Therefore, the user can select an attribute identifier recording area at a position where a connection line can be easily connected for each piece of recording information at various positions, and record the connection line connected to the attribute identifier at that position. As a result, it is possible to reduce the possibility that a plurality of connecting lines intersect and the possibility that a connecting line and an information area intersect, and execute the determination process of the correspondence between the information area and the attribute identifier by image analysis with higher accuracy. And accurate data management is realized. In addition, since the user can easily enter the connection line, the load on the user is reduced.

It is a figure explaining the example of the original document which recorded the attribute identifier. It is a block diagram explaining the structure and process of the information processing apparatus which concerns on one Example of this invention. It is a figure explaining the layout analysis which the information processing apparatus of this invention performs. It is a figure explaining the correspondence data of an information area and an attribute generated by processing which information processor of the present invention performs. It is a block diagram explaining the structure and process of an information processing apparatus which concern on 2nd Example of this invention. It is a figure which shows the flowchart explaining the process sequence which the information processing apparatus of one Example of this invention performs. It is a block diagram explaining the structure and process of the information processing apparatus which concern on 3rd Example of this invention. It is a figure explaining the output change example of the attribute identifier implement | achieved by the process of the information processing apparatus which concerns on 3rd Example of this invention. It is a figure explaining the output change example of the attribute identifier implement | achieved by the process of the information processing apparatus which concerns on 3rd Example of this invention. It is a figure which shows the flowchart explaining the process sequence which the information processing apparatus which concerns on 3rd Example of this invention performs. It is a figure explaining the hardware structural example of the information processing apparatus of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Document 11 Attribute identifier 12 Connection line 15 Information area data 21 Intersection 101 Same attribute identifier plural addition means 102 Data output means 103 Image input means 104 Connection line extraction means 105 Connection line designation attribute identifier determination means 106 Layout analysis means 107 Information area correspondence Attribute determination means 108 Database 110 Output original 111, 112, 113 Attribute identifier recording area 120 Completed original 121, 123, 125, 127 Information area 122, 124, 126, 128 Link 131-137 Information area 201 Multiple addition of same attribute identifier Means 202 Image display means 203 User input means 204 Connection line extraction means 205 Connection line designation attribute identifier determination means 206 Layout analysis means 207 Information area correspondence attribute determination means 208 Database 210 Display means 211 Document 220 Input document 301 Attribute identifier writing sun learning means 411, 412 Information area 421, 422 Information area 431, 432 Information area 441, 442 Information area 451, 452 Information area 501 CPU (Central Processing Unit)
502 ROM (Read-Only-Memory)
503 RAM (Random Access Memory)
504 Host bus 505 Bridge 506 External bus 507 Interface 508 Keyboard 509 Pointing device 510 Display 511 HDD (Hard Disk Drive)
512 drive 514 connection port 515 communication unit 521 removable recording medium 522 external connection device 531 data reading unit 532 data output unit

Claims (9)

An information processing device,
A connection line extracting means for extracting a connection line between the information area and the attribute identifier included in the image data in which the same attribute identifier is recorded at a different position of the document;
Layout analysis means for performing layout analysis of image data;
Each information area obtained as an analysis result of the layout analysis means, an attribute identifier connected by the connecting line, and an information area corresponding attribute determination means for determining an attribute of the information area;
An information processing apparatus comprising: The information processing apparatus further includes:
The information processing apparatus according to claim 1, characterized in that it comprises a database for storing the information area and the attribute information of each information region obtained by the corresponding attribute determination unit, in association with the information of each information region. The information processing apparatus further includes:
Learning means for executing learning processing including statistical processing of attribute information of each information area stored in the database;
Attribute identifier adding means for executing processing for determining an attribute identifier setting mode based on a learning result in the learning means;
The information processing apparatus according to claim 2 , wherein the information processing apparatus has a configuration. An information processing method,
A connection line extracting step for extracting a connection line between the information area and the attribute identifier included in the image data in which the same attribute identifier is recorded at different positions on the document;
A layout analysis step for performing layout analysis of image data;
Each information area obtained as an analysis result in the layout analysis step, an attribute identifier connected by the connecting line, an information area corresponding attribute determination step for determining an attribute of the information area,
An information processing method characterized by comprising: The information processing method further includes:
5. The information processing method according to claim 4 , further comprising a step of storing the attribute information of each information area acquired in the information area correspondence attribute determination step and the information of each information area in a database in association with each other. . The information processing method further includes:
A learning step for executing a learning process including a statistical process of attribute information of each information area stored in the database;
An attribute identifier adding step for executing a process of determining an attribute identifier setting mode based on a learning result in the learning step;
The information processing method according to claim 5 , further comprising: A computer program for causing an information processing apparatus to execute document analysis processing;
A connection line extracting step for extracting a connection line between the information area and the attribute identifier included in the image data in which the same attribute identifier is recorded at different positions on the document;
A layout analysis step for performing layout analysis of image data;
Each information area obtained as an analysis result in the layout analysis step, an attribute identifier connected by the connecting line, an information area corresponding attribute determination step for determining an attribute of the information area,
A computer program characterized by comprising: further,
8. The computer program according to claim 7, further comprising a step of storing the attribute information of each information area acquired in the information area correspondence attribute determining step and the information of each information area in a database in association with each other. . further,
A learning step for executing a learning process including a statistical process of attribute information of each information area stored in the database;
An attribute identifier adding step for executing a process of determining an attribute identifier setting mode based on a learning result in the learning step;
The information processing apparatus according to claim 8, further comprising:

Images