JP6841208B2 - Image processing device - Google Patents

Description

The present invention relates to an image processing device capable of editing a character string in an original image.

Generally, a manuscript created by a word processor or the like may be corrected by handwriting.

Further, it is known that an image processing device reads an image of the manuscript to which a handwritten character string is added and performs document editing processing based on the handwritten character string based on the scanned image (for example, Patent Document 1). reference). In this case, the image processing device inserts a character string of electronic data corresponding to the handwritten character string at a designated position in the original character string printed on the manuscript, and represents the edited character string. Generate document data.

JP-A-2010-244466

By the way, it would be convenient if the format of a part of the character string printed on the manuscript could be easily changed.

For example, one person first creates a manuscript without worrying about the format of the character string, and another person or the same person adds a mark by hand to a part of the character string in the manuscript to create an image. It is conceivable that the processing device executes a process of replacing the marked character string with a character string in the format specified by the mark. This makes it possible to easily change the format of a part of the character string printed on the manuscript.

An object of the present invention is to provide an image processing apparatus capable of easily changing the format of a part of a character string printed on a manuscript.

The image processing device according to one aspect of the present invention includes a character string extraction device, an edit content setting device, and an image data generation device. The character string extraction device extracts a mark satisfying a predetermined condition from the original image represented by the original image data and a target character string which is a character string with the mark. The editing content setting device is the character format corresponding to the mark type attached to the target character string based on editing information including information on the correspondence between the mark type and the character format type. A specific format can be set. The image data generation device executes an editing process including a process of replacing a portion of the target character string in the original image with an image of the converted character string which is the target character string represented in the specific format. Generates output image data representing the edited output image.

According to the present invention, it is possible to provide an image processing apparatus capable of easily changing the format of a part of a character string printed on a manuscript.

FIG. 1 is a block diagram of an image processing device according to an embodiment. FIG. 2 is a diagram showing an example of a marked document. FIG. 3 is a diagram showing an example of a printed matter obtained by the automatic editing process of the image processing apparatus according to the embodiment. FIG. 4 is a flowchart showing an example of the procedure of the automatic editing process of the image processing apparatus according to the embodiment. FIG. 5 is a diagram showing an example of a format setting screen in the image processing apparatus according to the embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. It should be noted that the following embodiment is an example embodying the present invention and does not have a character that limits the technical scope of the present invention.

FIG. 2 shows an example of the manuscript 91 in which the original image I1 including the handwritten marks M1, M2, M3, and M4 is formed. The image processing apparatus 10 according to the embodiment reads the original image I1 from the original 91 as shown in FIG. 2, edits the original image I1 in a document corresponding to the marks M1, M2, M3, and M4, and outputs the edited image. It has a function to generate data of image I2.

[Configuration of image processing device 10]
As shown in FIG. 1, the image processing device 10 includes a CPU (Central Processing Unit) 1, an operation display device 2, an image reading device 20, a reading control device 30, an image forming device 40, a printing control device 50, and a communication device 60. , Image data processing device 70, RAM (Random Access Memory) 1a, secondary storage device 1b, and the like.

The CPU 1, the read control device 30, the print control device 50, and the communication device 60 are connected to the bus 9, and data can be exchanged with each other through the bus 9.

The image reading device 20 reads the image of the original 91 and outputs the original image data D01 representing the original image I1. The image reading device 20 includes an exposure device (not shown), an image sensor, and the like. The exposure device irradiates the document 91 with light, and the image sensor detects the amount of light reflected from the document 91 for each pixel. Further, the image sensor outputs original image data D01 including data of light intensity values of a plurality of pixels.

In the present embodiment, the image reading device 20 includes a color image sensor capable of reading a color image. Therefore, when the original image I1 includes a color image, the image reading device 20 outputs the color original image data D01.

The reading control device 30 controls the image reading device 20 and acquires the original image data D01 from the image reading device 20. Further, the reading control device 30 transfers the original image data D01 to another device such as the image data processing device 70 through the bus 9.

The image forming apparatus 40 forms an image on a sheet by a well-known electrophotographic method or an inkjet method image forming process.

For example, the electrophotographic image forming apparatus 40 includes a photoconductor (not shown), a charging apparatus, a laser scanning unit, a developing apparatus, a transfer apparatus, a fixing apparatus, and the like.

The charging device charges the photoconductor, the laser scanning unit writes an electrostatic latent image on the photoconductor, and the developing device develops the electrostatic latent image on the photoconductor into a toner image. The transfer device transfers the toner image from the photoconductor to the sheet. The fixing device fixes the toner image on the sheet by heating the toner image on the sheet. The sheet on which the toner image is fixed is the printed matter 92.

The print control device 50 acquires the output image data D02 from the image data processing device 70, and causes the image forming device 40 to execute a process of forming an image based on the output image data D02 on the sheet. The output image data D02 is image data for output obtained by image processing based on the original image data D01. The image represented by the output image data D02 is the output image I2.

The communication device 60 is a communication interface device that transmits / receives data to / from an external device such as a personal computer through a communication line 101 such as a LAN. All communication with the external device executed by the CPU 1 is performed through the communication device 60.

Further, the communication device 60 transfers data to and from each device such as the CPU 1, the read control device 30, and the print control device 50 through the bus 9.

The image data processing device 70 executes various data processing on image data and the like obtained from other devices through the bus 9. The original image data D01 is the target of data processing by the image data processing device 70.

The read control device 30, the print control device 50, and the image data processing device 70 are realized by, for example, a processor such as an MPU (Micro Processing Unit) or a DSP (Digital Signal Processor), or a circuit such as an ASIC (Application Specific Integrated Circuit). ..

The operation display device 2 is a user interface device, and includes an operation device 2a and a display device 2b. The operation device 2a is an information input device that accepts user operations. In the present embodiment, the operating device 2a includes a touch panel.

The display device 2b is a device that displays information as an image. For example, it is conceivable that the display device 2b is a liquid crystal display panel.

The CPU 1 is a processor that executes various operations and data processing. The CPU 1 controls the image processing device 10 in a centralized manner.

For example, the CPU 1 causes the display device 2b to display various menu screens and the like. Further, the CPU 1 outputs a control command to another control unit according to the input information input through the operation on the operation device 2a and the detection results of various sensors.

The RAM 1a is a volatile computer-readable main storage unit that temporarily stores a program for execution by the CPU 1.

The secondary storage device 1b is a non-volatile computer-readable storage unit that stores various information referred to by the CPU 1. The secondary storage device 1b stores a program for causing the CPU 1 to execute various processes, information referred to by the CPU 1, and information written by the CPU 1.

As shown in FIG. 2, the manuscript 91 created by a word processor or the like may be modified by handwriting. The original image I1 shown in FIG. 2 includes handwritten marks M1, M2, M3, M4 added to the original manuscript 91, and a handwritten character string T1.

In the present embodiment, the image read from the document 91 is an example of the original image I1 including the marks M1, M2, M3, and M4.

Further, in the present embodiment, the image data obtained by the image reading device 20 reading the image of the document 91 is an example of the original image data D01. The original image data D01 may be included in the print job received from another device.

It is known that a conventional device that executes image processing reads an image of a document 91 to which a handwritten character string T1 is added, and performs document editing processing based on the handwritten character string T1 based on the scanned image. In this case, the conventional device inserts a character string of electronic data corresponding to the handwritten character string T1 at a designated position in the original character string printed on the document 91, and represents the edited character string. Generate document data.

By the way, it would be convenient if the format of a part of the character string printed on the manuscript 91 could be easily changed.

For example, one person first creates a manuscript 91 without worrying about the format of the character string, and another person or the same person adds marks M1 and M2 by hand to a part of the character string in the manuscript 91. It is conceivable to do. Further, it is conceivable that the image processing device 10 executes a process of replacing the marked character string with a character string in the format specified by the marks M1 and M2. This makes it possible to easily change the format of a part of the character string printed on the document 91.

The image processing device 10 can execute the automatic editing process described later. As a result, the user of the image processing device 10 can easily change the format of a part of the character string printed on the document 91.

The image data processing device 70 includes a character string extraction unit 71 and an image data generation unit 72. The character string extraction unit 71 is an example of a character string extraction device, and the image data generation unit 72 is an example of an image data generation device.

For example, when the image data processing device 70 is composed of a processor such as the MPU or the DSP, the processor executes a computer program, and the processor operates as a character string extraction unit 71 and an image data generation unit 72. To do.

When the image data processing device 70 is composed of a circuit such as an ASIC, the circuit includes a plurality of sub-circuits that operate as a character string extraction unit 71 and an image data generation unit 72.

Further, the CPU 1 includes an edit content setting unit 11, an edit history recording unit 12, an edit history output unit 13, an edit rule generation unit 14, and the like. The editing content setting unit 11 is an example of an editing content setting device, the editing history recording unit 12 is an example of an editing history recording device, and the editing history output unit 13 is an example of an editing history output device. The generation unit 14 is an example of an editing rule generation device.

The CPU 1 operates as an edit content setting unit 11, an edit history recording unit 12, and an edit history output unit 13 by executing a computer program stored in the secondary storage device 1b.

[Automatic editing process]
Hereinafter, an example of the procedure of the automatic editing process will be described with reference to the flowchart shown in FIG. In the following description, S1, S2, ... Represent the identification code of a plurality of steps in the automatic editing process.

The reading control device 30 starts the automatic editing process when a predetermined automatic editing start event occurs. For example, it is conceivable that the automatic editing start event is that a predetermined automatic editing start operation has been performed on the operation device 2a.

<Step S1>
In the automatic editing process, the reading control device 30 causes the image reading device 20 to execute a process of reading the image of the document 91. As a result, the reading control device 30 acquires the original image data D01 through the image reading device 20.

Further, the reading control device 30 transfers the original image data D01 to the image data processing device. After that, the reading control device 30 shifts the process to step S2.

<Process S2>
In step S2, the character string extraction unit 71 executes a character recognition process for specifying all the character strings included in the original image I1 represented by the original image data D01. After that, the character string extraction unit 71 shifts the process to step S3.

<Process S3>
In step S3, the character string extraction unit 71 extracts the first mark M1, the second mark M2, the third mark M3, and the fourth mark M4 that satisfy the predetermined mark conditions from the original image I1. For example, the mark condition includes a condition for specifying the underline mark, a condition for specifying the box mark M21 and the balloon mark M22, a condition for specifying the underline mark M31, a condition for specifying the deletion mark M32, and the like.

Further, in the step S3, the character string extraction unit 71 is a target character which is a character string to which the first mark M1, the second mark M2, or the third mark M3 is attached from the whole character string obtained in the step S2. Extract column T0.

Further, in step S3, the character string extraction unit 71 extracts the handwritten character string T1 corresponding to the fourth mark M4 from the original image I1. This process is executed when the fourth mark M4 is extracted from the original image I1.

In the example shown in FIG. 2, the first mark M1 is an underline mark recorded along the character string. The color of the first mark M1 is one of a plurality of predetermined candidate colors.

The position of the first mark M1 represents the position of the target character string T0 which is a part or all of all the character strings included in the original image I1. The color of the first mark M1 represents the type of format to be set for the target character string T0.

A plurality of first marks M1 having different colors may be duplicated with respect to one target character string T0. This means that a plurality of types of the character formats are set for one target character string T0. For example, it is conceivable that two types of the character formats, bold and italic, are set for one target character string T0.

In the present embodiment, the editing information D1 is stored in the secondary storage device 1b in advance (see FIG. 1). The editing information D1 includes information on the correspondence between the color of the first mark M1 and the type of character format (see FIG. 5). The color of the first mark M1 is an example of the type of the first mark M1.

It is also conceivable that the editing information D1 includes information on the correspondence between a form other than the color such as the shape of the first mark M1 and the type of the character format.

As the type of format to be set for the target character string T0, bold, diagonal, underline, font type, character string size, and the like can be considered. However, the first mark M1 represents a type of format other than the character string size.

In the example shown in FIG. 2, the second mark M2 has an enclosing mark M21 surrounding the character string, a balloon mark M22 associated with the enclosing mark M21, and a designated value M23 recorded in the balloon mark M22. Including. The designated value M23 is one of a plurality of predetermined candidate values.

The box mark M21 indicates that the character string existing inside the box mark M21 is the target character string T0. Further, the enclosing mark M21 indicates that the size of the target character string T0 corresponding to the surrounding mark M21 is enlarged or reduced by a magnification corresponding to the specified value M23.

That is, the second mark M2 indicates that the character string size is set for the target character string T0. The character string size is an example of a format set for the target character string T0.

In the example shown in FIG. 2, the round balloon mark M22 indicates that the target character string T0 is enlarged, and the inside of the triangular balloon mark M22 indicates that the target character string T0 is reduced.

In the present embodiment, the editing information D1 further includes information on the correspondence between the designated value M23 of the second mark M2 and the magnification of the target character string T0 (see FIG. 5).

In the following description, the registration mark refers to the first mark M1 of the color associated with the character format type in the editing information D1 and the second mark M2 associated with the magnification in the editing information D1. The first mark M1 and the second mark M2 that are not so are referred to as unregistered marks.

The third mark M3 includes an underline mark M31 recorded along the character string and a deletion mark M32 associated with the underline mark M31. The deletion mark M32 shown in FIG. 2 is a cross mark.

The position of the underline mark M31 represents the position of the target character string T0. The deletion mark M32 indicates that the corresponding target character string T0 is deleted. The character string extraction unit 71 extracts the target character string T0, which is a character string with the third mark M3, as the deleted character string Td0 from all the character strings obtained in step S2 (FIGS. 2 and 3). reference). The third mark M3 is an example of a predetermined deletion designation mark.

In the example shown in FIG. 2, the fourth mark M4 is a mark that specifies a specific insertion position in the entire character string. The fourth mark M4 is an example of a predetermined insertion mark. A handwritten character string T1 is written at a position corresponding to the fourth mark M4 in the manuscript 91.

As shown above, the character string extraction unit 71 executes a character recognition process for specifying all the character strings included in the original image I1 (S1). Further, the character string extraction unit 71 executes a mark extraction process for extracting the first mark M1, the second mark M2, the third mark M3, and the fourth mark M4 from the original image I1 (S3).

Further, the character string extraction unit 71 extracts a character string existing at a position corresponding to the first mark M1, the second mark M2, and the third mark M3 from all the character strings as the target character string T0. Then, the character string extraction unit 71 shifts the process from the process S3 to the process S4.

<Process S4>
In step S4, the edit content setting unit 11 of the CPU 1 executes the specific format automatic setting process.

The specific format automatic setting process is a process of setting a specific format which is the character format corresponding to the type of the first mark M1 attached to the target character string T0 based on the edit information D1. When the first mark M1 is the registered mark, the specific format is set by the specific format automatic setting process.

<Process S5>
Further, the editing content setting unit 11 determines whether or not the first mark M1 or the second mark M2 extracted in the step S3 includes the unregistered mark.

If the character string extraction unit 71 determines that the first mark M1 or the second mark M2 includes the unregistered mark, the process shifts to the process S6, and if not, the process shifts to the steps S7 and S8.

<Step S6>
In step S5, the editing content setting unit 11 executes the specific format manual setting process. Further, the editing content setting unit 11 shifts the process from the process S6 to the processes S7 and S8.

The specific format manual setting process includes a process of displaying the format setting screen g0 including the information of the unregistered mark on the display device 2b (see FIG. 5). Further, the specific format manual setting process includes a process of setting the specific format corresponding to the unregistered mark according to an operation on the operation device 2a.

The format setting screen g0 shown in FIG. 5 is a screen including the editing information D1 regarding the first mark M1 and the second mark M2.

In the example shown in FIG. 5, the format setting screen g0 includes a plurality of color display frames g1, a plurality of format selection frames g2, and a plurality of magnification setting frames g3.

Each of the color display frames g1 is a display unit on which the color information of the first mark M1 is displayed. Each of the color display frames g1 corresponds to each of the plurality of candidate colors of the first mark M1.

Each of the format selection frames g2 is a display unit for displaying information on the type of the character format corresponding to each of the plurality of candidate colors of the first mark M1, and a plurality of predetermined types of the character format. It is an operation unit that accepts the operation to select from the candidate formats of.

Each of the magnification setting frames g3 is a display unit that displays the magnification corresponding to each of the plurality of designated values M23 of the second mark M2, and is an operation unit that accepts an operation for setting the magnification.

When the first mark M1 or the second mark M2 extracted in the step S3 includes the unregistered mark, the format setting screen g0 and the unregistered notification icon g4 associated with the unregistered mark are included.

That is, when the first mark M1 or the second mark M2 attached to the target character string T0 is the unregistered mark, the editing content setting unit 11 displays the format setting screen g0 including the information of the unregistered mark. Displayed on the device 2b.

In step S6, the character format or the magnification corresponding to the unregistered mark is set according to the operation of the operation device 2a by the user.

Further, the editing content setting unit 11 can change the character format or the magnification corresponding to the registration mark according to the operation for the operation device 2a.

Further, the format setting screen g0 shown in FIG. 5 also includes an execution icon g5, a save icon g6, a stop icon g7, and the like.

The editing content setting unit 11 ends the specific format manual setting process in response to an operation on the execution icon g5, and shifts the process to steps S7 and S8.

Further, the editing content setting unit 11 updates the editing information D1 stored in the secondary storage device 1b to the content set on the format setting screen g0 in response to the operation for the save icon g6.

Further, the editing content setting unit 11 ends the automatic editing process in response to an operation on the stop icon g7. In FIG. 4, the procedure of processing according to the operation for the stop icon g7 is omitted.

<Steps S7 and S8>
In steps S7 and S8, the image data generation unit 72 executes the format conversion process and the character string editing process. The character string editing process includes one or both of a delete process and an insert process. Further, the image data generation unit 72 shifts the process from the steps S7 and S8 to the step S9.

In the format conversion process, the portion of the target character string T0 in the original image I1 is an image of the converted character string T00 which is the target character string T0 represented by the specific format corresponding to the first mark M1 or the second mark M2. It is a process to replace with.

In the output image I2 shown in FIG. 3, the converted character string T00 in which the target character string T0 is enlarged, the converted character string T00 in which the target character string T0 is represented in diagonal characters, and the target character string T0 are in diagonal and bold characters. Includes the converted character string T00 represented by and the converted character string T00 in which the target character string T0 is reduced.

The deletion process is a process of deleting the deleted character string Td0, which is the target character string T0 corresponding to the third mark M3, from all the character strings specified by the character recognition process (see FIGS. 2 and 3).

The insertion process is a process of inserting an additional character string Ti0 corresponding to the handwritten character string T1 at the position of the fourth mark M4 in the entire character string specified by the character recognition process (see FIG. 3). The additional character string Ti0 is a character string based on electronic data representing the font.

The processes of steps S7 and S8 are an example of an editing process including the format conversion process of replacing the portion of the target character string T0 in the original image I1 with the image of the character string T00 after conversion.

<Process S9>
In step S9, the image data generation unit 72 generates output image data D02 representing the edited output image I2 obtained by the editing process of steps S7 and S8 (see FIG. 3). After that, the image data generation unit 72 shifts the process from step S9 to step S10.

That is, the image data generation unit 72 generates the output image data D02 representing the edited output image I2 by executing the editing process including the format conversion process, the deletion process, and the insertion process (S7 to S7 to). S9).

When the third mark M3 is extracted from the original image I1, the image data generation unit 72 generates the output image data D02 representing the remaining character string by executing the deletion process as the edit process. When the fourth mark M4 and the handwritten character string are extracted from the original image I1, the image data generation unit 72 executes the insertion process as the editing process to execute the insertion process as the editing process, so that the entire character string and the inserted additional characters are inserted. Output image data D02 representing the column Ti0 is generated.

<Step S10>
In step S10, the print control device 50 causes the image forming device 40 to execute a process of forming an image based on the output image data D02 on the sheet. After that, the print control device 50 shifts the process from the process S10 to the process S11.

The process of step S10 is an example of the image output process based on the output image data D02. It is also conceivable that the communication device 60 executes a process of transmitting the output image data D02 to a preset destination as the image output process.

<Process S11>
In step S11, the edit history recording unit 12 of the CPU 1 executes the edit history recording process. After that, the editing history recording unit 12 ends the automatic editing process.

The edit history recording process is a process of recording the edit history information D2 representing the history of the contents of the edit processes S7 and S8 in the secondary storage device 1b (see FIG. 1). The secondary storage device 1b is an example of a non-volatile storage device.

For example, it is conceivable that the editing history recording unit 12 records the content and frequency information of the editing process for each target character string T0 in the secondary storage device 1b as the editing history information D2.

By adopting the image processing device 10 capable of executing the automatic editing process, it is possible to easily change the format of a part of the character string printed on the document 91.

On the other hand, the edit history output unit 13 of the CPU 1 can execute an edit history output process for outputting information based on the edit history information D2 to a predetermined device. For example, the edit history output unit 13 executes the edit history output process in response to a predetermined history output operation for the operation device 2a.

For example, it is conceivable that the device to which the information is output in the edit history output process is an external device connected through the display device 2b or the communication line 101.

The information output by the edit history output process is the edit history information D2 itself, or information in which the content and frequency information of the edit process for each target character string T0 in the edit history information D2 is graphed. Can be considered.

From the information output by the edit history output process, the user can easily grasp what kind of edit process was executed in the past and at what frequency.

The editing rule generation unit 14 of the CPU 1 determines whether or not the information on the frequency of the editing process for each target character string T0 in the editing history information D2 includes information satisfying the frequency condition that the frequency exceeds a predetermined reference frequency. To do.

The user can set the frequency condition based on the information output by the edit history output process. That is, the editing rule generation unit 14 can set the frequency condition according to the operation on the operation device 2a.

In the following description, among the target character strings T0 included in the edit history information D2, those corresponding to the frequency information satisfying the frequency condition are referred to as learning character strings.

Further, when the editing rule generation unit 14 determines that the editing history information D2 includes the information of the frequency satisfying the frequency condition, the editing rule generation unit 14 edits the information representing the correspondence relationship between the learning character string and the content of the editing process. It is set as rule information D3 (see FIG. 1).

For example, it is conceivable that the editing rule generation unit 14 records the editing rule information D3 in the secondary storage device 1b. In the editing rule information D3, the information representing the content of the editing process includes the information in the character format.

Then, the reading control device 30 starts the learning editing process when a predetermined learning editing start event occurs. For example, it is conceivable that the learning / editing start event is that a predetermined learning / editing start operation has been performed on the operation device 2a.

[Learning editing process]
Hereinafter, an example of the learning editing process will be described. In the learning editing process, the reading control device 30 acquires the original image data D01 in the same manner as in step S1 of FIG.

However, the first mark M1 and the second mark M2 may not be written on the manuscript 91 to be read in the learning editing process.

Further, in the learning and editing process, the character string extraction unit 71 identifies the entire character string by executing the character recognition process in the same manner as in step S2 of FIG.

Further, the character string extraction unit 71 executes a process of extracting the same character string as the learning character string included in the editing rule information D3 from the entire character string as the target character string T0, in addition to the process of step S3 of FIG. To do.

Further, in addition to the process of step S4 of FIG. 4, the editing content setting unit 11 sets the character format associated with the same target character string T0 as the learning character string in the editing rule information D3 as the specific format. ..

The specific format set based on the editing rule information D3 is the character format that has been frequently adopted in the past for the same target character string T0 as the learning character string.

Further, in the learning and editing process, the character string extraction unit 71 executes the processes of steps S5 to S8 of FIG. 4, the image data generation unit 72 executes the process of step S9 of FIG. 4, and the print control device 50 However, the process of step S10 of FIG. 4 is executed.

When the learning editing process is executed, it is possible to save the trouble of writing the first mark M1 and the second mark M2 on the manuscript 91.

1: CPU
1a: RAM
1b: Secondary storage device 2: Operation display device 2a: Operation device 2b: Display device 9: Bus 10: Image processing device 11: Editing content setting unit (editing content setting device)
12: Editing history recording unit (editing history recording device)
13: Editing history output unit (editing history output device)
14: Editing rule generator (editing rule generator)
20: Image reading device 30: Reading control device 40: Image forming device 50: Printing control device 60: Communication device 70: Image data processing device 71: Character string extraction unit (character string extraction device)
72: Image data generation unit (image data generation device)
91: Manuscript 92: Printed matter 101: Communication line D01: Original image data D02: Output image data D1: Editing information D2: Editing history information D3: Editing rule information I1: Original image I2: Output image M1: First mark M2: First 2 mark M21: Enclosed mark M22: Blowout mark M23: Specified value M3: Third mark (deletion designation mark)
M31: Underline mark M32: Delete mark M4: Fourth mark (insertion mark)
T0: Target character string T00: Converted character string T1: Handwritten character string Td0: Deleted character string Ti0: Additional character string g0: Format setting screen g1: Color display frame g2: Format selection frame g3: Magnification setting frame g4: Unregistered Notification icon g5: Execute icon g6: Save icon g7: Cancel icon

Claims (5)

A character string extraction device that extracts a mark that satisfies a predetermined condition from the original image represented by the original image data and a target character string that is a character string with the mark, and
Editing that can set a specific format that is the character format corresponding to the mark type attached to the target character string based on editing information including information on the correspondence between the mark type and the character format type. Content setting device and
An output image after editing by executing an editing process including a process of replacing a portion of the target character string in the original image with an image of the converted character string which is the target character string represented in the specific format. An image data generator that generates output image data representing
An edit history recording device that represents a history of the contents of the edit process and records edit history information including information on the contents and frequency of the edit process for each target character string in a non-volatile storage device.
When the editing history information includes a learning character string which is a target character string corresponding to the frequency satisfying a predetermined frequency condition, an editing rule indicating a correspondence relationship between the learning character string and the content of the editing process. and an editing rule generation device to set the information,
The character string extraction device executes a character recognition process for specifying all the character strings included in the original image, and further, the character string existing at a position corresponding to the mark from the all character strings is the target character. Can be extracted as a column
Further, the character string extraction device can extract the same character string as the learning character string included in the editing rule information from all the character strings as the target character string.
The editing content setting device can set the character format included in the content of the editing process associated with the same target character string as the learning character string in the editing rule information as the specific format. apparatus. An operating device that accepts operations and
Further equipped with a display device for displaying information,
When the mark attached to the target character string is an unregistered mark of a type that is not associated with the character format in the editing information, the editing content setting device obtains the information of the unregistered mark. The image processing device according to claim 1, wherein the image processing device is displayed on a display device, and the specific format corresponding to the unregistered mark is set according to an operation on the operating device. An edit history recording device that records edit history information representing the history of the contents of the edit process in a non-volatile storage device, and
The image processing device according to claim 1 or 2, further comprising an edit history output device that outputs information based on the edit history information to a predetermined device. The character string extraction device executes a process of extracting a predetermined deletion designation mark from the original image and a process of extracting a deletion character string with the deletion designation mark from all the character strings. It is possible and
The image data generating apparatus, by executing the process of deleting the deletion string from the whole string as the editing process, it is possible to generate the output image data representing the remainder of the string, from claim 1 The image processing apparatus according to any one of claims 3. The character string extraction device can execute a process of extracting a predetermined insertion mark and a handwritten character string corresponding to the insertion mark from the original image.
The image data generation device is inserted with the entire character string by executing a process of inserting an additional character string corresponding to the handwritten character string at the position of the insertion mark in the entire character string as the editing process. The image processing apparatus according to claim 4 , wherein the output image data representing the additional character string can be generated.

Images