JP4208566B2 - Document image search apparatus and method, document image search system, and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a document image search apparatus and method, document image search system, and program for managing OCR results of document images and searching for OCR results that match the search conditions based on input search conditions. .
[0002]
[Prior art]
2. Description of the Related Art Conventionally, a technique for inputting a document image and performing OCR (Optical Character Recognition) on the document image has been known as digitization of a document. Further, as this applied technology, a document management for managing an OCR target document image and an OCR result (character code data) obtained as an OCR result in association with each other, and retrieving the corresponding document image using the OCR result. The device is realized.
[0003]
In this document management apparatus, by inputting character code data as a search condition included in a document image to be searched, an OCR result made up of the character code data is searched, and the searched OCR result is displayed or The document image to be displayed is displayed. At this time, the character code data input as a search condition included in the OCR result is displayed separately from other character code data, so that the user can be notified of the search status.
[0004]
Japanese Patent Laid-Open No. 9-237320 discloses a technique for generating a file that can display a read document that can be viewed without a sense of incongruity by restoring the format of the read document within the range of characters displayed in character codes. Yes.
[0005]
Furthermore, Japanese Patent Laid-Open No. 10-134141 discloses a recognition result obtained by optically reading a character written on a sheet, and corresponding to the character written on the sheet previously stored in a storage medium. A technique is disclosed in which electronic data and a recognition result are collated, a collation result is obtained, characters of the electronic data are displayed by switching a display method according to the collation result, and the collation result is visually confirmed.
[0006]
[Problems to be solved by the invention]
However, the OCR described in the above prior art is not 100% recognizable, and the OCR result includes not a few misrecognitions. Therefore, for example, even when searching for an OCR result or a corresponding document image using character code data included in the OCR result as a search condition, a satisfactory search result may not be obtained.
[0007]
When searching for a desired character image in the corresponding document image from the OCR result, the character code data that is the OCR result of the desired character image is once input as a search condition from the OCR result, and the search is performed. It is necessary to visually search for a desired character image in the corresponding document image based on the display position of the character code data of the search condition displayed separately from other character code data on the OCR result including the condition, It took time and effort.
[0008]
The present invention has been made to solve the above-described problem, and can efficiently search for a desired OCR result, and easily recognize a desired character image in a document image corresponding to the OCR result. An object of the present invention is to provide a document image search apparatus and method, document image search system, and program that can be used.
[0009]
[Means for Solving the Problems]
  In order to achieve the above object, a document image retrieval apparatus according to the present invention comprises the following arrangement. That is,
  A document image search device that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions,
  First search means for executing a search by a first search character string constituting the input search condition;
  Search by the first search meansofresultWhen the first search character string is not included in the OCR result, Of the first search string1 characterSecond search means for performing a re-search by a second search character string in which is replaced with a wild card;
  Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
  If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
  The firstSearch means through the aboveFirst3Search meansAt least one ofCorresponds to the OCR result retrieved inSaidDocument imageWhenThe contrast display image ofRespectivelyGeneration means to generate and
  Is provided.
[0010]
  Also preferably,The developed image data obtained by developing the OCR result into an image is compared with the corresponding document image, and a space is inserted into the developed image data, so that the layout of the developed image data and the layout of the document image become the same. Layout adjustment means to adjust,
  Conversion means for extracting character image position information of the developed image data and converting the OCR result into formatted text data including page information and margin data;
  When the first search means, the second search means, and the third search means search the first search character string, the second search character string, and the fourth search character string, respectively, Detecting means for detecting positions of the first search character string, the second search character string, and the fourth search character string searched by the search means, the second search means, and the third search means, respectively;
  Based on the positions of the detected first search character string, the second search character string, and the fourth search character string, the first search character string, the second search character string, and the Change means for changing the display attribute of the position corresponding to the position of the fourth search character string;
  The contrast display image is:Changed by the changing meansThe first search character string in the document imageAnd saidSecond search stringAnd the fourth search stringCharacter image display attribute corresponding to, and other character image display attributesWhenIs differentEach is displayed.
[0012]
  Preferably, when the second search means cannot obtain a search result based on the second search character string, the second search meansAnother characterPerform a re-search using a search string in which is replaced with a wildcard.
[0013]
  Preferably, the second search means has a predetermined number of strokes or more in the first search character string.1Replace characters with wildcards.
[0014]
  In order to achieve the above object, a document image retrieval system according to the present invention comprises the following arrangement. That is,
  A document image search server that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions and a search terminal that inputs the search conditions are mutually connected via a network. A document image retrieval system configured to be connected to
  The search terminal is
    An input means for entering search conditions;
    First transmission means for transmitting the search condition to the document image search server;
    First receiving means for receiving a search result corresponding to the search condition from the document image search server;
    Display means for displaying the search results,
  The document image search server
    Second receiving means for receiving a search condition from the search terminal;
    First search means for executing a search using a first search character string constituting the search condition;
    Search by the first search meansofresultWhen the first search character string is not included in the OCR result, Of the first search string1 characterSecond search means for performing a re-search by a second search character string in which is replaced with a wild card;
    Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
    If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
    The first searchMeansFirst3Search meansAt least one ofCorresponds to the OCR result retrieved inSaidDocument imageWhenThe contrast display image ofRespectivelyGeneration means to generate and
    Second transmission means for transmitting the contrast display image to the search terminal;
  Is provided.
[0015]
  In order to achieve the above object, a document image search method according to the present invention comprises the following arrangement. That is,
  Manages OCR results of document images, and searches for OCR results that match the search conditions based on the input search conditions.In document image retrieval deviceA document image search method comprising:
  A first search means of the document image search device;A first search step of performing a search by a first search character string constituting the input search condition;
  Search by the first search meansofresultWhen the first search character string is not included in the OCR result,A second search means of the document image search device;Of the first search string1 characterA second search step of performing a re-search by a second search character string in which is replaced with a wild card;
  When the second search character string is not included in the OCR result as a result of the search in the second search step, the third search means of the document image search device uses the misrecognized character list in the first search character string. A third search character string is generated by replacing the first character managed in step 2 with the second character associated with the first character, and one character of the generated third search character string is replaced with a wild card. A third search step for performing a search by the fourth search character string;
  The generation unit of the document image search device includes:The firstSearch means through the aboveFirst3Search meansAt least one ofCorresponds to the OCR result retrieved inSaidDocument imageWhenThe contrast display image ofRespectivelyGeneration process to generate
  Is provided.
[0016]
  In order to achieve the above object, a method for controlling a document image retrieval system according to the present invention comprises the following arrangement. That is,
  A document image search server that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions and a search terminal that inputs the search conditions are mutually connected via a network. A method for controlling a document image search system configured to be connected to
  The document image search server includes storage means for storing a misrecognized character list for managing a character group that is easily misrecognized.
  A receiving step in which the receiving means of the document image search server receives the search condition input from the search terminal from the search terminal;
  A first search means of the document image search server;A first search step of performing a search using a first search character string constituting the search condition;
    Search by the first search meansofresultWhen the first search character string is not included in the OCR result,A second search means of the document image search server;Of the first search string1 characterA second search step of performing a re-search by a second search character string in which is replaced with a wild card;
  If the second search character string is not included in the OCR result as a result of the search in the second search step, the third search means of the document image search server causes the misrecognized character list in the first search character string. A third search character string is generated by replacing the first character managed in step 2 with the second character associated with the first character, and one character of the generated third search character string is replaced with a wild card. A third search step for performing a search by the fourth search character string;
  The generation unit of the document image search server includes:The firstSearch means through the aboveFirst3Search meansAt least one ofCorresponds to the OCR result retrieved inSaidDocument imageWhenThe contrast display image ofRespectivelyA generation process to generate;
  The transmission means of the document image search server includes:A transmission step of transmitting the contrast display image to the search terminal;
  Is provided.
[0017]
  According to the invention to achieve the above objectcontrolThe program has the following configuration. That is,
  Control of a document image search apparatus that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditionsA program,
  The document image search device
    First search means for executing a search by a first search character string constituting the input search condition;
    If the first search character string is not found in the OCR result as a result of the search by the first search means, a re-search is performed using the second search character string in which one character of the first search character string is replaced with a wild card. Second search means for performing,
    Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
    If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
    Generating means for respectively generating a comparison display image of the OCR result searched by at least one of the first search means to the third search means and the corresponding document image;
  Make it work.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0020]
FIG. 1 is a diagram showing a configuration of a document image search system according to this embodiment.
[0021]
A scanner PC (personal computer) 100 controls various operations including an input operation of the scanner 102 and stores a document image input from the scanner 102 in a storage folder 101. Further, based on an instruction from the OCR server 300, the document image stored in the storage folder 101 may be transmitted to the OCR server 300, and the document image may be centrally managed by the OCR server 300.
[0022]
An image management server 200 controls various operations including an input operation of the network scanner 500 connected on the network 600, and stores the document image input from the network scanner 500 in the storage folder 201. Further, based on an instruction from the OCR server 300, the document image stored in the storage folder 201 is transmitted to the OCR server 300.
[0023]
Note that the image management server 200 is configured not to store the document image input by the network scanner 500 in the storage folder 201 but to store it on a storage device connected to the network 600 or another PC. Also good. In this case, the storage folder 201 manages location information (for example, an address, URL, IP address, etc.) indicating the storage destination of the document image.
[0024]
Reference numeral 300 denotes an OCR server, which stores a document image received via the network 600 as image data in the database 301, executes OCR of the document image, and stores the OCR result as formatted text data in the database 302. To do. At this time, the OCR target document image and the formatted text data as the OCR result are managed in association with each other. A misrecognized character list 303 manages misrecognized character groups that are easily misrecognized in the OCR. Examples of misrecognized characters include “arithmetic” and “nose”, “籠” and “蘢”, and the like.
[0025]
Although the databases 301 and 302 are configured separately, it is needless to say that the databases may be configured in different storage areas on one storage medium.
[0026]
Examples of the text data with formatting include a format realized by various word processing software such as Word (registered trademark) of Microsoft Corporation and Ichitaro (registered trademark) of Just System Corporation.
[0027]
Reference numeral 400 denotes a search PC that can input, for example, a character code as a search condition and display formatted text data managed by the OCR server 300 and a corresponding document image as a search result.
[0028]
A network scanner 500 is a scanner that can be remotely operated by a server or PC connected to the network 600.
[0029]
Reference numeral 600 denotes a network, which connects various components constituting the document image search system of the present embodiment.
[0030]
Note that various servers constituting the document image search system of the present embodiment have a WEB server function, and a PC accessing these servers uses a WEB browser to access WEB sites provided by various servers, and Process. In addition to this, various servers may be provided with a client program including a dedicated GUI (graphic user interface), and the PC may perform various processes using the client program.
[0031]
In FIG. 1, the scanner PC 100 and the network scanner 500 are each constituted by one unit, but it goes without saying that the scanner PC 100 and the network scanner 500 may be constituted by a plurality of units.
[0032]
Next, the hardware configuration of various terminals and servers constituting the document image search system of the present embodiment will be described with reference to FIG.
[0033]
FIG. 2 is a diagram showing the hardware configuration of each of the various terminals and servers that make up the document image search system of this embodiment.
[0034]
In FIG. 2, a CPU 21, a RAM 22, a ROM 23, a LAN adapter 24, a video adapter 25, an input unit (keyboard) 26, an input unit (mouse) 27, a hard disk 28, and a CD-ROM drive 29 are connected to each other via a system bus 20. Has been. The system bus 20 means, for example, a PCI bus, an AGP bus, a memory bus, and the like. In FIG. 2, a chip for connecting between buses, a keyboard interface, and an input / output interface such as so-called SCSI or ATAPI are omitted.
[0035]
The CPU 21 performs various operations such as four arithmetic operations and comparison operations, and controls hardware and software. In the RAM 22, an operation system program or application program (executed by each terminal or server described later) read from a storage medium such as a CD-ROM or CD-R mounted in the hard disk 28 or CD-ROM drive 29. Each program for executing the flowchart is stored, and these are executed under the control of the CPU 21.
[0036]
The ROM 23 stores a so-called BIOS that manages input / output to / from a hard disk in cooperation with the operation system. The LAN adapter 24 communicates with the outside via a network in cooperation with a communication program of the operation system controlled by the CPU 21. The video adapter 25 generates an image signal to be output to a display device (not shown), and the input unit (keyboard) 26 and the input unit (mouse) 27 are used to input instructions to the terminal.
[0037]
The hard disk 28 stores an operation system and the above-described application programs, and is loaded into the RAM 22 when the terminal is activated or as necessary.
[0038]
The CD-ROM drive 29 is used for installing a storage medium such as a CD-ROM, CD-R, or CD-R / W and installing an application program on the hard disk 28.
[0039]
Needless to say, a CD-R drive, a CD-R / W drive, an MO drive, or the like may be used instead of the CD-ROM drive 29.
[0040]
Next, processing executed in the document image search system of this embodiment will be described.
[0041]
The process executed in the document image search system of this embodiment is roughly divided into two processes. One is a document image management process for inputting a document image, performing OCR of the document image, and managing the document image and the OCR result, and the other is using the managed OCR result to obtain a desired image. This is a document image search process for searching for a document image corresponding to an OCR result.
[0042]
First, the document image management process will be described with reference to FIG.
[0043]
FIG. 3 is a flowchart showing the document image management process of the present embodiment.
[0044]
FIG. 3 shows an example in which a document image input from the scanner 102 connected to the scanner PC 100 is OCRed by the OCR server 300 and the OCR result and the document image are managed. The document image management processing is realized by the CPU 21 executing a document image management processing program that realizes the document image management processing stored in the RAM 22 of the OCR server 300.
[0045]
First, in step S201, the scanner PC 100 inputs a document image from the scanner 102 as image data. In step S <b> 102, the scanner PC 100 stores the input document image in the storage folder 101. Alternatively, the document image group stored in the storage folder 101 may be transmitted to the image management server 200 at a predetermined timing and stored in the storage folder 201 of the image management server 200.
[0046]
On the other hand, in step 201, the OCR server 300 checks whether there is image data (document image) in the storage folder 101 of the scanner PC 100 at regular intervals. If there is no image data (NO in step S202), the check is executed again after waiting for a predetermined time. On the other hand, if there is image data (YES in step S201), if there is image data (YES in step S201), the process proceeds to step S202.
[0047]
In step S202, the OCR server 300 receives the image data from the scanner PC 100 and stores the image data in the database 301. At this time, the scanner PC 100 deletes the image data in the storage folder 101 after transferring the image data to the OCR server 300.
[0048]
In step S203, the OCR server 300 executes OCR including recognition for recognizing a blank in the document image as space data. In step S204, the OCR server 300 performs layout correction processing. Specifically, this layout correction processing compares the developed image data obtained by developing text data that is an OCR result into an image and the original image data to be subjected to OCR, inserts a blank gap, Fine-tune the layout to be the same as the original image data layout.
[0049]
In step S205, the OCR server 300 analyzes the developed image data after the layout correction process, extracts the position information of the character image in the original image data, and extracts the position information (for example, page break data) from the OCR result. Format conversion to text data with formatting that reflects the data.
[0050]
Next, the document image search process will be described with reference to FIG.
[0051]
FIG. 4 is a flowchart showing the document image search process of the present embodiment.
[0052]
The document image search process of FIG. 4 is realized by the CPU 21 executing a document image search process program for realizing the document image search process stored in the RAM 22 of the OCR server 300.
[0053]
First, the OCR server 300 performs steps S301 to S303 as preprocessing for searching for a document image that matches the search condition input from the search PC 400.
[0054]
  Specifically, step S301.so,The image data group (document image) stored in the database 301 is read into the RAM 22. Next, in step 302, formatted text data corresponding to each image data group stored in the database 302 is read into the RAM 22. Next, in step S303, a contrast display image for displaying the text data with the format corresponding to the image data as a search result on the search PC 400 is generated.
[0055]
At this time, the comparison display image may be transmitted to the search PC 400 for display, or after receiving the search condition, only the comparison display image that matches the search condition is transmitted to the search PC 400. It may be displayed.
[0056]
In step S304, a search character string that is a search condition input from the search PC 400 is received. In step S305, a wild card character position counter n indicating a character position where a part of the search character string is a wild card is set to zero.
[0057]
Next, in step S306, the formatted text data including the search character string is searched. In step S307, the presence / absence of formatted text data including a search character string is determined. If there is formatted text data including the search character string (YES in step S307), the process proceeds to step S311 and the position information including the position of the search character string included in the searched formatted text data (number of pages, number of lines) , Character position).
[0058]
The position information may be detected by detecting all search character strings included in the formatted text data or by detecting the first search character string detected from the beginning of the formatted text data. May be.
[0059]
In step S312, based on the detected position information, the display attribute of the character image at the corresponding position in the corresponding image data of the formatted text data is changed to update the comparison display image, and to the search PC 400. Send. As a result, the search display 400 displays a comparison display image that is a search result based on the input search character string.
[0060]
Note that this change in display attribute means, for example, changing the display form such as reverse display or colored display, in order to distinguish the character image corresponding to the search character string in the image data from other character images. belongs to.
[0061]
Here, FIG. 5 shows an example of a comparison display image displayed on the search PC 400 as a search result. In the example of FIG. 5, image data on the left and formatted text data on the right are displayed on the same screen. In FIG. 5, the search character string that is the search condition is “to budget”, and the formatted text data including the “budget ratio” is searched, and the search result corresponds to the formatted text data. In this state, image data is displayed in comparison. As shown in FIG. 5, the character image in the image data corresponding to “ratio to budget” in the formatted text data is displayed surrounded by a rectangle. Thereby, the user can easily visually recognize the character image in the image data corresponding to the search character string.
[0062]
On the other hand, if there is no formatted text data including the search character string in step S307 (NO in step S307), the process proceeds to step S308, and the wildcard character position counter n is incremented by one.
[0063]
In step S309, whether the number of search character strings / X (for example, X = 3: the value of X is appropriately determined according to the number of times of search using a search character string including a wild card) is less than n. Determine whether. If the number of search character strings is less than n (NO in step S309), the process proceeds to step S310, and a search character string including wildcards at the positions indicated by the wildcard character position counter n is generated from the current search character string. To do. For example, when the search character string is “budget ratio” and the wild card character position counter n = 1, the search character string including the wild card (for example, “?”, “*”) Is used as “? Ratio ”, when the wild card character position counter n = 2,“ comparison ratio ”, when the wild card character position counter n = 3,“ comparison ratio ”, and the wild card character position counter n = 4 In some cases, “for budget?” Is generated. Using the search character string including the wild card generated as described above as a search condition, the formatted text data including the search character string is searched in step S306.
[0064]
Here, FIG. 6 shows an example of a comparison display image displayed on the search PC 400 as a search result based on a search character string generated by changing a search character string including a wild card. In the example of FIG. 6, as with FIG. 5, image data on the left and formatted text data on the right are displayed on the same screen. In FIG. 6, the search character string that is the search condition generates “preliminary ratio” as a search character string including a wildcard from “budget ratio”, and the formatted text including the “preliminary ratio” As a search result when data is searched, the formatted text data and the corresponding image data are displayed in comparison. As shown in FIG. 6, the “nose” in the “to nose ratio” in the formatted text data corresponds to the wild card of the search character string “to nose ratio”. The character image in the image data corresponding to is displayed in a rectangle. Thereby, the user can easily visually recognize the character image in the image data corresponding to the search character string.
[0065]
However, the display attribute of the character image corresponding to the wild card in the search character string is different from the display attribute of the other character image in order to indicate that the search result is the search result by the search character string including the wild card. It becomes.
[0066]
On the other hand, if the number of search character strings / X is n or more in step S309 (YES in step S309), the process proceeds to step S313, and the character group in the misrecognized character list is matched with one character in the search character string.
[0067]
This matching may be performed by matching each character of the search character string with the misrecognized character group of the misrecognized character list, or each character and the misrecognized character list from the beginning of the search character string to a predetermined number. It is also possible to perform matching with the misrecognized character group, and this matching method can be appropriately changed according to the use and purpose.
[0068]
Next, in step S314, it is determined by matching whether or not the character to be matched in the search character string is a misrecognized character existing in the misrecognized character list. If the character is a misrecognized character (YES in step S314), the process advances to step S315 to generate a search character string in which the matching target character is replaced with another corresponding misrecognized character. For example, if the search string is “Budget Ratio”, the matching target character is “Calculation”, and “Nose” is the misrecognized character of that “Calculation”, then the search string is “Budget Ratio” It will be changed to “Noisy ratio”. In addition, a new search character string is generated by replacing characters in the search character string with misrecognized characters, and the search result by the search character string conforms to the display form of the comparison table image as shown in FIG. However, in this case, the display attribute of the character image corresponding to the misrecognized character is different from the display attribute of the other character image.
[0069]
If a search character string is generated in step S314, the character string update flag indicating that the search character string is changed and the search is executed is turned on again. This character string update flag is managed by the OCR server 300, and is turned off when the process ends or when the OCR server 300 receives a search character string as a new search condition from the search PC 400 for another search. Become. Thereafter, the process proceeds to step S305, and the subsequent processing is executed. In this case, a search using a search character string including a misrecognized character and a wild card can be executed.
[0070]
On the other hand, if it is not a misrecognized character in step S314 (NO in step S314), it is determined that there is no formatted text data that matches the search condition, and the process ends.
[0071]
As described above, according to the present embodiment, when a search result based on the search character string input from the search PC 400 cannot be obtained, a part of the input search character string is used as a wild card and the search is performed again. Thus, a desired OCR result can be efficiently retrieved from an OCR result (formatted text data) that is premised on erroneous recognition. In addition, if a search result using a search character string including a wild card cannot be obtained, a misrecognition may occur by replacing some characters in the search character string with another misrecognized character and performing a search again. Therefore, a desired OCR result can be efficiently retrieved from the OCR result that is premised on this.
[0072]
Further, as a search result, image data corresponding to the OCR result (formatted text data) is displayed in comparison, and a character image on the image data matching the search character string is displayed separately from other character images. The user can easily visually recognize the character image to be subjected to the OCR, and can reduce the man-hour for confirming the desired character image in the document image to be subjected to the OCR as compared with the conventional case.
[0073]
In the above embodiment, the OCR server 300 stores the image data and the formatted text data as the OCR result in the databases 301 and 302, respectively, and stores the document image management processing program and the document image search processing program in the RAM 22. However, it is not limited to this. For example, the OCR server 300 includes only the image data storage and document image management processing program, and includes the formatted text data and the document image search processing program as the OCR result of the image data in a separately configured search server. Any configuration may be used.
[0074]
In addition, the wild card is configured to be sequentially switched from the beginning of the search character string, but is not limited thereto. For example, only characters with a large number of strokes that are easily misrecognized in the search character string, that is, characters with a predetermined number of strokes or more may be set as wildcard targets. In this case, the processing speed can be increased.
[0075]
Further, the comparison display image is configured such that when the search result is obtained, the comparison display image as the search result is presented to the search PC 400. For example, depending on the search character strings having different wildcard positions, You may make it display each search result collectively. In this case, the contrast display image may be displayed by distinguishing the character image in the document image corresponding to each search character string from other character images. In addition, the position of the wild card in each search character string may be displayed. You may display so that each may be distinguished.
[0076]
An object of the present invention is to supply a storage medium storing a program code of software that implements the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in the.
[0077]
In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
[0078]
As a storage medium for supplying the program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0079]
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
[0080]
Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.
[0081]
When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the flowcharts described above.
[0082]
【The invention's effect】
As described above, according to the present invention, a desired OCR result can be efficiently searched, and a desired character image in a document image corresponding to the OCR result can be easily visually recognized. An image search apparatus and method, a document image search system, and a program can be provided.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of a document image search system according to an embodiment.
FIG. 2 is a diagram showing a hardware configuration of each of various terminals and servers constituting the document image search system of the present embodiment.
FIG. 3 is a flowchart showing document image management processing executed in the present embodiment.
FIG. 4 is a flowchart showing document image search processing of the present embodiment.
FIG. 5 is a diagram showing an example of a comparison display image of the present embodiment.
FIG. 6 is a diagram illustrating an example of a comparison display image according to the present embodiment.

Claims (14)

A document image search device that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions,
First search means for executing a search by a first search character string constituting the input search condition;
If the first search character string is not found in the OCR result as a result of the search by the first search means, a re-search is performed using the second search character string in which one character of the first search character string is replaced with a wild card. Second search means for performing,
Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
Document image retrieval apparatus comprising: a generating means for generating respective comparison display image of the document image and the corresponding been OCR search results in at least one of said first search means to said third searching means . The developed image data obtained by developing the OCR result into an image is compared with the corresponding document image, and a space is inserted into the developed image data, so that the layout of the developed image data and the layout of the document image become the same. Layout adjustment means to adjust,
Conversion means for extracting character image position information of the developed image data and converting the OCR result into formatted text data including page information and margin data;
When the first search means, the second search means, and the third search means search the first search character string, the second search character string, and the fourth search character string, respectively, Detecting means for detecting positions of the first search character string, the second search character string, and the fourth search character string searched by the search means, the second search means, and the third search means, respectively;
Based on the positions of the detected first search character string, the second search character string, and the fourth search character string, the first search character string, the second search character string, and the Change means for changing the display attribute of the position corresponding to the position of the fourth search character string;
The contrast display image includes a display attribute of a character image corresponding to the first search character string , the second search character string, and the fourth search character string in the document image changed by the changing unit, and the others. other document image retrieval apparatus according to claim 1 in which the display attribute of the character image, characterized in that it is displayed different from each other. The second search means executes a re-search by a search character string in which another character of the first search character string is replaced with a wild card when a search result by the second search character string is not obtained. The document image search apparatus according to claim 1 , wherein the document image search apparatus is a document image search apparatus. The second searching means, a document image retrieval apparatus according to any one of claims 1 to 3, characterized in that to replace the predetermined number of strokes or more one letter in the first search string in a wildcard . A document image search server that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions and a search terminal that inputs the search conditions are mutually connected via a network. A document image retrieval system configured to be connected to
The search terminal is
An input means for entering search conditions;
First transmission means for transmitting the search condition to the document image search server;
First receiving means for receiving a search result corresponding to the search condition from the document image search server;
Display means for displaying the search results,
The document image search server
Second receiving means for receiving a search condition from the search terminal;
First search means for executing a search using a first search character string constituting the search condition;
If the first search character string is not found in the OCR result as a result of the search by the first search means, a re-search is performed using the second search character string in which one character of the first search character string is replaced with a wild card. Second search means for performing,
Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
Transmitting said comparison displayed image and generating means for generating respective comparison display image of the document image corresponding to at least have been OCR search results in either the first search means to third search means to said search terminal A document image retrieval system comprising: a second transmission unit. The developed image data obtained by developing the OCR result into an image is compared with the corresponding document image, and a space is inserted into the developed image data, so that the layout of the developed image data and the layout of the document image become the same. Layout adjustment means to adjust,
Conversion means for extracting character image position information of the developed image data and converting the OCR result into formatted text data including page information and margin data;
When the first search means, the second search means, and the third search means search the first search character string, the second search character string, and the fourth search character string, respectively, Detecting means for detecting positions of the first search character string, the second search character string, and the fourth search character string searched by the search means, the second search means, and the third search means, respectively;
Based on the positions of the detected first search character string, the second search character string, and the fourth search character string, the first search character string, the second search character string, and the Change means for changing the display attribute of the position corresponding to the position of the fourth search character string;
The contrast display image includes a display attribute of a character image corresponding to the first search character string, the second search character string, and the fourth search character string in the document image changed by the changing unit, and the others. Are displayed differently from the display attributes of other character images
The document image retrieval system according to claim 5, wherein A document image search method in a document image search apparatus that manages OCR results of document images and searches for OCR results that match the search conditions based on an input search condition,
A first search step in which a first search means of the document image search device executes a search using a first search character string constituting the input search condition;
Results of the search of the first search means, when there is no the first search string in the OCR result, the second search unit of the document image retrieval apparatus, the one character of the first search string to a wildcard A second search step of performing a re-search with the replaced second search character string;
When the second search character string is not included in the OCR result as a result of the search in the second search step, the third search means of the document image search device uses the misrecognized character list in the first search character string. A third search character string is generated by replacing the first character managed in step 2 with the second character associated with the first character, and one character of the generated third search character string is replaced with a wild card. A third search step for performing a search by the fourth search character string;
Generating step of generating means of the document image retrieval apparatus, the contrast display image of the document image corresponding to at least have been OCR search results in either the first search means to said third searching means for generating, respectively it A document image search method comprising: A layout adjustment unit of the document image search device compares the developed image data obtained by developing the OCR result into an image and the corresponding document image, inserts a space in the developed image data, and layout of the developed image data. And a layout adjustment step for adjusting the document image layout to be the same,
A conversion step in which the conversion means of the document image search apparatus extracts position information of the character image of the expanded image data, and converts the format of the OCR result into formatted text data including page information and margin data;
When the first search character string, the second search character string, and the fourth search character string are searched in the first search step, the second search step, and the third search step, respectively, the document image The first search character string, the second search character string, and the fourth search character string searched by the detection means of the search device in the first search step, the second search step, and the third search step, respectively. A detection step of detecting the position of
The changing means of the document image search device is configured such that the first search character of each of the character images is based on the detected positions of the first search character string, the second search character string, and the fourth search character string. A change step of changing a display attribute of a position corresponding to the position of the column, the second search character string, and the fourth search character string;
The comparison display image, display attributes and others of the corresponding character image to the first search character string of the document in the image that has been changed by said changing step and said second search character string and the fourth search string document image retrieval method according to claim 7, the display attributes of another character image, characterized in that it is displayed different from each other. In the second search step, when a search result by the second search character string is not obtained, a search by the search character string in which another character in the first search character string is replaced with a wild card is executed. document image retrieval method according to claim 7 or claim 8, characterized. 10. The document image search method according to claim 7, wherein in the second search step, one character having a predetermined number of strokes or more in the first search character string is replaced with a wild card. 11 . . A document image search server that manages OCR results of document images and searches for OCR results that match the search conditions based on the input search conditions and a search terminal that inputs the search conditions are mutually connected via a network. A method for controlling a document image search system configured to be connected to
The document image search server includes storage means for storing a misrecognized character list for managing a character group that is easily misrecognized.
A receiving step in which the receiving means of the document image search server receives the search condition input from the search terminal from the search terminal;
A first search step in which a first search means of the document image search server executes a search using a first search character string constituting the search condition;
Results of the search of the first search means, when there is no the first search string in the OCR result, the second search unit of the document image retrieval server, one character of the first search string to a wildcard A second search step of performing a re-search with the replaced second search character string;
If the second search character string is not included in the OCR result as a result of the search in the second search step, the third search means of the document image search server causes the misrecognized character list in the first search character string. A third search character string is generated by replacing the first character managed in step 2 with the second character associated with the first character, and one character of the generated third search character string is replaced with a wild card. A third search step for performing a search by the fourth search character string;
A generation step of generating means of the document image search server generates the contrast display image of the document image corresponding to at least have been OCR search results in either the first search means to said third searching means respectively,
A transmission method of the document image search server, comprising: a transmission step of transmitting the comparison display image to the search terminal. The layout adjustment unit of the document image search server compares the developed image data obtained by developing the OCR result into an image and the corresponding document image, inserts a space into the developed image data, and layout of the developed image data. And a layout adjustment step for adjusting the document image layout to be the same,
A conversion step in which conversion means of the document image search server extracts character image position information of the developed image data, and converts the format of the OCR result into formatted text data including page information and margin data;
When the first search character string, the second search character string, and the fourth search character string are searched in the first search step, the second search step, and the third search step, respectively, the document image The first search character string, the second search character string, and the fourth search character string respectively detected by the detection means of the search server in the first search step, the second search step, and the third search step, A detection step of detecting the position of
The changing means of the document image search server is configured such that the first search character of each of the character images is based on the detected positions of the first search character string, the second search character string, and the fourth search character string. A change step of changing a display attribute of a position corresponding to the position of the column, the second search character string, and the fourth search character string;
  The comparison display image includes a display attribute of a character image corresponding to the first search character string, the second search character string, and the fourth search character string in the document image changed by the changing step, and the others. Are displayed differently from the display attributes of other character images
The method of controlling a document image search system according to claim 11. A control program for a document image search apparatus that manages OCR results of document images and searches for OCR results that match the search conditions based on an input search condition ,
The document image search device
First search means for executing a search by a first search character string constituting the input search condition;
If the first search character string is not found in the OCR result as a result of the search by the first search means, a re-search is performed using the second search character string in which one character of the first search character string is replaced with a wild card. Second search means for performing,
Storage means for storing a misrecognized character list for managing a group of characters that are easily misrecognized in association with each other;
If there is no second search character string in the OCR result as a result of the search by the second search means, the first character managed in the misrecognized character list in the first search character string is the first character. A third search character string replaced with the second character associated with the character is generated, and a search is performed using the fourth search character string in which one character of the generated third search character string is replaced with a wild card. 3 search means;
Generating means for respectively generating a comparison display image of the OCR result searched by at least one of the first search means to the third search means and the corresponding document image;
Control program for a document image retrieval apparatus for causing the function to function . The developed image data obtained by developing the text data of the OCR result into an image is compared with the corresponding document image, a space is inserted into the developed image data, and the layout of the developed image data and the layout of the document image are obtained. Layout adjusting means for adjusting to be the same;
Conversion means for extracting character image position information of the developed image data and converting the OCR result into formatted text data including page information and margin data;
When the first search means, the second search means, and the third search means search the first search character string, the second search character string, and the fourth search character string, respectively, The first search character string searched by the search means, the second search means, and the third search means, respectively, and the Detecting means for detecting positions of the second search character string and the fourth search character string;
Based on the positions of the detected first search character string, the second search character string, and the fourth search character string, the first search character string, the second search character string, and the first of the character images, respectively. 4 further function as a changing means for changing the display attribute of the position corresponding to the position with the search character string,
The contrast display image includes a display attribute of a character image corresponding to the first search character string, the second search character string, and the fourth search character string in the document image changed by the changing unit, and the others. Are displayed differently from the display attributes of other character images
14. The control program for a document image search apparatus according to claim 13, wherein the control program is a document image search apparatus.

Images