JP6079014B2 - Image display device, image display processing program, and image display method - Google Patents

Description

  The present invention relates to a technical field such as an apparatus or a method used for inspecting a plurality of images obtained by scanning or photographing a plurality of pages of a printed material.

  In recent years, printed materials such as books, magazines, and other paper materials that have been created in the past have been scanned with an image scanner or taken with a digital camera and digitized, and then used and processed for various purposes. Yes. For example, Patent Document 1 discloses an electronic system that reads the contents of a double-page book from an image reader, displays the contents of both read pages on a touch screen, and allows free capture by a page-by-page touch instruction. Is disclosed. By using such an electronic system, it is possible to visually check whether all the pages of the book are photographed in the correct order by displaying the photographed images one by one in order.

JP 9-244504 A

  However, in the conventional method, for example, the operation of advancing the pages of one book takes a certain amount of time, and oversight is likely to occur because the listability is poor. In addition, for example, it may be possible to reduce and display a list of images obtained by capturing the contents of one page or two spread pages. For example, if similar layout pages continue, the reduced image However, it is necessary to overlook without distinguishing, or to switch to an enlarged display each time, which causes a decrease in inspection efficiency.

  Accordingly, the present invention has been made in view of the above points and the like, and provides an image display device, an image display processing program, and an image display method capable of improving the inspection efficiency of a plurality of pages in a printed matter. With the goal.

In order to solve the above-described problem, the invention described in claim 1 includes a capturing unit that captures a plurality of page images obtained by scanning or photographing a plurality of pages of a printed material, and capturing by the capturing unit. Setting means for setting a frame surrounding the portion including the page number displayed in the page image for the page image, and the frame setting the image of the portion surrounded by the frame set by the setting means Cutting means for cutting out each page image as a cut image, and display control means for displaying a list of a plurality of cut images cut out by the cutting means in association with file names of page images that are the basis of the cut image It is characterized by providing.

  According to a second aspect of the present invention, in the image display device according to the first aspect, among the plurality of page images captured by the capturing unit, the image is displayed on a smaller number of page images than the plurality of page images. Receiving means for accepting designation of a frame surrounding a part including a page number from a user via an operation means, and the setting means is configured to apply the frame designated by the user to a page image in which the frame is designated. A frame corresponding to the position and size of the frame specified by the user is set for a page image other than the page image for which the frame is specified.

  According to a third aspect of the present invention, in the image display device according to the first or second aspect, the fetching unit fetches a plurality of page images scanned or photographed in page order, and the display control unit A plurality of clipped images clipped by the means are displayed in a list in the order of scanning or photographing.

Invention according to claim 4, in the image display apparatus according to claim 2, wherein the receiving means receives at least one of correction of the position and size of the specified the frame by the user, the setting means Is characterized in that the frame in which at least one of the position and size of the frame is corrected is set for a page image in which the frame is designated.

The invention according to claim 5 displays the computer on a page image captured by the capturing unit, a capturing unit that captures a plurality of page images obtained by scanning or photographing a plurality of pages of the printed material. Setting means for setting a frame surrounding a part including the page number to be set for the page image, and cutting out the image of the part surrounded by the frame set by the setting means for each page image in which the frame is set A cutout unit that cuts out as an image, and a display control unit that displays a plurality of cutout images cut out by the cutout unit in association with file names of page images that are the basis of the cutout image. To do.

A sixth aspect of the present invention is an image display method executed by a computer, wherein a plurality of page images obtained by scanning or photographing a plurality of pages of a printed matter are captured, and the capturing is performed. A setting step for setting a frame surrounding the portion including the page number displayed in the page image captured by the loading step for the page image, and an image of the portion surrounded by the frame set by the setting step. A cropping step for cropping as a cropped image for each page image in which the frame is set, and a plurality of cropped images clipped by the cropping step are displayed in a list in association with file names of page images that are the basis of the cropped image. And a display control step.

  According to the present invention, a frame surrounding a portion including a page number displayed in a captured page image is set for the page image, and a clipped image of a portion surrounded by the frame is cut out from the page image and displayed as a list Therefore, it is possible to efficiently detect a page image dubbing, omission, or out of order in a short time, or to confirm that there is no page image. Therefore, it is possible to improve the inspection efficiency of a plurality of pages in the printed material.

It is a figure which shows the example of a schematic structure of the noble inspection system which concerns on this embodiment. 4 is a flowchart showing processing of a display control unit 23 of the noble inspection apparatus 2. It is a figure which shows an example of the designation | designated screen of a cutting frame. It is a figure which shows an example of a noble list screen. It is a figure which shows an example of the designation | designated screen of the cropping frame which displays the page image taken in by image | photographing two pages of facing pages of a left-right one page each.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a noble inspection system.

  First, with reference to FIG. 1 etc., the structure and function of the noble inspection system which concerns on this embodiment are demonstrated. FIG. 1 is a diagram illustrating a schematic configuration example of a noble inspection system according to the present embodiment. As shown in FIG. 1, the noble inspection system includes a digital camera 1 and a noble inspection device 2. The digital camera 1 and the noble inspection device 2 can communicate with each other by wire or wirelessly.

  The digital camera 1 transmits data of a plurality of images (hereinafter referred to as page images) obtained by photographing a plurality of pages of printed matter such as books, magazines, and other paper materials to the noble inspection apparatus 2 by wired or wireless communication. Output. An image scanner may be provided instead of the digital camera 1. In this case, data of a plurality of page images obtained by scanning a plurality of pages of the printed matter by the image scanner are output to the noble inspection device 2.

  The noble inspection apparatus 2 includes an operation unit 20 as an operation unit, a storage unit 21, a communication unit 22, a display control unit 23, and the like. The noble inspection apparatus 2 is an example of the image display apparatus of the present invention. A general-purpose personal computer can be applied to the noble inspection apparatus 2.

  The operation unit 20 includes, for example, a mouse and a keyboard, receives an instruction from an inspection worker who is a user of the noble inspection apparatus 2, and outputs a signal corresponding to the instruction to the display control unit 23. The storage unit 21 includes, for example, a hard disk drive and stores an operating system (OS) and a noble inspection processing program (including the image display processing program of the present invention). The storage unit 21 stores page image data captured from the digital camera 1 in a predetermined file format (for example, an image file such as a JPEG file). The communication unit 22 includes a communication port for performing wired or wireless communication with the digital camera 1. The communication unit 22 may be an interface that is electrically connected to an external recording device such as an external USB hard disk. In this external recording device, page image data shot by the digital camera 1 is recorded in a predetermined file format. In this case, page image data may be taken into the non-bleb inspection apparatus 2 from an external recording device via an interface.

  The display control unit 23 includes a CPU (an example of a computer) that performs various arithmetic processes, a memory (for example, a working RAM) that temporarily stores data of a page image captured from the digital camera 1, and the like, and an operating system. By executing the noble inspection processing program, it is made to function as a capturing means, a setting means, a clipping means, a display control means, a receiving means, etc. of the present invention. Specifically, the display control unit 23 captures a plurality of page images obtained by photographing a plurality of pages of the printed material from the digital camera 1 via the communication unit 22, and displays them on the captured page images. A frame (hereinafter referred to as “noble frame”) surrounding a portion including a page number (hereinafter referred to as “noble”) is set for the page image. For example, the display control unit 23 receives the designation of the noble frame from the inspection operator via the operation unit 20 and sets the designated noble frame for the page image in which the frame is designated. Then, the display control unit 23 cuts out the image of the portion surrounded by the set noble frame (image of the noble portion) as a cut image (hereinafter referred to as “noble image”) for each page image in which the frame is set. The plurality of clipped noble images are displayed in a list on a display (not shown).

  In the present invention, paying attention to the fact that a noble is printed at a specific position on a printed matter such as a book, an image near the portion of the photographed page image where the noble is displayed is cut out to show the number of the noble. The list is displayed in a size that can be read. As a result, the inspection operator can efficiently discover the duplication, omission, order difference, and the like of the page images by visually confirming the arrangement order of the numbers.

  Next, with reference to FIG. 2 etc., the operation example of the noble test | inspection apparatus 2 which concerns on this embodiment is demonstrated. FIG. 2 is a flowchart showing the processing of the display control unit 23 of the noble inspection apparatus 2.

  The process shown in FIG. 2 is started, for example, by starting a noble inspection processing program. When the processing shown in FIG. 2 is started, the display control unit 23 captures one page image from the digital camera 1 via the communication unit 22 in accordance with an instruction from the inspection operator via the operation unit 20. These data are stored in the storage unit 21. In this way, the image file of each page image for one book is stored in, for example, a folder designated by the inspection operator. Note that page images are captured in page order, and image file names are generated so that serial numbers in page order are included.

  Next, the display control unit 23 displays a clipping frame designation screen (step S1). For example, a page image related to the image file having the smallest serial number included in the image file name is displayed on the cut frame designation screen. The displayed page image is switched and displayed in response to a page switching instruction from the inspection operator via the operation unit 20. FIG. 3A is a diagram illustrating an example of a clipping frame designation screen. The clipping frame designation screen shown in FIG. 3A is an example in which two pages of a book (left page and right page) are taken as one image. In the thumbnail display area 52 of the clipping frame designation screen shown in FIG. 3A, a list of image files (a list of page images and image file names) stored in the folder designated by the bibliographic folder designation unit 51 is displayed. It is displayed. In the thumbnail display area 52, page images and image file names related to six image files in all image files for one book (in this example, the total number of image files (total number of frames) is 204). Is displayed. Note that page images and image file names relating to image files that cannot be displayed in the thumbnail display area 52 are displayed in response to a scroll instruction from the inspection operator via the operation unit 20. Of these six image files, the image file with the image file name “00000008.jpg” is selected, and the page image is enlarged and displayed in the page image display area 53. On the page image displayed in the page image display area 53, the inspection operator can operate the operation unit 20 to designate a noble frame.

  When there is a page switching instruction from the inspection operator through the operation unit 20 (step S2: YES), the display control unit 23 switches and displays the page image displayed in the page image display area 53 (step S3). ). The page switching instruction is made, for example, when a page image or an image file name related to another image file displayed in the thumbnail display area 52 is designated through the operation unit 20 by the inspection operator. The page switching instruction is made, for example, when the inspection operator designates the page image return button 53a or the page image advance button 53b through the operation unit 20.

  When the inspection operator gives an instruction to specify a noble frame via the operation unit 20 (step S4: YES), that is, when the display control unit 23 receives specification of a noble frame from the inspection operator, the display is performed. The control unit 23 sets a noble frame surrounding the portion including the noble displayed on the page image for the page image (step S5). For example, in the display state of the page image display area 53 shown in FIG. 3A, the inspection operator operates the mouse included in the operation unit 20 to designate a new button 54, as shown in FIG. The position and size of the frame 531 that can be displayed on the screen can be specified (by clicking and dragging the mouse) while moving the mouse pointer. By setting the noble frame, for example, an image file name corresponding to the page image and coordinate (coordinate in the page image) information for determining the position and size of the noble frame are stored in association with each other. As shown in FIG. 3B, when a page image consisting of two spread pages is displayed in the page image display area 53, the inspection operator displays each of the left page and the right page. The inspection operator may specify only one of the left page and the right page. When the inspection worker designates only one of the left page and the right page, the inspection page is automatically set in step S7 to be described later even if the inspection worker does not designate the other noble frame.

  As described above, the inspection operator operates the operation unit 20 to switch the page image, and repeatedly designates and sets the noble frame for the required number of page images among all the page images. Here, as a necessary number of page images, there are about three examples of the first page image, the middle page image, and the last page image. Ideally, if the inspection operator designates a noble frame for a single noble part through all the page images, the noble frame for the page image for which the noble frame is not designated is automatically set in step S7 described later. However, the rising situation near the boundary between the left page and the right page when shooting a spread page varies between the beginning, middle, and end of the page. As a result, there is a case where the number of the bumbles protrudes from the automatically set number frame by shifting the position of the number of pages. Therefore, for example, the inspection operator may specify a noble frame for the first page image, the middle page image, and the last page image.

  Then, for example, when the determination button 56 shown in FIG. 3B is designated and the inspection operator gives an instruction to determine a noble frame via the operation unit 20 (step S6: YES), the display control unit 23 Then, using the coordinate information of the already set noble frame, the noble frame is set for the page image in which the noble frame is not set (step S7). For example, as shown in FIG. 3B, when a page image consisting of two spread pages is displayed in the page image display area 53, for example, if a left page noble frame is set, the left page noble frame is set. Based on the coordinate information, the coordinate position (symmetrical position of the left page's noble frame on the right page) of the right page's noble frame (same size as the left page's noble frame) is calculated, and the right page's noble frame ( For example, a broken line 532) is set. In addition, for a page image in which a noble frame is not set on both the right page and the left page, for example, before the page image (for example, the serial number included in the image file name is one smaller), or the page Based on the coordinate information of the noble frame set after the image (for example, the serial number included in the image file name is one larger), the noble frame is set at the same coordinate position as the noble frame. That is, a frame corresponding to the position and size of the noble frame designated by the inspection operator is set for a page image other than the page image for which the noble frame is designated.

  Also, when the inspection operator gives an instruction to correct the noble frame by specifying the correction button 55 shown in FIG. 3B via the operation unit 20 (step S8: YES), that is, by the user already. When the display control unit 23 accepts correction of at least one of the position and size of the designated noble frame, the display control unit 23 displays the noble frame in which at least one of the position and size of the noble frame is corrected. Is reset for the page image (step S9). For example, the inspection operator operates the operation unit 20 to switch the page image, confirms whether the displayed noble portion is within the noble frame for a plurality of page images, and protrudes from the noble frame. In this case, by operating the operation unit 20 and specifying the correction button 55 shown in FIG. 3B, the position and size of the noble frame 531 that can be corrected can be changed by moving the mouse pointer. Modify (change) it to fit within the frame.

  As described above, when the inspection worker makes a certain degree of certainty that a plurality of page images are corrected as necessary, and a noble frame is set so that all the page images fit in the noble portion. (The inspection operator does not necessarily have to check the noble frame for all page images). For example, the operation unit 20 is operated to designate the extraction execution button 57 shown in FIG. As a result, if there is an instruction to start extracting (cutting out) the noble image (step S10: YES), the display control unit 23 determines whether or not the noble frame is set for all the page images (step S10). S11). If the display control unit 23 determines that the noble frame is set for all the page images (step S11: YES), the display control unit 23 executes the cutting process of the noble image (step S12). In the cutting process of the noble image, the display control unit 23 cuts out the image of the portion surrounded by the set noble frame as a noble image based on the coordinate information of the noble frame for each page image in which the noble frame is set. To extract. The extracted noble image data is stored in association with the image file name of the base page image. On the other hand, when the inspection worker wants to redo the extraction of the noble image, he / she operates the operation unit 20 and designates the extraction cancel button 58 shown in FIG. Thereby, if there is an instruction to cancel the extraction of the noble image (step S13: YES), if the noble image has already been extracted (step S14: YES), the display control unit 23 extracts the stored noble image. Are deleted (step S15).

  Then, when a list display button 59 shown in FIG. 3B is designated by the inspection operator via the operation unit 20, for example, there is a list display instruction for the nonblem images (step S16: YES), the display control unit 23 displays a noble list screen for displaying a list of the plurality of noble images extracted in step S12 (step S17). FIG. 4 is a diagram showing an example of the noble list screen. Such a noble list screen is displayed, for example, in a separate window from the clipping frame designation screen and superimposed on the clipping frame designation screen. In the noble image display area 61 of the noble list screen shown in FIG. 4, the noble images clipped from the page images are arranged in the order of the serial numbers included in the image file names corresponding to the page images (in other words, the shooting order). It is displayed. If the number of pages is large, the cropping process in step S12 takes a certain amount of time. Therefore, after the extraction execution button 57 is designated, the list display button 59 is designated without waiting for completion of the cropping process. As a result, the noble list screen is displayed. In this case, the cropping process itself is performed in the order of the serial numbers included in the image file name, so that the noble image up to the page where the cropping process has been completed is displayed on the noble list screen. And once the noble list screen is displayed, the clipping process continues in the background, so when it is only displayed halfway, in order to display the noble image again after a while, An update button 65 is provided. In addition, when the processing capability of the CPU is high, the extraction is performed each time a non-bleb image is extracted by the clipping process that continues in the background without displaying the update button 65 after the noble list screen is displayed. The configured noble image may be configured to be sequentially displayed. A noble image that cannot be displayed in the noble image display area 61 is displayed when the inspection operator designates the page feed button 62 or the page return button 63 shown in FIG. On this noble list screen, the inspection operator can visually check the arrangement of the numbers of the nobles to efficiently find page images that are doubled, missing, out of order, or can confirm that they are not present. . At this time, the inspection operator can adjust the number of noble images to be displayed at a time so that the number portion of the noble becomes a size that can be read on the screen. For example, the inspection operator operates the operation unit 20 to change the horizontal size and vertical size of the image in the designation fields 64a and 64b in the image size designation area 64 shown in FIG. A list of the number of noble images will be displayed. Then, in the confirmation of the noble image, the inspection operator returns to the clipping frame designation screen when a noble image in which a part of the noble is cut off (that is, the noble frame protrudes from the noble frame) is found. After correcting the position and size of the noble frame, the noble image cropping process may be executed again. Further, when the inspection operator operates the operation unit 20 to specify a desired image file name displayed in the noble image display area 61 (for example, double-clicking with a mouse), a page corresponding to the specified image file name You may comprise so that an image may be displayed on another window.

  As described above, according to the above-described embodiment, the noble frame surrounding the portion including the noble displayed on the captured page image is set for the page image, and the noble image of the portion surrounded by the noble frame is set. Is extracted from the page image, and a plurality of extracted noble images are displayed in a list on the display, so that page images can be efficiently detected in a short time. It can be confirmed that there is no. Therefore, it is possible to improve the inspection efficiency of a plurality of pages in the printed material.

  In the above-described embodiment, the rising situation near the boundary between the left page and the right page when shooting a spread page tends to gradually shift as the page advances. It may be configured to automatically correct the noble frame by calculating the deviation amount. For example, for the page image corresponding to the serial number “2” (the beginning of the page) and the page image corresponding to the serial number “50” (for example, the middle of the page), a non-noble frame is set by the inspection operator. It is assumed that the noble frame is automatically set for the page images between them, for example, the page images whose serial numbers (even numbers) on the right page are “4” to “48”. In this case, the display control unit 23 shifts based on the coordinate information of the noble frame for the page image corresponding to the serial number “2” and the coordinate information of the noble frame for the page image corresponding to the serial number “50”. Calculate the amount. Next, the display control unit 23 divides the calculated shift amount by the number of page images (the number of even pages) between the serial numbers “2” to “50”, thereby shifting the shift per page image. The quantity D is calculated. Then, the display control unit 23 corrects the position of the noble frame with respect to the page image having an even serial number between “2” to “50” based on the calculated shift amount D per page image. . For example, assuming that the amount of deviation is in the X-axis direction, the amount of deviation D is added to the X coordinate of the noble frame for the page image corresponding to the serial number “4”, and the noble for the page image corresponding to the serial number “6”. Correction is made by adding a shift amount that increases by D as the page image corresponding to the serial number “50” is approached, such as adding a shift amount D × 2 to the X coordinate of the frame. The left page is also corrected in the same manner as the right page. If comprised in this way, the correction burden of the inspection operator's noble frame can be reduced more, and as a result, the inspection efficiency of a plurality of pages can be further improved.

  In the above embodiment, the configuration is such that two noble frames are set per page image and a noble image is extracted with respect to a page image obtained by photographing a spread page of the printed matter. It may be configured such that two page spreads are taken one by one on the left and right sides to capture the left and right page images, and one nonblem frame is set per page image to extract the nonblem image. FIG. 5 is a diagram illustrating an example of a clipping frame designation screen that displays a page image captured by photographing two spread pages of a printed material for each of the left and right pages. In this case, the inspection operator designates a single frame in each of the page images of the odd-numbered page (FIG. 5A) and the even-numbered page (FIG. 5B). In this case, the process shown in FIG. 2 can be applied. In the case of a page image obtained by photographing a single-sided printed material as a printed matter, the inspection operator designates a single noble frame in one page image. The process shown can be applied.

  Further, in the above embodiment, when the noble displayed on the printed material can be read by OCR, the display control unit 23 is configured to determine whether the page image is doubled, missing, or out of order based on the read noble. May be. In this case, the display control unit 23 outputs an alarm to the outside when it is determined that the page image is doubled, missing, or out of order. Thereby, it is possible to promptly notify the inspection operator of page image duplication, omission, out of order, and the like.

  In the above embodiment, the inspection operator designates the noble frame in at least one place in all the page images, but the display control unit 23 can recognize the position of the noble in the predetermined page image in advance. The processing shown in FIG. 2 can be applied even if the inspection operator does not designate a noble frame.

DESCRIPTION OF SYMBOLS 1 Digital camera 2 Noble inspection apparatus 20 Operation part 21 Storage part 22 Communication part 23 Display control part

Claims (6)

Capture means for capturing a plurality of page images obtained by scanning or photographing each of a plurality of pages of the printed matter;
Setting means for setting a frame surrounding a part including a page number displayed on the page image captured by the capturing means for the page image;
Clipping means for clipping the image of the portion surrounded by the frame set by the setting means as a cut image for each page image in which the frame is set;
Display control means for displaying a list of a plurality of clipped images clipped by the cropping means in association with file names of page images that are the basis of the clipped image;
An image display device comprising: A specification of a frame surrounding a portion including a page number displayed on a smaller number of page images than the plurality of page images out of the plurality of page images captured by the capturing unit is received from the user via the operation unit. With a reception means,
The setting means sets the frame specified by the user for the page image in which the frame is specified, and the frame corresponds to the position and size of the frame specified by the user. The image display device according to claim 1, wherein the image display device is set for a page image other than the designated page image. The capturing means captures a plurality of page images scanned or photographed in page order,
The image display apparatus according to claim 1, wherein the display control unit displays a plurality of cutout images cut out by the cutout unit in a list in the order of scanning or photographing. The accepting means accepts correction of at least one of the position and size of the frame designated by the user;
The image display device according to claim 2, wherein the setting unit sets the frame in which at least one of the position and the size of the frame is corrected for a page image in which the frame is specified. . Computer
Capture means for capturing a plurality of page images obtained by scanning or photographing a plurality of pages of a printed matter,
Setting means for setting, for the page image, a frame surrounding a portion including a page number displayed on the page image captured by the capturing means;
Clipping means for cutting out the image of the portion surrounded by the frame set by the setting means as a cut image for each page image in which the frame is set; and
An image display processing program that functions as display control means for displaying a list of a plurality of clipped images clipped by the cropping means in association with file names of page images that are the basis of the clipped image. An image display method executed by a computer,
A capturing step of capturing a plurality of page images obtained by scanning or photographing each of a plurality of pages of a printed matter;
A setting step for setting, for the page image, a frame surrounding a portion including a page number displayed in the page image captured by the capturing step;
A cutout step of cutting out the image of the portion surrounded by the frame set in the setting step as a cutout image for each page image in which the frame is set;
A display control step of displaying a list of a plurality of clipped images clipped by the cropping step in association with file names of page images that are the basis of the clipped image;
An image display method comprising: