JP4336978B2 - Image processing method and image processing apparatus - Google Patents

Description

  The present invention includes an image input step for inputting a photographic image as an original image, an original image display step for displaying the input original image, and a plurality of corrections for distortion caused by the photographing lens with respect to the displayed original image. A distortion correction level setting step for setting a distortion correction level for the original image, and a distortion correction processing step for correcting the original image based on the set distortion correction level. And an image processing method configured to include a corrected image display step for displaying the corrected image that has been corrected, and an image processing apparatus in which the image processing method is embodied.

  Digital exposure such as a laser optical system based on digital image data that is usually read with a scanner for film images taken with an optical camera or photographic image data taken with a digital still camera and stored in a storage medium When obtaining a photographic print by driving the head to expose the photographic paper, various image correction processes such as gradation correction and color correction are performed on the digital image data in order to obtain an appropriate photographic print. It is.

  One such image correction process is distortion caused by the taking lens, for example, chromatic aberration of magnification that is out of focus by color because the refractive index of the lens differs depending on the wavelength of light, and a straight line becomes a curve at the periphery of the screen. Compared to the center due to distortion aberration that the quadrangle dents inwardly like a spool and bulges outward, and conversely bulges outward to form a barrel, and the fluctuation of the incident angle with respect to the lens structure and light receiving surface. For example, there is a distortion correction process for correcting distortion such as tilting in a trapezoidal shape because the peripheral light is darkened and the lens optical axis and the light receiving surface do not intersect perpendicularly.

When performing these distortion corrections, a distortion correction level setting step for setting a distortion correction level for the original image, a distortion correction processing step for correcting the original image based on the set distortion correction level, and a corrected image The corrected image display processing step for displaying the image is executed by an operator's operation, and these steps are repeatedly executed while visually evaluating the displayed corrected image.
JP 2000-324339 A

  However, in the above-described conventional image processing method, since the corrected image is displayed at a predetermined reference magnification, for example, equal magnification, it is difficult for the operator to judge whether the correction is fine or not. was there. Therefore, it is conceivable that the display magnification of the corrected image can be switched and set so that accurate and quick judgment can be made. However, the periphery of the image that shows the largest distortion when the enlarged display is performed in a limited display area is lost. Problem arises.

  In view of the above-described conventional drawbacks, the present invention is to provide an image processing method and an image processing apparatus that can quickly and accurately determine a state after correction with respect to a set distortion correction level.

In order to achieve the above-mentioned object, the first characteristic configuration of the image processing method according to the present invention includes an image input step of inputting a photographic image as an original image, as described in claim 1 of the document of the claims. An original image display step for displaying the input original image, and a plurality of distortion correction steps for correcting distortion caused by the photographing lens with respect to the displayed original image, wherein the distortion correction step is performed on the original image. A distortion correction level setting step for setting a distortion correction level; a distortion correction processing step for correcting the original image based on the set distortion correction level; and a corrected image display step for displaying the corrected image after the correction processing. a composed image processing method Te, the corrected image display step, in internal region of the corrected image, a divided image including the reference position of at least the distortion correction, the And it displays a plurality of divided areas including a divided image including a peripheral region spaced from the reference position, a first display mode for displaying the divided image displayed by the given scale factor, converting and displaying the set magnification The second display mode is configured to be switchable.

According to the above-described configuration, in the image display processing step, by switching to the second display form that is displayed after being converted to the set magnification, for example, by setting the set magnification as an enlargement magnification, it corresponds to a plurality of parts of the original image since division image is enlarged and displayed, Ru Nodea the degree of improvement of the distortion will be able to easily determine.

In addition , since the image including the peripheral region in which the degree of distortion appears greatly in the second display form is displayed as a divided image, the degree of improvement in distortion can be determined very easily, and the distortion correction reference Since the determination can be made in comparison with the divided image including the position, the evaluation of the entire photographic image can be easily performed.

As described in claim 2 , the second characteristic configuration is that, in addition to the first characteristic configuration described above, the distortion correction step performs chromatic aberration correction on the original image. This is suitable for correcting chromatic aberration that is largely distorted with respect to the optical axis of the photographing lens.

According to the first characteristic configuration of the image processing apparatus of the present invention, as described in claim 3 , an image input unit that inputs a photographic image as an original image, and an original image display unit that displays the input original image A plurality of distortion correction units that correct distortion caused by the photographing lens with respect to the displayed original image, and the distortion correction unit sets a distortion correction level setting unit that sets a distortion correction level for the original image; An image processing apparatus configured to include a distortion correction processing unit that corrects the original image based on the corrected distortion correction level, and a corrected image display unit that displays the corrected corrected image. The display unit displays a plurality of divided regions including a divided image including at least a distortion correction reference position and a divided image including a peripheral region spaced from the reference position in the internal region of the correction image. Minutes A first display mode for displaying an image at a predetermined scale factor, in that it is switchable configured to a second display mode for displaying by converting the set magnification.

In the second characteristic configuration, as described in the fourth aspect , the distortion correction unit performs chromatic aberration correction on the original image.

  As described above, according to the present invention, it is possible to provide an image processing method and an image processing apparatus that can quickly and accurately determine a corrected state with respect to a set distortion correction level.

  The case where the image processing method and the image processing apparatus are applied to a photographic processing apparatus according to an embodiment of the present invention will be described below. As shown in FIG. 1, a photographic image processing apparatus 1 includes a photographic printer 2 that performs an exposure process based on output image data on a photographic paper P and develops the exposed photographic paper, and a developed photographic film. A media driver 32 that reads image data from an image data storage medium M such as a memory card that stores image data taken by a film scanner 31 or a digital still camera that reads an image from F, or a general-purpose computer as a controller 33 The print station is configured to include input of print order information for a photographic image as an input original image and an operation station 3 for performing various image correction processes. The print is edited from the original image by the operation station 3. Data is output to the photographic printer 2 so that a desired photographic print can be made. It is made.

  As shown in FIGS. 1 and 2, the photographic printer 2 has two systems of photographic paper magazines 21 containing roll-shaped photographic paper P, and photographic paper P drawn from the photographic paper magazine 21 with a predetermined print. A sheet cutter 22 that cuts into a size; a back print unit 23 that prints print information such as a frame number on the back of the cut photographic paper P; an exposure unit 24 that exposes the photographic paper P based on the print data; A development processing unit 25 including a plurality of processing tanks 25a, 25b, and 25c filled with processing solutions for developing, bleaching, and fixing the exposed photographic paper P is disposed along the conveyance path of the photographic paper P. The laterally-feeding conveyor 26 that discharges the photographic paper P that has been dried after the development process, and the sheet-paper (photo print) P that is stacked on the laterally-feeding conveyor 26 is sorted in order units. Configured to include the data 27.

  The exposure unit 24 receives the RGB three-color light flux modulated on the basis of the print data in the main scanning direction orthogonal to the conveyance direction with respect to the photographic paper P conveyed in the sub-scanning direction by the conveyance mechanism 28. An exposure head 24a for outputting and exposing is accommodated.

  A transport mechanism 28 including a plurality of roller pairs that transport the photographic printing paper P at a process speed corresponding to the exposure unit 24 and the development processing unit 25 disposed along the transport path is disposed before and after the exposure unit 24. Is provided with a chucker-type transport mechanism 28a capable of transporting photographic paper P in multiple rows.

  The controller 33 provided in the operation station 3 is installed with an application program that operates under the control of a general-purpose operating system and executes various controls of the photographic processing apparatus 1, and a monitor 34 as an operation interface with the operator. A keyboard 35, a mouse 36, and the like are connected.

  The photographic processing process executed by the cooperation of the hardware and software of the controller 33 will be described in functional blocks. As shown in FIG. 3, a photographic image as an original image read by the film scanner 31 or the media driver 32 is obtained. An image input unit 40 that receives and performs predetermined preprocessing and transfers it to a memory 41, which will be described later, and print order information and image editing information are displayed on the screen of the monitor 34. The graphic user interface unit 42 generates various control commands based on the input operation from the keyboard 35 and the mouse 36 to the displayed graphic operation screen, and the graphic user interface unit 42 that displays the operation icons for the image, and the image Source transferred from the input unit 40 Generates print order information and a memory 41 in which image data, corrected image data after correction processing by an image processing unit 47 described later, processing parameters at that time, and set print order information are partitioned and stored. From the order processing unit 43, the image processing unit 47 that performs various corrections such as gradation correction, color correction, enlargement / reduction processing, distortion correction on the original image stored in the memory 41, and the graphic user interface unit 42 A display control unit 46 including a video RAM for displaying the original image and the corrected image data developed in the memory 41 based on the display command, and various input / output graphic data on the monitor 34; Print data for outputting the final corrected image for which various correction processes have been completed to the photographic printer 2 is generated. A lint data generating unit 44, and the like formatter 45 which converts the final corrected image according to customer orders to a file format for writing in a storage medium such as a CD-R.

  The film scanner 31 is configured to operate in two modes: a pre-scan mode that reads an image recorded on the film F at a high speed although it has a low resolution, and a main scan mode that reads a high-resolution image at a low speed. Various correction processes described later are performed on the low-resolution image read in the can mode, and the high-resolution image read in the main scan mode based on the correction parameters stored in the memory 41 at that time. The final correction process is executed. Similarly, the image file read from the media driver 32 includes a high-resolution captured image and its thumbnail image, and various correction processes described later are performed on the thumbnail image. Based on the stored correction parameters, a final correction process is performed on the high-resolution captured image. When the image file does not include a thumbnail image, the image input unit 40 generates a thumbnail image from the high-resolution captured image and transfers it to the memory 41. In this way, the calculation load of the controller 33 is reduced by executing various editing processes that are frequently trial and error on low-resolution images.

  The image processing unit 47 includes, for example, a gradation correction unit 50 that corrects the gradation of the main subject due to excessive or insufficient exposure settings during shooting, for example, a color correction unit 51 that beautifully reproduces the skin color of the main subject, and the size of the photo print Enlargement / reduction processing unit 52 for converting to an image size suitable for the image, for example, a filter processing unit (not shown) for ensuring image sharpness and reducing granular noise, distortion for correcting distortion caused by the taking lens with respect to the original image A correction unit 53 is provided.

  The distortion correction unit 53 includes a magnification chromatic aberration correction unit 53a that corrects a chromatic aberration of magnification that is out of focus due to the color because the refractive index of the lens varies depending on the wavelength of light, and a straight line appears as a curve at the periphery of the screen. Due to the distortion of the incident angle with respect to the lens structure and the light receiving surface of the lens, and the distortion aberration correcting unit 53b for correcting the distortion aberration that becomes indented like a pincushion and becomes a drum shape and conversely bulges outward and becomes a barrel shape. Peripheral dimming correction unit 53c that corrects peripheral dimming in which the periphery becomes darker than the center, and tilt correcting unit 53d that corrects, for example, trapezoidal tilting so that the lens optical axis and the light receiving surface do not intersect perpendicularly. Each distortion correction unit 53 is set with a reference point setting unit 54 for setting a correction reference point for the original image, and a distortion correction level setting unit 55 for setting a distortion correction level for the original image. A distortion correction processing unit 56 that corrects the original image based on the positive reference point and the distortion correction level, and an area that divides the corrected corrected image into areas and performs enlargement / reduction processing at a magnification set by an operator's operation A division / enlargement / reduction processing unit 57 is provided.

  Hereinafter, the distortion correction procedure by the distortion correction unit 53 will be described in detail based on the flowchart shown in FIG. 4 and the display screen explanatory diagrams of the monitor 34 shown in FIGS. In response to the customer's print order, the operator sets the film F on the film scanner 31 and operates in the pre-scan mode, or when the memory card M storing the photographed image file is set in the media driver 32, it is read. The frame image is loaded into the memory 41 via the image input unit 40 (S1), and a pre-judge screen is displayed on the monitor 34 (S2). As shown in FIG. 5, on the pre-judge screen, six frames of original images are displayed in the upper and lower two-stage image display frames 60, and a color density correction setting area 61 and a print number setting area 62 are displayed below each image display frame 60. Has been placed.

  The color density correction setting area 61 displays yellow, magenta, and cyan color balance adjustment icons 61a to 61c and a density adjustment icon 61d. When each icon is clicked with the mouse 36, -3 (lightest), -2 , -1, 0, 1, 2, 3 (darkest) pull-down menu is displayed. When the corresponding level is selected, the selected value is displayed on the icon surface, and the corrected image displayed in the display frame is displayed. It is configured so that the degree of correction can be visually evaluated. When there is no correction, a neutral display N is displayed. A print number setting icon 62a is displayed in the print number setting area 62, and the number of prints is set when a numerical value is entered via the keyboard 35 in the setting frame displayed by clicking the icon 62a (S3).

  A print setting display area 63 is arranged in the lower area of the image display frame 60. The print setting display area 63 is configured and set so that conditions such as photographic paper size, necessity of index, necessity of media output, etc. can be set based on the print order. The print channel that matches the specified condition is displayed.

  Detailed correction for each frame image displayed in the image display frame 60, for example, tone curve correction processing for adjusting the color balance in detail, sharpening processing for improving the sharpness of the image, and decoration effects are added to the image. When the operator determines that it is necessary to perform cross-filter processing, distortion correction for correcting distortion caused by the photographing lens, etc., a corresponding frame image is double-clicked to enlarge a single frame that is a detailed correction processing screen. It is updated and displayed on the display screen (S4, S5).

  As shown in FIG. 6, on the one-frame enlarged display screen, the correction target image (the original image or the corrected image displayed on the six-frame display screen) is displayed in the enlarged image display area 64 arranged at the center of the screen. The display is enlarged and arranged so that the color density correction setting area 65 and the detailed correction tab area 66 are displayed on the right side of the screen. The correction tab area 66 includes a correction 1 tab 66a for performing tone curve correction processing and the like, and a correction 2 tab 66b for performing cross filter processing, distortion correction processing, and the like, and a manual lens displayed on the correction 2 tab 66b. When the aberration correction icon 67 is selected (S6), the screen shifts to a distortion correction processing screen according to the present invention.

  As shown in FIG. 7, on the distortion correction processing screen, an image area displayed in the enlarged image display area 68 in the frame image is framed at the upper right side of the enlarged image display area 68 that is also arranged at the center of the screen. A display confirmation area 69 indicated by a line 69a, and a center coordinate confirmation area 70 indicating a center coordinate (correction reference point) CP serving as a reference for distortion correction are arranged below the display confirmation area 69, and the peripheral dimming is provided below the enlarged image display area 68. Peripheral light amount correction icon 71 for activating distortion correction by the correction unit 53c, chromatic aberration correction icon 72 for activating distortion correction by the magnification chromatic aberration correction unit 53a, distortion correction icon 73 for activating distortion correction by the distortion aberration correction unit 53b, A trapezoidal correction icon 74 for operating the distortion correction by the tilt correction unit 53d is positioned, and a correction execution icon for executing the selected distortion correction on the right side thereof. Down 75 is located.

  After the operator operates the mouse 36 and clicks one of the distortion correction icons to select one of the distortion corrections (S7), the frame display displayed in the display confirmation area 69 is moved and operated. The image area displayed in the enlarged image display area is changed (S8), and the image displayed in the enlarged image display area 68 is enlarged or reduced by changing the magnification of the display size setting area 76 (S9). ). Further, the correction reference point CP for the original image is set by dragging and dropping the cross line L displayed in the enlarged image display area 68 with the mouse 36, and the set correction reference point CP is the reference value. It is stored in the point storage unit 41 (S10).

  Next, when the operator clicks the correction execution icon 75 (S11), the display is switched to the selected distortion correction detailed setting screen. For example, if the correction execution icon 75 is clicked with the chromatic aberration correction icon 72 selected, the display is switched to the chromatic aberration correction screen shown in FIG. 8 (S12).

  The chromatic aberration correction screen has a correction image display area 78 in which nine correction images are displayed at the center of the screen, a display size setting area 82 at the upper right portion thereof, and a central position of the correction image display area 78 at the lower portion thereof. A display confirmation area 79 indicated by a frame line 79a is arranged on the original image as a displayed image portion, and a vertical axis correction level setting area 80 for setting a vertical axis correction level is arranged below the display confirmation area 79. A horizontal axis direction correction level setting area 81 for setting a correction level in the horizontal axis direction is disposed below the correction image display area 78.

  In the corrected image display area 78, the corrected image is divided into a plurality of areas 78a to 78i and displayed by the area dividing / enlargement / reduction processing unit 57, and the displayed divided image is displayed at a predetermined reference magnification. It is configured to be switchable between one display form and a second display form that is converted into a set magnification and displayed.

  More specifically, an area surrounded by the frame line 79a of the display confirmation area 79 is displayed in a central area 78e of the corrected image display area 78, and the original image includes four corner areas and each corner area. The area is divided into eight areas, and each divided area is displayed corresponding to the above-described areas 78a to 78i. The divided image is a divided image including at least the distortion correction reference position set in step S10 (initially set at the center position of the image and can be changed by the operator), that is, in the central region 78e. The displayed divided image includes a divided image including a peripheral area spaced from the reference position. Then, the display size is changed and set by operating the up / down key in the display size setting area 82. For example, the first display form which is a 100% image shown in FIG. 8 to the 400% image shown in FIG. The two-display form is enlarged and displayed (S13). Specifically, the image on the memory 41 that has been enlarged or reduced to the set display size is cut into a size that can be displayed in the divided area of the corrected image display area 78 and displayed in advance in the divided area. Only the area corresponding to the possible size may be enlarged or reduced.

  As described above, chromatic aberration is a phenomenon in which the refractive index of a lens varies depending on the wavelength of light, and is out of focus depending on the color. In view of this, it is possible to determine the degree of aberration correction very easily by enlarging and displaying a peripheral image separated from a reference position where there is minimal or no chromatic aberration, preferably a divided image including the edge of the original image. .

  In this state, distortion correction processing is executed by setting correction levels in the vertical and horizontal directions (S14). If the result of visual evaluation is insufficient, the process returns to step S14 or step S13 and correction processing is performed. Repeated.

  The correction level setting will be described in detail. R (red) G (green) of the reference color icons 80a and 81a displayed in the vertical axis correction level setting area 80 and the horizontal axis correction level setting area 81 of FIGS. ) One of B (blue), for example, R is selected as a reference color, and the correction levels of the other two colors GB with respect to R are set by operating the adjustment gauges 80b, 80c, 81b, 81c. The correction level is set by dragging and dropping the knob icon of each adjustment gauge with the mouse 36, and when the knob icon is moved upward or left from the center position, it is corrected in the spreading direction with respect to the reference color R. When moved downward or rightward from the center position, the reference color R is corrected in the narrowing direction. That is, the vertical and horizontal magnifications of the G component plane and the B component plane with respect to the R component plane are converted to different values based on the correction reference point, and the degree of the magnification is set by the knob icon.

  If it is determined that the result is sufficient by viewing the corrected image, the OK icon 83 is clicked, and the chromatic aberration correction process is terminated (S15). At this time, the set correction reference point and correction level are stored in the memory 41, and the screen returns to the distortion correction processing screen shown in FIG. Here, each data of the correction reference point and the correction level stored in the memory 41 is used for distortion correction processing for a high-resolution image for outputting a photographic print later. If the cancel icon 84 is clicked, the process returns to the correction operation stage one step before.

  Returning to step S7, the distortion correction processing is completed after the inherent distortion correction processing is repeated in response to the selection operations of the peripheral light amount correction icon 71, the distortion correction icon 73, and the trapezoid correction icon 74 (S16).

  When the various correction setting processes and the order information setting process for each frame image set in the pre-judge screen are completed in this way, the print data generating unit is subjected to the final correction process for the high resolution data. The print data for the photo printer 2 is generated.

Note that an original image display unit that displays the original image input by the graphic user interface unit 42, the display control unit 46, and the monitor 34 described above is configured, and further includes a region division / enlargement / reduction processing unit 57 for correction processing. A corrected image display unit for displaying an image is configured.

  Another embodiment will be described below. In the above-described embodiment, the correction image is divided into a plurality of areas and displayed, and the first display form in which the displayed divided image is displayed at a predetermined reference magnification, and the first image that is converted into the set magnification and displayed. Although the corrected image display unit configured to be switchable to the two-display mode is applied to chromatic aberration correction, the corrected image display unit may be applied to other distortion correction.

  The reference point setting unit for setting the correction reference point for the original image in the embodiment described above, the distortion correction level setting unit for setting the distortion correction level for the original image, the original image based on the set correction reference point and the distortion correction level. The specific processing procedure and the correction algorithm of the distortion correction processing unit that performs correction processing and the corrected image display unit that displays the corrected image after correction processing are merely examples, and may be changed as appropriate within the scope of the effects of the present invention. It goes without saying that it is configurable. Further, the distortion correction level for the original image is a concept that includes not only the distortion correction level for the original image itself but also the distortion correction level for the correction target image, and includes the correction level for the corrected image that has been corrected for distortion. It is a waste.

  The distortion correction processed for thumbnail images and low-resolution images by pre-scanning is not limited to those that are later reflected in high-resolution images. It may be configured to perform distortion correction.

External view of photographic image processing device Block diagram of photo printer Functional block diagram of photographic image processing device Flowchart explaining photographic image processing procedure Illustration of the monitor display screen (pre-judge screen) Illustration of the monitor display screen (single frame enlarged display screen) Illustration of the monitor display screen (distortion correction screen) Illustration of the monitor display screen (chromatic aberration correction screen) Illustration of the monitor display screen (chromatic aberration correction screen)

1: Image processing device (photographic image processing device)
53: Distortion correction unit 53a: Magnification chromatic aberration correction unit 53b: Distortion aberration correction unit 53c: Peripheral dimming correction unit 53d: tilt correction unit 54: reference point setting unit 55: distortion correction level setting unit

Claims (4)

An image input step for inputting a photographic image as an original image, an original image display step for displaying the input original image, and a plurality of distortion correction steps for correcting distortion caused by the photographing lens with respect to the displayed original image A distortion correction level setting step for setting a distortion correction level for the original image, a distortion correction processing step for correcting the original image based on the set distortion correction level, and a correction process. An image processing method comprising a corrected image display step for displaying the corrected image,
The corrected image display step displays a plurality of divided areas including a divided image including at least a distortion correction reference position and a divided image including a peripheral area spaced from the reference position in an internal area of the correction image. In addition, an image processing method configured to be switchable between a first display form in which the displayed divided image is displayed at a predetermined reference magnification and a second display form in which the divided image is converted into a set magnification and displayed. The image processing method according to claim 1 , wherein the distortion correction step performs chromatic aberration correction on the original image. An image input unit that inputs a photographic image as an original image, an original image display unit that displays the input original image, and a plurality of distortion correction units that correct distortion caused by the photographing lens with respect to the displayed original image A distortion correction level setting unit that sets a distortion correction level for the original image, a distortion correction processing unit that corrects the original image based on the set distortion correction level, and a correction process. An image processing apparatus configured to include a corrected image display unit that displays the corrected image,
The corrected image display unit displays a plurality of divided areas including a divided image including at least a distortion correction reference position and a divided image including a peripheral area spaced from the reference position in an internal area of the correction image. In addition, an image processing apparatus configured to be switchable between a first display form in which the displayed divided image is displayed at a predetermined reference magnification and a second display form in which the divided image is converted into a set magnification and displayed. The image processing apparatus according to claim 3 , wherein the distortion correction unit performs chromatic aberration correction on the original image.