JP5407588B2 - Image processing apparatus, imaging apparatus, and image processing program - Google Patents

Description

  The present invention relates to an image processing device, an imaging device, and an image processing program.

  In general, image data acquired at the time of photographing using a digital camera is generally compressed and encoded in a predetermined compression format such as a JPEG format after image processing, and is written in a storage medium or the like. In digital cameras provided in recent years, in addition to the above-described image data, it is also possible to write image data not subjected to the above-described image processing and compression encoding, so-called RAW image data, in a storage medium.

  Such RAW image data is developed using development software installed in the PC (for example, Patent Document 1). It is preferable that the development process is performed based on the shooting conditions. However, when the development process is performed based on the shooting conditions, for example, a color cast may occur. Therefore, the user adjusts the development conditions while confirming the preview image that has been subjected to the image processing according to the set development conditions, and applies the development processing under the optimum development conditions to the RAW image data.

JP 2008-283291 A

  However, when the development conditions are adjusted while checking the preview image and the development processing under the optimum development conditions is applied to the RAW data, it is necessary to generate the preview image every time the adjustment is made. Therefore, it takes time until a preview image subjected to image processing based on the adjusted development condition is generated, and it takes time to confirm the preview image. As a result, there is a disadvantage that the time required for the development process itself becomes long.

  Accordingly, an object of the image processing apparatus, the imaging apparatus, and the program of the present invention is to quickly confirm the adjustment effect when adjusting the development parameters of the RAW image data.

The image processing apparatus according to the present invention performs display processing for displaying an image, and development processing using resolution conversion according to the resolution of the display unit and a plurality of different development conditions for input RAW image data. comprising an image processing unit that generates a plurality of preview image data, wherein the plurality of different development conditions, pre-priority is set, the image processing unit, the priority from the high priority development conditions The plurality of preview image data are generated so that the order of development conditions is low.

  It should be noted that the setting unit for setting the development condition and extraction for extracting preview image data having the same development condition as the development condition set by the setting unit from a plurality of preview image data created by the image processing unit. And a display control unit for displaying a preview image on the display unit using the preview image data extracted by the extraction unit.

Further, it is preferable that the setting unit can set the developing condition by changing at least one of a parameter used at the time of white balance processing and a parameter used at the time of brightness adjustment as the first condition of the developing condition. .

Further, the setting unit can set at least one parameter of a parameter used at the time of saturation adjustment, a parameter used at the time of contrast adjustment, or a parameter used at the time of edge enhancement as the second condition of the development condition, The display control unit may control the display unit based on the second condition when displaying the preview image developed based on the first condition.

Further, the image processing unit further includes a selection unit that selects RAW image data that is a target for generating the preview image data from a plurality of RAW image data, and the image processing unit applies the RAW image data selected by the selection unit. Development processing using a plurality of development conditions may be executed.

An imaging apparatus according to the present invention includes the above-described image processing apparatus and an imaging unit that acquires the RAW image data.

The image processing program according to the present invention includes a display process for displaying an image, and resolution conversion according to the resolution of the display process and development processing using a plurality of different development conditions on the input RAW image data. An image processing step for generating a plurality of preview image data, wherein the plurality of different development conditions are preset in priority order, and the image processing step starts with the priority order from the development condition having the higher priority order. The plurality of preview image data are generated so that the order of development conditions is low.

The image processing apparatus according to the present invention performs a resolution conversion corresponding to the resolution of the display unit on a display unit that displays an image and input RAW image data, and then performs the resolution conversion on the RAW image data subjected to the resolution conversion An image processing unit that generates a plurality of preview image data by continuously performing development processing using a plurality of different development conditions, and a preview image based on any one of the plurality of preview image data A setting unit that sets development conditions for the RAW image data when displayed on the display unit, and a preview image that has been developed under the development conditions set by the setting unit from the plurality of preview image data An extraction unit for extracting data, and a preview image displayed by the extraction unit on the preview image displayed on the display unit; Characterized by comprising a display control unit for switching the preview image based on the data.

  According to the image processing apparatus, the imaging apparatus, and the program of the present invention, the adjustment effect can be quickly confirmed when adjusting the development parameter of the RAW image data.

It is a block diagram which shows the structure of the imaging device 1 in embodiment of this invention. It is a figure which shows the flow until it produces | generates a preview image from RAW image data. It is an example of the parameter input screen of STAGE1. It is an example of the parameter input screen of STAGE2. 4 is a flowchart illustrating an operation at the time of developing RAW image data in the imaging apparatus 1. It is a table | surface which shows the order which produces | generates a preview image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In this embodiment, an imaging apparatus is used as an example of the image processing apparatus of the present invention. FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 1 according to an embodiment of the present invention.

  As shown in FIG. 1, the imaging device 1 includes an imaging lens 2, an imaging device 3, an A / D conversion unit 4, a buffer memory 5, an image processing unit 6, a control unit 7, a monitor controller 8, a monitor 9, and an operation unit 10. , A memory 11, a recording I / F unit 12, a recording medium 13, and a bus 14.

  The imaging lens 2 forms a subject image on the imaging surface of the imaging element 3. The imaging lens 2 may be an imaging optical system including a plurality of lenses such as a zoom lens and a focus lens. The imaging element 3 photoelectrically converts the subject light that has passed through the imaging lens 2 and outputs analog image signals corresponding to R, G, and B colors.

  An image signal output from the image sensor 3 is input to the A / D converter 4. The A / D conversion unit 4 performs A / D conversion on the analog image signal output from the image sensor 3 and changes it to a digital image signal. The digital image signals are collected into one frame and recorded in the buffer memory 5 as image data. Hereinafter, image data that has been A / D converted and grouped into one frame is referred to as RAW image data. The buffer memory 5 temporarily records image data in the pre-process and post-process of image processing by the image processing unit 6.

  The image processing unit 6 performs image processing on the image data recorded in the buffer memory 5. Examples of the image processing include well-known white balance adjustment, brightness adjustment, color interpolation, gradation conversion processing, and contour enhancement processing. The image processing unit 6 also executes processing for compressing in JPEG (Joint Photographic Experts Group) format and the like, and processing for decompressing and restoring the compressed data. In addition, the image processing unit 6 performs development processing on RAW image data recorded on a recording medium 13 described later. This development processing is processing including resolution conversion processing, image processing, and compression processing. Thereby, image data in JPEG format is generated.

  The image processing unit 6 generates thumbnail image data for identifying RAW image data when recording the RAW image data on the recording medium 13. For example, the image processing unit 6 performs resolution conversion processing, image processing, and compression processing on the RAW image data based on the imaging conditions and the like to generate thumbnail image data.

  The image processing unit 6 generates a reference preview image at the time of development. FIG. 2 is a diagram showing a flow until a preview image is generated from RAW image data. First, the image processing unit 6 generates RAW image data R ′ having a resolution lower than the resolution of the RAW image data R based on the RAW image data R. Next, the image processing unit 6 generates 49 preview images P1 to P49 by combining 7 types of white balance and 7 levels of brightness based on the RAW image data R ′. The types of white balance are auto, preset, clear sky, light bulb, fluorescent light, cloudy sky, and strobe. A white balance correction value corresponding to each light source type or color temperature is set in advance. The degree of brightness is indicated by −3, −2, −1, 0, +1, +2, +3, with 0 being the standard brightness, and the larger the numerical value, the brighter the preview image. Note that the preview images P <b> 1 to P <b> 49 are recorded in the buffer memory 5.

  The control unit 7 performs overall control of the imaging apparatus 1 according to a predetermined sequence program, and executes various calculations (AF, AE, etc.) necessary for imaging. The monitor controller 8 controls the monitor 9. Various images displayed on the monitor 9 include an image generated by imaging, an image recorded on the recording medium 13, a parameter input screen described later, a menu screen, and the like. Further, the monitor controller 8 superimposes and displays a menu screen, a cursor, etc. on the above image. In addition, the monitor controller 8 adjusts the display of the image on the monitor 9 and artificially changes the degree of saturation, contrast, and edge enhancement.

  By the way, development processing for RAW image data is performed in two stages of STAGE 1 and STAGE 2. In STAGE 1, processing with a large display change, such as white balance adjustment and brightness adjustment, is executed. In STAGE 2, processing with a smaller display change compared to STAGE 1, such as adjustment of saturation, contrast, and degree of edge enhancement, is executed.

  FIG. 3 is a diagram of a parameter input screen of STAGE 1. As shown in FIG. 3, the parameter input screen of STAGE 1 can select the type of white balance and the degree of brightness corresponding to the preview images P1 to P49. For example, the monitor 9 displays a preview image (preview image P4 in FIG. 3), a bar 21 indicating the type of white balance, and a bar 22 indicating the degree of brightness. The types of white balance shown in the bar 21 are, from the top, auto, preset, clear sky, light bulb, fluorescent light, cloudy sky, and strobe (in FIG. 3, 21a to 21g, respectively). The type of white balance of the preview image P4 is surrounded by a thick frame 23. Further, the brightness levels displayed on the bar 22 are -3, -2, -1, 0, +1, +2, and +3 from the left. The cursor 24 indicates the brightness level of the preview image P4. The type of white balance can be selected by operating the upper and lower buttons of the cross key 16. The degree of brightness can be selected by operating the left and right buttons of the cross key 16. That is, the user can easily adjust the white balance or brightness simply by operating the cross key 16. The cross key 16 will be described later.

  FIG. 4 is a diagram of a parameter input screen of STAGE2. As shown in FIG. 4, the monitor 9 displays a preview image (preview image P11 in FIG. 4), a bar 31 indicating the degree of saturation, a bar 32 indicating the degree of contrast, and a bar 33 indicating the degree of edge enhancement. To do. The degree of saturation displayed on the bar 31 and the degree of contrast shown on the bar 32 are auto, -2, -1, 0, +1, +2 from the left. Further, the degree of contour enhancement shown in the bar 33 is 0, 1, 2, 3, 4, 5 from the left. Note that as the value increases, the degree of saturation, contrast, and edge enhancement increases. The cursor 34, the cursor 35, and the cursor 36 indicate the saturation, contrast, and contour enhancement degree of the preview image P11. In addition, any one of the items of saturation, contrast, and edge enhancement can be selected by operating the upper and lower buttons of the cross key 16. In addition, the degree of each item can be selected by operating the left and right buttons of the cross key 16.

  The operation unit 10 includes a release button 15, a cross key 16, and the like. The release button 15 is operated by the user during imaging. The cross key 16 is operated on the above parameter input screen or the like. The state of the release button 15 and the cross key 16 is detected by the control unit 7, and a sequence based on the detected button and key states is executed. The memory 11 records firmware and the like. The recording I / F unit 12 includes a connector for connecting the recording medium 13. By connecting the recording I / F unit 12 and the recording medium 13, data writing / reading is executed with respect to the recording medium 13. The bus 14 connects the buffer memory 5, the image processing unit 6, the control unit 7, the monitor controller 8, and the recording I / F unit 12 to execute input / output of data and signals.

FIG. 5 is a flowchart illustrating an operation at the time of developing RAW image data in the imaging apparatus 1.

  Step S101 is processing for selecting an image to be developed. The control unit 7 reads the image file from the recording medium 13. The monitor 9 displays a list of thumbnail images. Then, the control unit 7 accepts selection of any thumbnail image via the cross key 16. Hereinafter, an example in which a thumbnail image corresponding to the RAW image data R is selected will be shown.

  Step S102 is processing for generating a preview image. The image processing unit 6 generates preview images P1 to P49. The monitor 9 may display a message such as “Please wait” along with an hourglass picture.

  Step S103 is processing to shift to STAGE1. The monitor 9 displays a parameter input screen of STAGE1. Note that the monitor 9 first displays a preview image P4 in which the white balance is auto and the brightness level is 0.

  Step S104 is processing for determining whether or not a change in at least one of the type of white balance and the degree of brightness has been accepted. When the change is accepted (when the determination in step S104 is YES), the process proceeds to step S105. On the other hand, when the change is not received (when the determination in step S104 is NO), the process proceeds to step S106 described later.

  Step S105 is processing to display a corresponding preview image. The control unit 7 reads out from the buffer memory 5 the preview image corresponding to the type of white balance after the change accepted in step S104 and the degree of brightness. The monitor 9 displays the read preview image. That is, when adjusting the white balance or brightness, the display of the preview image is switched.

  Step S106 is processing to determine whether or not an instruction for determining the type of white balance and the degree of brightness has been received. If an instruction to determine is accepted (when the determination in step S106 is YES), the type of white balance and the degree of brightness are set as development parameters, and the process proceeds to step S107. On the other hand, when the instruction to determine is not received (when the determination in step S106 is NO), the process returns to step S104.

  As a result, it is only necessary to generate a preview image in which the white balance and brightness with a large display change on the monitor 9 are changed, so that it is not necessary to generate a preview image in which all development parameters are combined. Therefore, the preview image generation time can be saved and the waiting time of the user can be shortened. Further, by generating the preview images P1 to P49 from the RAW image data R ′, the processing time can be further reduced as compared with the case where the preview images P1 to P49 are generated from the RAW image data R.

  Step S107 is processing to shift to STAGE2. The monitor 9 displays a parameter input screen of STAGE2. The monitor 9 first displays a preview image corresponding to the type of white balance and the degree of brightness determined in STAGE 1.

  Step S108 is a process of determining whether or not at least one of the saturation, the contrast, and the degree of contour enhancement is accepted. When the change is accepted (when the determination in step S108 is YES), the process proceeds to step S109. On the other hand, when the change is not received (when the determination in step S108 is NO), the process proceeds to step S110 described later.

  Step S109 is processing for displaying a pseudo-processed preview image. The monitor controller 8 changes the display of the preview image on the monitor 9 and displays on the monitor 9 the preview image corresponding to the degree of saturation, contrast, and edge enhancement after the change accepted in step S108.

  For example, the monitor controller 8 adjusts the gradation characteristics by using gamma adjustment means (generally resistors are used) provided for each output color component (for example, RGB) in the monitor controller 8, Adjust saturation and contrast. When adjusting the degree of saturation, the ratio of the color components is changed by individually adjusting the gamma characteristics for each output color component with different adjustment amounts corresponding to the adjustment degrees. When adjusting the degree of contrast, the gamma characteristic for each output color component is adjusted with a uniform adjustment amount according to the degree of adjustment.

  Further, the adjustment of the degree of contour enhancement can be realized by adding an integration circuit in the monitor controller 8. When adjusting the degree of contour enhancement, the degree of amplification by integration is adjusted according to the degree of adjustment.

  That is, when adjusting saturation, contrast, and edge enhancement, since the display change is smaller than when adjusting white balance and brightness, a change in the preview image on the monitor 9 is displayed in a pseudo manner. Therefore, the preview image generation time can be saved and the waiting time of the user can be shortened.

  Step S110 is processing for determining whether or not an instruction for determining the degree of saturation, contrast, and edge enhancement has been received. When an instruction to determine is accepted (when the determination in step S110 is YES), the saturation, contrast, and degree of edge enhancement are set as development parameters, and the process proceeds to step S111. On the other hand, when the instruction to determine is not received (when the determination in step S110 is NO), the process returns to step S108.

  Step S111 is a development process. The image processing unit 6 performs development processing on the RAW image data using the development parameters set in Step S106 and Step S110.

  Step S112 is a process of displaying the image after the development process.

  Step S113 is a process of accepting selection as to whether or not to record the image after the development process. When the selection to record is accepted (when the determination in step S113 is YES), the process proceeds to step S114. On the other hand, when the selection to record is not received (when determination of step S113 becomes NO), it returns to step S101.

  Step S114 is a process of recording the image after the development process. The control unit 7 records the developed image on the recording medium 13 and ends the series of processes. Note that the control unit 7 may delete the RAW image data or may record the RAW image data together with the developed image without deleting the RAW image data.

  As described above, the imaging apparatus 1 according to the present embodiment first generates a plurality of preview images in which white balance and brightness with a large display change are changed. When the white balance and brightness are adjusted in STAGE 1, the display of the preview image is switched. Next, when adjusting the saturation, contrast, and contour emphasis with a small display change in STAGE 2, the display of the preview image on the monitor 9 is adjusted by the monitor controller 8.

  Therefore, according to the imaging device 1 of the present embodiment, the adjustment effect can be quickly confirmed when adjusting the development parameters of the RAW image data. Further, the stage in which the user operates is divided into STAGE 1 and STAGE 2, and the preview image is generated before moving to STAGE 1, so that the waiting time can be made unconscious. Furthermore, since each parameter can be set by operating the up / down / left / right direction of the cross key 16, usability is not impaired.

  In the above embodiment, an example is shown in which all 49 preview images are generated before the transition to STAGE 1. However, the present invention is not limited to this. As described above, when moving to STAGE 1, the monitor 9 first displays the preview image P4, and then switches the display of the preview image according to the number of times the cross key 16 is operated. Therefore, after displaying the preview image P4, the image processing unit 6 generates preview images in the descending order of possibility of being displayed next. FIG. 6 is a table showing the order in which preview images are generated. In FIG. 6, numbers are assigned according to the number of times the up / down / left / right buttons of the cross key 16 are pressed with reference to a preview image in which the white balance is auto and the brightness level is 0.

  In this case, the process may move to STAGE 1 when the preview image P4 is generated. Then, in the background of STAGE 1, the image processing unit 6 generates preview images in the order shown in FIG. Thus, by generating a preview image with priorities, it is possible to shorten the time from selecting an image to be developed to shifting to STAGE 1.

  Further, the order of generating preview images is not limited to this. For example, a preview image in which the white balance is fixed and the brightness level is changed may be generated on the basis of a preview image in which the white balance is auto and the brightness level is 0, or the brightness level is fixed. Alternatively, a preview image with the white balance changed may be generated. In the table of FIG. 6, a preview image of white balance and brightness of peripheral blocks may be generated with reference to a block whose white balance is auto and whose brightness is 0.

  Furthermore, the type of white balance set at the time of imaging may be read from the image file, and a preview image of this white balance may be preferentially generated. In this case, a cursor indicating the white balance set at the time of imaging may be displayed near the bar 21 indicating the type of white balance on the parameter input screen of STAGE 1.

  In the above-described embodiment, an example in which one preview image is displayed on the parameter input screen of STAGE 1 has been described. However, a plurality of preview images may be displayed in a comparable manner.

  In STAGE 2, the display of the preview image does not change significantly compared to STAGE 1. For this reason, the size of the preview image displayed in STAGE 2 may be smaller than the preview image displayed in STAGE 1.

  Also, the types of white balance, brightness, saturation, contrast, and the degree of edge enhancement are examples and are not limited.

  Moreover, although the example divided into STAGE1 and STAGE2 was shown in said embodiment, the number of stages is not limited.

  In the above embodiment, the example of the imaging device 1 has been described, but the present invention is not limited thereto. For example, the present invention can be similarly applied to an imaging apparatus having a configuration other than that shown in FIG. The present invention can also be applied to an image processing apparatus such as a photo frame that can reproduce an image acquired by an imaging apparatus.

  Moreover, it is good also as a structure which implement | achieves a part of process which the image process part 6 or the control part 7 performed with the computer. In this case, a program for executing part or all of the processing (from step S101 to step 106 in FIG. 2) performed by the image processing unit 6 or the control unit 7 is stored in the computer. By performing this process, the same effect as the above embodiment can be obtained.

DESCRIPTION OF SYMBOLS 1 ... Imaging device, 6 ... Image processing part, 7 ... Control part, 8 ... Monitor controller, 9 ... Monitor, 16 ... Cross key

Claims (8)

A display for displaying an image;
An image processing unit that generates a plurality of preview image data by performing resolution conversion according to the resolution of the display unit and development processing using a plurality of different development conditions on the input RAW image data ;
Equipped with a,
Priorities are set in advance for the plurality of different development conditions,
The image processing device is characterized in that the image processing unit generates the plurality of preview image data so that the development conditions having a high priority are arranged in the order of the development conditions having a low priority . The image processing apparatus according to claim 1.
A setting unit for setting the development conditions;
An extraction unit that extracts preview image data having the same development condition as the development condition set by the setting unit from a plurality of preview image data created by the image processing unit;
An image processing apparatus, further comprising: a display control unit configured to display a preview image on the display unit using the preview image data extracted by the extraction unit. The image processing apparatus according to claim 2 ,
The setting unit is capable of setting the development condition by changing at least one of a parameter used at the time of white balance processing and a parameter used at the time of brightness adjustment as the first condition of the development condition. Image processing device. The image processing apparatus according to claim 3 .
The setting unit can set at least one parameter of a parameter used at the time of saturation adjustment, a parameter used at the time of contrast adjustment, or a parameter used at the time of edge enhancement as the second condition of the development condition,
The display control unit controls the display unit based on the second condition when displaying a preview image developed based on the first condition . The image processing apparatus according to claim 1 , wherein:
A selection unit that selects, from a plurality of RAW image data, RAW image data for which the preview image data is to be generated;
The image processing apparatus, wherein the image processing unit performs development processing using a plurality of development conditions on the RAW image data selected by the selection unit. The image processing apparatus according to any one of claims 1 to 5,
  An imaging unit for acquiring the RAW image data;
  An imaging apparatus comprising: A display process for displaying an image;
An image processing step of generating a plurality of preview image data by performing resolution conversion according to the resolution of the display step and development processing using a plurality of different development conditions on the input RAW image data;
To the computer,
Priorities are set in advance for the plurality of different development conditions,
The image processing program is characterized in that the plurality of preview image data are generated so that the development conditions having a high priority are arranged in the order of the development conditions having a low priority .   A display for displaying an image;
  After the resolution conversion corresponding to the resolution of the display unit is performed on the input raw image data, the development processing on the raw image data subjected to the resolution conversion is continuously performed using a plurality of different development conditions. An image processing unit for generating a plurality of preview image data,
  A setting unit that sets development conditions for the RAW image data when a preview image based on any one of the plurality of preview image data is displayed on the display unit;
  An extraction unit that extracts, from the plurality of preview image data, preview image data that has been subjected to development processing under the development conditions set by the setting unit;
  A display control unit that switches the preview image displayed on the display unit to a preview image based on the preview image data extracted by the extraction unit;
  An image processing apparatus comprising:

Images