JP5875291B2 - Imaging device, control method thereof, and control program - Google Patents

Description

  The present invention relates to an imaging apparatus that performs composition setting of a subject at the time of shooting, and in particular, an imaging apparatus that performs color correction processing using color correction information included in a reference image displayed on a display unit, a control method thereof, And control program.

  In general, in an imaging apparatus such as a digital camera, the outline information of a reference image is superimposed and displayed on a so-called through image displayed on a display unit such as an LCD (liquid crystal display device), and a composition setting related to a subject is set during shooting. There is something to do.

  For example, there is a display in which a composition template is displayed superimposed on a subject image displayed on a monitor display device (display unit). Here, the composition of the subject is determined using the composition template, and a photograph can be easily taken with the composition (see Patent Document 1).

  Also, there is a frame (focus detection area frame) of an AF (autofocus) frame, a closest priority area frame displayed in the frame frame, and a dynamic AF area frame displayed in different colors (Patent Literature). 2). These frames are superimposed on the through image in the finder so that the role of each frame can be visually distinguished.

JP 2007-166250 A JP 2009-44382 A

  However, the technique described in Patent Document 1 does not disclose a technique for changing the hue for each region of the composition template. Each area is subjected to a color correction suitable for each area, for example, a blue area is corrected to be blue in an empty area, so that a more preferable image is obtained.

  Accordingly, an object of the present invention is to provide an imaging apparatus capable of performing color correction using composition information at the time of shooting, a control method thereof, and a control program.

To achieve the above object, an imaging apparatus according to the present invention is an imaging apparatus that performs imaging in accordance with the composition of the preset shot shown to configuration diagram information, the composition information is at least two closed regions the a, the for each of the closed regions and Nde including a color setting information for setting the color, the image represented by the image data obtained through the imaging lens, each area corresponding to the closed area of the composition information Color correction amount calculating means for obtaining color information, comparing the color setting information with the color information for each closed region of the composition information, and obtaining a color correction amount for each closed region of the composition information; and the image possess an image correcting means for performing color correction, the depending on the color correction amount for each closed area of the composition information about the data, the color correction amount calculating means, for all of the closed region, the said color information color The difference from the setting information exceeds a predetermined threshold If the proportion of the area exceeds a predetermined ratio, and changing the exposure time of shooting.

Control method according to the present invention is a control method of an image pickup apparatus to perform photographing according to the composition of the preset shot shown to configuration diagram information, the composition information includes at least two closed regions, the the color setting information for setting the color for each of the closed regions and Nde including, an image represented by the image data obtained through the imaging lens, to obtain color information for each region corresponding to the closed area of the composition information the compared to the color setting information for each closed region of composition information and the color information, a color correction amount calculating step of calculating a color correction amount for each closed area of the composition information, the composition information for the image data of possess an image correction step of performing color correction, the depending on the color correction amount for each closed region, in the color correction amount calculating step, for all of the closed region, the difference between the color setting information and the color information Closes over a certain threshold When the ratio of the frequency exceeds a predetermined ratio, and changing the exposure time of shooting.

Control program according to the present invention is a control program used a composition of a preset shot by the image pickup apparatus to perform photographing according to indicate to configuration diagram information, the composition information includes at least two closed regions the closed region each have Nde including a color setting information for setting the color for the, to the computer that the imaging device comprises, for an image represented by the image data obtained through the imaging lens, the closed area of the composition information corresponding to obtain color information for each region, the compared to the color setting information for each closed region of composition information and the color information, color correction amount calculation for obtaining the color correction amount for each closed area of the composition information step a, the image correction step of performing color correction in accordance with the image data to the color correction amount for each closed area of the composition information, is executed, in the color correction amount calculating step, pairs to all closed region That the proportion of closed area difference between the color setting information and the color information is greater than a predetermined threshold value exceeds a predetermined ratio, and changing the exposure time of shooting.

  According to the present invention, color correction can be performed using composition information during shooting.

1 is a block diagram illustrating a digital camera that is an example of an imaging apparatus according to an embodiment of the present invention. FIG. 3 is a flowchart for explaining an example of processing when a composition template is used when shooting is performed by the imaging apparatus shown in FIG. 1 (No. 1). FIG. 6 is a flowchart for explaining an example of processing when a composition template is used when shooting is performed by the imaging apparatus illustrated in FIG. 1 (part 2). It is a figure which shows an example of the composition template used with the imaging device shown in FIG.

  Hereinafter, an imaging device according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a digital camera which is an example of an imaging apparatus according to an embodiment of the present invention.

  Referring to FIG. 1, the illustrated digital camera includes an optical unit 1 having a plurality of lenses including an imaging lens. The optical unit 1 is driven in the optical axis direction by a motor driver 13. Light from the subject incident from the optical unit 1 forms an image on the image sensor 5 as an optical image.

  The image sensor 5 photoelectrically converts the optical image and outputs an electrical signal (analog image signal) corresponding to the optical image. The AFE (analog front end) 4 drives the image sensor 5 under the control of the CPU 2 and converts an analog signal output from the image sensor 5 into a digital signal (image data). This digital signal is given to the CPU 2. The AFE 5 includes a CDS (Correlated Double Sampling) / AD converter (not shown). The CDS / AD converter performs digital sampling to generate a digital signal.

  When displaying the through image, the AFE 4 stores the image data obtained as a result of the thinning drive of the image sensor 5 under the control of the CPU 2 in the image temporary memory 6. Then, the display image generation unit (display control means) 7 converts the image data stored in the image temporary memory 6 into display data. The display data is displayed on the display unit 9 as a through image by the display driver 8. Hereinafter, image data obtained by thinning driving is referred to as through image data.

  The imaging auxiliary information generation unit 10 generates imaging auxiliary information indicating the shutter speed, ISO sensitivity value, and the number of images that can be captured, and expands the imaging auxiliary information in the auxiliary information temporary memory 11. When displaying the through image on the display unit 9, the display image generating unit 7 superimposes the photographing auxiliary information on the through image and displays it on the display unit 9.

  The operation unit 12 is provided with a release button (not shown). When the user presses the release button halfway, the drive control unit 3 moves the image sensor 5 through the AFE 4 under the control of the CPU 2 (AF (autofocus)). For drive control. The drive control unit 3 controls the motor driver 13 to drive the optical unit 1 to perform AE (automatic exposure) and AF while capturing an image signal from the imaging sensor 5 by the AFE 4.

  Thereafter, when the user fully presses the release button, the drive control unit 3 performs drive control of the imaging sensor 5 for main photographing via the AFE 4 under the control of the CPU 2. As a result, the AFE 4 captures the image signal of the main photographing from the image sensor 5 and stores (decompresses) it in the image temporary memory 6. Hereinafter, an image obtained by the main photographing drive is referred to as main photographing image data.

  The correction amount calculation unit (color correction amount calculation means) 14 calculates various correction amounts, which will be described later, in accordance with the actual captured image data developed in the temporary image memory 6. Then, the image correction unit (image correction unit) 15 performs correction processing such as optical system correction processing, color correction processing, and noise reduction processing on the captured image data, and causes the recording unit 16 to store still image data or moving images. Record as data.

  Here, a composition template used for shooting, which is a feature of the present embodiment, will be described. The composition template assists the photographer in photographing with a favorite composition by superimposing it on the subject image at the time of photographing. In the present embodiment, each composition template includes, as composition information, contour information indicating the boundary of each area, color information indicating the classification of each area, and correction information for performing color correction for each area for each area. Have. Specifically, image data as shown in FIG. 3A is stored as composition information including a set of coordinate data (contour information) indicating the contour of the closed region and color information, and color difference is used as correction information for each region. A gain or the like is associated with the position of each region and stored in the composition template storage unit 17 together with image data.

  Here, the outline information and the color information in the composition template are newly created using a touch panel (not shown) provided in the operation unit 12. Alternatively, the composition template stored in the composition template storage unit 17 may be edited to obtain contour information and color information.

  When a composition template (composition information), that is, contour information and color information is made new, a closed region is created on the display screen of the display unit 9 using the operation unit 12, and a display color is set for each closed region. Set. When the contour information and the color information are obtained by editing, for the composition template stored in the composition template storage unit 17, the user operates the operation unit 12 to correct at least one of the contour information and the display color. The composition template obtained by new creation or the composition template obtained by editing is overwritten or newly saved in the composition template storage unit 17.

  The composition template is composed of a set of two or more closed areas, and a display color is recorded in each of the closed areas. The user can set the display color according to the finished display color image without being particularly conscious of the color correction setting.

  Thus, each composition template has at least two closed regions. The composition template includes contour information (composition contour information) that defines the boundary of the closed region as a contour and color setting information for setting the color of each closed region.

  2A and 2B are flowcharts for explaining an example of processing when a composition template is used when shooting is performed by the imaging apparatus shown in FIG. The flowcharts shown in FIGS. 2A and 2B are executed by the CPU 2 shown in FIG.

  With reference to FIG. 1, FIG. 2A, and FIG. 2B, first, the imaging device prompts the user to select a composition template before the start of shooting (before shooting). At this time, for example, a screen (template selection screen) for prompting selection of a composition template is displayed on the display unit 9. When a composition template selection button is pressed on the template selection screen, a list of composition templates (template list) stored in the composition template storage unit 18 is displayed on the display unit 9.

  When the user selects a composition template to be used from the template list, the contour information of the selected composition template (selected composition information) is expanded from the composition template storage unit 17 to the auxiliary information temporary memory 11 (step S201). Then, the closed area number k included in the selected composition template is read into the auxiliary information temporary memory 11 (step S202).

  The display image generation unit 7 superimposes the contour information of the composition template on the through image data developed in the temporary image memory 6, and displays the through image on which the contour information is superimposed on the display unit 9 (step S203).

  Subsequently, the CPU 2 determines whether or not the user has pressed the release button halfway (step S204). If the release button is not pressed halfway (NO in step S204), CPU 2 stands by.

  On the other hand, when the release button is pressed halfway (YES in step S204), as described above, the CPU 2 stores the AF image data in the image temporary memory 6 (step S205: AF image capture). The CPU 2 performs AF processing according to the AF image data (step S206).

Next, the correction amount calculation unit 14 initializes a variable n of a closed region number counter (not shown) and a variable s of a color saturation counter (not shown) to zero (step S207). Subsequently, the correction amount calculation unit 14 checks whether or not the variable n of the closed region counter is equal to the number k of closed regions in the composition template (step S208). If the closed area counter variable n has not reached the number k of closed areas (NO in step S208), the correction amount calculation unit 14 uses the color information in the closed area corresponding to the variable n for the selected composition template (selected composition information). (Hue H _Tn , Lightness V _Tn , Saturation C _Tn ) is fetched from the composition template storage unit 17 via the auxiliary information temporary memory 11 (step S209). The color information in the composition template is called template color information.

Subsequently, the correction amount calculation unit 14 calculates the average value of the color information in the region n of the variable n for the AF image data in order to compare with the color information of the composition template, and calculates the average color information (hue H _n , lightness V _n , saturation C _n ) are obtained (step S210). The average color information in the AF image data is called image color information.

The correction amount calculation unit 14 compares the hue in the template color information with the hue in the image color information to obtain a hue difference (difference) ΔH _n = | H _n −H _Tn |. Then, the correction amount calculation unit 14 checks whether or not the hue difference ΔHn is smaller than the hue threshold value H _th predetermined (step S211).

If ΔH _n <H _th (less than the threshold value) (YES in step S211), the correction amount calculation unit 14 determines the lightness difference (difference) ΔV _n = | V _n −V _Tn between the template color information and the image color information. It is confirmed whether or not | is smaller than a predetermined lightness threshold value _Vth (step S212). If ΔV _n <V _th (less than the threshold) (YES in step S211), the correction amount calculation unit 14 sets V _n −V _Tn as the brightness correction amount V _cn (step S213).

On the other hand, if ΔV _n ≧ V _th (NO in step S211), the correction amount calculation unit 14 determines that the subject in the composition template does not match the subject in the AF image data. Then, the correction amount calculation unit 14 sets the brightness correction amount V _cn to zero (step S214). That is, the correction amount is not calculated.

Subsequently, the correction amount calculation unit 14 checks whether or not the lightness difference ΔV _n2 = V _n −V _Tn is greater than a predetermined positive color saturation threshold V _th2 (step S215). If ΔV _n2 > V _th2 (YES in step S215), the correction amount calculation unit 14 determines that the brightness in the AF image data is higher than the brightness of the composition template by a predetermined value or more. Then, the correction amount calculation unit 14 increments the color saturation counter variable s (step S216: S = S + 1).

Next, the correction amount calculation unit 14 checks whether or not the saturation difference ΔC _n = | C _n −C _Tn | is smaller than a predetermined saturation threshold C _{th in the} template color information and the image color information. (Step S217). If ΔC _n <C _th (YES in step S217), the correction amount calculation unit 14 sets Cn−C _Tn as the lightness correction amount C _cn (step S218).

On the other hand, if ΔC _n ≧ C _th (NO in step S217), the correction amount calculation unit 14 determines that the subject in the composition template and the subject in the AF image data do not match. Then, the correction amount calculation unit 14 sets the lightness correction amount C _cn to zero (step S219).

When the series of processing so far is completed, the correction amount calculation unit 14 counts up the closed region counter variable n (step S220: n = n + 1). Then, the correction amount calculation unit 14 returns to the process of step S208 to check whether or not the closed region counter variable n is equal to the number of closed regions k. If ΔV _n2 ≦ V _th2 in step S215 (NO in step S215), correction amount calculation unit 14 proceeds to the process of step S220.

In step S211, if ΔH _n ≧ H _th (NO in step S211), the hue is greatly different between the template color information and the image color information, so the correction amount calculation unit 14 determines that the composition template and the subject are different. To do. Then, the correction amount calculation unit 14 does not perform correction in the closed region. That is, the correction amount calculation unit 14 sets the lightness correction value V _cn and the saturation correction value C _cn to zero (step S221). Then, the correction amount calculation unit 14 proceeds to the process of step S200 and counts up the closed region counter variable n (S220).

  In step S208, if the closed region counter variable n is equal to the number k of closed regions in the composition template (YES in step S208), it is assumed that the correction amount calculation unit 14 has finished processing for all closed regions.

Subsequently, the correction amount calculation unit 14 calculates a ratio (color saturation ratio) s / k determined as color saturation in all closed regions. Then, the correction amount calculating unit 14 is color saturation ratio s / k and checks color saturation threshold _{s th} is larger than (step S222).

If s / k> s _th (YES in step S222), the correction amount calculation unit 14 determines that the exposure is too high and the color saturation ratio is large, and corrects the exposure (changes the exposure) (step). S223: Δe = f (s / k)). Then, the correction amount calculation unit 14 returns to the process of step S205, takes in the AF image data from the image temporary memory 6, and performs a series of processes after step S206.

  Here, the exposure change amount at the time of exposure correction is determined in advance for each color saturation ratio s / k, an exposure change amount table is created, and this exposure change amount table is stored in a memory (not shown). When performing exposure correction, the correction amount calculation unit 14 refers to the exposure change amount table according to the color saturation ratio s / k and determines the exposure change amount.

When s / k ≦ s _th (NO in step S222), the correction amount calculation unit 14 and the image correction unit 15 determine the brightness correction value V _cn and the saturation correction value determined for each closed region for all closed regions. Color correction is performed by applying C _cn (step S233). Then, the correction amount calculation unit 14 and the image correction unit 15 end the processing.

  FIG. 3 is a diagram illustrating an example of a composition template used in the imaging apparatus illustrated in FIG.

  FIG. 3 shows a composition template of Mt. Fuji and cherry blossoms. In FIG. 3, the illustrated composition template has three closed areas “0” to “2”. Here, the closed area “0” is empty, the closed area “1” is cherry blossom, and the closed area “2” is Mt. Fuji. Here, calculation of the correction amount for each of the closed regions “0” to “2” will be described.

Now, (H _T0 , V _T0 , C _T0 ) = (170, 128, 255), (H _T1 , V) as (hue H, lightness V, saturation C) in the closed areas “0” to “2”, respectively. _{It is} assumed that ( _{T 1} , C _T1 ) = (213, 179, 255) and (H _T2 , V _T2 , C _T2 ) = (255, 255, 255) are set. Furthermore, here, it is assumed that the hue difference threshold H _th = lightness threshold V _th = saturation threshold C _th = 30.

  When color correction is performed on the composition template shown in FIG. 3, the image indicated by the AF image data is first divided into closed regions “0” to “2” of the composition template. Then, for each of the closed regions obtained by the division, the average value of hue, lightness, and saturation is compared with the hue, lightness, and saturation in the composition template to calculate a correction value (correction amount).

Here, in the AF image data, the average values of the hue, lightness, and saturation of the closed region are (H ₀ , V ₀ , C ₀ ) = (149, 153, 255), (H ₁ , V ₁ , Assume that C ₁ ) = (234, 210, 255) and (H ₂ , V ₂ , C ₂ ) = (31, 153, 255). Therefore, for the closed region “0”, ΔH ₀ = | H ₀ −H _T0 | = | 149−170 | = 21 <H _th = 30, ΔV ₀ = | V ₀ −V _T0 | = | 128−153 | = 25 <V _th = 30, and ΔC ₀ = | C ₀ −C _T0 | = | 255−255 | = 0 <C _th = 30. As a result, as described with reference to FIGS. 2A and 2B, for the closed region “0”, the brightness correction value V _C0 = V ₀ −V _T0 = 128-153 = −25, and the saturation correction value C _C0 = C _0. -C _T0 = 2 and 55-255 = 0.

For the closed region “1”, ΔH ₁ = | H ₁ −H _T1 | = | 234−213 | = 21 <H _th = 30 and ΔC ₁ = | C ₁ −C _T1 | = | 255−255 | = 0 <C _th = 30. On the other hand, the brightness difference | V ₁ −V _T1 | = | 179−210 | = 31 ≧ V _th = 30. Therefore, for the closed region “1”, the lightness correction value V _C1 = 0 and the saturation correction value C _C0 = 255-255 = 0.

For the closed region “2”, ΔH ₂ = | H ₂ −H _T2 | = | 31−255 | = 224 ≧ H _th = 30, so it is determined that the subject is different in the closed region, and the brightness correction value and Both the saturation correction values are set to 0.

  As described above, in the above-described embodiment, when shooting is performed using the composition template including the color setting information, the color of the closed region is determined according to the color information and color setting information of the AF image data (that is, the through image). Since the correction amount is obtained, both the subject in the composition template and the color correction amount are visually easy for the user to understand and the color correction can be easily performed.

  Although the present invention has been described in detail based on the embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. It is. A part of the above-described embodiments may be appropriately combined.

  For example, in the above embodiment, the digital camera has been described as an example.

  In the above embodiment, the composition template is input from the operation unit. However, the composition template may be downloaded from the network and stored in the composition template storage unit 17. In this case, a user-desired composition template is selected from a plurality of composition templates prepared on the network and downloaded to the composition template storage unit 17.

  Furthermore, in the above embodiment, the color correction is performed when the release button is half-pressed. However, the same processing may be performed on the actual photographing data obtained after the release button is fully pressed.

  In addition, the function of the above embodiment may be used as a control method, and this control method may be executed by the imaging apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus.

  At this time, each of the control method and the control program has at least a correction amount calculation step and an image correction step. The control program is recorded on a computer-readable recording medium, for example.

  The present invention can also be realized by executing the following processing. That is, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

4 AFE (Analog Front End)
DESCRIPTION OF SYMBOLS 5 Image sensor 7 Display image generation part 9 Display part 12 Operation part 14 Correction amount calculation part 15 Image correction part 17 Composition template preservation | save part

Claims (6)

An imaging apparatus that performs imaging in accordance with the composition of the preset shot shown to configuration diagram information,
The composition information includes at least two closed regions, and Nde including a color setting information for setting the color for each of the closed area,
The image represented by the image data obtained through the imaging lens, to obtain color information for each region corresponding to the closed area of the composition information, the color setting information for each closed area of the composition information and the color information And a color correction amount calculation means for obtaining a color correction amount for each closed region of the composition information;
Have a, and an image correcting means for performing color correction in accordance with the color correction amount for each closed area of the composition information for said image data,
The color correction amount calculating means changes the exposure at the time of photographing when the ratio of the closed area where the difference between the color information and the color setting information exceeds a predetermined threshold with respect to all closed areas exceeds a predetermined ratio. An imaging apparatus characterized by: The imaging apparatus according to claim 1, further comprising a display control unit configured to superimpose a boundary of a closed region of the composition information on a through image obtained through the imaging lens and to display on the display unit. The imaging apparatus according to claim 1 or 2, characterized by using the brightness as each of the color information and the setting information. The color correction amount calculating means, the image pickup apparatus according to any one of claims 1 to 3, characterized in that for calculating the color correction amount by using the image data obtained after changing the exposure . A method of controlling an image pickup apparatus to perform photographing according to the composition of the preset shot shown to configuration diagram information,
The composition information includes at least two closed regions, and Nde including a color setting information for setting the color for each of the closed area,
The image represented by the image data obtained through the imaging lens, to obtain color information for each region corresponding to the closed area of the composition information, the color setting information for each closed area of the composition information and the color information A color correction amount calculation step for obtaining a color correction amount for each closed region of the composition information,
Have a, and an image correction step of performing color correction in accordance with the color correction amount for each closed area of the composition information for said image data,
In the color correction amount calculating step, when the ratio of the closed area where the difference between the color information and the color setting information exceeds a predetermined threshold with respect to all the closed areas exceeds a predetermined ratio, the exposure at the time of shooting is changed. A control method characterized by: A control program used a composition of a preset shot by the image pickup apparatus to perform photographing according to indicate to configuration diagram information,
The composition information includes at least two closed regions, and Nde including a color setting information for setting the color for each of the closed area,
In the computer provided in the imaging device,
The image represented by the image data obtained through the imaging lens, to obtain color information for each region corresponding to the closed area of the composition information, the color setting information for each closed area of the composition information and the color information A color correction amount calculation step for obtaining a color correction amount for each closed region of the composition information,
An image correction step of performing color correction in accordance with the color correction amount for each closed area of the composition information for the image data, to the execution,
In the color correction amount calculating step, when the ratio of the closed area where the difference between the color information and the color setting information exceeds a predetermined threshold with respect to all the closed areas exceeds a predetermined ratio, the exposure at the time of shooting is changed. A control program characterized by: