JP4301977B2 - Imaging method and imaging apparatus - Google Patents

Description

  The present invention relates to an imaging method and an imaging apparatus that detect a focal length from image data.

  2. Description of the Related Art Conventionally, in an imaging apparatus such as a video camera or an electronic still camera, a configuration is known in which a high-frequency component of captured image data is extracted to focus a lens. In this configuration, photographing is performed while moving the focus by driving the lens, and a high-frequency component of the image data is extracted at each position of the lens to calculate a contrast evaluation value (hereinafter referred to as contrast). Then, the position of the lens is moved in the direction in which the contrast increases, and the position where the contrast is maximized is set as the in-focus position of the lens.

  In this regard, a so-called bracketing photographing method is known in which a plurality of pieces of image data are continuously photographed by one photographing operation and a subject intended by the photographer is reliably photographed. For this bracket shooting, in addition to exposure bracket shooting that changes the exposure to the plus side and minus side around the exposure that is judged to be appropriate, a configuration that shoots with multiple white balances, and a focus bracket that shoots with multiple focal lengths Shooting is known.

  For example, in bracket shooting for white balance, a configuration is known in which a shooting screen is divided into a plurality of areas and an image is shot with a white balance setting set corresponding to each area (see, for example, Patent Document 1). .).

Also, with regard to focus bracket shooting, a configuration is known in which distances to a plurality of subjects existing in the shooting range are measured and shot at each focus position (see, for example, Patent Document 2). In this configuration, the measurement of a plurality of subjects is performed by detecting the peak position of the evaluation value of the high frequency component while moving the lens, or measuring the subject distance for each of the plurality of distance measuring areas.
Japanese Patent No. 3332396 (first page, FIG. 12) Japanese Patent Laid-Open No. 2001-116979 (second page, FIG. 4)

  As described above, focus bracket shooting improves the possibility of focusing on the intended subject. However, when the contrast of luminance information of the intended subject is low, it is detected as the peak of the evaluation value of the high-frequency component. Or it may not be detected as a subject in the distance measurement area and may not focus on the intended subject.

  SUMMARY An advantage of some aspects of the invention is that it provides an imaging method and an imaging apparatus that can capture an image focused on a subject intended by a photographer.

An imaging method according to one aspect of the present invention uses a plurality of pieces of color information image data, detects a focal length for each color information, and executes imaging at each focal length detected for each color information.

  In this configuration, by performing imaging at each of the focal lengths detected using a plurality of pieces of color information, the subject that is characteristic of specific color information is photographed in focus, and the subject intended by the photographer The possibility of capturing an image focused on is increased.

An imaging method according to another aspect of the present invention uses image data of a plurality of color information, detects a focal length for each of the plurality of color information, and uses a focal length detected for each of the plurality of color information. In the detection of the focal length for each of the plurality of color information, a plurality of images corresponding to a plurality of different focal lengths are obtained by changing the focal length of the optical system for the image data of the color information. A plurality of image detection areas adjacent to each other are set in the image data of the color information, and in each of the acquired image data, the maximum contrast value for each of the image detection areas An evaluation value based on the above and a peak position where the maximum value is recorded are obtained, and each image detection area is pre- The partial focal length is calculated depending on which focal length corresponds to the peak of the evaluation value, and the difference between the peak positions in at least two of the plurality of image data is obtained, The reliability of the image detection area is calculated such that the greater the difference obtained is, the lower the reliability is, and the partial focus calculated for the image detection area in which the product of the reliability and the evaluation value exceeds a predetermined value A focal length for the color information is selected according to a preset condition from the distance and a predetermined focal length.

In this configuration, the peak position at which the maximum contrast value is recorded is obtained for each image detection area of the image data, and the greater the difference between the peak positions in at least two of the plurality of image data, the lower the reliability. In order to calculate the reliability of the image detection area so that the degree of accuracy is high, the partial focal length of the low-reliability image detection area in which the subject has moved relatively is excluded from the selection target, and the accurate focal length for each color information Can be detected.

In the imaging method according to another aspect of the present invention, it is possible to perform imaging in any one of the nearest distance selection mode and the farthest distance selection mode, and the nearest distance selection mode and the farthest distance selection. When instructed to perform imaging in both modes, a focal length is detected for each of the plurality of color information for each of the shooting modes, and imaging is performed at each of the detected focal lengths, and the closest distance is detected. In the distance selection mode, in the detection of the focal length for each of the plurality of color information, the smallest of the partial focal lengths calculated for the image detection region in which the product of the reliability and the evaluation value exceeds a predetermined value A partial focal length or a predetermined first focal length is selected as the focal length for the color information, and in the farthest distance selection mode, the plurality of In detection of the focal length for each color information, the maximum partial focal length or the predetermined focal length among the partial focal lengths calculated for the image detection area in which the product of the reliability and the evaluation value exceeds a predetermined value Then, a second focal length that is larger than the first focal length may be selected as the focal length for the color information.

In this configuration, by performing imaging at a focal length detected using a plurality of pieces of color information in a plurality of shooting modes, the subject is photographed while focusing on a subject characteristic of specific color information. The possibility of capturing an image focused on the intended subject increases.

An image pickup apparatus according to an aspect of the present invention includes an image pickup element, an optical system that forms an object on the image pickup element, an optical system driving unit that changes a focal length of the optical system, and an image output from the image pickup element. Image processing means for processing the data and controlling the optical system driving means, the image processing means for detecting a focal length for each of a plurality of color information, and image data of the color information With respect to the optical system, a plurality of image data respectively corresponding to a plurality of different focal lengths are obtained by changing a focal length of the optical system, and a plurality of image detection regions adjacent to each other are set in the image data of the color information In each of the acquired plurality of image data, the evaluation value based on the maximum contrast value and the peak value recording the maximum value are recorded for each image detection region. A position is obtained, and for each of the image detection regions, a partial focal length is calculated based on which focal length corresponds to the peak of the evaluation value recorded in the plurality of image data, and the plurality of images The difference between the peak positions in at least two image data among the data is calculated, the reliability of the image detection area is calculated so that the higher the calculated difference is, the lower the reliability, the reliability and the evaluation value A process of selecting a focal length for the color information according to a preset condition from the partial focal length and the predetermined focal length calculated for the image detection region whose product exceeds a predetermined value, Imaging is performed at each focal length calculated for each of a plurality of color information.

In this configuration, the peak position at which the maximum contrast value is recorded is obtained for each image detection area of the image data, and the greater the difference between the peak positions in at least two of the plurality of image data, the lower the reliability. In order to calculate the reliability of the image detection area so that the degree of accuracy is high, the partial focal length of the low-reliability image detection area in which the subject has moved relatively is excluded from the selection target, and the accurate focal length for each color information Can be detected.

In the imaging device of one aspect of the present invention, it may as shall comprise a warning means for indicating that it is running imaging.

  In this configuration, when a plurality of images are sequentially captured, the photographer can warn the user not to move the imaging device from the subject.

  According to the present invention, by performing imaging at each focal length detected using a plurality of pieces of color information, the subject that is characteristic of specific color information is photographed in focus, and the subject intended by the photographer It is possible to increase the possibility of capturing an image focused on.

  Hereinafter, an embodiment of an imaging method and an imaging apparatus according to the present invention will be described with reference to the drawings.

  In FIG. 1, reference numeral 10 denotes an image pickup device. The image pickup device 10 is a digital camera for taking a still image or a moving image, including a focusing device, an optical system 11 including a lens and a diaphragm, and an image pickup element. CCD 12, analog circuit 13 to which the output of CCD 12 is sequentially input, A / D converter 14, image processing circuit 15 constituting information selection means and image processing means, memory 16 such as RAM as storage means, image processing CPU 17 constituting the control means constituting the means, CCD drive circuit 18 driven by the CPU 17 to drive the CCD 12, motor drive circuit 19 constituting the optical system drive means controlled by the CPU 17, and motor drive circuit 19 A motor 20 that constitutes an optical system driving means that is driven to drive a focus lens of the optical system 11, that is, a lens such as a focus lens, back and forth to change the focal length; An image display device 21 such as a liquid crystal display that constitutes a notification means, an image recording medium 22 such as a memory card, an auxiliary light device 23 that constitutes an information selection means, and a housing (not shown), a photographing button, a changeover switch, or a photographing mode selection The operation means which comprises a means, a power supply device, an input-output terminal, etc. are provided.

  The CCD 12 is a charge coupled device type solid-state imaging device which is an image sensor using a charge coupled device (CCD). The CPU 17 is a so-called microprocessor and controls the system. In this embodiment, the CPU 17 performs aperture control and focal length scaling control (focus control) of the optical system 11, and in particular, drives the optical system 11 by the motor 20 via the motor drive circuit 19, that is, The focus control is performed by changing the position of one or a plurality of focus lenses back and forth. Further, the CPU 17 controls the drive of the CCD 12 through the control of the CCD drive circuit 18, the control of the analog circuit 13, the control of the image processing circuit 15, the processing of the data recorded in the memory 16, and the control of the image display device 21. Then, recording and reading of image data on the image recording medium 22, and projection of auxiliary light by the auxiliary light device 23 are performed. Further, the memory 16 is composed of an inexpensive DRAM or the like, and includes a program area for the CPU 17, a work area for the CPU 17 and the image processing circuit 15, an input / output buffer for the image recording medium 22, a video buffer for the image display device 21, and other images. Shared as a temporary recording area for data.

  Then, the amount of light of the subject light incident on the CCD 12 is adjusted by the CPU 17 controlling the diaphragm of the optical system 11 and the like. The CCD 12 is driven by the CCD drive circuit 18 and outputs an analog video signal obtained as a result of photoelectric conversion of the subject light to the analog circuit 13. The CPU 17 also controls the electronic shutter of the CCD 12 through the CCD drive circuit 18. The analog circuit 13 includes a correlated double sampling and gain control amplifier, and performs noise removal of the analog video signal output from the CCD 12, amplification of the image signal, and the like. Further, for example, the amplification degree of the gain control amplifier of the analog circuit 13 is controlled by the CPU 17.

  The output of the analog circuit 13 is input to the A / D converter 14 and converted into a digital video signal by the A / D converter 14. The converted video signal is temporarily recorded in the memory 16 as it is and waits for the subsequent processing, or is input to the image processing circuit 15 and subjected to image processing, and then the image display device via the memory 16 21 or recorded as a moving image or a still image on the image recording medium 22 according to the user's intention. Further, the pre-processed image data temporarily recorded in the memory 16 is processed by the CPU 17, the image processing circuit 15, or both.

  Further, as shown in FIG. 2, the image processing circuit 15 of the present embodiment includes a matrix interpolation circuit 27, a switch 28, an area determination circuit 31, a filter circuit 32 as a contrast detection means, a peak determination circuit 33, a peak position determination. A circuit 34 and an arithmetic circuit 35 are provided.

  A subject image incident on the optical system 11 at a predetermined lens position, that is, in a state where the optical system 11 is set to an appropriate focal length, is converted into an analog image signal through the CCD 12, and the analog circuit 13 and the A / D converter. 14 is converted into digital image data. The digital image data output from the A / D converter 14 is stored in the memory 16, and at the same time, data processing for control such as focusing and exposure is performed by the image processing circuit 15. In other words, the image data converted into digital image data by the A / D converter 14 is input to the matrix complementing circuit 27, and subjected to color conversion or complementing processing in this matrix complementing circuit 27, and is subjected to focusing control or exposure control. As image data, YCC format luminance data (hereinafter referred to as luminance information) and RGB format signal data (hereinafter referred to as color information) are output. Note that the setting of this conversion process can be changed by the CPU 17 in accordance with the program. The luminance information and color information output from the matrix complementing circuit 27 are input to the switch 28 controlled by the CPU 17, and are selected and output as control image data according to the photographing conditions. That is, in addition to normal YCC format luminance data image data, R (red), G (green), and B (blue) signals of RGB format image data can be output as image data.

  The image data output from the switch 28 is input to the area determination circuit 31, and the area determination circuit 31 is used to determine the focused image range W that is an image area for focusing shown in FIG. The area determination process is performed. The focused image range W has two or more image detection areas Wh. Here, the image detection area Wh is composed of windows W1 to W9, that is, in each window W1 to W9, that is, the subject T. In the following description, it is assumed that there is means for calculating the distance from the optical system 11 to the subject T (hereinafter referred to as subject distance) in the range of the plurality of portions. In other words, in order to detect the magnitude of the contrast of each window W1 to W9 in the focused image range W, the high frequency component is analyzed by the filter circuit 32, and the evaluation value of the contrast is calculated for each window W1 to W9. The filter circuit 32 may be a high-pass filter (HPF) having a relatively high contrast.

  Furthermore, in the present embodiment, among the evaluation values calculated from the horizontal filter circuits 32, the highest evaluation value is obtained by the peak determination circuit 33 for each window W1 to W9. Output as evaluation values of W1 to W9. At the same time, the peak position determination for calculating the position on the image data (hereinafter referred to as the peak position) where the highest evaluation value is obtained by the peak determination circuit 33 from the position that is the starting point of the windows W1 to W9 being calculated. A circuit 34 is provided. The outputs of the peak determination circuit 33 and the peak position determination circuit 34 are respectively stored in the memory of the peak value of the contrast evaluation value for each horizontal line of each window W1 to W9 and the peak position where the peak value is recorded. 16 is temporarily stored and held.

  The peak value and the peak position calculated for each horizontal line of the CCD 12 are added in each window W1 to W9 by an arithmetic circuit 35 which is an adder as arithmetic means, and the addition is performed for each window W1 to W9. The peak value and the added peak position, which is the average position of the peak positions in the horizontal line direction, are output, and the added peak value and the added peak position are sent to the CPU 17 as the values of the windows W1 to W9. Note that the arithmetic circuit 35 for calculating the added peak value for each of the windows W1 to W9 can also be configured to calculate only the peak value within a specified range.

  Then, the optical system 11 is driven, the lens position is changed within the set range (drive range), the added peak value and the added peak position at each lens position are calculated and stored in the memory 16. The driving range, that is, the number of shots for focusing processing, can be set to an appropriate value depending on the lens magnification, the distance information to be shot, the shooting conditions designated by the photographer, and the like. Further, as shown below, the number of driving ranges is reduced when the subject distance is small, such as when the evaluation value is equal to or greater than the preset FVTHn in FIG. The focusing time can be shortened.

  Then, in this driving range, the peak value is compared for each window W1 to W9, and if there is a peak in the peak value with respect to the driving direction of the lens, it is set as the peak of each window W1 to W9.

  Then, it can be estimated that the subject T is focused in the vicinity of this peak. The focal length estimated from the peak value is set as the partial focal length of each of the windows W1 to W9.

  Here, since a plurality of windows W1 to W9 are set in the focused image range W, for example, there is a window in which the subject T is moving in the vicinity of the peak, while there is no blurring in the vicinity of the peak. There is also a window that captures the subject T.

  That is, the partial focal lengths of the windows W1 to W9 include those with high reliability (effective) and those with low reliability (invalid). Therefore, the CPU 17 determines the reliability for each of the windows W1 to W9 using the calculation result of the peak value and the peak position, that is, weights the focusing position specifying means.

  For example, when the average position of the peak position is rapidly moving near the partial focal length, or the average position of the peak positions of the windows W1 to W9 adjacent in the horizontal direction of the windows W1 to W9 is abrupt. If it is moving, it can be estimated that blurring or the like that the subject T moves has occurred, so the weights of the windows W1 to W9 are reduced. On the other hand, if the average position of the peak positions has not changed much, it is determined that the subject T has not moved, and the weighting is not reduced.

  Further, when the peak position of the subject T in the window moves to another window, the peak value and the peak position change greatly. Therefore, the window whose peak value and peak position have changed greatly in this way is reduced in weighting, that is, the reliability of the window is lowered, and as a result, the partial focal length of the window capturing the subject T is prioritized. .

  In order to evaluate the horizontal contrast peak in each of the windows W1 to W9, if there is a contrast peak of the subject T in the windows W1 to W9, the evaluation value is obtained even if the subject T moves. There is no change.

  Also, if the peak position of the peak value varies each time the lens position is moved, it is often the case that there is no contrast in the window, such as noise, so it is determined that there is no subject T, and the weighting amount is reduced.

  This weighting amount can be set in advance, or can be calculated from an evaluation value of image data based on photographing conditions such as luminance information and focus magnification.

  Then, the CPU 17 multiplies the evaluation value by a weight for each of the windows W1 to W9 to obtain a weighted evaluation value.

  Here, the CPU 17 as the determination means invalidates the evaluation value when the weighted evaluation value is equal to or less than a predetermined value and does not use it thereafter.

  Then, the CPU 17 as the selection unit adds the weighted evaluation value for each lens driving position, and calculates the final in-focus position where the contrast is maximized. That is, when the calculation result of the evaluation value is sent to the CPU 17, the CPU 17 adds the evaluation values (additional peak value and addition peak position) obtained in the windows W1 to W9, and the subject position at the current lens position. Is used as one evaluation value. In this calculation, if the peak position is a value divided by the number of vertical lines in each of the windows W1 to W9, the center of gravity of the peak position can be found. For the case where the amount of change is large or the case where the center of gravity moves from the horizontal window to the corner of the window, addition is performed after reducing the weight of the window evaluation value to obtain the final evaluation value.

  Then, the minimum partial subject distance is selected from the evaluation values that are validated, and this partial subject distance is selected as the in-focus distance. That is, the CPU 17 instructs the movement of the lens of the optical system 11 to the position where the final evaluation value is the highest by the motor drive circuit 19 and the motor 20 based on the size of the final evaluation value. If there is no change in the final evaluation value, stop of the motor 20 is instructed via the motor drive circuit 19.

  In other words, since the weighting is performed, it is possible to avoid selecting an erroneous peak due to blurring of the subject T, so that the subject T can be selected without mistakes for blurring even when calculating a plurality of focal lengths having a plurality of regions. For this reason, it is possible to accurately select an in-focus position and take a picture by a method that gives priority to a short distance that is generally effective.

  It should be noted that the focus position of the lens constituting the optical system 11, that is, the position of the lens focused on a predetermined distance is a variation due to focal magnification or a change due to the aperture position relative to the designed shooting distance range, and the lens. It changes depending on conditions such as temperature conditions and attitude differences of the lens barrel that supports the lens. Therefore, in addition to the driving range calculated at the designed focus position, the optical system 11 can also move by the amount of change between the short distance side and the far distance side in consideration of the change amount due to fluctuations in these conditions. A range, that is, an overstroke area is provided, and the control means including the CPU 17 and the like is set so that the lens position can be driven so that the lens can be driven in the overstroke area.

  For example, assuming that the total moving amount of the focus position of the lens when the designed shooting distance range is from 50 cm to infinity is 10 mm, and the integrated maximum value of the above change amount is 1 mm, each short distance An overstroke area of 1 mm on the side and 1 mm on the far side is provided, and the total amount of movement of the focal position of the lens, that is, the driving range is set to 10 mm from 10 + 1 + 1. Since the overstroke area is provided in this way and the lens position can be driven in this overstroke area, the photographing distance range defined in the design can be satisfied.

  In addition, the auxiliary light device 23 is provided with a plurality of light sources that emit light according to the luminance of the subject in the present embodiment in the shooting environment, that is, when the subject is dark. Some auxiliary lights L1 and L2 are provided. The auxiliary lights L1 and L2 are connected to light source circuits 43 and 44, respectively, and the light source circuits 43 and 44 are connected to the CPU 17 via first and second switches 45 and 46, respectively. The auxiliary lights L1 and L2 are controlled by the light source circuits 43 and 44 to emit light, and the CPU 17 controls whether or not the auxiliary lights L1 and L2 need to be emitted and controls the lighting timing. Further, the first switch 45 switches which of the two auxiliary lights L1 and L2 is controlled by the control of the CPU 17. The second switch 46 switches whether to control both the two auxiliary lights L1 and L2 at the same time under the control of the CPU 17.

  The auxiliary lights L1, L2 are not limited to two, and a plurality of (N) auxiliary lights L1, L2,. The plurality of auxiliary lights L1, L2,... LN may emit light of the same color in addition to light of different colors. In addition, the auxiliary lights L1, L2,... LN are controlled independently and controlled in combination with a plurality of auxiliary lights L1, L2,... LN, and at the same time, a plurality of auxiliary lights L1, L2,. ... By emitting LN, it is possible to emit light having a different color from that when light is emitted alone.

  Next, the automatic focusing operation and the photographing operation of the photographing operation according to this embodiment will be described with reference to FIGS.

  In the present embodiment, in order to determine the lens position for each bracket shooting, that is, in order to focus accurately, the photographer uses color information and auxiliary light in addition to using normal luminance information. In addition, by dividing the image data into a plurality of windows, it is possible to focus accurately even if the subject is blurred.

  First, with reference to FIG. 3, an operation when there is no subject blur due to camera shake or the like will be described for a configuration in which image data is divided into a plurality of windows.

  In the present embodiment, as shown in FIG. 3A, the focused image range W is arranged at the center of the screen of the CCD 12, and three focused image ranges W in the horizontal direction and in the vertical direction. The windows W1 to W9 are divided into a total of nine and the windows W1 to W9 are set. Note that the number of such windows can be set to an appropriate number as long as a plurality of adjacent area portions exist. The subject T when there is no subject blur is set so as to obtain a sufficient contrast in each of the windows W1 to W9.

  The result of evaluating the contrast in the state shown in FIG. 3A is shown by a curve Tc in FIG. This example shows a final evaluation value obtained by adding evaluation values when a plurality of image data obtained by photographing the subject T by the optical system 11 driven from the near (NEAR) to far (FAR) by the motor 20 is evaluated. The subject distance Td is clearly shown in the evaluation value peak P.

  Next, with reference to FIG. 4 to FIG. 6, an operation in the case where there is blurring of the subject due to camera shake or the like will be described.

  First, with reference to FIG. 4, blurring such as subject movement or camera shake in a method having a plurality of regions will be described.

  FIG. 4 shows a case where the imaging apparatus 10 has moved relative to the subject T during the focusing operation, that is, the camera S, that is, unexpectedly moving during the shooting, and the scene S (H -1) to the scene S (H + 1) through the scene S (H), a focused image in a state where image data is input while moving the lens position of the optical system 11 is shown. That is, when a subject movement or camera shake phenomenon occurs, for example, a high contrast portion of the subject T present in the window W1 in the scene S (H-1) is relatively moved to the window W5 in the scene S (H) due to the movement. In the scene S (H + 1), it moves relative to the window W9. Therefore, if the evaluation value of the contrast is evaluated only in a specific window such as the window W1 in this state, the correct evaluation is not performed.

  FIG. 5 also shows a case where camera shake occurs during the focusing operation. In FIG. 5A, a focused image range W similar to that in FIG. 3A is set, but the subject T moves relatively from the position indicated by the broken line T4 to the position indicated by the solid line T5. This shows a state in which blurring has occurred and the portion of the subject T where the contrast is high has moved relatively, for example, from the window W4 to the window W5. When the focusing operation for driving the lens of the optical system 11 is performed during the movement of the subject T from T4 to T5, as shown in FIG. 5B, the result of evaluating the contrast of the window W4. The evaluation value is indicated by the curve Tc4, and the evaluation result of the window W5 is indicated by the curve Tc5. For example, when attention is paid to the curve Tc4 which is the evaluation value of the window W4, a position Td4 different from the subject distance Td is obtained. It becomes the peak P4 of the evaluation value, which may cause a malfunction such as being indistinguishable when there are a plurality of subjects for each distance.

  FIG. 6 shows the peak positions relatively moving in the windows W1 to W9. When the subject T moves relatively in the horizontal direction, the range of the peak position is determined by the number of pixels in the horizontal direction of each of the windows W1 to W9, and the peak position X1 is the peak position in the window W4 in FIG. The reference point is A, and the peak position X2 shows the case where the reference point of the peak position is B in the window W5 of FIG. When the focal length of the optical system 11, that is, the lens position is N, the near (NEAR) direction is N-1 and the far (FAR) direction is N + 1. Here, when the lens position of the optical system 11 has moved from N-1 to N + 1 in the far direction, the peak position has moved from the window W4 to the window W5. In this state, since the peak position clearly changes, it is possible to easily detect the subject blur even while the focusing operation is being performed.

  However, even when such subject blurring occurs, for example, a window having a correct evaluation value exists as long as a portion having a large contrast does not move across a plurality of windows, such as the window W9. Therefore, the peak position of the correct evaluation value can be calculated by detecting the peak position changing portion extending over the plurality of windows and simultaneously reducing the evaluation value for the window having the change by weighting.

  First, for ease of explanation, a focusing control method for performing the above-described weighting process will be described with reference to the flowcharts of FIGS. FIG. 7 shows the entire focusing process, and FIGS. 8 to 10 show a part of the focusing process in FIG. 7 in detail. Further, FIG. 7 will be described with an operation of calculating one focal length without performing bracket photographing.

  As shown in FIG. 7, a plurality of pieces of image data are used in the focusing process. First, one screen is shot for focusing processing at the initial position or the current lens position, and image data of the focused image range W is obtained. Is obtained (step 101). Next, for the captured image data, a contrast evaluation value is calculated for each of the windows W1 to W9 in the focused image range W (step 102). In this calculation, the peak values of all lines are added for each of the windows W1 to W9. Next, the relative positions from the reference positions of the peak values of all the lines for each window W1 to W9 are obtained and added for each window W1 to W9 to calculate the average position of the subject T (step 103). Then, the number of shots N is calculated (step 104), and shooting is performed while moving the lens of the optical system 11 (step 106), that is, the movement and focusing of the lens, until N times are completed (step 105). Processing photographing is repeated N times (steps 101 to 106), and evaluation values of continuous image data are acquired.

  If the lens position driven in step 106 is relatively close to the distance of the subject T, the average position calculated in step 103 from the image data captured for focusing processing in step 101 is the main subject T. The contrast feature is fully reflected. Accordingly, the average position of the peak position changes particularly when the subject moves due to camera shake or the like in a window where the lens position is close to the distance of the subject T.

  Here, the calculation part (step 104) of the number N of photographed image data during the focusing operation will be described with reference to the flowchart of FIG.

  This setting of the number of shots N is necessary by changing the number of shots N according to the magnification of the lens of the optical system 11, distance information of the subject T to be shot, or shooting conditions specified by the photographer. Sufficient image data is acquired.

  First, the evaluation value FV of each window W1 to W9 calculated in step 102 of FIG. 7 is compared with a predetermined reference value FVTHn (step 201). If the evaluation value FV is larger than the reference value FVTHn, N0 is set to N0. Input (step 202). It should be noted that the step 201 can be omitted, or N0 can be input to N as a variable corresponding to the focus magnification. In addition, the evaluation value FV is equal to or less than the reference value FVTHn (step 201), and short-distance shooting is performed by the setting of the photographer who is the operator of the imaging device 10 (step 203), or the focus magnification is relatively large, for example If it is twice or more (step 204), N2 is input to N (step 205). On the other hand, when the above condition is not satisfied, that is, when the evaluation value FV is equal to or less than the reference value FVTHn (step 201), close-up shooting is not performed (step 203), and the focus magnification is relatively small, for example, less than 2 times (Step 204), N1 is input to N (step 206). Here, the values N0, N1, and N2 have a relationship of N0 <N1 <N2, and when the short-distance shooting or the focus magnification is large, the number of shots N is increased and the lens drive of the optical system 11 is set. When the subject T is close to the optical system 11 such as when the evaluation value FV is greater than or equal to the predetermined reference value FVTHn, and the detailed evaluation is possible, the number of shots N is reduced. Thus, the focusing time can be shortened. That is, by providing means for selectively setting the lens driving range based on the evaluation value, the focusing time can be shortened without reducing the focusing accuracy.

  Then, as shown in FIG. 7, camera shake or the like is determined with respect to the average position of the peak positions obtained by performing N times of imaging, and a weighting amount that is a reliability for each window Wh (W1 to W9) is calculated. (Step 111). Hereinafter, the calculation of the weighting amount by the determination unit will be described in detail with reference to the flowchart of FIG.

  In this process, first, an initial value Kp = PTH (base) of the peak value average position movement amount PTH is set in advance (step 301), and step 102 is performed for each window Wh of the focused image range W in which each scene is photographed. One or a plurality of scenes S (H) Wh showing the highest evaluation value is obtained from the evaluation values calculated in (Step 302).

  Further, the peak value average position movement amount PTH is used as a final determination value for selecting the weighting amount of each window Wh, and is a variable that changes in accordance with photographing conditions such as luminance and focal length. .

  That is, when the luminance of the shooting scene is relatively high (step 303), the shutter speed is relatively high, and therefore the amount of movement within one window Wh tends to be small. Therefore, the ratio of the peak value average position movement amount PTH is made smaller than a preset initial value Kp = PTH (base), that is, the ratio K (L) by which the peak value average position movement amount PTH is multiplied is, for example, 80%. (Step 304). On the other hand, when the brightness of the photographic scene is other than that, for example, it is relatively low (step 303), the ratio K (L) is set to 100%, for example (step 305). Subsequently, when the focus magnification is relatively high (step 306), since the possibility of camera shake is higher than when the focus magnification is low, the ratio of the peak value average position movement amount PTH is set to an initial value set in advance. The ratio K (f) to be multiplied by the peak value average position movement amount PTH is set to 80%, for example, 80% (step 307). On the other hand, when the focus magnification is other than that, for example, when it is relatively low (step 306), the ratio K (f) is set to 100%, for example (step 308).

  Then, the peak value average position as the optimum judgment value for the shooting scene is obtained by multiplying the preset initial value PTH (base) by the ratios K (L) and K (f) to the obtained luminance and focus magnification. A movement amount PTH is calculated (step 309). That is, PTH = Kp × K (L) × K (f) is calculated. Here, the peak value average position movement amount PTH is calculated according to the luminance and the focus magnification. However, if the optimum determination value can be obtained in advance, the initial value PTH (base) of the peak value average position movement amount PTH is calculated. The peak value average position movement amount PTH can be used as it is.

  Next, as an operation for calculating the reliability of each window Wh, first, a weighting coefficient as a weighting amount is initialized (step 310). This weighting coefficient is shown as a ratio with respect to 100%, and is initialized to 100%, for example. At the same time, a variable m is provided so that the weighting coefficient can be set as a variable according to the obtained peak value average position movement amount PTH. For example, when the weighting coefficient is provided in four stages, m is given a value of 4, 3, 2, 1 with an initial value of 4.

  When weighting is determined, the ratio of the obtained peak value average position movement amount PTH is set to be variable with the peak value average position movement amount PTH (m) using the variable m (step 311). . Specifically, the peak value average position movement amount PTH (m) is obtained by dividing the obtained peak value average position movement amount PTH by the variable m.

  The difference between the peak value average position ΔPS (H) Wh represented by the scene S (H) Wh and the peak value average position ΔPS (H-1) Wh represented by the previous scene S (H-1) Wh. Is larger than the peak value average position movement amount PTH (m), the CPU 17, which is the determination means, moves the subject T between the windows W1 to W9 due to camera shake or the like, or affects the evaluation value calculation. It is determined that there is (step 312). Similarly, the peak value average position ΔPS (H) Wh represented by the scene S (H) Wh and the peak value average position ΔPS (H + 1) Wh represented by the subsequent scene S (H + 1) Wh. If the absolute value of the difference between the two is larger than the peak value average position movement amount PTH (m), the determination means moves the subject T between the windows W1 to W9 due to camera shake or the like, or affects the evaluation value calculation. It is determined that there is (step 313). On the other hand, if the absolute values of these differences are both equal to or less than the peak value average position movement amount PTH (m), the weighting coefficient of the window Wh is assumed that there is no camera shake or the evaluation value calculation is not affected. Do not lower. The larger the variable m is, the smaller the peak value average position movement amount PTH (m) to be compared is, but the judgment of the peak value average position movement amount becomes severe, and the weighting coefficient is the peak value average position movement amount PTH ( It is determined according to m) (step 315). In step 312 or step 313, if the absolute value of any of the differences is larger than the set peak value average position movement amount PTH (m), it is assumed that there is a camera shake, and the weighting of the window Wh is lowered, and the weighting coefficient Is reduced to, for example, a maximum of 25% (step 315). Then, this comparison operation is performed by subtracting the variable m one by one from the initial value, eg, 4 (step 316), and repeated until the variable becomes 0 (steps 311 to 317), and the weighting amount is determined according to each variable (step 311). Steps 314 and 315). The weighting coefficient is, for example, a minimum of 25%, but is not limited to this configuration, and may be, for example, a minimum of 0%. Further, the peak value average position movement amount PTH (m) is set as a ratio to the peak value average position movement amount PTH obtained in the previous step. However, if possible, a plurality of preset optimum determination values may be used. it can.

  In this way, it is possible to set a plurality of levels of reliability more finely by determining whether or not there is a camera shake by providing a plurality of determination criteria.

  Further, this operation is repeated until the calculation is completed for all windows W1 to W9 (steps 301 to 318). By this weighting, the reliability of each of the windows W1 to W9 can be quantified as a weighting coefficient.

  Then, by performing the above-described processing on the window adjacent to the window S (H) Wh, it is possible to know whether or not there has been an influence of the movement of the peak subject such as camera shake. That is, as shown in FIG. 7, after calculating the weighting coefficient (reliability) of each window Wh, first, Eval FLG is set to 0 (step 112). Thereafter, when the number of windows Wh having a weighting coefficient, that is, reliability of 100% is equal to or greater than a predetermined value, for example, 50% or greater (step 113), or the reliability of adjacent windows Wh is equal to or greater than a predetermined value. For example, if both windows Wh exist (step 114), it is determined that there is no movement of the subject T in the scene, and evaluation weighting described below is not performed, and is the evaluation value larger than a predetermined determination value? Is compared (step 117) to determine whether it is valid or invalid.

  On the other hand, when neither of the conditions of step 113 and step 114 is satisfied, as shown below, a calculation process is performed in consideration of the weighting coefficient. That is, after calculating the weighting coefficient of each window W1 to W9, the obtained weighting coefficient is multiplied to each evaluation value for each window W1 to W9, and the weight of the evaluation value is reflected in each evaluation value itself (step 115). ). At this time, Eval FLG is set to 1 in order to indicate that the arithmetic processing with weighting is performed (step 116).

  Next, each weighted evaluation value is compared with whether it is larger than a predetermined determination value VTH (step 117), and all operations for determining whether the evaluation target is valid (step 118) or invalid (step 119) are all performed. For windows W1 to W9 (steps 117 to 120).

  When a plurality of windows are enabled, the CPU 17 performs a focus distance calculation from the in-focus position of the window that is enabled, that is, the partial focus position (step 121), and obtains the focus distance. .

  Details of the focus distance calculation in step 121 are shown in FIG. Here, first, it is determined from the Eval FLG state whether or not weighting is added in the calculation of the evaluation value (step 401). If weighting is performed, the evaluation values are added for each distance (step 401). 402) If there is no weighting, no addition is performed. Then, a peak focus position (peak position) is obtained from these evaluation values (step 403). When these peak focus positions are all outside the set photographing range (step 404), or when the reliability of all the peak focus positions is not more than a predetermined value, for example, 25% or less (step 405). Determines that the subject distance cannot be calculated, and forcibly sets a predetermined distance as a focus position (focus focus position) (step 406). At this time, it is determined that the focus distance determination is NG (step 407).

  In other cases, that is, there is at least one peak focus position (peak position) within the set shooting range (step 404), and the peak focus position is within the set shooting range. Is greater than a predetermined value, for example, greater than 25% (step 405), it is determined that the subject distance can be calculated, and the peak position is the closest among the valid windows W1 to W9. A partial focus position is selected, and this position is set as the focus position (step 408). At this time, it is determined that the in-focus distance determination is OK (step 409).

  In this in-focus distance calculation, when weighting is performed, the respective evaluation values are added and calculated in step 402. Therefore, the evaluation value is one, and the peak position is the center of gravity including a plurality of evaluation values. However, the present invention is not limited to this configuration, and it is possible to select only a window whose peak position is a short distance, add each window, calculate the partial focal position, and set this position as the in-focus position. In the case where weighting is not performed, it is also possible to select the closest partial focal position from the windows W1 to W9 in which the evaluation values are valid and set it as the in-focus position.

  Then, depending on the result of the focus distance determination (steps 407 and 409) obtained from the focus distance calculation (step 121), whether the focus distance determination is OK or NG as shown in FIG. A determination is made (step 122). In the case of OK, the lens of the optical system 11 is moved to the calculated in-focus position (step 123). In the case of NG, the optical system 11 is moved to a predetermined in-focus position. By moving the lens (step 124), the lens can be arranged at the final in-focus position.

  Thus, according to this configuration, an automatic focusing device using image data used for an imaging device such as a digital camera or a video camera, the screen is divided into a plurality of regions, and the focusing position is set in each region. In the autofocus operation of the determination method, even in scenes where distance measurement is disturbed, such as subject movement or camera shake, the blur is detected, the distance is appropriately measured using only the optimum data, and the optical system 11 is focused. it can.

  In other words, when the peak of the evaluation value is calculated in each of the plurality of regions, the evaluation taking into account the reliability compared to the configuration in which the partial focal length that is the in-focus position showing the highest evaluation value is simply the in-focus position. By using the weighting method, the partial focal length obtained from a window with low reliability due to camera shake, etc. is excluded, and even if the evaluation value is not the highest, judgment is made using only the reliable evaluation value, and In particular, by using the closest partial focal length, it is possible to improve the probability of accurate focusing, accurately determine the in-focus position, and perform in-focus shooting. In particular, the optical system 11 can effectively function in a so-called high magnification model with a large zoom magnification.

  In addition, even if the evaluation value before weighting is low, such as an evaluation value due to the influence of noise or an evaluation value when there is no valid subject in the window, the focal length can be accurately determined by invalidating the window. Can be detected.

  In other words, in the calculation of a plurality of focal lengths having a plurality of regions, when priority is given to a generally effective short distance, in the conventional method, an erroneous peak due to subject movement, camera shake, or the like is closer to the subject. In some cases, the subject cannot be determined as the in-focus position, and an incorrect peak is determined as the in-focus position, and the in-focus position cannot be set correctly. Even if it is at a distance, it is possible to detect subject movement and camera shake, and to correctly set an in-focus position that is appropriate and prioritizes short distance using only optimum data.

  Further, in the conventional method of correcting the image blur or camera shake of the subject by changing the image detection area and performing the focus evaluation again after changing the image detection area, it takes time to calculate the in-focus position. However, in this configuration, the in-focus position is calculated only from the information given from the preset image detection area, so that quick processing is possible and the photo opportunity is captured. Can do.

  Further, it is not necessary to provide a special device such as an acceleration sensor for detecting image blur or camera shake of a subject, and the configuration can be simplified and the manufacturing cost can be reduced.

  In addition, since the reliability of the calculated plurality of subject distances becomes high, other algorithms can be assembled.

  In addition, since the evaluation value is acquired within the preset image detection area and the focal position is calculated, it is possible to suppress the photographer's uncomfortable feeling caused by focusing on an unintended subject.

  In addition, since the peak position of the evaluation value of the image does not fluctuate without being affected by the luminance change of the flickered image due to a fluorescent lamp or the like, the reliability for each of the plurality of regions can be evaluated regardless of the size of the evaluation value.

  In the above-described embodiment, a so-called hill-climbing distance measuring method is used in which evaluation values at a plurality of positions are acquired while the operation of the optical system 11 is performed, and a peak is determined when the evaluation value changes from increasing to decreasing. Although employed, in the case of subject blurring, the peak position moves in each window and eventually moves to the adjacent windows W1 to W9. When the peak portion of the contrast of the subject T moves from one window to another window, the peak value of the evaluation value also decreases rapidly. In this way, for windows in which the evaluation value has changed abruptly for scenes shot before and after, by reducing the weight, data with camera shake is eliminated, and only the optimum data is used for proper distance measurement. Can burn.

  In this configuration, the peak position of the evaluation value is added, and the peak position of the relatively blurred image varies. Therefore, the weighting of a large variation can be reduced, and when the peak value is originally low, the weighting of the evaluation value can be decreased.

  In this way, each time the lens position of the optical system 11 is moved, the difference between the peak values of the evaluation values of the same window is measured, or the difference in the movement amount of the average position of the peak positions of the windows adjacent to each other is measured. Alternatively, by measuring both of these, the reliability of the evaluation value of the window can be determined and the reliability can be increased. Therefore, when determining the final in-focus position, the reliability of distance measurement can be improved even when a short distance is selected from the focal positions for a plurality of regions, even in the case of camera shake or when the subject moves.

  In this way, it is possible to improve the focusing reliability even when there is a subject blur or the like.

  In this configuration, the configuration corresponding to the movement of the subject T in the horizontal direction has been described. However, in addition to this configuration or in addition to this configuration, the configuration can be similarly applied to the vertical direction or the oblique direction.

  Further, the image processing circuit 15 shown in FIGS. 1 and 2 is configured by the same chip as other circuits such as the CPU 17 or realized on the software of the CPU 17 to simplify the circuit and reduce the manufacturing cost. You can also. Further, the filter circuit 32 of the image processing circuit 15 can be realized in any configuration as long as the contrast can be detected.

  Further, the distance measuring method is not limited to the so-called hill-climbing method, and it is also possible to scan the entire operable range of the automatic focusing device.

  Also, the evaluation value for each window is added to a plurality of windows adjacent to each other after the weighting process shown in FIG. 9, or the weighting process is performed after adding the evaluation values of a plurality of selected windows. You can also.

  In the processing shown in FIGS. 7 and 9, one peak value average position movement amount PTH value and one determination value VTH are set in advance, but can be selected from a plurality of set values. By making it variable according to shooting conditions such as information on the optical system 11 such as brightness information, shutter speed, focus magnification, etc., it is possible to select an optimum value, or by calculating these conditions as variables and obtaining the optimum value, Evaluation according to the scene can be performed.

  Furthermore, when shooting with a strobe, the in-focus distance is detected using the above-mentioned focal length detection method by emitting the strobe in synchronization with in-focus processing shooting and obtaining image data for each scene. it can. In the configuration using the strobe, photographing can be performed based on the light emission control of the strobe according to the in-focus distance and the light amount control such as the aperture and shutter speed of the camera.

  Further, in this configuration, the closest partial focal length is used among the evaluation values that are validated, that is, the partial focusing position with the closest peak position is selected, and this position is set as the focusing position ( The step 408) is not limited to this configuration, and the control means is selected directly by the photographer's operation or according to the photographer's operation according to the user's or photographer's intention, that is, the operation for selecting the photographing mode. Thus, it is possible to automatically select a partial in-focus position other than the closest to the in-focus position. In the above embodiment, when the in-focus distance determination is NG (step 122), the lens of the optical system 11 is moved to a predetermined in-focus position (step 124). A predetermined focus position is set, and the lens of the optical system 11 can be moved to any predetermined focus position according to the photographer's intention, that is, an operation for selecting a shooting mode.

  Thus, in this focal length detection method, a plurality of image detection areas adjacent to each other are set, a plurality of pieces of image data are obtained while changing the focal length of the optical system, and each of the obtained pieces of image data is For each image detection area, the partial focal length is calculated based on which image data is recorded with the peak value of the contrast evaluation value, and the position where the peak value is recorded is moved between the plurality of image data. A corresponding reliability is calculated, and a focal length is selected from the partial focal length and a predetermined focal length according to the reliability and the evaluation value. In this configuration, since the reliability corresponding to the movement between the image data at the position where the peak value of the contrast evaluation value is recorded is calculated, the partial focal length of the image detection region with low reliability where the subject has moved relatively Is removed from the selection target, and the focal length can be detected accurately.

  In this focal length detection method, the evaluation value is weighted according to the calculated reliability, and the focal length is selected from the partial focal lengths of the image detection area according to the weighted evaluation value. It is. In this configuration, by using the evaluation value weighted according to the calculated reliability, the partial focal length of the image detection area with low reliability is excluded from the selection target, and the accurate focal length can be detected. become.

  In this focal length detection method, the reliability is lowered when the position where the peak value is recorded moves from at least one image detection area where the peak value is recorded to another at least one image detection area. Is. In this configuration, the partial focal length of the image detection region with low reliability in which the subject has moved relatively is excluded from the selection target, and the accurate focal length can be detected.

  Further, in this focal length detection method, when the position where the peak value is recorded moves beyond a predetermined distance between a plurality of image data where the peak value is recorded, the reliability is lowered. In this configuration, the partial focal length of the image detection region with low reliability in which the subject has moved relatively is excluded from the selection target, and the accurate focal length can be detected.

  Further, in this focal length detection method, when image data having a large peak value is acquired, the number of image data to be acquired is reduced. In this configuration, the focusing time can be shortened by acquiring only necessary and sufficient image data.

  Further, in this focal length detection method, when calculating the reliability, the peak position movement determination value for determining whether or not the position where the peak value is recorded has moved is a variable obtained according to the shooting conditions. It is. In this configuration, by setting the peak position movement determination value according to the imaging condition, a more appropriate reliability according to the imaging condition is calculated, and an appropriate focal length can be detected.

  Further, in this focal length detection method, when calculating the reliability, a plurality of peak position movement determination values for determining whether or not the position where the peak value is recorded have moved are set and sequentially compared with the image data. Is. In this configuration, by setting a plurality of peak position movement determination values and sequentially comparing them with the image data, it is possible to set the reliability stepwise and to detect an appropriate focal length.

  Further, in this focusing device, an image sensor, an optical system that forms an image of a subject on the image sensor, an optical system drive unit that changes a focal length of the optical system, and image data output from the image sensor Image processing means for processing and controlling the optical system driving means, the image processing means controlling the optical system driving means to acquire a plurality of image data while changing the focal length of the optical system. A plurality of adjacent image detection areas are set in the acquired plurality of image data, and for each image detection area, a partial focal length depends on which image data is recorded with the peak value of the contrast evaluation value. And calculating the reliability according to the movement between the plurality of image data at the position where the peak value is recorded, and calculating the reliability and the evaluation value. Flip and is for selecting the focal length from among the partial focal lengths and a predetermined focal length. In this configuration, since the reliability corresponding to the movement between the image data at the position where the peak value of the contrast evaluation value is recorded is calculated, the partial focal length of the image detection region with low reliability where the subject has moved relatively Can be removed from the selection target, and an accurate focal length can be selected and focused.

  Next, with reference to FIG. 11 to FIG. 16, as a premise of the present embodiment, an operation for calculating a lens position, that is, a focal length of each bracket shooting will be described.

  In this embodiment, on the premise of the configuration shown in FIG. 7 to FIG. 10, the photographer decides the lens position, that is, decides the focal length of photographing corresponding to each color information of bracket photographing. As image data to be used, in addition to luminance information, that is, normal YCC format luminance data, color information, that is, R (red) signal, G (green) signal, and B (blue) signal of RGB format image data are automatically or manually. It can be selected. Furthermore, the photographer can select and set the long-distance priority mode in addition to the normal mode, that is, the short-distance priority mode, which is the normal photographing mode, and can further set the photographing distance range by a mode that can be referred to as a distant view mode or an infinite mode. Can be specified. The description of the same parts as those of the embodiment shown in FIGS. 1 to 10 will be omitted. Further, FIG. 11 will be described with an operation of calculating one focal length without performing bracket photographing.

  That is, in this configuration, an operation unit that determines whether luminance information or color information is automatically or manually selected as image data used by the photographer for determining the focal length, and a manual case Operating means for setting what color of light to be used, and operating means that is a photographing mode selecting means for allowing the photographer to select a long distance priority mode or a distant view mode. Therefore, in contrast to the flowchart of the operation of the focusing device shown in FIG. 7, as shown in FIG. 11, the shooting mode setting process (step 11) and the image signal determination process are performed before focusing processing shooting (step 101). (Step 12) is performed, and the reliability calculation process (Step 111) of each window is performed to determine the weighting amount of the evaluation value used for the focal length calculation for the image data selected in the image signal determination process. ) And the in-focus distance calculation (step 121).

  That is, for the shooting mode setting process, when specifying a shooting distance range, in the focusing process, first, as a focusing condition, the shooting distance range associated with the lens driving range is set in accordance with the shooting mode of the imaging device 10. Need to figure out. If the imaging mode of the imaging device 10 is, for example, from 50 cm to an infinite position in the normal mode, the lens driving range is set accordingly. In addition, if the imaging device 10 can set a distant view mode (infinite mode), a macro mode, etc. in addition to the normal mode, an operation unit that allows the photographer to select these modes, i.e., the photographer selects the shooting distance range, i.e. Operation means capable of designating a lens driving range is provided.

  Further, in the focusing process, as a focusing condition, the final focal length determination method is a short distance priority or a long distance priority, or the photographer operates the operating means provided in the imaging device 10, Select the shooting mode. Then, if the shooting mode of the imaging device 10 is the long distance priority mode, the longest distance selection mode for driving the lens is set so that the farthest distance in the shot image becomes the in-focus distance. In the short distance priority mode, the closest distance selection mode in which the shortest distance is the in-focus distance among the captured images is set, and generally used near distance priority shooting is possible.

  That is, in the shooting mode setting process (step 11) shown in FIG. 11, first, as shown in FIG. 12, it is determined whether the photographer specifies the shooting distance range (step 1201). If the mode for selecting the shooting distance range is selected, it is further determined whether or not the distant view mode is selected (step 1202). Furthermore, when the distant view mode is selected, the farthest distance selection mode is set (step 1203), and when the distant view mode is not selected, that is, in the normal mode or the macro mode, the closest distance selection mode is selected. (Step 1204). That is, here, depending on the shooting distance range, the shooting mode for prioritizing the short distance or prioritizing the long distance is automatically determined.

  On the other hand, when the mode for selecting the shooting distance range is not selected in step 1201, it is further determined whether the long distance priority mode is selected (step 1205). If the photographer has selected the long distance priority mode, set the farthest distance selection mode (step 1203). If the long distance priority mode is not selected, set the closest distance selection mode. (Step 1204). That is, here, a shooting mode in which the final focus distance can be determined with priority according to the photographer's intention is determined.

  Next, in the image signal determination process (step 12) shown in FIG. 11, in the focusing process from step 11 to step 106 in FIG. 11, the photographer manually sets the luminance information or the color information according to the subject or the like. Or whether to automatically set on the imaging device 10 side. In this image signal determination process, as shown in detail in FIG. 13, first, the photographer determines whether to use luminance information or color information among information included in the image data. Is selected (step 1301). If the manual mode is set in advance, it is further determined whether the photographer has selected a mode that uses color information (step 1302). When color information is not used, a mode is used in which only single luminance information is used (step 1303), and since RGB color information is not selected, variable CN is stored as 1 (CN = 1) (step 1304). ). In step 1302, if a mode that uses color information instead of luminance information is selected for focusing, the weighting amount of color information of each color of RGB for focal length calculation is arbitrarily set as a set value. The numerical value can be set (step 1305). For example, when three pieces of color information of RGB are selected, a variable CN indicating the number of color information is stored as 3 (CN = 3) (step 1306). Then, the matrix complementing circuit 27 and the switch 28 shown in FIG. 2 are set according to the settings of the color information and the luminance information such as the variable CN.

  On the other hand, if the manual mode is not selected in step 1301, the automatic mode is selected in which the color information and the luminance information are automatically selected. In this automatic mode, first, the luminance value of the shooting environment is observed (step 1307). If the current luminance value LV is lower than the preset luminance value LVTH, it is determined that it is better to use only luminance information as the image data for focusing because the color information is insufficient. Move to 1303. If it is determined in step 1307 that color information can be used, RGB color information weights are automatically set based on various settings such as the shooting mode set in step 11. The

  First, when the white balance tracking mode is set (step 1308), the weighting amounts of the RGB color information are automatically set based on information such as the current subject color information and white balance WB ( Step 1309). For example, when it is determined that there are many R (red) subjects, the weighting amount of R is increased and the weighting amount of G (green) or B (blue) is decreased when calculating the weighting amount of the evaluation value. Set to.

  Although not shown, when a plurality of image areas can be set, the color information of the set plurality of image areas can be detected, respectively, and the weighting amount of the color having the largest value can be increased.

  Further, the weighting amount of the evaluation value can be set corresponding to a plurality of shooting modes other than those set in step 11 (step 1310).

  For example, in the embodiment provided with the auxiliary light device 23, based on the setting for the control of the emission of the auxiliary lights L1 and L2 by the auxiliary light device 23 (step 1311), a predetermined weighting amount of RGB color information is set. These are set automatically or manually (steps 1312 and 1305). The auxiliary light determination process which is control of these auxiliary lights L1 and L2 will be described in detail with reference to FIG. The photographer can select whether the auxiliary lights L1 and L2 are automatically emitted or manually emitted as a photographing mode (step 1401). If the manual mode is selected in step 1401, the auxiliary lights L1 and L2 to be emitted are individually selected from the plurality of auxiliary lights L1 and L2 of the auxiliary light device 23 of the imaging device 10 according to the photographer's selection. Or as a plurality of combinations (step 1402). On the other hand, if the manual mode is not selected in step 1401, the automatic mode is set, and the auxiliary lights L1 and L2 are automatically emitted as necessary (step 1403). Here, the CPU 17 determines whether or not the auxiliary lights L1 and L2 need to be emitted using luminance information or the like. Further, when the auxiliary lights L1 and L2 are automatically emitted, calculation is performed using the luminance information and color information of the subject (step 1404), and it is determined what color auxiliary lights L1 and L2 are suitable. To do. Then, based on the result of this calculation or manual setting, it is determined whether or not it is necessary to emit a plurality of auxiliary lights L1 and L2 (step 1405). If only one auxiliary light L1, L2 should be emitted, the color information of the selected first auxiliary light L1 (step 1406) or second auxiliary light L2 (step 1407) is further included. Accordingly, the optimum weighting amount, that is, the weighting amount for the evaluation value of each color information of RGB is selected so that the evaluation value is maximized (steps 1408 and 1409).

  Further, using three or more N auxiliary lights L1, L2,... LN, the weighting amounts corresponding to these auxiliary lights L1, L2,... LN can be set (steps 1410, 1411). When the color information of each auxiliary light L1, L2,... LN is indefinite, it is necessary to process it as an error. The setting value in this error is the first auxiliary light that is general auxiliary light. A weighting amount is set assuming light L1 (step 1408). When a plurality of auxiliary lights L1 and L2 are emitted automatically or manually (step 1405), for example, when the first auxiliary light L1 and the second auxiliary light L2 are emitted simultaneously (step 1412), In accordance with the color information in a state in which the auxiliary lights L1 and L2 are emitted simultaneously, an optimum weighting amount, that is, a weighting amount for the evaluation value of each color information of RGB is selected so that the evaluation value is maximized ( Step 1413). When N auxiliary lights L1, L2,... LN are emitted in combination (step 1414), as in the case of emitting two auxiliary lights L1, L2 in combination, auxiliary lights L1, L2,. ... An optimum weighting amount is selected according to the combination of LN (step 1415). If the color information of the combined auxiliary lights L1, L2,... LN is indefinite, it is necessary to treat them as errors as in the case where the single auxiliary lights L1, L2,. Assuming that the set value in the case of this error is a combination of the first auxiliary light L1 and the second auxiliary light L2 as a general combination of auxiliary light, weighting is set (step 1413). In this auxiliary light determination process, when any auxiliary light L1, L2,... LN is finally emitted, the variable LWeightFlg is stored as 1 (step 1416), and any auxiliary light L1, L2,. ... When not emitting LN, the variable LWeightFlg is stored as 0 (step 1417), and the process returns to the flowchart shown in FIG. This variable LWeightFlg is used to determine whether or not the setting of the weighting amount has been completed when the auxiliary lights L1, L2,... LN are emitted in the shooting mode (step 1304) of the flowchart shown in FIG. Use for.

  Further, if the emission of the auxiliary lights L1, L2,... LN is not set in step 1311 and the shooting range is a short distance, that is, macro shooting (step 1313), the subject can be estimated as relatively vivid color information. Therefore, the weighting amount of the RGB color information is set so as to increase for all the RGB color information (step 1314).

  Furthermore, when the subject is limited to a specific subject, it is easy to focus on the color of the subject and matches the color of a member other than the subject that is expected to be placed close to the subject. Set the weighting amount so that it is hard to burn. For example, when the mode is set so that the subject is clearly designated as a flower (step 1315), the weight of green (G) is set so that the user wants to focus on the flower but does not focus on the green leaf. Is reduced (step 1316).

  If none of the above conditions is met, that is, the mode that follows the color temperature, white balance, etc. is not set (step 1308), and the shooting mode is not specified, so-called no setting mode. In this case (step 1310), a predetermined weighting amount set in advance is set (step 1317), and the variable CN indicating the number of color information is stored as 3 (CN = 3) (step 1306). In the no-setting mode, for example, a weighting amount that can easily focus on the skin color of a person can be set.

  In this way, in the image signal determination process and the auxiliary light determination process shown in FIGS. 13 and 14, the weights determined in advance in steps 1309, 1312, 1314, 1316, 1317, 1408, 1409, 1411, 1413, and 1415. Set the amount. Then, according to the color information or luminance information set in this way, the color information or luminance information is set in the matrix complementing circuit 27 and the switch 28 shown in FIG. 2 in the manual mode and the automatic mode.

  Next, after performing the processing from step 101 to step 120 in FIG. 11, the final focusing processing in the focusing processing is determined according to the set shooting mode.

  Here, the processing from step 11 to step 106 is repeated to acquire an evaluation value of a set of continuous image data. When there are a plurality of pieces of color information, a plurality of sets of evaluation values are acquired. In order to process the plurality of sets of evaluation values, the reliability calculation processing of each window in step 111 and the weighting multiplication processing of the evaluation values in step 115 are different from the configuration of the embodiment shown in FIG. .

  That is, the evaluation value obtained from the image data of the selected luminance information or color information can be weighted in the process shown in step 111 of FIG. 11, that is, the process shown in FIG. Then, the evaluation value Window (Wh) for each window is obtained using the color information number CN stored in advance. First, similar to the processing shown in FIG. 9, a series of processing from step 301 to step 318 in FIG. 15 is performed. Next, a value of CNB = CN-1 is obtained (step 319). Thereafter, the obtained evaluation value Window (Wh) is replaced with a weighting amount Window (Wh) (CNB) (step 320). If the calculation result of CNB is 0 (step 321), it is understood that only the luminance information or only the color information of one color can be dealt with. Therefore, the weighting amount window (Wh) replaced in step 320 is sufficient. The value of (CNB) is stocked as a result of reliability calculation (step 322). When CN = 3, the weighting amount Window (Wh) (CNB) is obtained until the processing for the three pieces of color information is completed. Then, after calculating the calculation results of all the sets, that is, all the colors, the weighting amount Window (Wh) (CNB) corresponding to the color information of the evaluation value Window (Wh) of each window is stocked (step 322). .

Then, after the processing from step 112 to step 114 in the flowchart shown in FIG. 11, weighting multiplication is performed on the evaluation value using the weighting amount Window (Wh) (CNB) corresponding to the color information of Window (Wh) of each window. Arithmetic processing is performed (step 115). This calculation process is a process of multiplying the evaluation value by the weighting amount, that is, the reliability. In this embodiment, the evaluation value and the reliability for each color information are obtained for each window. The arithmetic processing is performed according to each color information. That is, this weighting operation is performed for the evaluation value Window (Wh) of one window.
Evaluation value (Wh) = Σ {FocusValue (CNB) x Window (CNB)} / CNB
It becomes. However, in the case of CN = 1, the calculation process is the same as in step 115 shown in FIG.

  Then, this evaluation value (Wh) is multiplied by the entire evaluation value of each of the windows W1 to W9.

  Further, after performing the processing from step 117 to step 120 in FIG. 11, in step 121, the in-focus distance calculation shown in FIG. 16 is performed instead of the configuration shown in FIG.

  Here, first, similarly to the processing of FIG. 10, it is determined from the state of Eval FLG whether or not weighting is taken into account in the evaluation value calculation (step 1601). Is added for each distance (step 1602), and when weighting is not performed, addition is not performed. Then, a peak focus position (peak position) is obtained from these evaluation values (step 1603). If the interlocking range selection is set based on the shooting mode determined in step 11 of FIG. 11 (step 1604), these peak focus positions are all out of range with respect to the set shooting distance range. If there is (step 1605), or if the reliability of all peak focus positions is not more than a predetermined value, for example, 25% or less (step 1606), it is determined that the subject distance cannot be calculated (step 1607). In this case, the predetermined distance is forcibly set as the in-focus position (in-focus position) according to the shooting mode set in advance in step 11. Here, since the shooting mode is the closest distance selection mode or the farthest distance selection mode, if it is determined that the subject distance cannot be calculated, it is determined whether or not it is the farthest distance selection mode (step 1607). In the case of the farthest distance selection mode, the predetermined distance 1 is set (step 1608), and in the case of not being the farthest distance selection mode, the predetermined distance 2 is set (step 1609). Here, the predetermined distance 1 is set longer than the predetermined distance 2 (predetermined distance 1> predetermined distance 2). Then, it is determined that the focus distance determination is NG (step 1610).

  Further, even when the interlocking range selection is not set based on the shooting mode determined in step 11 of FIG. 11 (step 1604), the reliability of all the peak focus positions is not more than a predetermined value, for example, 25%. In the following case (step 1606), it is determined that the subject distance cannot be calculated (step 1607), and the same processing is performed (steps 1608 to 1610).

  On the other hand, in steps 1604 to 1605, in cases other than the above, that is, the interlocking range selection is set (step 1604), and the peak focus is within the shooting distance range corresponding to the shooting mode given in the set shooting mode. When at least one position (peak position) exists (step 1605), and the peak focus position within the set photographing range has a reliability greater than a predetermined value, for example, greater than 25% (step 1606). ) Determines that the subject distance can be calculated. In determining the peak position, in the case of the farthest distance selection mode among the selection modes determined in the shooting mode in step 11 (step 1611), the peak is selected from the valid windows W1 to W9. If the farthest partial focus position is selected, this position is set as the focus position (step 1612). If not in the farthest distance selection mode (step 1611), that is, if it is the shortest distance selection mode, it is valid. From the windows W1 to W9 thus selected, the partial focus position with the closest peak position is selected, and this position is set as the focus position (step 1613). Then, it is determined that the in-focus distance determination is OK (step 1614).

  Further, even when the interlocking range selection is not set based on the photographing mode determined in step 11 of FIG. 11 (step 1604), there is at least one peak focus position having a reliability greater than a predetermined value. However, if there is a peak focus position having a reliability greater than 25% (step 1606), for example, it is determined that the subject distance can be calculated, and the same processing is performed (steps 1611 to 1614).

  Then, depending on the result of the focus distance determination (steps 1610 and 1614) obtained from the focus distance calculation (step 121), as shown in FIG. 7, whether the focus distance determination is OK or NG. A determination is made (step 122). In the case of OK, the lens of the optical system 11 is moved to the calculated focus position (step 123). In the case of NG, a predetermined distance 1 which is a predetermined focus position set in advance. Alternatively, by moving the lens of the optical system 11 to the predetermined distance 2 (step 124), the lens can be arranged at the final focus position.

  As described above, according to this configuration, when the focal length is detected using the image data, the color information is used to accurately detect the focal length under various shooting environments for a subject having various color information. Can be detected. That is, focusing accuracy can be improved by a distance measuring method and a focusing device that perform weighting calculation on the contrast evaluation value of the color signal of the image signal and use only optimum data. Compared to the configuration in which focusing is performed according to the evaluation value obtained by extracting only the high-frequency component of the luminance signal obtained from the image data, the high-frequency of only the luminance difference is obtained by using information other than luminance information such as color information. Distance measurement is possible even for subjects that cannot be measured by the evaluation value based on the components, and subjects that are not good at focusing control can be reduced.

  In other words, the focusing device of the present embodiment has means for detecting the evaluation value of the contrast for each of the plurality of color information, that is, for each image data obtained through at least two different color filters. In addition to performing a focusing process for each of the plurality of image data, a means for selecting and calculating the plurality of image data (see matrix complementing circuit 27, switch 28) and a processing step (see step 12 in FIG. 11) are provided. Further, there is means for performing weighting calculation processing on the evaluation value for each image data obtained by the selection and calculation processing, and focusing on the subject.

  Further, in the present embodiment, for each of a plurality of image detection regions set in each image data, a reliability weighting amount is calculated for each evaluation value obtained according to the plurality of image data (FIG. 15 steps 319-322).

  Furthermore, weighting (see step 111 in FIG. 11) and addition (see step 115 in FIG. 11) are performed on the obtained evaluation values (see steps 11 to 12, FIG. 12, and FIG. 13) according to the shooting mode. In accordance with this evaluation value, a predetermined focal length corresponding to the shooting mode is selected from the partial focal lengths of the image detection area.

  Further, the image processing circuit 15 constituted by the CPU 17 or the like adds a weight (see step 111 in FIG. 11, step 1309 in FIG. 13, etc.) to the obtained evaluation value according to the color information or white balance output (see FIG. 11). 11), and a predetermined focal length corresponding to the shooting mode is selected from the partial focal lengths of the image detection area using the weighted evaluation value.

  Further, there is means for automatically switching a plurality of image data (matrix complementing circuit 27, switch 28, see step 12 in FIG. 11) for calculating the focal length (see NO after step 1301 in FIG. 13). .

  Further, there is means for manually switching a plurality of image data (matrix complementing circuit 27, switch 28, step 12 in FIG. 11) for calculating the focal length (see YES after step 1301 in FIG. 13). .

  Further, there is means for automatically switching image data of color information for calculating the focal length (see matrix complementing circuit 27) according to the luminance value of the subject (see step 1307 in FIG. 13).

  Further, the photographer can arbitrarily set the respective weights of the contrast evaluation values obtained from the image data for calculating the focal length (matrix interpolation circuit 27, switch 28, see step 12 in FIG. 11) (FIG. 11). Means (refer to steps 1301 to 1305 in FIG. 13).

  Further, evaluation based on weighting (see step 111 in FIG. 11) is performed, and a predetermined focal length corresponding to the shooting mode is selected from the partial focal lengths of the image detection region.

  As described above, in the present embodiment, since a means for selecting and calculating one or a plurality of different image signals from a plurality of different image data is provided, focusing is performed using the evaluation value of contrast. As a means for performing image recognition, it is possible to recognize the contrast of an image in a wider range of situations, that is, for a subject having various color information under various photographing environments, and to evaluate each of a plurality of different photographed image data. Since the value is subjected to a weighting calculation, a focusing calculation suitable for the characteristics of the subject can be performed.

  Then, by evaluating the contrast evaluation value for each of a plurality of image data according to the color information or white balance, the contrast can be evaluated under the optimum conditions for the subject.

  In addition, since an automatic mode for automatically selecting a plurality of image data according to the subject is provided, the photographer can concentrate on shooting by using this automatic mode.

  On the other hand, since a manual mode in which selection of a plurality of image data can be manually set is provided, the intention of the photographer can be directly reflected in the focusing process by using this manual mode. In addition, the manual setting can directly set the weighting amount that is indispensable for the weighting calculation of the focusing process as well as the selection of the image data. Therefore, even in special shooting conditions where focusing is difficult with the conventional configuration. , Can be focused.

  In addition, this manual setting has a mode that allows you to select the focus image data and set the weighting amount according to the selection of shooting conditions such as the shooting mode. The position can be selected.

  In other words, in the present embodiment, conventionally, calculation of a plurality of focal lengths having a plurality of regions and determination of the final focal length are performed using only luminance information or single information close to the luminance information. For focusing processing, evaluation values based on different color information are used, and these evaluation values are weighted in a state reflecting the photographer's intention by setting the shooting mode, etc. In the automatic mode, the feature based on the color information of the subject can be determined and the evaluation value can be automatically weighted, so that focusing can be performed easily and accurately.

  Further, even when the contrast can be recognized by color information when viewed by human eyes, in the configuration using only single color information or luminance information, the contrast may not be detected if the luminance is the same. In this respect, in this embodiment, even in a dark environment, even under adverse conditions such as camera shake or subject movement, a plurality of color information or luminance information is used to detect contrast edges and Therefore, it is possible to focus accurately on a subject that has been difficult to focus on conventionally.

  In addition, when the photographer uses the manual mode to focus only on specific color information of the subject, the photographer weights the evaluation value according to the spectral color information or luminance information of the image data used for focusing. Therefore, for example, the selection of color information and the weighting amount of each color information can be arbitrarily set in accordance with a specific color of the subject, and the focus control suitable for the photographer's intention can be performed. For example, for human faces, etc., the contrast is relatively low, but color information or luminance information is selected with the skin color as a specific color so that it is not affected by other colors, and only the skin color is weighted when calculating the evaluation value Can be set large.

  In addition, if the photographer wants to focus on the petal in a situation where the flower of a plant is photographed, if the evaluation is performed only with luminance information, the green leaf around the petal becomes the peak of the evaluation value, and the petal matching It may not burn. In this regard, in the present embodiment, for example, when the petals are blue, the focusing device can surely recognize the petals as a subject by evaluating using only the blue color information. Even if there is shaking, you can definitely focus on the blue petals. In this way, by providing a shooting mode that calculates the focal length using only image data of predetermined color information according to the subject, by using only image data of predetermined color information, other color information can be obtained. It is possible to easily focus on the subject intended by the operator without being affected.

  In this embodiment, a luminance detection circuit including a CPU 17 for measuring luminance, and auxiliary light L1, which are a plurality of light sources for assisting photographing of focal length detection image data according to the luminance, L2 and light source circuits 43 and 44 for controlling the auxiliary lights L1 and L2, respectively, and emitting auxiliary lights L1 and L2 according to luminance information or color information (see steps 1403 and 1404 in FIG. 14). (See steps 1406, 1407, 1410, 1412 and 1414 in FIG. 14) and weighting (see steps 1408, 1409, 1411, 1413 and 1415 in FIG. 14).

  The auxiliary light L1 and L2 can be emitted by a single lamp, or a plurality of auxiliary lights L1 and L2 can be emitted simultaneously. In other words, a selectable controllable circuit (see light source circuits 43 and 44 and switches 45 and 46 shown in FIG. 2). ).

  Further, the auxiliary light determination processing means for selecting the auxiliary lights L1 and L2 includes selection means (see step 1401 in FIG. 14) for automatic or manual control.

  When the auxiliary lights L1 and L2 are manually selected (see step 1402 in FIG. 14), according to the color information of the plurality of auxiliary lights L1 and L2 (steps 1406, 1407, 1410, 1412 in FIG. 14). 1414), it is possible to perform a weighting calculation (see steps 1408, 1409, 1411, 1413, and 1415 in FIG. 14).

  Therefore, when shooting in a dark environment, it has a plurality of auxiliary lights L1 and L2 for assisting in focusing, and in use, an optimum image is selected according to characteristics such as the color temperature of the auxiliary lights L1 and L2. Focusing can be optimized by selecting data from a plurality of image data and performing weighting.

  That is, at least one auxiliary light L1, L2 which is an auxiliary light source for focusing is provided, and the auxiliary light L1, L2 having optimum color information is emitted from the auxiliary lights L1, L2, and is emitted. Since the color information is selected in accordance with the color temperature of each auxiliary light L1, L2, and the evaluation value is weighted, the auxiliary light L1, L2 can be focused efficiently while being efficiently used. For example, when a red (R) light emitting diode (LED) is used as auxiliary light, the evaluation value is obtained from the red image data, and the weighting of the red color information is increased, thereby making it cheaper than other colors. In addition, it is possible to illuminate far away with auxiliary light, and it is possible to focus accurately on a subject located in a dark place.

  When a plurality of auxiliary lights L1 and L2 are provided, the probability of focusing can be improved by selecting and emitting the auxiliary lights L1 and L2 according to the characteristics of the subject. Here, the characteristics of the subject are, for example, not shown, but when the three auxiliary lights L1, L2, and L3 are provided, the subject is assumed to emit light in red, blue, and green, respectively. It is effective to select a color that is recognized as the most effective evaluation value based on the color information and emit light.

  Furthermore, since the selection of which auxiliary light L1, L2 to emit can be set to manual or automatic, when the photographer has knowledge of the auxiliary light source, the optimum auxiliary light L1, L2 is selected according to the condition of the subject. In addition to being able to set arbitrarily, if there is no knowledge, it can be selected automatically, and the subject can be focused easily using an optimal light source.

  In the above embodiment, YCC luminance or RGB format image data is used as information for obtaining an evaluation value from an image signal. For example, cyan (C) is used by using the matrix complementation circuit 27 shown in FIG. , Magenta (M), yellow (Y) color difference formats and specific color information image data can be generated and used for processing. And according to each color information, the variable of a weight is set appropriately and a focal distance can be detected correctly.

  Furthermore, according to the present embodiment, since it is possible to focus on the long distance side according to the photographer's intention, it is possible to easily perform photographing focused on the long distance side according to the photographer's intention. That is, depending on the range of the shooting distance, the shooting distance range in the normal mode and the mode for shooting at a long distance, such as the distant view mode or the infinite mode, or the shooting distance range as the entire shooting distance range of the lens Since the mode for taking a short distance priority or a long distance priority can be selected, the photographer can easily perform the intended shooting. The determination of the in-focus position uses data that is determined to be effective in focus because it can be evaluated that it is not affected by a sudden movement of the subject from a plurality of image areas. Reflected shooting becomes possible. In other words, in an automatic focusing operation in which the screen is divided into a plurality of areas and the focus position is determined in each area, a blur is detected in a scene where there is an obstacle in distance measurement such as movement of a subject or camera shake, Since the optical system 11 can be focused by appropriately measuring the distance using only the optimum data, the focusing accuracy in the long distance mode can be improved.

  In other words, when prioritizing a generally effective short distance in calculating a plurality of focal lengths having a plurality of regions and determining a final focal length, in the conventional method, an erroneous peak due to subject movement or camera shake is closer to the subject. In this case, the subject cannot be determined as the in-focus position, and an incorrect peak is determined as the in-focus position, and the in-focus position may not be set correctly. In addition, when shooting a long-distance subject rather than a short-distance subject is intended, on the other hand, an erroneous determination is made with the peak on the short-distance side as the in-focus position due to subject movement or camera shake. Or, a wrong determination is made with the peak at the far side (for example, farther than the farthest subject in the captured image) as the in-focus position than the long distance intended by the photographer. , May be contrary to the intention of the photographer. In this regard, according to the present embodiment, even if an erroneous peak due to subject movement or camera shake exists at either a short distance or a long distance, movement of the subject or camera shake is detected, and only an appropriate evaluation value is used for proper detection. And the correct in-focus position can be set with a short distance priority or a long distance priority according to the shooting mode.

  For the shooting distance range, when the normal mode is set, the closest distance selection mode is automatically selected. When the shooting distance range is set to the long distance, the longest distance selection is automatically performed. Since this is a mode, the closest focus in the shooting distance range selected in the long-distance mode is not set as the final focus position, and the subject at the longest distance from multiple image areas can be set as the final focus position. This makes it possible to shoot in accordance with the photographer's intention.

  In the configuration in which the long distance priority mode and the short distance priority mode can be selected in the entire shooting distance range, the photographer only has to select the long distance priority mode. It is not necessary for the photographer to perform the complicated task of predetermining the shooting distance range by eye measurement, and it matches the photographer's intention, coupled with an accurate focusing operation that determines the final focal length after evaluating the reliability. Accurately focused shooting is possible.

  Furthermore, by using the long distance priority mode, it is possible to accurately focus on long distances other than infinity.

  In addition, since the subject distance is calculated and evaluated in each of the plurality of areas, even when the subject moves or the background is blurred, it is possible to suppress the fear of malfunction and to be unable to accurately evaluate the in-focus position. In the case of the condition, that is, when the evaluation value by contrast is low in all the image areas and the effective focus position cannot be obtained and the distance measurement becomes impossible, the predetermined distance corresponding to the shooting mode is focused. By setting the distance, shooting that reflects the photographer's intention becomes possible.

  Also, in this embodiment, the camera automatically recognizes images using empirical rules in addition to short-range priority or long-range priority in order to follow the intention of the photographer clearly indicated as short-range priority or long-range priority. Compared to a configuration that determines the focal length, the focal length can be confirmed intuitively before shooting, and it is not necessary to use a complicated algorithm. It is also possible to use a single-lens reflex optical finder and a liquid crystal panel using computing components. It is not necessary to provide a device such as an enlarged display, and the configuration can be simplified and the manufacturing cost can be reduced.

  In addition, the lens driving range changes with respect to the designed shooting distance range depending on conditions such as a variation due to the focus magnification, a change due to the aperture position, and a temperature condition and a posture difference of the lens barrel that supports the lens. Therefore, in addition to the driving range calculated at the designed focus position, the optical system 11 can also move by the amount of change between the short distance side and the far distance side in consideration of the change amount due to fluctuations in these conditions. A range, that is, an overstroke area is provided, and the control means including the CPU 17 and the like is set so that the lens position of the focusing lens unit can be driven in this overstroke area.

  Therefore, in the farthest distance selection mode, the focus position is near the far distance end of the lens drive range, and for example, even if the posture difference is on the far distance side, it is used for focusing on the overstroke area on the far distance side. The driving distance range can be satisfied by driving the lens position of the lens unit.

  In the closest distance selection mode, the focus position is near the closest distance end of the lens driving range. Further, for example, even if the posture difference is on the closest distance side, the focus is on the overstroke area on the near distance side. The driving distance range can be satisfied by driving the lens position of the lens unit.

  In this way, it is possible to shoot in consideration of the amount of defocus at the short distance side end and the long distance side edge, and easily satisfy the designed shooting distance range. Manufacturing cost can be reduced without requiring high-precision distance correction work (software).

  In the above embodiment, the photographing distance range and the long distance priority mode are configured to be set by the photographer, but only one of them can be set to simplify the configuration and operation. You can also.

  As described above, the focal length detection method of the present embodiment selects either the latest partial focal length or the farthest partial focal length in the partial focal lengths of the image detection area according to the operator's selection. This is selected as the focal length. In this configuration, an accurate focal distance at a short distance or a long distance is selected according to the intention of the operator.

  Further, according to the focal length detection method of the present embodiment, according to the selection of the shooting distance range of the operator, the control means is arranged such that the most recent partial focal length and the farthest partial focal length among the partial focal lengths of the image detection area. Is selected as the focal length. In this configuration, according to the selection of the shooting distance range by the operator, the control unit selects either the latest partial focal length or the farthest partial focal length in the partial focal lengths of the image detection area. By selecting the focal length, an accurate focal length according to the operator's intention is selected.

  The focal length detection method according to the present embodiment selects either a partial focal length selected from the partial focal lengths of the image detection area or a predetermined focal length as the focal length according to the reliability. Is. In this configuration, an accurate focal length is selected on the assumption that the focal length is selected from partial focal lengths with high reliability. Further, when there is no partial focal distance with high reliability, or when the reliability of partial focal distance is low as a whole, the selection of an incorrect focal distance is avoided by using a predetermined focal distance.

  In addition, the focal length detection method of the present embodiment uses a partial focal length selected from the partial focal lengths of the image detection area according to the reliability and a predetermined focal length selected according to the operator's selection. Is selected as the focal length.

  In this configuration, on the premise of a configuration in which a focal length is selected from among partial focal lengths with high reliability, an accurate focal length that is short or far is selected according to the intention of the operator. Also, when there is no partial focal length with high reliability, or when the reliability of partial focal length as a whole is low, the operator's intention is reflected by using a predetermined focal length according to the operator's selection. While selecting an incorrect focal length is avoided.

  In addition, the focusing device according to the present embodiment includes a shooting mode selection unit that selects a short distance priority mode and a long distance priority mode, and the image processing unit is configured to change the closest distance according to an operation of the shooting mode selection unit. The focal length is selected with priority given to either the partial focal length or the farthest partial focal length. In this configuration, an accurate focal distance at a short distance or a long distance is selected according to the intention of the operator. Manufacturing cost is suppressed without complicating the configuration.

  Further, in the focusing apparatus of the present embodiment, the optical system driving means is set so that the optical system can be driven in an overstroke region exceeding the range of the focal length that can be focused on the design. In this configuration, accurate focusing can be easily performed at a short distance or a long distance regardless of the shift of the focus of the optical system due to the temperature condition or posture.

  Next, the imaging apparatus of the present embodiment will be described with reference to FIGS. 17 and 18.

  The present embodiment is based on the above configuration, and the photographer uses the image data of the plurality of color information generated from the image data to calculate different partial focal lengths for each color information, Focus bracket shooting is performed in which shooting is performed at each focal length. That is, the configuration of the bracket shooting according to the present embodiment is based on the assumption that the color information in the range corresponding to the selection of the interlocking range (step 1201) in the shooting mode selection (step 11) in FIG. Calculation of the partial focal length used, selection of the shooting mode included in the image signal determination processing of FIG. 13 (step 1310), for example, control of whether or not the auxiliary lights L1 and L2 are emitted, combinations of a plurality of shooting modes, etc. The configuration is included.

  First, the S1 sequence, which is a sequence for capturing a still image, will be described with reference to the flowchart of FIG. This S1 sequence is a sequence in which the shutter is half-pressed. First, it is confirmed whether the photographer has set in advance whether or not to perform bracket shooting (step 1701). The variable BL_FLG is set to 1 (BL_FLG = 1) (step 1702), and when the bracket shooting is not set, the variable BL_FLG is set to 0 (BL_FLG = 0) (step 1703). This variable BL_FLG is used for determining whether bracket shooting is performed in the subsequent steps. Next, exposure matching processing is performed (step 1704). This exposure adjustment process is a process for determining control for setting the subject to an appropriate exposure, and mainly determines the shutter speed, aperture, and gain setting of the CCD 12 as an image sensor.

  Next, a focusing process is performed (step 1705). With respect to this focusing process, first, details of a case where the auxiliary light is not selected will be described with reference to FIG. In FIG. 18, the processing from step 11 to step 106 is performed as in the processing shown in FIG. Then, in step 111 for calculating the reliability of each window, as shown in FIG. 15, a weighting amount Window (Wh) (CNB) for the reliability is obtained for each color information (step 322). Then, through the processing of steps 112 to 114 in FIG. 18, using this weighting amount, a weighting operation (step 115) is performed on the evaluation value for each color information, similarly to the processing shown in FIG. Further, through the processing of steps 116 to 120, the focus distance calculation is performed based on the calculated evaluation value (step 121). If the in-focus processing determination is possible (OK) (step 122), the focal length in that state, that is, the focal lens position P (CNB) is stored (step 125). On the other hand, if the focus processing determination is not possible (NG) (step 122), a predetermined focal length, that is, a predetermined focal lens position P (CNB) is stored (step 126). Here, CNB indicates the number of color information. For example, when three colors of R (Red, Red), B (Blue, Blue), and G (Green, Green) are used, CNB is 3, and three types of color information are used. Calculate the focal length. The calculation is performed until all focal lengths are calculated (step 127), and the process returns to the flowchart of FIG. That is, at the stage where this focusing process (step 1705) is completed, the focal lens position corresponding to the color information of each color is calculated.

  If the variable BL_FLG is 0 in the flowchart of FIG. 17 (step 1706), the process proceeds to determination of whether or not to perform actual shooting (step 1711). On the other hand, when the variable BL_FLG is 1 (step 1706), the calculated focal lens positions P (CNB) are rearranged in order of increasing focal length (step 1707). First, the lens of the optical system 11 is the closest focal lens position. Move to P (CNB) (step 1708). This operation means that the lens is moved to the end position in the interlocking range as an initial setting in order to sequentially photograph at a plurality of focus lens positions P (CNB). Therefore, in this embodiment, the calculated focal lens position P (CNB) is rearranged in order of increasing focal length, and shooting is performed in this closest order, but the calculated focal lens position P (CNB) has a long focal length. You can also sort in order and shoot in the order of distant.

  Next, in the focusing process in step 1705, it is confirmed whether or not the use of auxiliary light is selected by the auxiliary light determining means (see step 1311 in FIG. 13) (step 1709), and a single auxiliary light is used. If there is (step 1710), the process proceeds to shooting determination (step 1711). If there are a plurality of auxiliary lights to be used (step 1710), a focusing process is performed for all combinations of the plurality of auxiliary lights, and the focal lens position P (CNB) is obtained (step 1710).

  If the shutter button is pressed after the lens has been moved and still image shooting is permitted (step 1711), shooting processing (step 1712) is started. Then, it waits until the photographing process is finished (step 1713), and after the photographing process is completed, it is confirmed whether or not the designated number of photographings is finished (step 1714).

  Here, when the number of auxiliary lights is singular, the number of bracket shootings is CNB. If the designated number is not completed in step 1714, the designated number counter is decremented by -1 (step 1716), and the lens is moved to the focal lens position P (CNB) on the far side from the present (step 1716). 1717). The lens movement and photographing are repeated until the designated number of images (CNB) is photographed (steps 1711 to 1717).

  In this way, bracket shooting for sequentially shooting at each focal length can be performed using the partial focal length of the image detection region obtained for each color information.

  This S1 sequence is a sequence in which the shutter is half-pressed, and mainly performs exposure adjustment processing (step 1707) and focus adjustment processing (step 1708). Then, with the shutter fully depressed (step 1711), actual still image bracket shooting is performed, that is, shooting processing (step 1712) is performed. Further, when the shutter is not fully pressed (step 1711), and when the designated number of images has been taken (step 1714), the S1 sequence is terminated (step 1715).

  Although not shown, when this S1 sequence is completed, if the shutter is half-pressed, the data of the focal lens position P (CNB) is held until the shutter is fully pressed again, and further, By fully pressing the shutter, bracket shooting can be performed.

  If photographing is not permitted in step 1711, the lens position is set to a predetermined position corresponding to the photographing mode within the focal length obtained for each color information.

  Further, when this bracketing photographing process (step 1712) is started, a warning is displayed on the image display device 21 that bracket photographing is being performed. This warning display may be until the first shooting process is completed (step 1713), or the warning display may be continued until the entire S1 sequence is completed (step 1715). In this way, by notifying the photographer that the bracket photographing is being performed, the photographer can be prevented from moving the imaging device 10 from the subject during the photographing. Although not shown in the figure, a voice generation means such as a speaker can be provided, and a warning can be given by voice, that is, aurally, at the same timing as the above warning display. This voice warning can be executed instead of the warning display, or can be executed together with the warning display.

  In this way, the present embodiment is, for each color signal obtained by performing bracketing photographing at the optimum in-focus position for each color signal, that is, by performing a weighting operation on the contrast evaluation value of the color information of the image signal. In addition, it is possible to improve the possibility that an image focused on the subject intended by the photographer can be captured by the focusing device that performs bracket shooting at the optimum focus position.

  In other words, the present embodiment has means for detecting the contrast evaluation value of each image data (see matrix interpolation circuit 27) obtained through at least two or more different color filters, and each of the plurality of image signals. 1 to 16 is a calculation process for performing the focusing process similar to the configuration shown in FIGS. 1 to 16, and means for selecting and calculating the plurality of image signals (matrix complementing circuit 27, switch 28, FIG. 18). And a means for focusing on the subject by weighting the evaluation value for each image data obtained by the selection and means. Further, a plurality of image detection areas are set for each of the plurality of image data, and a weighting amount of reliability of the evaluation value obtained according to each image detection area is calculated (see steps 319 to 322 in FIG. 15). For each output color information, a predetermined value corresponding to an evaluation value (see step 115 in FIG. 7 and step 115 in FIG. 18) and a photographing mode (step 11 in FIG. 18) is selected from the partial focal lengths of the image detection area. A focal length is selected, distance information for each color information is stored (see steps 125 and 126 in FIG. 18), and a plurality of partial focal lengths are determined by contrast evaluation values of image data obtained from different color information. The bracket shooting mode for sequentially shooting is provided (see FIG. 14).

  As described above, in this embodiment, a plurality of pieces of image data (see Step 12 in FIG. 18) generated from photographed image data are used in accordance with the photographing mode from among partial focal lengths obtained for each piece of image data. A means for calculating a predetermined focal length and sequentially shooting for the determined focal length is provided, so that features of the subject can be obtained without worrying about a shift in focus position due to a subtle color difference of the subject. You can shoot at the in-focus position.

  That is, in calculating a plurality of focal lengths having a plurality of image detection regions and determining a final focal length, partial focal lengths are calculated from image data of different color information, so that each image data of each color information The focal length is calculated, bracket shooting is performed based on these partial focal lengths, and an optimal image can be provided to the photographer with a single shooting operation. Furthermore, in this embodiment, in the manual mode, it is possible to weight the evaluation value according to the difference in color information, and to realize bracket shooting reflecting the photographer's intention according to the setting of the shooting mode, etc. On the other hand, in the automatic mode, by automatically recognizing white balance, auxiliary light color information, and the like, it is possible to judge features of the subject color information, weight evaluation values, and focus easily and accurately.

  That is, in the conventional focusing device, when only single luminance information or color information is used, the contrast of the subject can be recognized by the color information when viewed with the human eye, but the luminance of each part of the pattern constituting the subject. However, in this embodiment, image data with different color information is used as described above even in a dark environment, or when camera shake or movement of the subject is suitable. Therefore, the optimum partial focal length for each color information can be taken sequentially with a single shooting operation, so that even if the photographer has no knowledge of color information, it can accurately focus on subjects that were difficult to focus on automatically in the past. You can take a sharp image.

  For example, when photographing a flower of a plant and the like, when the photographer wants to focus on the petal, if evaluation is performed only with luminance information, the green leaf around the flower becomes the peak of the evaluation value, and the petal In this embodiment, for example, in order to calculate the partial focal length from the color information, for the petal of a specific color, the partial focus of the color information that matches the color information of the petal In addition to being able to shoot by detecting distance, even when there are multiple different colors of flowers, it is possible to shoot with the best focus position by sequentially shooting each petal in one shot. Become.

  Further, during or during the shooting of bracket shooting, the image display device 21 is used to visually display that bracket shooting is being performed, and in place of this display or together with this display, sound is output using voice means (not shown). By providing a warning means for notifying that bracket shooting is performed, it is possible to prevent the photographer from moving the imaging device 10 during bracket shooting.

  In the embodiment shown in FIG. 17, only the presence / absence of auxiliary light is exemplified as the photographing mode. However, the present invention is not limited to this configuration, and a plurality of photographing modes (see step 11 in FIG. 12) can be selected. In the shooting mode, it is possible to provide a bracket shooting mode in which shooting is sequentially performed at a plurality of partial focal lengths based on contrast evaluation values of image data obtained from different color information.

  For example, instead of the auxiliary light processing shown in steps 1709 and 1710 of FIG. 17, processing can be performed as shown in steps 1709 and 1710 shown in FIG. That is, the calculated focal lens position P (CNB) is rearranged in order of close focal length (step 1707), and the lens of the optical system 11 is moved to the closest focal lens position P (CNB) (step 1708). In the focusing process in step 1705, the shooting mode (see step 1310 in FIG. 13) is confirmed (step 1709). If the shooting mode to be used is single (step 1710), the process proceeds to shooting determination (step 1711). To do. If there are a plurality of shooting modes to be used (step 1710), a focusing process is performed for all of the plurality of shooting modes, and a focus lens position P (CNB) is obtained (step 1710).

  Similarly to the processing shown in FIG. 17, after the movement of the lens, when the shutter button is pressed and still image shooting is permitted (step 1711), the shooting processing (step 1712) is started. . Then, it waits until the photographing process is finished (step 1713), and after the photographing process is completed, it is confirmed whether or not the designated number of photographings is finished (step 1714).

  When the shooting mode is single, the number of bracket shooting is CNB. If the designated number is not completed in step 1714, the designated number counter is decremented by -1 (step 1716), and the lens is moved to the focal lens position P (CNB) on the far side from the present (step 1716). 1717). The lens movement and photographing are repeated until the designated number of images (CNB) is photographed (steps 1711 to 1717).

  In this way, bracket shooting for sequentially shooting at each focal length can be performed using the partial focal length of the image detection region obtained for each color information.

  The present invention can be applied to an imaging apparatus such as a digital camera or a video camera.

It is a block diagram which shows one Embodiment of the imaging device of this invention. It is explanatory drawing which shows the image processing circuit of an imaging device same as the above in detail. It is explanatory drawing which shows operation | movement of a state with no blurring of the focusing apparatus of an imaging device same as the above, (a) is explanatory drawing which shows the relationship between a window and a to-be-photographed object, (b) is explanatory drawing which shows the change of the evaluation value of contrast It is. It is explanatory drawing which shows the relationship between the window of a blurring state of a focusing apparatus same as the above, and a to-be-photographed object. It is explanatory drawing which shows operation | movement of a state with a blurring of a focusing apparatus same as the above, (a) is explanatory drawing which shows the relationship between a window and a to-be-photographed object, (b) shows the change of the evaluation value of contrast in windows W4 and W5 It is explanatory drawing. It is explanatory drawing which shows the relationship between the window of a blurring state of a focusing apparatus same as the above, and a to-be-photographed object. It is a flowchart which shows operation | movement of the focusing apparatus used as the premise of the imaging device of this invention. It is a flowchart which shows the operation | movement which calculates the number of image data which a focusing apparatus same as the above acquires. It is a flowchart which shows the weighting operation | movement of a focusing apparatus same as the above. It is a flowchart which shows the operation | movement of the focusing distance calculation of a focusing apparatus same as the above. It is a flowchart which shows operation | movement of the focusing apparatus used as the premise of the imaging device of this invention. It is a flowchart which shows operation | movement of a focusing apparatus same as the above. It is a flowchart which shows operation | movement of a focusing apparatus same as the above. It is a flowchart which shows operation | movement of a focusing apparatus same as the above. It is a flowchart which shows operation | movement of a focusing apparatus same as the above. It is a flowchart which shows the operation | movement of the focusing distance calculation of a focusing apparatus same as the above. 3 is a flowchart showing the operation of the imaging apparatus of the present invention. It is a flowchart which shows operation | movement of the focusing apparatus of an imaging device same as the above. It is a flowchart which shows other operation | movement of the imaging device of this invention.

Explanation of symbols

10 Imaging device
11 Optical system
12 CCD as an image sensor
15 Image processing circuit constituting image processing means
17 CPU constituting image processing means
19 Motor drive circuit constituting optical system drive means
20 Motor constituting optical system drive means
21 Image display device constituting warning means T Subject W1-W9 Window constituting image detection area Wh Image detection area

Claims (4)

Using the image data of a plurality of color information, respectively to detect the focal length for the plurality of color information to perform each captured at a focal length detected with each of the plurality of color information,
In the detection of the focal length for each of the plurality of color information,
With respect to the image data of the color information, by changing the focal length of the optical system, to obtain a plurality of image data respectively corresponding to a plurality of different focal lengths,
In the image data of the color information, a plurality of adjacent image detection areas are set,
In each of the obtained plurality of image data, for each image detection region, an evaluation value based on the maximum value of contrast and a peak position where the maximum value is recorded are obtained,
For each of the image detection regions, a partial focal length is calculated according to which peak of the evaluation value in the plurality of image data is recorded with image data corresponding to which focal length, and at least of the plurality of image data Find the difference between the peak positions in the two image data, calculate the reliability of the image detection region so that the greater the difference obtained, the lower the reliability,
A focal length for the color information is selected from the partial focal length and the predetermined focal length calculated for the image detection area in which the product of the reliability and the evaluation value exceeds a predetermined value according to a preset condition. An imaging method characterized by: When it is possible to execute imaging in either the closest distance selection mode or the farthest distance selection mode, and when it is instructed to execute imaging in both the closest distance selection mode and the farthest distance selection mode In addition,
For each of the shooting mode,
A focal length is detected for each of the plurality of color information , and imaging is performed at each detected focal length ,
In the closest distance selection mode, in the detection of the focal length for each of the plurality of color information, the partial focal length calculated for the image detection region in which the product of the reliability and the evaluation value exceeds a predetermined value. The smallest partial focal length or the predetermined first focal length is selected as the focal length for the color information,
In the farthest distance selection mode, in the detection of the focal length for each of the plurality of color information, the partial focal length calculated for the image detection region in which the product of the reliability and the evaluation value exceeds a predetermined value The imaging method according to claim 1 , wherein a second focal length that is a maximum partial focal length or a predetermined focal length and is larger than the first focal length is selected as a focal length for the color information . An image sensor;
  An optical system for forming an image of a subject on the image sensor;
  An optical system driving means for changing the focal length of the optical system;
  Image processing means for processing the image data output from the image sensor and controlling the optical system driving means,
  This image processing means
  A process of detecting a focal length for each of a plurality of color information,
  For the image data of the color information, by changing the focal length of the optical system, to obtain a plurality of image data respectively corresponding to a plurality of different focal lengths,
  In the image data of the color information, a plurality of adjacent image detection areas are set,
  In each of the obtained plurality of image data, for each image detection region, an evaluation value based on the maximum value of contrast and a peak position where the maximum value is recorded are obtained,
  For each of the image detection regions, a partial focal length is calculated according to which peak of the evaluation value in the plurality of image data is recorded with image data corresponding to which focal length, and at least of the plurality of image data Find the difference between the peak positions in the two image data, calculate the reliability of the image detection area so that the greater the difference, the lower the reliability,
  A focal length for the color information is selected according to a preset condition from the partial focal length and the predetermined focal length calculated for an image detection region in which the product of the reliability and the evaluation value exceeds a predetermined value. Do the processing,
  Execute imaging at each focal length calculated for each of the plurality of color information
  An imaging apparatus characterized by that. Provide warning means to indicate that imaging is in progress
The imaging apparatus according to claim 3 .

Images