JP5501405B2 - Control device - Google Patents

Description

  The present invention relates to an imaging apparatus such as a digital still camera.

  In recent years, digital still cameras using high-pixel image sensors have been commercialized. In general, in a digital still camera using a high-pixel imaging device, the operation of the imaging device during EVF or moving image shooting is a driving method that thins out other than the signal lines necessary for the display of the liquid crystal display device in order to increase the finder rate. Has been taken.

  On the other hand, high-resolution digital still cameras, like silver halide cameras, are strongly demanded to take still images immediately. For this reason, it is necessary to shorten the time from when the release switch is pressed to when shooting. In particular, regarding AF, since the time until focusing is short, many inventions relating to the phase difference AF method have been proposed.

  Patent Document 1 relates to an AF method in which a photoelectric conversion element for phase difference AF is arranged in an image sensor and an output signal of the image sensor is used in order to perform phase difference AF without having a mechanical phase difference detection structure. The technology is disclosed.

  Japanese Patent Application Laid-Open No. 2004-228561 reads out at the time of AF and image generation when reading out by thinning out the lines of the image sensor at the time of EVF or moving image shooting in an image pickup apparatus including a photoelectric conversion element for phase difference AF. A technique for switching lines is disclosed.

JP 2000-156823 A JP 2003-198925 A

  However, in the techniques of Patent Documents 1 and 2, for an image sensor having a line including and not including a phase difference AF photoelectric conversion element in the image sensor, photoelectric conversion for phase difference AF is performed during EVF display or moving image shooting. A line not including an element is read. During AF, a line including a photoelectric conversion element for phase difference AF is read out. This method cannot be applied to an image sensor in which photoelectric conversion elements for phase difference AF are arranged on all lines.

  In the techniques of Patent Documents 1 and 2, when performing AF, a line including a photoelectric conversion element for phase difference AF is read from the image sensor again, and only AF data is used. Therefore, as described in Patent Document 2, during AF, the previous image is redisplayed or rerecorded in the EVF or moving image, and a moving image with a sense of incongruity that freezes in the middle is generated. End up.

  An object of the present invention is to provide an imaging device including an imaging device having a pixel arrangement that can effectively change the accuracy of AF.

A first aspect of the present invention relates to a control device, wherein a first pixel for imaging for forming image data and a second pixel for focus detection for performing phase difference autofocus are arranged. An image pickup device, wherein the second line includes N first pixels (N is an integer equal to or greater than 2), and the second pixel includes M (M does not include zero smaller than N). A control device that controls an image sensor having a second line arranged in a natural number), wherein the first read mode for reading the first line and the second line of the image sensor, and the first Control means for controlling to read an imaging signal from the imaging device by switching between a second reading mode for reading a line and a third reading mode for reading the second line.

A second aspect of the present invention relates to a control device, wherein a first pixel for imaging for forming image data and a second pixel for focus detection for performing phase difference autofocus are arranged. An image pickup device, wherein the second line includes N first pixels (N is an integer equal to or greater than 2), and the second pixel includes M (M does not include zero smaller than N). A control unit that controls an image sensor in which a second line (natural number) arranged and a third line in which the second pixel is not arranged are arranged periodically, the first line of the image sensor A first read mode for reading the first, second, and third lines; a second read mode for reading the first line; a third read mode for reading the second line; Switch to 4th readout mode to read out the line Characterized in that it has a control means for controlling to read out the imaging signal from the imaging element.

  ADVANTAGE OF THE INVENTION According to this invention, an imaging device provided with the image pick-up element with the pixel arrangement | positioning which can change the precision of AF effectively can be provided.

1 is a block configuration diagram of an imaging apparatus according to a preferred first embodiment of the present invention. 1 is a schematic diagram of an image sensor according to a preferred first embodiment of the present invention. It is a schematic diagram of the image sensor concerning a suitable 2nd embodiment of the present invention. It is a figure which shows the processing flow of read-out mode switching at the time of the still image imaging | photography concerning the suitable 1st Embodiment of this invention. It is a figure which shows the processing flow of read-out mode switching at the time of the video recording which concerns on suitable 1st Embodiment of this invention. It is a figure which shows the processing flow of read-out mode switching at the time of the still image photography concerning the suitable 2nd Embodiment of this invention. It is a figure which shows the processing flow of read-out mode switching at the time of the video recording based on suitable 2nd Embodiment of this invention.

(First embodiment)
FIG. 1 is a block diagram of an imaging apparatus according to a preferred first embodiment of the present invention. A subject image incident through the lens 100 is photoelectrically converted into an electric signal by the image sensor 101. Here, the imaging element 101 includes imaging pixels (R, G, B) for forming image data and focus detection pixels (S1, S2) for performing phase difference AF, as shown in FIG. Are arranged.

  In the present embodiment, as shown in FIG. 2, an example is an image sensor in which the pixels for focus detection are arranged in pairs of S1 and S2, and the number of focus detection pixels is different for each line. In the present embodiment, a first line in which N focus detection pixels (N is an integer of 2 or more) are arranged, and a second line in which M focus detection pixels are arranged (M is a natural number smaller than N). Are periodically arranged. For example, referring to FIG. 2, a line in which two focus detection pixels are arranged (corresponding to an arrow “EDF”) and a line in which one focus detection pixel is arranged (corresponding to an arrow in “moving image”). Are periodically arranged.

  The A / D conversion unit 103 converts the electrical signal output from the image sensor 101 into a digital signal. The digital signal processing unit 104 converts the digital signal output from the A / D conversion unit 103 into image data in the YUV data format. The A / D conversion unit 103 can be configured by a WB circuit, a γ correction circuit, a matrix conversion circuit, and the like.

  The digital signal processing unit 104 extracts AF data from the digital signal output from the A / D conversion unit 103 in accordance with the reading mode of the image sensor 101.

  The CPU 108 determines the position of the focus detection pixels (S1, S2) based on the position pattern information of the distance measurement cells recorded in the ROM built in the CPU 108, and determines the pixel signal of this portion as a peripheral pixel. Interpolate more. For example, when S1 in FIG. 2 is interpolated, a known bicubic method or the like may be used using pixel signals of peripheral R pixels. Thereafter, the image data is converted into image data in the YUV data format. Further, processing such as γ correction is performed on the image data in the YUV data format.

  The phase difference detection unit 105 performs phase difference detection based on the AF data output from the digital signal processing unit 104. Here, details of phase difference detection by the image sensor are described in Japanese Patent Application Laid-Open No. 2000-156823, and thus detailed description thereof is omitted. In brief, in the conceptual diagram of the image sensor shown in FIG. 2, an approximate image is formed on the microlens with the S1 row and the S2 row almost the same line. If the camera lens that connects the image to the image sensor is in focus on the image sensor, the image signal from the S1 group in the row including S1 matches the image signal from the signal group in the S2 group in the row including S2. To do. If the point connecting the focus is in front of or behind the image plane of the image sensor, the phase difference between the image signal from the S1 group in the row including S1 and the image signal from the signal group in the S2 group in the row including S2 Occurs. Then, the phase shift direction is reversed between the case where the image formation point is before and the case where the image formation point is after. In principle, this is the same as the pupil division phase difference AF. Based on this principle, the image formed by S1 (a signal line due to the intensity of light) and the image formed by S2 coincide with each other if the camera lens is in focus, and otherwise deviate.

  Next, the phase difference detection result obtained by the phase difference detection unit 105 is sent to the CPU 108. The CPU 108 outputs a control signal to the lens barrel control unit 111 based on the detection result sent from the phase difference detection unit 105.

  The operation unit 112 includes a button for switching the shooting mode between still image shooting and moving image shooting, a setting switch such as a shutter switch, and the like. The CPU 108 sends a control signal to the timing control unit 109 according to the shooting mode set by the operation unit 112. The timing generator 110 functions as a drive signal generation unit that generates a read drive signal for image data based on a control signal from the timing control unit 109. The method for reading data from the image sensor 101 changes by switching the read drive signal in accordance with the shooting mode.

  A method of switching the reading mode of the image sensor 101 according to the shooting mode will be described later.

  The YUV data format image data output from the digital signal processing unit 104 is temporarily stored in the memory 107 via the memory I / F 106 for EVF display. The LCD I / F 113 reads the image data in the YUV data format stored in the memory 107 through the memory I / F 106 and converts it into the display format of the LCD 114. The LCD 114 performs EVF display based on the image data output from the LCD I / F 113.

  Further, during image recording, image data in the YUV data format output from the digital signal processing unit 104 is compressed in accordance with a standard such as JPEG in the compression recording unit 115 via the memory I / F 106 and recorded on the recording medium 116. .

  Next, a method for switching the readout mode of the image sensor 101 during the above-described still image shooting will be described with reference to FIG.

  Here, the first reading mode for reading all lines is a still image mode. In addition, as shown in FIG. 2, in the mode in which lines are thinned out and read out from the image sensor, the second readout mode in which lines with many focus detection pixels are read is referred to as EVF mode. The third readout mode for reading out lines with few focus detection pixels is a moving image mode.

  It is assumed that the processing flow starts when the power of the imaging apparatus of the present embodiment is ON and the shooting mode is set to the still image shooting mode in the operation unit 112. Note that the following processing is performed by the CPU 108 unless otherwise specified.

  In S100, the timing generator 110 is set to the EVF mode. As a result, a line with many focus detection pixels is read out from the image sensor 101.

  In S101, it is determined whether or not the shutter switch of the operation unit 112 is half pressed. If the shutter switch is not half-pressed (“NO” in S101), S101 is repeated. When the shutter switch is half pressed (“YES” in S101), the process proceeds to S102.

  In S102, phase difference detection is performed using AF data extracted from image data read from the image sensor 101. Then, the lens barrel control unit 111 moves the lens barrel to move the lens position so as to reduce the phase difference, thereby adjusting the focus.

  In S103, the state of the shutter switch is determined. Here, if the shutter switch is kept half pressed, S103 is repeated. If the shutter switch is away, the process returns to S101. If the shutter switch is fully pressed, the process proceeds to S104.

  In S104, the timing generator 110 is set to the still image mode. In the still image mode, the captured image is read from all lines in the image sensor 101.

  In S <b> 105, the read captured image (still image) is captured and recorded on the recording medium 116.

  Thereafter, the processing flow from S100 is repeated until the power is set to OFF by the operation unit 112.

  With the processing flow described above, AF accuracy can be increased for high resolution in still image shooting in the present embodiment. Thereby, during EVF, a line with many focus detection pixels is read from the image sensor 101, and autofocus and EVF display are performed. When recording a still image, all lines of the image sensor 101 are read out. As a result, a high resolution image can be recorded.

  Next, a method of switching the reading mode of the image sensor 101 during moving image shooting will be described with reference to FIG.

  It is assumed that the processing flow starts when the power of the imaging apparatus of the present embodiment is ON and the shooting mode is set to the still image shooting mode in the operation unit 112. Note that the following processing is performed by the CPU 108 unless otherwise specified.

  In S200, the timing generator 110 is set to the moving image mode. As a result, a line with few focus detection pixels is read from the image sensor 101.

  In S201, autofocus is performed. Autofocus performs phase difference detection using AF data extracted from image data read from the image sensor 101, as in still image shooting. Then, the lens barrel control unit 111 moves the lens barrel to move the lens position so as to reduce the phase difference, thereby adjusting the focus.

  In S202, it is determined whether or not the moving image shooting start button has been pressed on the operation unit 112. If the moving image shooting start button is not pressed (“NO” in S202), the process proceeds to S203. If the moving image shooting start button is pressed (“YES” in S202), the process proceeds to S204. .

  In S203, the timer is compared with a preset value to determine how much time has elapsed since the previous autofocus. Although FIG. 5 shows an example in which the timer is compared with 0.2 seconds, the present invention is not limited to this. If 0.2 seconds or more have elapsed ("YES" in S203), the process returns to S201, and autofocus is performed again. If 0.2 seconds or more have not elapsed (“NO” in S203), S202 is repeated.

  In S <b> 204, a moving image is captured and the image data is recorded on the recording medium 116.

  In S205, it is determined whether or not the moving image shooting end button has been pressed on the operation unit 112. When the moving image shooting end button is pressed (“YES” in S205), the process returns to S202. When the moving image shooting end button is not pressed (“NO” in S205), the process proceeds to S206.

  In S206, it is determined whether or not a preset time (for example, 0.2 seconds in FIG. 5) or more has elapsed since the previous autofocus was performed until the process proceeds to S206. If 0.2 seconds or more have elapsed ("YES" in S206), the process proceeds to S207 and autofocus is performed again. Thereafter, the process returns to S204, where the moving image is captured and the image data is recorded on the recording medium 116.

  If it is not longer than 0.2 seconds in S206 ("NO" in S206), the process returns to S204 without performing autofocus, captures a moving image, and records the image data on the recording medium 116. Thereafter, the processing flow from S200 is repeated until the power is set to OFF by the operation unit 112.

  With the above processing flow, in moving image shooting in the present embodiment, a line with fewer focus detection pixels is read from the image sensor 101 in order to record a moving image with better image quality than EVF during still image shooting. This makes it possible to record a moving image with better image quality than an EVF image.

(Second Embodiment)
In the first embodiment, as shown in FIG. 2, focus detection pixels are always included in every line of the image sensor 101. In contrast, in the second embodiment, as shown in FIG. 3, there is a third line (corresponding to an arrow of “record display”) that does not include the focus detection pixels in the image sensor 101. Hereinafter, switching of the readout mode of the image sensor according to the present embodiment will be described. The block diagram of the imaging apparatus according to the present embodiment is the same as FIG.

  Here, switching of the reading mode of the image sensor 101 during still image shooting according to the present embodiment will be described with reference to FIG.

  Here, the first reading mode for reading all lines without thinning out is set as a still image mode. Further, in the mode in which lines are thinned out and read out from the image sensor 101 as shown in FIG. 3, the second readout mode is used to read out the lines with many focus detection pixels for phase difference AF (two in one line in FIG. 3). Is set to EVF_AF mode. Also, a third readout mode for reading out lines with few focus detection pixels (one per line in FIG. 3) is a moving image_AF mode. The fourth read mode for reading a line without focus detection pixels is a recording display mode.

  It is assumed that the processing flow starts when the power of the imaging apparatus of the present embodiment is ON and the shooting mode is set to the still image shooting mode in the operation unit 112.

  In S300, the timing generator 110 is set to the recording display mode. As a result, a line not including focus detection pixels is read from the image sensor 101.

  In S301, it is determined whether or not the shutter switch of the operation unit 112 is half pressed. If the shutter switch is not half-pressed (“NO” in S301), S301 is repeated. If the shutter switch is half-pressed (“YES” in S301), the process proceeds to S302.

  In S302, the timing generator 110 is set to the EVF_AF mode. As a result, a line with many focus detection pixels is read out from the image sensor 101.

  In S303, phase difference detection is performed using AF data extracted from image data read from the image sensor 101. Then, the lens barrel control unit 111 moves the lens barrel to move the lens position so as to reduce the phase difference, thereby adjusting the focus.

  In S304, the state of the shutter switch is determined. Here, if the shutter switch is kept half pressed, S304 is repeated. If the shutter switch is released, the process returns to S300. When the shutter switch is fully pressed, the process proceeds to S305.

  In S305, the timing generator 110 is set to the still image mode. In the still image mode, the image sensor 101 reads image data from all lines.

  In S <b> 306, the read image data is captured and recorded on the recording medium 116. Thereafter, the processing flow from S300 is repeated until the power source is set to the OFF state by the operation unit 112.

  With the above processing flow, in still image shooting according to the present embodiment, the following processing is performed in order to improve the image quality of EVF when AF is not performed. That is, when autofocus is not performed, a line that does not include focus detection pixels for phase difference AF in the image sensor is read and EVF display is performed. When performing AF, in order to increase AF accuracy for high resolution, a line with many focus detection pixels is read from the image sensor, and autofocus and EVF display are performed. Furthermore, when recording a still image, it is possible to record a high-resolution image by reading all lines of the image sensor.

  Next, a method of switching the readout mode of the image sensor 101 during moving image shooting will be described with reference to FIG.

  It is assumed that the processing flow starts when the power of the imaging apparatus of the present embodiment is ON and the shooting mode is set to the still image shooting mode in the operation unit 112.

  In S400, the timing generator 110 is set to the moving image_AF mode. As a result, a line with few focus detection pixels is read from the image sensor 101.

  In S401, autofocus is performed. Autofocus performs phase difference detection using AF data extracted from image data read from the image sensor 101, as in still image shooting. Then, the lens barrel control unit 111 moves the lens barrel to move the lens position so as to reduce the phase difference, thereby adjusting the focus.

  In S402, the timing generator 110 is set to the recording display mode. As a result, a line not including focus detection pixels is read from the image sensor 101.

  In S403, it is determined whether or not the moving image shooting start button is pressed on the operation unit 112. If the moving image shooting start button has not been pressed (“NO” in S403), the process proceeds to S404.

  In S404, the timer is compared with a preset value to determine how much time has elapsed since the previous autofocus. Although FIG. 7 shows an example in which the timer is compared with 0.2 seconds, the present invention is not limited to this. If 0.2 seconds or more have elapsed (“YES” in S404), the process returns to S400. If 0.2 seconds or more have not elapsed (“NO” in S404), S403 is repeated.

  In S405, the moving image is captured and the image data is recorded on the recording medium 116.

  In S406, it is determined whether or not the moving image shooting end button is pressed on the operation unit 112. When the moving image shooting end button is pressed (“YES” in S406), the process returns to S403. If the shooting end button is not pressed (“NO” in S406), the process proceeds to S407.

  In S407, it is determined whether or not a preset time (for example, 0.2 seconds in FIG. 7) has passed since the previous autofocus was performed and the process proceeds to S407. If 0.2 seconds or more have not elapsed (“NO” in S407), the process returns to S405, the moving image is captured, and the image data is recorded on the recording medium 116. If 0.2 seconds or more have elapsed ("YES" in S407), the process proceeds to S408.

  In S408, the timing generator 110 is set to the moving image_AF mode. As a result, a line with few focus detection pixels is read from the image sensor 101.

  In step S409, autofocus is performed.

  In S410, a moving image is captured and the image data is recorded on the recording medium 116. The image recorded at this time is an image generated from image data read from the timing generator 110 in the moving image_AF mode.

  In S411, the timing generator 110 is set to the recording display mode. Thereafter, the process returns to S405 and the processing flow is repeated. After this, the processing flow from S400 is repeated until the power is set to OFF by the operation unit 112.

  With the above processing flow, in the moving image shooting in the present embodiment, when autofocusing is not performed, a line that does not include the photoelectric conversion element for phase difference AF is read from the image sensor 101. When autofocusing is performed, a line with fewer focus detection pixels is read from the image sensor 101 in order to record a moving image with better image quality than EVF during still image shooting. This makes it possible to record a moving image with better image quality than an EVF image.

101 Imaging elements R, G, B Imaging pixels S1, S2 Focus detection pixels

Claims (6)

An imaging device in which a first pixel for imaging for forming image data and a second pixel for focus detection for performing phase difference autofocus are arranged, and the number of the second pixels is N. An image sensor having a first line arranged (N is an integer of 2 or more) and a second line arranged with M second pixels (M is a natural number not including zero smaller than N). A control device for controlling
A first read mode for reading the first line and the second line of the image sensor, a second read mode for reading the first line, and a third read mode for reading the second line; control apparatus characterized by comprising control means for controlling so as to read an image signal from the imaging device by switching. Further comprising display means for displaying an image based on an imaging signal output from the imaging element;
The control unit records a captured image based on the imaging signal output from the imaging element in the first readout mode in a memory, and is output from the imaging element to the display unit in the second readout mode. 2. The control apparatus according to claim 1, wherein control is performed so as to display a captured image based on the captured image signal. Wherein, in the third read mode, the control device according to moving image based on the imaging signal outputted from the imaging device to claim 2, characterized in that controls to record into the memory. An imaging device in which a first pixel for imaging for forming image data and a second pixel for focus detection for performing phase difference autofocus are arranged, and the number of the second pixels is N. A first line arranged (N is an integer of 2 or more), a second line arranged with M second pixels (M is a natural number not including zero smaller than N), and the second line A control device that controls the image sensor in which the third line in which the pixels are not arranged is periodically arranged,
A first read mode for reading the first, second, and third lines of the image sensor, a second read mode for reading the first line, and a third read for reading the second line. A control apparatus comprising: control means for controlling to read out an imaging signal from the imaging element by switching between a mode and a fourth readout mode for reading out the third line. Further comprising display means for displaying an image based on an imaging signal output from the imaging element;
The control unit records a captured image based on the imaging signal output from the imaging element in the first readout mode in a memory, and is output from the imaging element to the display unit in the second readout mode. 5. The control unit according to claim 4, wherein a captured image based on the captured image signal is displayed, and focus detection is performed based on the captured image signal output from the image sensor in the third readout mode. Control device. The control device according to claim 5, wherein the control unit records a moving image based on an imaging signal output from the imaging element in a memory in the third readout mode.

Images