JP4859787B2 - Imaging apparatus and image processing method - Google Patents

Description

  The present invention relates to an imaging apparatus and an image processing method having an autofocus function for automatically adjusting the focus of a camera, an automatic exposure function for automatically adjusting the exposure time of a camera, and the like.

A conventional imaging device performs image recognition processing to detect the moving speed of an approaching object, and controls the shutter speed according to the moving speed of the approaching object, thereby enabling recording of a blur-free image. It has a function.
In addition, image recognition processing is performed to detect the brightness in the vicinity of the approaching object, and the aperture is controlled according to the brightness in the vicinity of the approaching object, so that an image with appropriate luminance can be recorded. It has a function (see, for example, Patent Document 1).

JP 2004-343803 A (paragraph numbers [0024] to [0028], FIG. 1)

Since the conventional imaging apparatus is configured as described above, for example, when flicker occurs when shooting under illumination using an indoor fluorescent lamp as a light source, stripe-like luminance shading occurs in the captured image of the camera. . Since the brightness of the striped brightness moves from frame to frame, there is a problem that the approaching object cannot be recognized correctly and the brightness control on the approaching object cannot be performed properly.
Further, when there are a plurality of subjects at the same time in the captured image of the camera, there is a problem that it is not possible to accurately detect the entering object only by detecting the movement of each subject.

The present invention has been made to solve the above-described problems, and it is an object of the present invention to obtain an imaging apparatus and an image processing method that can sharpen an image of a subject that is an entering object even if flicker occurs. Objective.
Another object of the present invention is to provide an imaging device that can easily detect a subject that is an entering object even when a plurality of subjects are present simultaneously in a captured image of a camera.

  An image pickup apparatus according to the present invention analyzes image data generated by a camera and detects motion of a subject existing in the picked-up image, and each line of the picked-up image from the image data generated by the camera. Is provided with flicker occurrence status specifying means for determining the flicker occurrence status from the integrated pixel value for each line and the exposure time and frame rate of the camera, and the motion correction means identifies the flicker occurrence status. The motion of the subject detected by the motion detection means is corrected according to the flicker occurrence status specified by the means.

  According to the present invention, the image data generated by the camera is analyzed to detect the motion of the subject existing in the captured image, and the pixel for each line of the captured image from the image data generated by the camera. A flicker occurrence status specifying means for determining the flicker occurrence status from the integrated value of the pixel value for each line and the exposure time and frame rate of the camera is provided, and the motion correction means is provided by the flicker occurrence status specifying means. Since the movement of the subject detected by the motion detection unit is corrected according to the identified flicker occurrence state, the image of the subject that is the entering object can be sharpened even if flicker occurs. There is an effect that can be done.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing an image pickup apparatus according to Embodiment 1 of the present invention. In the figure, a camera module 1 has a lens system that forms incident light and an autofocus that moves the lens system to adjust the focus. A lens moving mechanism for processing and an image sensor that converts an optical image formed by the lens system into an electrical signal and generates image data of a captured image indicating a signal level of each color component (R, G, B) And.
The image input unit 2 performs format conversion of the image data generated by the camera module 1, clipping of an effective image area, and the like, and outputs image data in a data format that can be processed by the subsequent image processing unit 3.

The image processing unit 3 performs image processing (for example, pixel interpolation processing, gradation conversion processing, color correction processing) on the image data processed by the image input unit 2, and performs imaging control such as autofocus processing and automatic exposure processing. Perform the process.
The image output unit 4 performs processing for converting the image output size and data format of the image data after the image processing by the image processing unit 3 into one suitable for the image recording device 5.
The image recording device 5 performs a process of recording the image data output from the image output unit 4 in an image memory.

The motion detection processing unit 11 of the image processing unit 3 analyzes the image data processed by the image input unit 2 and performs a process of detecting the motion of the subject existing in the captured image. The motion detection processing unit 11 constitutes motion detection means.
The pixel value integrating unit 12 performs a process of calculating an integrated value of pixel values for each line of the captured image from the image data processed by the image input unit 2.
The flicker detection processing unit 13 calculates the flicker from the integrated value of the pixel values for each line of the captured image calculated by the pixel value integration unit 12 and the exposure time and frame rate of the camera module 1 calculated by the automatic exposure processing unit 17. The processing for specifying the occurrence status (occurrence of flicker occurrence, flicker occurrence intensity, flicker moving direction and moving speed) is performed.
Here, the flicker detection processing unit 13 has been shown to identify the flicker occurrence state from the integrated value of the pixel values for each line of the captured image, the exposure time and the frame rate of the camera module 1, but will be described later. In addition, the flicker occurrence status may be specified from the frequency of the power source, the exposure time and the frame rate of the camera module 1.
The pixel value integrating unit 12 and the flicker detection processing unit 13 constitute flicker occurrence status specifying means.

  The motion detection correction unit 14 corrects the motion of the subject detected by the motion detection processing unit 11 according to the flicker occurrence status specified by the flicker detection processing unit 13, and flickers from the motion detection result of the motion detection processing unit 11. Implement processing to eliminate the effects of The motion detection / correction unit 14 constitutes a motion correction unit.

The focus detection unit 15 extracts a high-frequency component of the image data processed by the image input unit 2, and performs a process of calculating an index value indicating the focus state of the subject from the high-frequency component.
The autofocus processing unit 16 sets a detection window for autofocus processing in accordance with the movement of the subject corrected by the motion detection correction unit 14, and the camera module 1 according to the index value calculated by the focus detection unit 15. By controlling the lens moving mechanism, the process of adjusting the focus of the image sensor of the camera module 1 is performed.
The focus detection unit 15 and the autofocus processing unit 16 constitute an autofocus processing means.

  The automatic exposure processing unit 17 performs automatic exposure of the captured image around a point where the subject moves, and the integrated value of the pixel value for each line of the captured image calculated by the pixel value integrating unit 12 and the motion detection. From the movement of the subject corrected by the correction unit 14, the exposure time of the camera module 1 and the gain magnification of the analog gain amplifier are calculated, and the exposure time of the camera module 1 and the gain magnification of the analog gain amplifier are adjusted. To do. Note that the automatic exposure processing unit 17 constitutes an automatic exposure processing means.

The image quality adjustment processing unit 18 performs image processing (for example, pixel interpolation processing, gradation conversion processing, color correction processing) on the image data processed by the image input unit 2, and performs gradation processing and color reproduction of the image data. Adjust gender.
FIG. 2 is a flowchart showing an image processing method of the imaging apparatus according to Embodiment 1 of the present invention.

Next, the operation will be described.
The image sensor of the camera module 1 converts the optical image formed by the lens system into an electrical signal, and generates image data of the captured image indicating the signal level of each color component (R, G, B) (step ST1). ).
When the camera module 1 generates image data of a captured image, the image input unit 2 performs format conversion of the image data, extraction of an effective image area, and the like, and data that can be processed by the subsequent image processing unit 3 Format image data is output.

When the image processing unit 3 receives the image data from the image input unit 2, the image processing unit 3 performs image processing (for example, pixel interpolation processing, gradation conversion processing, color correction processing) on the image data, and performs autofocus processing and automatic exposure. An imaging control process such as a process is performed.
Hereinafter, the processing content of the image processing unit 3 will be specifically described.

When the motion detection processing unit 11 receives the image data from the image input unit 2, the motion detection processing unit 11 analyzes the image data and detects the motion of the subject existing in the captured image (step ST2).
Here, FIG. 3 is an explanatory diagram showing an example of a subject motion detection method.
Hereinafter, the subject motion detection processing in the motion detection processing unit 11 will be described in detail.

First, when receiving the image data from the image input unit 2, the motion detection processing unit 11 divides the image data into blocks of a plurality of frames (divides the image data in the horizontal direction and the vertical direction) as shown in FIG. To do.
When dividing the image data into blocks of a plurality of frames, the motion detection processing unit 11 integrates the pixel values in each divided image in the horizontal direction to create horizontal projection data, and the pixel values in each divided image in the vertical direction. To create vertical projection data.

When creating the horizontal projection data and the vertical projection data, the motion detection processing unit 11 shifts the projection data (horizontal projection data, vertical projection data) of the frame (2) one pixel at a time in order, for example. By comparing with projection data (horizontal projection data, vertical projection data), an amount with the highest degree of similarity is detected as an amount indicating the movement of the subject between frames.
As a method for calculating the similarity in the motion detection processing unit 11, for example, there is a method in which the absolute values of differences between projection data are integrated, and the similarity is determined to be higher as the integrated value is smaller.
Instead of calculating the inclination and curvature of the projection data as the feature amount and calculating the similarity of the projection data, the similarity between the feature amounts may be calculated.

When receiving the image data from the image input unit 2, the pixel value integrating unit 12 calculates an integrated value of the pixel values for each line of the captured image from the image data (step ST3).
The flicker detection processing unit 13 calculates the integrated value of the pixel value for each line of the captured image and the automatic exposure processing unit 17 when the pixel value integration unit 12 calculates the integrated value of the pixel value for each line of the captured image. From the exposure time and frame rate of the camera module 1, the flicker occurrence status (whether flicker is generated, flicker generation intensity, flicker moving direction and moving speed) is specified (step ST4).

Here, “flicker” refers to, for example, an imaging cycle of an image by the imaging device of the camera module 1 and an illumination blinking cycle when shooting is performed under a light source that periodically blinks at high speed like a fluorescent lamp. This is a flickering phenomenon of a photographed image that occurs due to the proximity of.
In particular, when the image sensor is an element of a different type (for example, a CMOS sensor) in which the readout timing of the image signal is different for each pixel, the flicker appears as a stripe pattern of luminance gradation on the captured image.

The intensity shading stripes generated by the flicker are determined by the relationship between the exposure time of the camera module 1 and the flickering cycle of the illumination, and the generation intensity increases as the exposure time of the camera module 1 is shorter. ing. In addition, as the exposure time is closer to an integral multiple of the blinking cycle of illumination, the generated intensity is weakened.
The period of the fringes generated on the captured image varies depending on the blinking period of the illumination, and the moving speed of the stripes is determined by the relationship between the blinking period of the illumination and the output frame rate of the image sensor.

The flicker detection processing unit 13 specifies the flicker occurrence status with high accuracy in consideration of the nature of the flicker that occurs. Specifically, the flicker occurrence status is specified as follows. Yes.
That is, the flicker detection processing unit 13 determines the presence or absence of shading between lines on the captured image from the integrated value of the pixel values for each line of the captured image calculated by the pixel value integrating unit 12 (for example, each If the level difference of the line shade exceeds the reference level, it is determined that the shade between the lines has occurred). If the shade between the lines has occurred, the line interval is obtained and flicker occurs. The presence / absence of light and the blinking cycle of the illumination are determined.

At this time, the lighting blinking cycle can be obtained from the integrated value of the pixel value for each line, but the power frequency of electricity in Japan is either 50 Hz or 60 Hz, and the frequency used for each region is Therefore, in devices equipped with mobile phone functions, use base station information for wireless communication is used to identify the use region, determine the power frequency from the use region, and determine the lighting blinking cycle from the power frequency. You may make it ask.
Alternatively, a GPS may be installed, a use area may be specified from current position information obtained from the GPS, a power frequency may be determined from the use area, and a lighting blinking period may be obtained from the power frequency.
From the presence / absence of occurrence of flicker and the blinking cycle of the illumination determined as described above, and the exposure time and frame rate information of the image sensor calculated by the automatic exposure processing unit 17, information on the density of the stripes and the moving direction is obtained.

When the flicker detection processing unit 13 specifies the flicker occurrence status, the motion detection correction unit 14 corrects the motion of the subject detected by the motion detection processing unit 11 according to the flicker occurrence status, and the motion detection processing unit The effect of flicker is excluded from the motion detection result of step 11 (step ST5).
That is, the motion detection correction unit 14 refers to the flicker occurrence status specified by the flicker detection processing unit 13 (whether flicker occurs, flicker generation intensity, flicker moving direction and moving speed), and the motion detection processing unit 11 removes the effect of flicker from the information on the motion of the subject for each block detected in step 11, and extracts only the motion information based on the actual motion of the subject.

Here, FIG. 4 is an explanatory diagram showing an example of a motion detection information correction method by the motion detection correction unit 14.
When flicker occurs, the information obtained from the motion detection processing unit 11 as subject motion information is the sum of the actual subject motion and the flicker motion due to flicker.
Therefore, as shown in FIG. 4, the motion detection / correction unit 14 uses the flicker detection information output from the flicker detection processing unit 13 based on the motion detection information output from the motion detection processing unit 11 (such as the density and movement of stripes caused by flicker). The amount of motion detection obtained from the speed and the method corresponding to the motion detection method) are excluded.

Since flicker occurs in a direction perpendicular to the scanning direction of the captured image, corrected motion detection information can be obtained by subtracting motion detection information for a specific intensity in the vertical direction from actual motion detection information. .
Since the corrected motion detection information obtained in this way excludes the occurrence of flicker, it is possible to detect motion with high accuracy even when shooting under a flicker occurrence.

When receiving the image data from the image input unit 2, the focus detection unit 15 extracts a high-frequency component of the image data, and calculates an index value indicating the focus state of the subject from the high-frequency component (step ST6). Since the calculation of the index value indicating the in-focus state of the subject is a known technique, the description thereof is omitted.
Upon receipt of the corrected subject motion detection information from the motion detection correction unit 14, the autofocus processing unit 16 sets a detection window for autofocus processing at the position of the subject motion indicated by the motion detection information. The focus of the image sensor of the camera module 1 is adjusted by controlling the lens moving mechanism of the camera module 1 according to the index value calculated by the focus detection unit 15 (step ST7).

  When the automatic exposure processing unit 17 receives the corrected motion detection information of the subject from the motion detection correction unit 14, the automatic exposure processing unit 17 performs automatic exposure of the captured image around the position of the motion of the subject indicated by the motion detection information. The exposure time of the camera module 1 and the gain magnification of the analog gain amplifier are calculated from the motion detection information of the subject and the integrated value of the pixel value for each line of the captured image calculated by the pixel value integrating unit 12, and the camera module 1 and the gain magnification of the analog gain amplifier are adjusted (step ST8).

When the image quality adjustment processing unit 18 receives the image data from the image input unit 2, the image quality adjustment processing unit 18 performs image processing (for example, pixel interpolation processing, gradation conversion processing, color correction processing) on the image data, and converts the level of the image data. Tonality and color reproducibility are adjusted (step ST9).
When the image quality adjustment processing unit 18 of the image processing unit 3 performs image processing for adjusting the gradation and color reproducibility of the image data, the image output unit 4 sets the image output size and data format of the image data after the image processing. The image is converted into one suitable for the image recording device 5.
When the image recording device 5 receives the image data whose image output size or data format has been converted from the image output unit 4, the image recording device 5 records the image data in the image memory (step ST10).

As apparent from the above, according to the first embodiment, the motion detection processing unit 11 that analyzes the image data generated by the camera module 1 and detects the motion of the subject existing in the captured image, and the camera A pixel value integrating unit 12 that calculates an integrated value of pixel values for each line of the captured image from the image data generated by the module 1, an integrated value of pixel values for each line calculated by the pixel value integrating unit 12, and a camera module A flicker detection processing unit 13 for specifying the flicker occurrence status from the exposure time and the frame rate of 1, and the motion correction processing unit 14 according to the flicker occurrence status specified by the flicker detection processing unit 13. Since the movement of the subject detected by the correction is corrected, even if flicker occurs, the image of the subject that is the approaching object is sharpened. An effect that can bet.
As a result, in a monitoring camera, etc., it is possible to adjust the focus to the location where there was a change in the captured image and to adjust the exposure conditions. It is possible to record a captured image under focus conditions and exposure conditions that are easy to perform.

Embodiment 2. FIG.
5 is a block diagram showing an image pickup apparatus according to Embodiment 2 of the present invention. In the figure, the same reference numerals as those in FIG.
The color discrimination processing unit 19 analyzes the image data whose gradation property and color reproducibility have been adjusted by the image quality adjustment processing unit 18, specifies the colors of one or more subjects existing in the captured image, and the subject A process of determining whether or not the color matches the specific color is performed. The color discrimination processing unit 19 constitutes subject color discrimination means.
The motion detection / correction unit 20 performs a process for correcting the movement of the subject in the same manner as the motion detection / correction unit 14 of FIG. From the results, a process of removing the motion detection result of the subject whose color does not match the specific color is performed. The motion detection / correction unit 20 constitutes a motion correction unit.

Next, the operation will be described.
When the image quality adjustment processing unit 18 performs image processing for adjusting the gradation and color reproducibility of the image data, the color discrimination processing unit 19 outputs signals of each color component (R, G, B) in the image data after the image processing. With reference to the level, the color of one or more subjects existing in the captured image is specified.
When the color determination processing unit 19 specifies the color of one or more subjects existing in the captured image, the color determination processing unit 19 determines whether the color of each subject matches the specific color, and matches the specific color. The subject presence area information indicating the area where the subject is present is output to the motion detection and correction unit 20.

The motion detection / correction unit 20 performs processing for correcting the movement of the subject in the same manner as the motion detection / correction unit 14 of FIG.
When the motion detection correction unit 20 receives the subject presence area information from the color discrimination processing unit 19, the motion detection correction unit 20 selects the subject presence area from the one or more subject motion detection information indicated by the motion detection result of the motion detection processing unit 11. The motion detection information of the subject existing outside the area indicated by the information is removed.
That is, only the motion detection information of the subject existing in the area indicated by the subject presence area information is extracted from the motion detection information of one or more subjects indicated by the motion detection result of the motion detection processing unit 11.
Here, FIG. 6 is an explanatory diagram illustrating an example of a method of correcting motion detection information by the motion detection / correction unit 20.
In the example of FIG. 6, the movement of three subjects is detected, but since there is one subject of a specific color (subject surrounded by a dotted line), only the motion detection information of one subject is extracted. It shows how it is.

  As apparent from the above, according to the second embodiment, the motion detection correction unit 20 refers to the discrimination result of the color discrimination processing unit 19 and the color is selected from the motion detection results of the motion detection processing unit 11. Since the motion detection information of the subject that does not match the specific color is removed, for example, even when there are a plurality of subjects at the same time in the captured image of the camera module 1, for example, the color of the approaching object is determined in advance. In such a case, it is possible to easily detect a subject that is an entering object.

Embodiment 3 FIG.
7 is a block diagram showing an image pickup apparatus according to Embodiment 3 of the present invention. In the figure, the same reference numerals as those in FIG.
The subject shape determination processing unit 21 analyzes the image data in which the gradation property and the color reproducibility are adjusted by the image quality adjustment processing unit 18 and specifies the shape of one or more subjects existing in the captured image. Processing for determining whether or not the shape of the subject matches the specific shape is performed. The subject shape discrimination processing unit 21 constitutes a subject shape discrimination means.
The motion detection / correction unit 22 performs a process of correcting the movement of the subject in the same manner as the motion detection / correction unit 14 in FIG. 1, and refers to the determination result of the subject shape determination processing unit 21 to move the motion detection processing unit 11. From the detection results, a process of removing the motion detection result of the subject whose shape does not match the specific shape is performed. The motion detection / correction unit 22 constitutes a motion correction unit.

Next, the operation will be described.
When the image quality adjustment processing unit 18 performs image processing for adjusting the gradation and color reproducibility of the image data, the subject shape determination processing unit 21 analyzes the image data after the image processing and exists in the captured image. It is determined whether or not one or more subjects existing in the captured image match the specific shape by performing pattern matching between the shape of the one or more subjects and the specific shape set in advance. Determine.
When the subject shape determination processing unit 21 determines whether or not one or more subjects existing in the captured image match a specific shape, the subject shape determination processing unit 21 indicates an area where a subject matching the specific shape exists. The subject presence area information is output to the motion detection / correction unit 22.

The motion detection / correction unit 22 performs processing for correcting the movement of the subject in the same manner as the motion detection / correction unit 14 of FIG.
In addition, when the motion detection correction unit 22 receives the subject presence area information from the subject shape determination processing unit 21, the motion detection correction unit 22 detects the subject presence from the motion detection information of one or more subjects indicated by the motion detection result of the motion detection processing unit 11. The motion detection information of the subject existing outside the area indicated by the area information is removed.
That is, only the motion detection information of the subject existing in the area indicated by the subject presence area information is extracted from the motion detection information of one or more subjects indicated by the motion detection result of the motion detection processing unit 11.
Here, FIG. 8 is an explanatory diagram showing an example of a method of correcting motion detection information by the motion detection correction unit 22.
In the example of FIG. 8, the movement of three subjects is detected, but since there is one subject having a specific shape (subject surrounded by a dotted line), only the motion detection information of one subject is extracted. It shows how it is.

  As is apparent from the above, according to the third embodiment, the motion detection / correction unit 22 refers to the determination result of the subject shape determination processing unit 21 and determines the shape from the motion detection results of the motion detection processing unit 11. Since the motion detection information of the subject that does not match the specific shape is removed, even if there are a plurality of subjects at the same time in the captured image of the camera module 1, for example, the shape of the approaching object is previously When it is known, there is an effect that it is possible to easily detect a subject that is an entering object.

BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram which shows the imaging device by Embodiment 1 of this invention. It is a flowchart which shows the image processing method of the imaging device by Embodiment 1 of this invention. It is explanatory drawing which shows an example of the motion detection method of a to-be-photographed object. It is explanatory drawing which shows an example of the correction method of the motion detection information by the motion detection correction part. It is a block diagram which shows the imaging device by Embodiment 2 of this invention. It is explanatory drawing which shows an example of the correction method of the motion detection information by the motion detection correction part. It is a block diagram which shows the imaging device by Embodiment 3 of this invention. It is explanatory drawing which shows an example of the correction method of the motion detection information by the motion detection correction part 22. FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Camera module, 2 Image input part, 3 Image processing part, 4 Image output part, 5 Image recording apparatus, 11 Motion detection process part (motion detection means), 12 Pixel value integration part (Flicker generation condition identification means), 13 Flicker Detection processing unit (flicker occurrence status specifying unit) 14, 20, 22 Motion detection correction unit (motion correction unit), 15 Focus detection unit (autofocus processing unit), 16 Autofocus processing unit (autofocus processing unit), 17 automatic exposure processing unit (automatic exposure processing unit), 18 image quality adjustment processing unit, 19 color discrimination processing unit (subject color discrimination unit), 21 subject shape discrimination processing unit (subject shape discrimination unit).

Claims (6)

  A camera that forms incident light to generate image data of a captured image; a motion detection unit that analyzes image data generated by the camera and detects a motion of a subject existing in the captured image; and Flicker generation that determines the flicker generation status from the integrated value of the pixel value for each line, the exposure time of the camera, and the frame rate from the image data generated by the camera, for each line of the captured image Situation specifying means, motion correcting means for correcting the motion of the subject detected by the motion detecting means in accordance with the flicker occurrence status specified by the flicker occurrence status specifying means, and the subject corrected by the motion correction means Auto-focus processing means for adjusting the focus of the camera in accordance with the movement of the camera, and the subject corrected by the motion correction means. In accordance with the come, imaging apparatus having an automatic exposure processing means for adjusting the exposure time of the camera.   The motion correction unit analyzes the image data generated by the camera, specifies one or more subject colors existing in the captured image, and determines whether the subject color matches the specific color. When the subject color discriminating means for discrimination is mounted, the motion detection of the subject whose color does not match the specific color from the motion detection results of the motion detection means with reference to the discrimination result of the subject color discrimination means The imaging apparatus according to claim 1, wherein a result is removed.   The motion correction unit analyzes the image data generated by the camera, specifies the shape of one or more subjects existing in the captured image, and determines whether the shape of the subject matches the specific shape. When the subject shape discriminating means to be discriminated is mounted, referring to the discrimination result of the subject shape discriminating means, the motion detection of the subject whose shape does not match the specific shape from the motion detection results of the motion detecting means The imaging apparatus according to claim 1, wherein a result is removed.   A camera that forms incident light to generate image data of a captured image, a motion detection unit that analyzes image data generated by the camera and detects a motion of a subject existing in the captured image, and a power source Flicker occurrence status specifying means for specifying the flicker occurrence status from the frequency of the image, the exposure time and the frame rate of the camera, and the motion detection means detected according to the flicker occurrence status specified by the flicker occurrence status specifying means. A motion correction unit that corrects the movement of the subject, an autofocus processing unit that adjusts the focus of the camera in accordance with the motion of the subject corrected by the motion correction unit, and a subject that has been corrected by the motion correction unit. An image pickup apparatus comprising: an automatic exposure processing unit that adjusts an exposure time of the camera in accordance with movement.   An image data generation step in which the camera forms incident light to generate image data of the captured image, and a motion detection unit analyzes the image data generated by the camera and moves the subject existing in the captured image. And a flicker occurrence state specifying unit obtains an integrated value of pixel values for each line of the captured image from the image data generated by the camera, and the integrated value of the pixel values for each line and the camera A flicker occurrence status specifying step for specifying the flicker occurrence status from the exposure time and the frame rate, and a subject detected by the motion detection means according to the flicker occurrence status specified by the flicker occurrence status specifying means by the motion correction means A motion correction step for correcting the movement of the subject and the autofocus processing means corrected by the motion correction means. An autofocus processing step for adjusting the focus of the camera in accordance with the movement of the body, and an automatic exposure in which the automatic exposure processing means adjusts the exposure time of the camera in accordance with the movement of the subject corrected by the motion correction means. An image processing method comprising processing steps.   An image data generation step in which the camera forms incident light to generate image data of the captured image, and a motion detection unit analyzes the image data generated by the camera and moves the subject existing in the captured image. A motion detection step for detecting flicker, a flicker occurrence status specifying means for specifying a flicker occurrence status from the frequency of the power supply, the exposure time and the frame rate of the camera, and a motion correction means for specifying the flicker occurrence status A motion correction step for correcting the motion of the subject detected by the motion detection means in accordance with the flicker occurrence status specified by the means, and an autofocus processing means in accordance with the motion of the subject corrected by the motion correction means. An autofocus processing step for adjusting the focus of the camera, and an automatic exposure processing means. Serial with the movement of the object corrected by the motion correction unit, an image processing method and an automatic exposure processing step of adjusting the exposure time of the camera.

Images