JP3524252B2 - Image processing apparatus and method, and imaging apparatus - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method for processing image information obtained by image pickup, and image pickup.
Regarding the device .

[0002]

2. Description of the Related Art Conventionally, a visualizer that displays presentation materials and a video camera with a negative-positive conversion function that shoots a negative film of a photograph and converts it into a positive film for display are mainly stationary, not moving objects. There is known an image pickup apparatus for picking up an image of a subject. When a still subject is imaged by such an image pickup device, if image shake occurs due to the image pickup device or the vibration of the subject, even if it is very small, compared to the case where a moving subject is imaged, Since it is noticeably recognized, it may be uncomfortable for the viewer of the obtained image.

On the other hand, there has been conventionally known an image pickup apparatus for recording an image signal of one field or one frame as a still image. This imaging device continuously records still images in an external recording device, or normally field images as moving images, and a still image at a time arbitrarily designated by an operator as a frame image with high definition. There is a video camera to record in. Even in these image pickup apparatuses, image blurring occurs due to camera shake during image pickup and movement of the subject, and the image quality of the obtained image deteriorates.

In order to prevent such image quality deterioration, a conventional image processing apparatus provided in a video camera or the like employs an image blur preventing method that combines a motion detecting method and a shake correcting method.

As a motion detecting method, there is a method of obtaining a motion vector by a correlation calculation of images between fields, and a method of obtaining a motion of an image pickup device by an angular velocity sensor.

As the shake correction method, in addition to a method of optically correcting the image shake by a variable apex angle prism, CC
There is a method of performing electronic correction by changing the read position of D (charge coupled device) or memory.

[0007]

However, the electronic or optical shake correction method in the above-described conventional image processing apparatus cannot correct the movement in the rotation direction in any case, and a slight shake remains after the correction. There was a problem.

Further, in the electronic shake correction method, the shake correction is performed after the image information is stored in the CCD, so that the image blur is caused by the shake of the hand or the movement of the subject during the storage of the image information, thereby preventing the deterioration of the image quality. There was a problem that I could not.

Further, in the optical shake correction method, the CCD
Shake correction is performed before image information is stored in the camera, so camera shake can be corrected, but slow motion is difficult to detect due to the characteristics of the angular velocity sensor, and motion of the subject cannot be corrected sufficiently, and low-frequency motion remains. There was a problem.

The present invention has been made in order to solve the above-mentioned problems of the prior art, and an object thereof is to obtain an image with less image quality deterioration due to vibration or movement of an image pickup device or an object and less discomfort. Image processing device and
A method and an imaging device are provided.

[0011]

The image processing apparatus according to claim 1 of the present invention in order to achieve the above object In order to achieve the above, an image information input means for inputting image information, the image information inputted by said image information input means a motion amount detecting means for detecting the motion amount of the image based on, a storage unit for storing the image information the input based on the motion amount of the detected image, the inputted image information and the storage comprising a selection means for selecting in response either to the motion amount of the detected image of the image information, and output means for outputting the image information selected by said selecting means, image by said storing means
Image information is stored when the detected motion amount of the image is the first.
Images that are smaller than the specified value and that are detected before that
If the movement amount is larger than the first predetermined value,
The selection means is configured so that the amount of movement of the detected image is the first
If it is less than or equal to the predetermined value of, the stored image information is selected.
On the other hand, the detected motion amount of the image is
If it is larger than the specified value, select the input image information
Characterized in that it.

[0012]

[0013]

Claims of the invention to achieve the same object
2 of the image processing apparatus, in the above configuration according to claim 1, wherein the detected motion amount storage means for storing the movement amount of the image, the motion amount of images smaller than the movement amount of the stored images is detected In this case, an update means for updating the stored image movement amount and the stored image information is provided.

Claims of the invention to achieve the same object
Third image processing apparatus, in the above configuration according to claim 1 or 2, a calculating means for calculating a correlation value between the fields of the input image information for each field by the image information input unit, which is the calculated correlation a correlation value storage means for storing a value, when the correlation value is greater than the stored correlation values are computed, that a updating means for updating the stored correlation values and the stored image information has been Is characterized by.

Claims of the invention to achieve the same object
The image processing device of No. 4 is characterized in that, in the configuration of claim 2 or 3 , the updating by the updating means is performed over a predetermined period.

Claims of the invention to achieve the same object
In the image processing apparatus according to the fifth aspect of the present invention, in the configuration according to the fourth aspect , the selection unit stores the stored image while the detected motion amount is equal to or less than the first predetermined value after the predetermined period has elapsed. Information is selected, and the input image information is selected after the amount of movement of the detected image becomes a value larger than the first predetermined value.

Claims of the invention to achieve the same objective
The image processing device according to No. 6 is the structure according to claim 5 , wherein during the predetermined period, the amount of motion of the detected image is smaller than a second predetermined value and the amount of motion of the image detected before that. Is greater than the second predetermined value.

Claims of the invention to achieve the same object
The image processing apparatus according to the seventh aspect has a still image information recording means capable of recording still image information in the configuration according to claim 4 , wherein the still image information recording means uses the selection means to store the stored image information. When selected, the image information output by the output means is recorded.

Claims of the invention to achieve the same objective
8 the image processing apparatus is in the configuration of the seventh aspect, the recording by the still image data recording unit is performed over a predetermined time period, further comprising a designation means for designating a start of the predetermined period And

Claims of the invention to achieve the same object
The image processing method of 9, an image information input step of inputting image information, and the motion amount detection step of detecting a motion amount of an image based on image information inputted in the image information input step, the detected image A storing step of storing the input image information based on the amount of motion of the image, and selecting one of the input image information and the stored image information according to the amount of motion of the detected image. seen including a selection step, and an output step of outputting the image information selected in the selection step, the image information in the storing step
The storage is performed when the detected motion amount of the image is a first predetermined value.
Is smaller and the amount of motion of the image detected before that is
The selection process is performed when the value is larger than the first predetermined value.
The detected amount of motion of the image is the first predetermined value.
If it is less than or equal to the value, select the stored image information
On the other hand, the amount of movement of the detected image is the first predetermined value.
Greater than it is characterized and this <br/> selecting the image information the input.

Claims of the invention to achieve the same objective
10 imaging device, Mo plurality of imaging modes that can be set
And de setting means, and an image processing apparatus according to any one of claims 1-8, depending on the set imaging mode by the image processing said mode setting means permission of execution of the processing of the image information by the device And a switching means for switching.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram showing the arrangement of an image processing apparatus according to the first embodiment of the present invention. The image information input to the present apparatus includes information on camera shake of the image pickup apparatus provided with the present apparatus and movement of a subject. This image information is input to the motion detector 11, the memory 12 and the switch 13.

The motion detector 11 detects the amount of motion of an image from the input image information. Specifically, a motion vector is obtained by a correlation calculation of images between fields to obtain a motion amount. Information on the detected amount of movement is obtained by the movement detection unit 1
Memory controller 14 and switch controller 1 connected to
Input to 5.

The memory control unit 14 has a memory 141 internally composed of a RAM (random access memory) or the like. In the memory 141, in addition to the amount of movement of an image, a correlation value between fields, a comparison judgment is made. Various variables, other predetermined values, etc. are stored. The memory control unit 14 sends a timing instruction for storing image information to the memory 12 connected to the memory control unit 14 according to the detected motion amount or correlation value, and the memory 12 receives the input by the timing instruction. The stored image information is stored or the stored image information is updated. The details of the control operation of the memory control unit 14 will be described later.

The switch control unit 15 has a memory 151 composed of a RAM or the like inside, and the memory 151 includes:
A motion amount, a correlation value, a variable, a predetermined value, etc. are stored as necessary. The switch control unit 15 controls the switching operation of the switch 13 connected to the switch control unit 15 according to the detected amount of movement. Details of the control operation of the switch control unit 15 will be described later.

The switch 13 is also connected to the memory 12,
According to an instruction from the switch control unit 15, the image information stored in the memory 12 or the input image information is switched to be output. That is, the image information is adaptively output according to the detected motion amount, the input image information is used to output the moving image information, and the image information stored in the memory 12 is used to output the still image information. .

FIG. 2 is a flowchart showing the control procedure of the image information storage processing by the memory control unit 14 of the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM (read only memory) and the like. In addition, this processing is executed every time the amount of motion information in each field is received, that is, each field.

First, the motion amount VC in the current field detected by the motion detecting section 11 is acquired and stored in the memory 141 (step S21).

Next, it is judged whether or not the motion amount VC in the current field is less than or equal to a predetermined value VREF (for example, 3 pixels) (step S22). When VC ≦ VREF is satisfied, the motion amount in the previous field is determined. It is determined whether VB is larger than a predetermined value VREF (step S23). as a result,
If VC> VREF or VB ≦ VREF holds, that is, if the motion amount VC in the current field is large or if the motion amount VC in the current field is continuously small from the previous field, this processing is immediately terminated.

On the other hand, as a result of the discrimination in step S23,
When VB> VREF is satisfied, that is, when the motion amount VC in the current field has newly become the predetermined value VREF or less this time, the input image information at that time is stored in the memory 12
(Step S24), and this processing ends.

By this processing, input image information when the motion amount VC newly becomes equal to or less than the predetermined value VREF is stored.

FIG. 3 is a flow chart showing the control procedure of the image information selection processing by the switch controller 15 of the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

First, the motion amount VC in the current field detected by the motion detector 11 is acquired and stored in the memory 151 (step S31).

Next, it is determined whether or not the motion amount VC is less than or equal to a predetermined value VREF (step S32). If the result of the determination is that VC≤VREF, the image information stored in the memory 12 is checked. While selecting (step S33),
When VC> VREF is established, the input image information is selected (step S34), and this processing ends.

By this processing, the motion amount V in the current field
When C is less than or equal to the predetermined value VREF, the still image information is controlled to be output by the switch 13, and when the motion amount VC is greater than the predetermined value VREF, the moving image information is controlled to be output by the switch 13. To be done.

According to the present image processing apparatus, it is possible to adaptively select and output a moving image and a still image depending on the situation. Further, the still image is caused by camera shake or movement of the subject. Image quality deterioration can be reduced.

(Second Embodiment) An image processing apparatus according to the second embodiment of the present invention will be described below. The image processing apparatus according to the present embodiment has basically the same configuration as the image processing apparatus according to the first embodiment, and therefore FIG. 1 is used as it is, and FIG. The image processing apparatus will be described with reference to FIG. 5 instead of 3, and FIG. 6 in addition.

FIG. 4 is a flow chart showing the control procedure of the image information update processing by the memory control unit 14 according to the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

First, the motion amount VC in the current field detected by the motion detecting section 11 is acquired and stored in the memory 141 (step S41).

Next, it is judged whether or not the counter value CN has reached the predetermined period T (10 to 30 field period, for example) (step S42).
A new counter value C is obtained by adding "1" to the counter value CN.
N (step S46), the motion amount VC is stored in the memory 141.
It is determined whether or not it is smaller than the comparison variable RN1 stored in (step S47).

As a result of the determination in step S47, VC ≧ RN
When 1 is satisfied, this process is immediately terminated, while VC
<When RN1 is satisfied, the comparison variable RN1 is updated to the motion amount VC in the current field, and the memory 12
The image information stored in is updated and the image information of the current field is controlled to be newly stored (step S4).
8) Then, this process ends.

As a result of the determination in the step S42, when the counter value CN reaches the predetermined period T, the step S4
3 and step S44, the same processing as step S22 and step S23 of FIG. 2 is performed. As a result, the motion amount VC
Is larger than a predetermined value VREF, or the motion amount VC is a predetermined value VREF following the motion amount VB of the previous field.
If it is less than or equal to this, this processing is immediately terminated, while if the motion amount VC is newly below the predetermined value VREF this time, the counter value CN is reset to 0 (step S45), Execute the process.

By this processing, the motion amount V in the current field
Memory 1 when C newly falls below a predetermined value VREF
2 is stored, and thereafter, every time a smaller motion amount VC is detected within the predetermined period T, the comparison variable RN is
1 and the stored image information in the memory 12 are updated.

FIG. 5 is a flow chart showing the control procedure of the image information selection processing by the switch controller 15 of the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

In steps S51, S52 and S56, steps S41 and S4 in FIG.
2, the same processing as step S46 is performed, and step S5
After the process of 6, the process proceeds to step S58. However, the motion amount VC is stored in the memory 151 in step S51.

As a result of the determination in step S52, when the counter value CN reaches the predetermined period T, it is determined whether or not the motion amount VC in the current field is equal to or less than the predetermined value VREF (step S53), and VC When ≦ VREF is satisfied, it is determined whether or not the movement amount VB in the previous field is larger than the predetermined value VREF (step S54).

As a result, when the motion amount VC is larger than the predetermined value VREF, the input image information is selected (step S5).
8) Then, this process ends. When VC ≦ VREF is satisfied and VB ≦ VREF is satisfied, that is, when the motion amount VC is equal to or less than the predetermined value VREF following the previous field, the image information stored in the memory 12 is selected (step S57). ), And this processing ends. On the other hand, VC ≦ VR
When EF holds and VB> VREF holds,
Since the motion amount VC has newly become equal to or less than the predetermined value VREF this time, the counter value CN is reset to "0" (step S55), and then the process of step S58 is executed. The image information selected in this way is output by the switch 13.

By this processing, when the motion amount VC newly becomes below the predetermined value VREF, the predetermined period T is started,
Input image information is selected within the predetermined period T. Further, after the lapse of the predetermined period T, the memory 12 is displayed while the motion amount VC is small.
Image information is selected and the input image information is selected when the motion amount VC increases again.

FIG. 6 is a diagram showing the relationship between the amount of movement and the image information update timing in this image processing apparatus, and corresponds to the processing results of FIGS. 4 and 5. In the figure, the horizontal axis represents time, and the unit is the field period. The vertical axis represents the movement amount VC.

According to the figure, at time As, the motion amount VC
Becomes a predetermined value VREF or less, the predetermined period T
Starts at time As. From time As to time Ae, the motion amount VC takes a smaller value, so the comparison variable R
The image information in N1 and the memory 12 is updated. Time point Ae
From the time point to the time point Bs, the motion amount VC keeps a value larger than the value at the time point Ae, so the comparison variable RN1 and the image information in the memory 12 are not updated. Hereinafter, the update is performed from the time Bs to the time Be and from the time Cs to the time Ce (hatched section), and from the time Be to the time Cs, and from the time Ce to the time D. Not done Further, the update is not performed after the predetermined period T has elapsed.

Further, in the figure, the switch controller 15
Thus, the input image information is selected for the predetermined period T, and the image information in the memory 12 is selected from the time point D to the time point E until the motion amount VC exceeds the predetermined value VREF. Then, after the time point E when the motion amount VC exceeds the predetermined value VREF, the input image information is selected again.

According to this image processing apparatus, the image information when the movement amount VC is the smallest is updated and stored in the memory 12 within the predetermined period T, and after the predetermined period T, the movement amount VC changes. Since the image information is adaptively selected accordingly, it is possible to obtain an image with less discomfort, and it is possible to obtain the still image information with the least image quality deterioration within the predetermined period T.

For example, in the case of a small movement that the operator does not intend, such as a vibration of an image pickup device or an object, still image information is selected and an operation intended by the operator such as pan, tilt, and zoom. In the case of a large movement such as or movement of a subject, moving image information is selected.

(Third Embodiment) An image processing apparatus according to the third embodiment of the present invention will be described below. The image processing apparatus according to the present embodiment has basically the same configuration as the image processing apparatus according to the second embodiment, and therefore FIG. 1 is used as it is, and FIG. , FIG. 8 will be described.

FIG. 7 is a flow chart showing the control procedure of the image information update processing by the memory control unit 14 according to the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

In the present image processing apparatus, the determination as to whether or not the image information can be updated is made not by the motion amount VC but by the correlation value C between fields
The difference from the image processing apparatus according to the second embodiment is that it is performed based on ON. The correlation value is calculated by the motion detection unit 11
Done by.

First, the motion amount VC and the correlation value CON in the current field obtained by the motion detector 11 are acquired and stored in the memory 141 (step S71).

Next, in steps S72 to S76, the same processing as steps S42 to S46 in FIG. 4 is performed. After the processing of step S76, step S77
After that, the process proceeds to step S78 after the process of step S75.
Go to.

In step S 77, the correlation value CON in the current field is compared with the comparison variable RN stored in the memory 151.
It is determined whether or not 2 or more, and when CON <RN2 is satisfied, this processing is immediately terminated, while CON ≧ RN2
When is satisfied, the comparison variable RN2 is updated and the correlation value C
While turning on, the image information of the memory 12 is updated to newly store the image information of the current field (step S7).
8) Then, this process ends.

Switch control unit 1 in the image processing apparatus
The image information selection processing by 5 is similar to that of the second embodiment, and therefore is performed by executing the flowchart shown in FIG.

FIG. 8 is a diagram showing the relationship between the correlation value and the image information update timing in this image processing apparatus, which corresponds to the processing results of FIGS. 7 and 5. The horizontal axis of the figure is the same as that of FIG. 6, but the vertical axis shows the correlation value CON between the fields.

In the figure, the predetermined period T is started from the time point As when the motion amount VC (not shown in the figure) becomes equal to or less than the predetermined value VREF. The shaded section, that is, from time As to time Ae ′, from time Bs ′ to time B
During the period up to e ′ and from the time Cs ′ to the time Ce ′, the correlation value CON takes a value larger than the value of the comparison variable RN2, so that the comparison variable RN2 and the image information of the memory 12 are updated. It is not updated in other sections and after the elapse of the predetermined period T.

Further, in the figure, the switch controller 15
Thus, the input image information is selected for the predetermined period T, and after the time point D, the motion amount VC is the predetermined value VREF as in FIG.
The image information in the memory 12 is selected until the time point E, which is higher than the above. Then, after the time point E, the input image information is selected again.

According to the present image processing apparatus, the characteristic that the less the image blur is, the higher the correlation between the fields is used, the same as the effect in the second embodiment of updating the image information based on the motion amount VC. The effect of can be obtained.

(Fourth Embodiment) An image processing apparatus according to the fourth embodiment of the present invention will be described below.

FIG. 9 is a block diagram showing the arrangement of the image processing apparatus according to this embodiment. In the figure, an external input unit 16 and an external recording unit 17 are added to the configuration of FIG. 1, and the same components as those of FIG. 1 are designated by the same reference numerals and the description thereof will be omitted.

The external input section 16 is connected to the memory control section 14 and the switch control section 15, and receives various time information (hereinafter referred to as “timing information”) regarding the processing by the memory control section 14 or the switch control section 15 from the operator. Can be specified and is configured to be output.

Memory controller 14 or switch controller 1
5 allows the start of the predetermined period T based on the timing information of the external input unit 16, the start of the update of the image information in the memory 12, and the start of the update of the motion amount and the comparison variable in the memory 141 and the memory 151. To do.

The external recording section 17 is composed of a magnetic tape or the like, is connected to the switch 13 and records the output image information from the switch 13. The external recording unit 17 records the still image information output from the switch 13 based on the timing information from the external input unit 16, particularly when the image information in the memory 12 is selected. Details of recording the still image information by the external recording unit 17 will be described later.

FIG. 10 is a flow chart showing the control procedure of the image information storage processing by the memory control unit 14 in the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

First, the motion amount VC in the current field detected by the motion detecting section 11 is acquired and stored in the memory 141 (step S101).

Next, it is determined whether or not the timing information is input from the external input unit 16, and when it is input, the counter value CN is reset to "0" (step S104),
On the other hand, when the timing information is not input while proceeding to step S106, it is determined whether or not the counter value CN is smaller than the predetermined period T (step S103).

As a result of the determination in step S103, CN ≧ T
When is satisfied, this process is immediately terminated, while CN <
When T is satisfied, "1" is added to the counter value CN to obtain a new counter value CN (step S105), and it is determined whether or not the motion amount VC is smaller than the predetermined value VREF (step S106).

As a result of the determination in step S106, VC ≧ V
When REF is established, this processing is immediately terminated, while when VC <VREF is established, the counter value CN
For a predetermined period T, and the image information in the memory 12 is updated to newly store the input image information (step S10).
7) Then, this process ends.

According to this processing, the predetermined period T is started by the operator's designation, and within the predetermined period T, the motion amount VC
The input image information when is less than or equal to the predetermined value VREF is stored in the memory 12.

FIG. 11 is a flow chart showing the control procedure of the image information output processing by the switch control unit 15 in the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

First, the motion amount VC in the current field detected by the motion detector 11 is acquired and stored in the memory 151 (step S111).

Next, steps S112 to S11
6, the steps S102 to S106 of FIG.
Perform the same processing as.

As a result of the determination in step S113, CN ≧ T
Is satisfied, or as a result of the determination in step S116, if VC ≧ VREF is satisfied, the switch 13 is turned off, and the process is terminated without recording the image information in the external recording unit 17 (step S118). To do.

On the other hand, as a result of the determination in step S116, V
When C <VREF is satisfied, the counter value CN is set to the predetermined period T and the switch 13 is turned on to record the still image information of the memory 12 in the external recording unit 17 (step S117), and the present processing is performed. To finish.

By this processing, the movement amount V within the predetermined period T
When C is equal to or less than the predetermined value VREF, still image information is recorded in the external recording unit 17.

According to this image processing apparatus, the motion amount VC is the predetermined value V within the predetermined period T arbitrarily designated by the operator.
Image information when it is smaller than REF can be recorded / stored in the external recording unit 17 as a still image.

Therefore, for example, an image can be obtained in which the deterioration of the image quality due to camera shake or movement of the subject is suppressed during the image information accumulation time by the CCD of the image pickup device.

(Fifth Embodiment) An image processing apparatus according to the fifth embodiment of the present invention will be described below. The image processing apparatus according to the present embodiment has basically the same configuration as the image processing apparatus according to the fourth embodiment, and therefore FIG. 9 is used as it is, and instead of FIG. 10 and FIG. Figure 1
This image processing apparatus will be described with reference to FIG.

FIG. 12 is a flowchart showing the control procedure of the image information storage processing by the memory control unit 14 in the present image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

In steps S121 to S125, the same processes as steps S101 to S105 in FIG. 10 are performed, and after the process in step S124, the process proceeds to step S127.

After the processing of step S125, the motion amount VC
Is smaller than the comparison variable RN1 stored in the memory 141 (step S126), and when VC ≧ RN1, this processing is immediately terminated, while VC> R
When N1 is satisfied, the process proceeds to step S127, the comparison variable RN1 is updated, and the motion amount VC is set as a new comparison variable RN.
At the same time, the image information in the memory 12 is updated and the input image information is newly stored, and this processing is ended.

According to this processing, the predetermined period T is started by the operator's instruction, and the image information in the memory 12 is updated every time a smaller motion VC is detected over the predetermined period T.

FIG. 13 is a flow chart showing the control procedure of the image information output processing by the switch control unit 15 in the image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

In steps S131 to S135, the same processes as steps S111 to S115 in FIG. 11 are performed.

Step S134 or step S135
After the processing in step S136, the process proceeds to step S136, the switch 13 is turned off, and the processing is ended without recording the image information in the external recording unit 17 (step S136).

As a result of the determination in step S133, CN
When ≧ T is satisfied, the process proceeds to step S137, the switch 13 is turned on, the still image information in the memory 12 is recorded in the external recording unit 17, and the present process ends.

According to this process, the image information in the memory 12 is recorded as the still image information in the external recording unit 17 after the elapse of the predetermined period T started by the operator's designation.

FIG. 14 is a diagram showing the relationship between the amount of movement and the image information update timing in this image processing apparatus.
2 and the processing result of FIG. 13. In the figure, the vertical axis and the horizontal axis are the same as those in FIG. 6, and the time points As,
Ae, Bs, Be, Cs, Ce, D represent the same time points as in FIG.

The figure shows that the start time As of the predetermined period T is determined by the input of the timing information by the external recording unit 17, and the movement amount VC becomes equal to or less than the predetermined value VREF. Is shown to be started, which is different from FIG.

Further, in the figure, it is shown that the image information in the memory 12 is updated in the hatched section within the predetermined period T, and is not updated after the time point D.

According to this image processing apparatus, the input image information when the motion amount VC is the smallest is set in the external recording section 17 as the still image information within the predetermined period T started from the time arbitrarily specified by the operator. Can record and save.

Therefore, for example, it is possible to record and save an image with the least image quality deterioration due to camera shake or movement of the subject during the CCD accumulation time of the image pickup device.

(Sixth Embodiment) An image processing apparatus according to the sixth embodiment of the present invention will be described below.

Since this image processing apparatus has basically the same configuration as the image processing apparatus according to the fifth embodiment, FIG. 9 is used as it is, and FIG. 1 and FIG.
The image processing apparatus will be described with reference to FIGS.

FIG. 15 is a flowchart showing the control procedure of the image information storage processing by the memory control unit 14 in the image processing apparatus. A program for executing this process is stored in a storage unit (not shown) including a ROM and the like. Further, this processing is executed every time the amount of motion information in each field is received, that is, every one field.

First, in step S151, the motion detector 1
The motion amount VC and the correlation value CON in the current field obtained by 1 are acquired and stored in the memory 141. Next, in steps S152 to S155, the same processing as steps S122 to S125 of FIG. 12 is performed,
After the processing of step S154, the process proceeds to step S157.

After the processing of step S155, step S1
In step 56, it is determined whether the correlation value CON is equal to or larger than the comparison variable RN2 stored in the memory 141. As a result of the determination, when CON <RN2 is satisfied, the present process is immediately terminated, while when CON ≧ RN2 is satisfied, the process proceeds to step S157, the comparison variable RN2 is updated, and the correlation value CON in the current field is calculated. A new comparison variable RN2 is set, the image information in the memory 12 is updated, the input image information is newly stored, and this processing ends.

According to this processing, the predetermined period T is started by the instruction of the operator, and the image information in the memory 12 is updated each time a larger correlation value CON is calculated within the predetermined period T.

The output processing of the image information by the switch control unit 15 in the present embodiment is the same as that in the fifth embodiment, and therefore, it is performed by executing the flowchart shown in FIG.

FIG. 16 is a diagram showing the relationship between the correlation value and the image information update timing in this image processing apparatus.
5 and the processing result of FIG. 13. The vertical axis, the horizontal axis, and each time point shown in the same figure are the same as those shown in FIG.

Similar to FIG. 8, this figure shows that the image information in the memory 12 is updated in the shaded section within the predetermined period T, and is not updated after the time point D.

According to this image processing apparatus, the input image information when the largest correlation value CON is calculated within the predetermined period T started from the time arbitrarily specified by the operator is externally recorded as still image information. It can be recorded and saved in the section 17.

Therefore, the same effect as that of the image processing apparatus according to the fifth embodiment can be obtained.

(Seventh Embodiment) An image pickup apparatus according to the seventh embodiment of the present invention will be described below. This imaging device
One of the image processing apparatuses according to the first to sixth embodiments is applied as a constituent element.

FIG. 17 is a block diagram showing the arrangement of the image pickup apparatus. In the figure, 171 is a lens, and the input image light passes through the lens 171 and is incident on a CCD (charge coupled device) unit 172 and converted into an electric signal. C
The output signal from the CD section 172 is transmitted through a sample hold (S / H) section 173 connected to the CCD section 172.
The gain is controlled by being input to the automatic gain control (AGC) unit 174 connected to the sample hold unit 173. The output signal from the automatic gain control unit 174 is converted into a digital signal by the A / D (analog / digital) conversion unit 175 connected to the automatic gain control unit 174.

The image processing unit 176 connected to the A / D conversion unit 175 is a processing unit for performing image processing such as edge enhancement and gamma correction on the digital signal from the A / D conversion unit 175. Image pickup mode. The imaging mode is configured to be arbitrarily switched by a mode switch 177 connected to the image processing unit 176. The plurality of image pickup modes are referred to as a first mode, a second mode ... An nth mode.

An image processing section 178 corresponding to the image processing apparatus according to any of the first to sixth embodiments is connected to the mode changeover switch 177. Mode change switch 1
77 switches the image capturing mode and switches the switch in accordance with the image capturing mode, so that the image processing unit 178 performs the series of processes described above (selection of image information,
It is determined whether to perform processing such as storage, update, and recording by the memory control unit 14 or the switch control unit 15.

When the mode changeover switch 177 instructs the image processing section 178 to execute a series of processes,
The output signal from the image processing unit 176 is the image processing unit 178.
D / A (digital / analog) converter 17 connected to
9 through the image processing unit 178 and converted into an analog signal.

On the other hand, the D / A converter 179 is also directly connected to the mode changeover switch 177, and when the mode changeover switch 177 prohibits the image processing unit 178 from performing a series of processes, The output signal from 176 is directly input to the D / A conversion unit 179 without passing through the image processing unit 178.

According to this image pickup apparatus, the effect of the image processing apparatus according to any one of the first to sixth embodiments can be obtained according to the image pickup mode.

For example, in the normal image pickup mode, the input image is output as it is, and in the negative / positive conversion mode in which a still subject (negative film or the like) is imaged, the image quality deterioration according to the first to sixth embodiments is executed. It is possible to adaptively obtain a still image with a small amount.

In the first, second and third embodiments, the image is stored or the predetermined period T is started based on the motion amount VC in the current field and the motion amount VB in the previous field. However, these may be performed based on only the motion amount VC in the current field.

Although the predetermined period T has a common value in the second to sixth embodiments, it is not limited to this value, and an appropriate value may be set for each embodiment. .

Furthermore, in the fourth, fifth, and sixth embodiments, the timing information stores or updates the image information in the memory 12, the start of the predetermined period T, and the external recording section 1.
The timing of recording the still image information in 7 may be specified separately.

In step S73 and step S74 of FIG. 7 according to the third embodiment, the judgment may be made by comparison with an appropriate predetermined value of the correlation value CON instead of the motion amount VC.

[0124]

As described above , according to the present invention ,
It is possible to obtain an image with less image deterioration and less discomfort.
It For example, when the operator does
It is common to output a still image for small movements not shown.
Movements that the operator intends, such as pan, tilt, and zoom.
Movies and large movements such as movement of the subject
Images can be output.

[0125]

[0126]

[0127]

[0128]

[0129]

[0130]

[0131]

[0132]

[0133]

[0134]

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an image processing apparatus according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing a control procedure of image information storage processing by a memory control unit 14 according to the apparatus.

FIG. 3 is a flowchart showing a control procedure of image information selection processing by a switch control unit 15 according to the apparatus.

FIG. 4 is a flowchart showing a control procedure of image information update processing in the image processing apparatus according to the second embodiment of the present invention.

FIG. 5 is a flowchart showing a control procedure of image information selection processing in the apparatus.

FIG. 6 is a diagram showing a relationship between a motion amount and image information update timing in the same apparatus.

FIG. 7 is a flowchart showing a control procedure of image information update processing in the image processing apparatus according to the third embodiment of the present invention.

FIG. 8 is a diagram showing a relationship between a correlation value and image information update timing in the same apparatus.

FIG. 9 is a block diagram showing a configuration of an image processing apparatus according to a fourth embodiment of the present invention.

FIG. 10 is a flowchart showing a control procedure of image information storage processing in the apparatus.

FIG. 11 is a flowchart showing a control procedure of image information output processing in the apparatus.

FIG. 12 is a flowchart showing a control procedure of image information storage processing in the image processing apparatus according to the fifth embodiment of the present invention.

FIG. 13 is a flowchart showing a control procedure of image information output processing in the apparatus.

FIG. 14 is a diagram showing a relationship between a movement amount and image information update timing in the same apparatus.

FIG. 15 is a flowchart showing a control procedure of image information storage processing in the image processing apparatus according to the sixth embodiment of the present invention.

FIG. 16 is a diagram showing a relationship between a correlation value and image information update timing in the same apparatus.

FIG. 17 is a block diagram showing a configuration of an image pickup apparatus according to a seventh embodiment of the present invention.

[Explanation of symbols]

11 Motion detector 12 memories 13 switch 14 Memory controller 15 Switch control unit 16 External input section 17 External recording unit 141 memory 151 memory 177 Mode selector switch 178 Image processing unit

Claims (10)

(57) [Claims] 1. A image information input means for inputting image information, and the motion amount detecting means for detecting the motion amount of the image based on the image information input by said image information input means, the movement of the detected image A storage unit that stores the input image information based on an amount; and a selection unit that selects one of the input image information and the stored image information according to the amount of movement of the detected image. When, and output means for outputting the image information selected by said selecting means, storing the image information by the storage unit was the detection
The amount of movement of the image is smaller than the first predetermined value, and
The amount of motion of the previously detected image is larger than the first predetermined value.
When the threshold is detected, the selecting means selects the detected image.
If the amount of movement of the image is less than or equal to the first predetermined value, the case
While selecting the stored image information, the detected image
If the amount of movement of is larger than the first predetermined value, the input
An image processing device, characterized in that selected image information is selected . Wherein said motion amount storage means for storing the motion amount of the detected image, if the amount of motion of images smaller than the amount of movement of the stored image is detected, movement of the stored image the amount and the image processing apparatus according to claim 1 Symbol mounting, characterized in that a updating means for updating the stored image information. 3. A calculating means for calculating a correlation value between the fields of the input image information for each field by the image information input means, a correlation value storage means for storing the calculated correlation values, said stored The image processing according to claim 1 or 2 , further comprising: an updating unit that updates the stored correlation value and the stored image information when a correlation value larger than the correlation value is calculated. apparatus. 4. The image processing apparatus according to claim 2 , wherein the updating by the updating unit is performed over a predetermined period. 5. The selecting means, after the lapse of the predetermined period,
When the stored image information is selected while the detected amount of motion is less than or equal to the first predetermined value, and the amount of motion of the detected image becomes a value larger than the first predetermined value. The image processing apparatus according to claim 4, wherein the input image information is selected thereafter. 6. The predetermined period of time when the amount of motion of the detected image is smaller than a second predetermined value and the amount of motion of an image detected before that is larger than the second predetermined value. The image processing apparatus according to claim 5, which is started. 7. A still image information recording means capable of recording still image information, wherein the still image information recording means outputs by the output means when the stored image information is selected by the selecting means. The image processing apparatus according to claim 4 , wherein the recorded image information is recorded. 8. The image processing apparatus according to claim 7 , wherein the recording by the still image information recording unit is performed over the predetermined period, and the image processing apparatus further comprises a designation unit that designates start of the predetermined period. 9. A picture information input step of inputting image information, and the motion amount detection step of detecting a motion amount of an image based on image information inputted in the image information input step, the movement of the detected image A storing step of storing the input image information based on an amount, and a selecting step of selecting one of the input image information and the stored image information according to the amount of movement of the detected image. When, viewed including an output step of outputting the image information selected in the selection step, the storage of the image information in said storing step is the detection
The amount of movement of the image is smaller than the first predetermined value, and
If the amount of motion of the image detected before is greater than the first predetermined value
If it is larger, the detection step is performed in the selection step.
If the amount of movement of the image is less than or equal to the first predetermined value, then
While selecting the stored image information, the detected
If the amount of movement of the image is larger than the first predetermined value, then
An image processing method characterized by selecting input image information . 10. A plurality of imaging modes settable mode <br/> setting means, and an image processing apparatus according to any one of claims 1-8, the processing of the image information by the image processing apparatus An image pickup apparatus comprising: a switching unit that switches whether execution is permitted according to the image pickup mode set by the mode setting unit.