JPH0817454B2 - Television signal processor - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for processing a video signal picked up by a television camera (hereinafter referred to as a TV camera).

[0002]

2. Description of the Related Art Conventionally, a TV camera has been put to practical use as an input for a VTR for broadcasting or a home. In a TV camera, an optical image of a subject is photoelectrically converted by an image pickup tube or an image pickup plate, and its output is obtained through a matrix circuit to obtain a luminance signal and a color signal.
It is converted into a composite video signal such as L and sent to the outside.

[0003]

This TV camera is operated by a cameraman for broadcasting and a general consumer for domestic use. There is not much problem when operating the TV camera by fixing it with a tripod, etc.
When a general consumer who is not familiar with handling a camera tries to pick up the image with the camera held still by hand-held imaging, "camera shake" occurs, and the output signal of the TV camera at this time is displayed on the monitor TV for viewing. Then, the image vibrates vertically and horizontally, resulting in a very unsightly image.

Even in the case of a signal provided for broadcasting operated by an expert, when a runner is imaged by a TV camera mounted on a relay vehicle in the case of a marathon relay, vibrations of the vehicle during running are transmitted to the TV camera and displayed as an image. A large up and down motion will occur and the image will be unsightly.

Also in a portable VTR (ENG) for data collection, it is practically impossible for a cameraman to take an image while running because of the same camera shake problem.

The present invention solves such a problem and provides a video signal processing apparatus for performing signal processing that does not affect the image even when the image is picked up by a TV camera having camera shake. .

[0007]

SUMMARY OF THE INVENTION The television broadcast of the present invention.
The signal processing device corresponds to the scanning range of the first television system.
However, the number of scanning lines in the vertical direction is K _V times (K _V > 1).
In addition, K _H times (K _H > 1) per horizontal direction,
Image the scanning range corresponding to the second television scanning system
The image pickup means and the entire range of the screen output from the image pickup means
Memory means for storing information and obtained from the imaging means
Of images across the entire screen between consecutive
By detecting the motion from the video signal of the entire screen,
The motion detection means for detecting the motion of the image pickup means, and the above-mentioned memo.
Vertical direction of the contents of the screen information stored in the memory
1 / K _V times per scanning line, 1 / K _H times per horizontal direction
Corresponding to the first television system corresponding to
Means for reading the information on the screen from the reading position of
The above-mentioned control is provided with a control means for moving the reading position.
Means detected in response to the output of the motion detecting means
To move the readout position to offset the movement
By removing the vibration of the image due to the blurring of the image pickup means,
It is.

[0008]

According to the present invention, with the above structure, the image
Imaged by the imaging means being given a harmful movement.
Even if it is hit, it can be obtained as an image excluding the effect of the above motion.
You can That is, the image pickup means is the second television.
Being scanned. This is the first thing you should get as the final output
K in the vertical direction, compared to the 1st television scanning system _VDouble
K in horizontal direction_HIt is scanning twice as wide a range.

An image obtained by the second scanning system, that is, a wide range scanning is A / D converted and stored in the screen memory. This screen memory can store a plurality of screens. If the image pickup means moves during image pickup, the image being picked up moves with respect to the image stored in the screen memory. This movement is detected by the movement detecting means. The first television scanning system scans a part of the screen of the second television scanning system. When reading from the screen memory, the read range is moved according to the motion detected by the motion detecting means. Then, the image moving in the second television scanning system looks as if it is stationary in the first television scanning system.

Therefore, if the television signal processing system according to the present invention is applied with the first television scanning system as a standard system such as NTSC or PAL, an image of a subject is picked up by a television camera which is given harmful motion. However, it is possible to obtain an image as if it were captured by a stationary NTSC or PAL television camera.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Before explaining specific embodiments, the outline of the operating principle will be described with reference to FIG. Consider a case where an image pickup tube is used as the image pickup element. In FIG. 2, reference numeral 1 denotes a target of the image pickup tube. The range indicated by 2 is the scanning range required when transmitting a normal television signal. Therefore,
This range is the TV camera of the normal NTSC system, the horizontal scanning frequency 15.734KH _Z, the vertical scanning frequency of 5
Scanning is performed at 9.9 H _Z and 525 scanning lines (excluding the blanking period to be exact).

On the other hand, according to the present invention, 3 is formed on the target 1.
The range indicated by 2 is scanned, and after signal processing, the range indicated by 2 is to be transmitted. Furthermore, within range 3, range 2
The position of can be freely moved like 2 '. The moving direction and the moving amount are determined so as to follow the unnecessary movement of the image in the range 3 caused by the vibration of the camera during image pickup. As a result, even if the image moves within the range 3, the transmitted image is obtained assuming that it is at a fixed position within the range 2.

FIG. 1 shows an embodiment of the present invention. Reference numeral 4 is an image pickup tube, 5 is a frame memory capable of storing three screens, 6 is a synchronizing signal generating circuit, and 7 is a motion detecting circuit.
The image pickup tube 4 is operated by the synchronizing signal Sy2 (second scanning system) generated by the synchronizing signal generating circuit 6, and scans the scanning range 3. When the frame memory 5 is an analog memory, the imaged output is digitized, and when the frame memory 5 is a digital memory, it is digitized and written in the frame memory 5. The operation timing of the frame memory at this time is called mode II. FIG. 3 shows an explanatory diagram of the operation timing of the frame memory. In this figure, M to M + 3 indicate frame numbers. At the same time when the Mth frame is imaged, this frame is written in the frame memory 5. Reading from the frame memory 5 is performed simultaneously with writing.
The signal one frame before at the position exactly the same as the position being imaged by the image pickup tube 4 is read at the same timing of mode II. The signal written in the frame memory, that is, the signal of the M frame and the signal read from the frame memory, that is, the signal of the (M-1) frame are input to the motion detection circuit 7, and the motion vector between these frames is obtained. To be The motion detection circuit has a buffer memory corresponding to the capacity of a small portion of the screen, and relatively moves the position of the block of one frame between the small blocks in the above two frames to determine the position and direction where the correlation becomes maximum. The motion vector is detected by obtaining it. For such a small block, motion vectors may be calculated at several positions in one frame and the motion of the entire screen may be detected by majority logic.

As described above, the image pickup frame No.
At the timing of (M), the frame M is a frame (M-
Compared to 1), "how much distance did you move in which direction?"
Is required. According to this result, the imaging frame N
o. The signal of frame M is shown in FIG. 2 at the timing of (M + 2).
Only the scanning range 2 of is read. The operation timing of the frame memory at this time is called mode I. This is the synchronization signal S
It operates by y1 (first scanning system).

The operation timing of the frame memory and modes I and II will be described below. Table 1 shows the specifications of modes I and II when the NTSC signal is obtained as the final output signal.

[0016]

[Table 1]

Here, the larger K _V and K _H are, the more adjacent the two are.
It is clear that large motions between frames can be compensated.

However, when K _V and K _H are increased, a, the maximum frequency of the video signal becomes higher accordingly. b. The target area of the picture tube must be increased. c. If the size of the target is not changed, the resolution will deteriorate. The problems such as will become more serious.

As for a, if the maximum frequency in the scanning system 1 is f _max 1, the maximum frequency in the scanning system 2 is f _max 2 = K _V × K _H × f _max 1. Further, the target area is also K _V × K _H times, so that K = K _V = K _H =
It is considered that about 1.2 to 1.6 is suitable.

The difference in operation depending on the mode of the frame memory when K = 1.5 will be described below.

FIG. 4A shows the operation timing in the vertical direction. The hatched portion in the timing shown in Mode I indicates that it corresponds to the scanning range 2 in Mode I. This part is read out in mode II and expanded on the time axis. Further, it is shown that the shaded portion of Mode I moves from the lower limit to the upper limit of the scanning range 3 during the M frame to the (M + 2) frame.

FIG. 4B shows the operation timing in the horizontal direction. SyNC is a horizontal synchronizing signal period. Although not shown in the figure, writing and reading in this case have a time difference of two frames as can be seen from (a). This figure shows that the Nth scan line in mode II corresponds to the (ND) scan line in mode I.
This means that the first scan line of scan range 2 is (D
This is an example of the case starting from the +1) th scanning line.

As described above, since the frame memory is read in a narrower range in both the vertical and horizontal directions than the image pickup screen by the second scanning system, in order to obtain a normal image by the first scanning system, the time axis expansion processing as described above is performed. Need to do.

As is apparent from the above description, according to the present invention, it is possible to obtain an image as if it were taken from a stationary camera by changing the read position of the frame memory following the unnecessary movement of the camera. On the other hand, if you intentionally move the camera, that is, pan,
There is an inconvenience if the signal processing of the present invention is operated during camera operation such as tilting. In order to prevent such a situation, the camera is equipped with a manual switch that can distinguish between pan, tilt, and standstill, and by turning on the corresponding switch when performing a certain operation, only vertical movement during pan, tilt during tilt It suffices to give a control signal for compensating for horizontal movement only and vertical and horizontal movement when stationary. In addition, it is necessary to provide a switch that does not operate this signal processing during complicated camera operations such as zooming.

Further, in order to completely cope with complicated camera operations such as those for broadcasting, the screen corresponding to the scanning range 3 is once recorded in the VTR designed for this signal processing, and the reproduced signal is reproduced. On the other hand, it is conceivable that after performing this signal processing, editing and re-recording in a standard VTR. The advantage of providing such a process is that when the accuracy of the motion detected by the motion detection circuit is not good, the correct motion can be given according to the instruction of the editor, and it is possible to sufficiently cope with complicated camera work. is there.

Although all the above explanations have dealt with the movement between frames, in order to cope with more intense movements,
It is possible to perform similar processing between fields.

[0027]

As described above in detail, according to the present invention, an image obtained by a handheld image pick-up by a general consumer, an image picked up by a TV camera mounted on an automobile or the like which is violently vibrating , With camera work
Removes the vibration of the image due to the blurring of unrelated imaging means,
The captured image intended by the photographer does not have any omission, and unnecessary blur can be removed from the image containing blur to restore a normal image.

As a result, in the above-mentioned case, not only a much better image can be obtained as compared with the conventional case, but also the camera coverage, which is conventionally impossible in practical use such as taking an image while traveling while holding a TV camera. It will be possible.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing a relationship between an imaging screen and a sending screen.

FIG. 3 is an operation timing chart in one embodiment of the present invention.

FIG. 4 is a more detailed timing diagram of an embodiment of the present invention.

[Explanation of symbols]

 4 image pickup tube 5 frame memory 6 synchronization signal generation circuit 7 motion detection circuit

Claims (11)

[Claims] 1. The scanning range of the first television system corresponds to K _V times (K _V > 1) scanning lines in the vertical direction and K _H times (K _H > 1) in the horizontal direction. , An image pickup means for picking up an image of a scanning range corresponding to the second television scanning system, a memory means for storing information on the entire range of the screen output from the image pickup means , and the image pickup means.
By detecting the movement of the image across the entire screen between consecutive time-wise screens from the video signal of the entire screen ,
The motion detection means for detecting the motion of the image pickup means, and the above-mentioned memo.
Vertical per 1 / K _V times the scanning line of the contents of the screen information stored in the re-section, the reading of a range corresponding to the first television system corresponding to 1 / K _H times per horizontal It is equipped with a means for reading information on the screen from the position and a control means for moving the read position, and the control means moves the read position so as to cancel the detected motion in accordance with the output of the motion detection means. A television signal processing device, characterized in that the vibration of the image due to the blurring of the image pickup means is eliminated by doing so. 2. 1.2 <K _V <1.6, 1.2 <K _H <
The television signal processing device according to claim 1, wherein the television signal processing device is 1.6 . 3. The television signal processing device according to claim 1, wherein the screen memory is a frame memory. 4. The television signal processing apparatus according to claim 1, wherein the screen memory is a field memory. 5. The television signal processing apparatus according to claim 1, wherein the image pickup means includes an image pickup tube. 6. The television signal processing apparatus according to claim 1, wherein the image pickup means includes a solid-state image pickup plate. 7. The first scanning means conforms to the NTSC, PAL, or SECAM system.
The described television signal processing device. 8. The television signal processing apparatus according to claim 1, further comprising means for expanding the read signal on the time axis. 9. The television signal processing apparatus according to claim 1, further comprising means for limiting the operation of the control means. 10. The television signal processing apparatus according to claim 1, further comprising means for stopping the operation of the control means. 11. The television signal processing apparatus according to claim 1, wherein the motion vector is detected using information of a plurality of small blocks between two temporally consecutive screens.