JP3873000B2 - Moving image moving object detection apparatus and detection method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a moving image moving object detection apparatus and method.
[0002]
[Prior art]
In order to detect a moving object, it is generally necessary to examine the movement of each pixel.
However, the process of examining the movement for each pixel has a problem that a large amount of calculation is actually required. For example, ITU-T H. 261, H. In the case of the CIF format often used in H.263, ISO / IEC MPEG-4, etc., motion is detected for a total of 101,376 pixels including 352 pixels wide and 288 pixels high. For processing with such a large amount of calculation, it is necessary to prepare dedicated hardware, which causes a serious problem in terms of cost.
[0003]
Therefore, Japanese Patent Laid-Open No. 9-252467 “Moving Object Detection Device” has devised a method for detecting a moving object from a motion vector generated by a moving image encoding device. According to this method, since the motion vector for each block created by the video encoding device is used, it is not necessary to examine the motion of the pixel specially for detecting the moving object, and the calculation amount can be greatly reduced. .
[0004]
However, as a problem of the moving object detection technology using the conventional encoded data, a block with a large motion vector or a block being rewritten is not necessarily a moving object, and even a block inside the moving object, When there is a block that has not been rewritten and it is considered to be used for monitoring or the like, a necessary image cannot always be obtained.
[0005]
[Problems to be solved by the invention]
As described above, according to the conventional technique, there is a problem that a large amount of calculation is required to detect a moving object, and the method using moving image encoded data has a problem in accuracy.
[0006]
An object of the present invention is to provide a moving image moving object detection apparatus capable of detecting a moving object stably at high speed at high speed.
[0007]
[Means for Solving the Problems]
  The moving image moving object detection apparatus according to the present invention uses any one of the first mode for performing intra-frame coding, the second mode for performing inter-frame coding, and the third mode for performing coding unnecessary. Decodes video data encoded for each macroblockAn image decoded by the moving image decoding unit and a moving object detection unit that determines whether the decoded image is a moving object and generates a rectangular image representing the area of the moving object. In the moving image moving object detection apparatus configured to combine the signal and the rectangular image and display on the display unit,
  The moving object detection unit uses at least mode information indicating the types of the first, second, and third encoding modes for the decoded image for each macroblock, and determines whether the moving state detection unit moves in a stationary state for each mode. Based on the determination result of the macroblock static motion determination means for determining whether the state is the state or the macroblock static motion determination means, a single dynamic macroblock surrounded by static macroblocks is rewritten as a static macroblock. A moving object determination unit that performs a noise removal process, searches for a macroblock in the frame after the noise removal, and generates a minimum rectangular image including a region where a moving macroblock is adjacent to the moving macroblock. The image signal decoded by the moving image decoding unit and the rectangular image are combined and displayed on the display unit.
[0008]
  The moving image moving object detection device of the present invention is any one of the first mode for performing intraframe coding, the second mode for performing interframe coding, and the third mode for performing coding unnecessary. Encode video for each macroblock by modeEncoding unit and encoding unitThe moving image data encoded by the method is locally decoded for each macroblockA moving image decoding unit; and a moving object detection unit that determines whether or not the image encoded by the encoding unit is a moving object and generates a rectangular image representing a region of the moving object. In the moving image moving object detection apparatus configured to synthesize the image signal decoded by the unit and the rectangular image and display on the display unit,
  The moving object detection unit determines whether the encoded image for each macroblock is in a stationary state for each mode using at least mode information indicating the types of the first, second, and third encoding modes. Macro block static motion determining means for determining whether the moving state;,
Based on the determination result of the macroblock static motion determination means, a single dynamic macroblock surrounded by static macroblocks is rewritten as a static macroblock to perform noise removal processing. A moving object determination unit that searches for a macroblock and generates a minimum rectangular image including an area where the moving macroblock is adjacent to the image, and the image signal decoded by the moving image decoding unit And the rectangular image are combined and displayed on the display unit.
[0009]
  The moving image moving object detection device of the present invention is any one of the first mode for performing intraframe coding, the second mode for performing interframe coding, and the third mode for performing coding unnecessary. A moving image decoding unit that decodes moving image data encoded for each macroblock according to a mode, and a moving object detection that determines whether the decoded image is a moving object and generates a rectangular image that represents the area of the moving object In the moving image moving object detection apparatus, the image signal decoded by the moving image decoding unit and the rectangular image are combined and displayed on the display unit.
  The moving object detection unit determines whether the decoded image for each macroblock is in a stationary state or a moving state according to the type of the encoding mode, and when the image is encoded in the first mode The static motion is determined based on the difference value between the decoded image signal and the image signal of the previous frame, and when it is encoded in the second mode, the motion vector and transform coefficient of the macroblock A static motion is determined based on the size of the macroblock, and if the image is encoded in the third mode, the macroblock static determination means determines that the image of the macroblock is in a static state; Based on the determination result of the motion determination means, a noise removal means for performing noise removal processing by rewriting a single motion macroblock surrounded by a static macroblock as a static macroblock, and the noise A moving object inclusion processing unit that searches for a macroblock in the frame after the removal and generates a minimum rectangular image including a region where the moving macroblock is adjacent to the moving image decoding unit. And the rectangular image is synthesized and displayed on the display unit.
[0010]
  The moving image moving object detection device of the present invention is any one of the first mode for performing intraframe coding, the second mode for performing interframe coding, and the third mode for performing coding unnecessary. An encoding unit that encodes a moving image for each macroblock according to a mode, a moving image decoding unit that locally decodes the moving image data encoded by the encoding unit for each macroblock, and a code that is encoded by the encoding unit A moving object detection unit that determines whether the converted image is a moving object and generates an image representing the area of the moving object, and the image signal decoded by the moving image decoding unit and the area of the moving object are In the moving image moving object detection device that combines the images to be displayed and displays them on the display unit,
  The moving object detection unit determines whether the encoded image for each macroblock is in a stationary state or a moving state according to the type of the encoding mode, and when the image is encoded in the first mode. The macroblock is determined to be static based on the magnitude of the difference value between the image signal decoded by the moving image decoding unit and the image signal of the previous frame, and is encoded in the second mode. In this case, static motion is determined based on the motion vector of the macroblock and the size of the transform coefficient, and when encoded in the third mode, the image of the macroblock is determined to be static. Based on the determination result of the macro block static motion determination means and the macro block static motion determination means, a single dynamic macro block surrounded by static macro blocks is written as a static macro block. Noise removal means for performing noise removal processing, and moving object inclusion processing means for searching for a macroblock in the frame after the noise removal and generating a minimum rectangular image including a region where a moving macroblock exists adjacently The image signal decoded locally by the moving image decoding unit and the rectangular image are combined and displayed on the display unit.
[0011]
  Furthermore, the moving image moving object detection method of the present invention includes any one of a first mode for performing intra-frame coding, a second mode for performing inter-frame coding, and a third mode for performing coding unnecessary. A moving image decoding step for decoding moving image data encoded for each macroblock according to a mode, and a moving object detection for determining whether the decoded image is a moving object and generating a rectangular image representing the area of the moving object In the moving image moving object detection method, comprising the step of combining the image signal decoded by the moving image decoding unit and the rectangular image and displaying the synthesized image on the display unit,
  In the moving object detection step, the decoded macroblock is encoded according to the first mode in order to determine whether the image for each decoded macroblock is a stationary state or a moving state according to the type of the encoding mode. If it has been converted, the static motion is determined based on the magnitude of the difference between the decoded image signal and the image signal of the previous frame, and the decoded macroblock is encoded in the second mode. If it is determined that the motion is static based on the motion vector of the macroblock and the magnitude of the transform coefficient, and if the decoded macroblock is encoded in the third mode, The macroblock image is determined to be in a static state, and the macroblock static motion determination step and the macroblock static motion determination means determine that the entire surrounding area is a static macroblock. A step of performing noise reduction processing by rewriting the enclosed single dynamic macroblock as a static macroblock, searching for a macroblock in the frame after the noise removal, and including a region where the dynamic macroblock exists adjacently A moving object inclusion processing step for generating a minimum rectangular image, and the image signal decoded by the moving image decoding step and the rectangular image are combined and displayed on a display unit.
[0012]
  As described above, in the present invention, by combining the moving image decoding unit and the moving object detection unit, it is possible to greatly narrow down the detection range of the moving object from the static motion determination result for each macroblock simultaneously with the decoding. This makes it possible to detect moving objects at high speed.
[0015]
  In the present invention,Video codingPartAnd moving object detectionPartCan be combined with encodingThe macrobSince the moving object detection range can be significantly narrowed from the static motion determination result for each lock, the moving object can be detected at high speed.
[0016]
  Also,macroIn static judgment result for each blockBased onThe means for determining a moving object includes a block in which an image in the block is in a moving state.Generate a rectangular image (for example, a rectangular image)Determine moving objectsbe able to.
[0017]
By such processing, the influence of detection error can be suppressed, and the detection result can be displayed more clearly.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a moving image moving object detection device according to an embodiment of the present invention.
[0019]
FIG. 1 is a block diagram showing a configuration of a moving image moving object detection device according to an embodiment of the present invention. The moving image moving object detection apparatus in FIG. 1 includes two parts, a moving image decoding unit 110 and a moving object detection unit 115.
[0020]
In the video decoding unit 110, first, the encoded data received from the transmission path or the storage system is once stored in the input buffer 101, and is demultiplexed based on the syntax for each frame by the demultiplexing unit 102, and is variable. The data is output to the long decoding unit 103. The variable length decoding unit 103 decodes variable length codes of information of each syntax.
[0021]
In the variable length decoding unit 103, if the mode of the macroblock is INTRA, the mode changeover switch 109 is selected to be off, and the quantized DCT coefficient information decoded by the variable length decoding unit 103 is the inverse quantization unit. A reproduced image signal is generated by performing inverse quantization at 104 and performing inverse discrete cosine transform processing at the IDCT unit 105. The reproduced image signal is stored as a reference image in the frame memory 107 and input to the moving object composition display unit 114 in the moving object detection unit 115.
[0022]
  In the variable length decoding unit 103, if the mode of the macroblock is INTER and NOT_CODED, the mode switch 109 is set.onThe quantized DCT coefficient information decoded by the variable length decoding unit 103 is inversely quantized by the inverse quantization unit 104 and subjected to the inverse discrete cosine transform processing by the IDCT unit 105 to perform variable length decoding. Based on the motion vector information decoded by the unit 103, the motion compensation unit 108 performs motion compensation on the reference image, and the adder 106 adds them to generate a reproduced image signal. The reproduced image signal is stored as a reference image in the frame memory 107 and input to the moving object composition display unit 114 in the moving object detection unit 115.
[0023]
On the other hand, as shown in the flowchart of FIG. 2, the moving object detection unit 115 performs three processes of macroblock static motion determination (S101), moving object determination (S102), and moving object composition display (S103) for each frame. This is performed by the macroblock static motion determination unit 111, the moving object determination unit 112, and the moving object composition display unit 114 respectively.
[0024]
In the macroblock static determination unit 111, the mode information, motion vector information, DCT coefficient information decoded by the variable length decoding unit 103, the reproduced image signal at the time of the INTRA macroblock obtained by the subtractor 112, and one frame before From the sum of absolute differences (SAD) with the frame memory, static motion determination is performed for each macroblock in the frame.
[0025]
FIG. 3 is a specific flowchart of macroblock static determination (S101). Here, i and j represent the addresses of the vertical and horizontal macroblocks in the frame, respectively, and V_NMB and H_NMB represent the numbers of vertical and horizontal macroblocks in the frame. The two-dimensional array M [i] [j] is an array for storing information indicating whether each macro block is a dynamic macro block. If TRUE, a dynamic macro block is indicated, and if it is FALSE, a static macro block is indicated.
[0026]
First, the mode information MODE from the variable length decoding unit 103 is determined for each macroblock. (S203)
If MODE is INTRA, the sum of absolute differences (SAD) between the reproduced image signal of the macroblock and the frame memory of the previous frame is calculated and compared with the threshold value T0. (S204) If the value is larger than the threshold value T0, the macro block is determined to be a moving macro block, and TRUE is substituted for M [i] [j]. (S206) When the value is equal to or less than the threshold value T0, the macroblock is determined to be a static macroblock, and FALSE is substituted for M [i] [j]. (S207)
If MODE is INTER, the absolute value sum Σ | MV | of the motion vector of the macroblock and the absolute value sum Σ | COF of the DCT coefficient are calculated from the motion vector information and DCT coefficient information from the variable length decoding unit 103. | Is calculated and compared with the respective threshold values T1 and T2. (S205) If the sum of the absolute value of the motion vector and the sum of the absolute values of the DCT coefficients is smaller than the threshold value, the macro block is determined to be a static macro block, and FALSE is assigned to M [i] [j]. . (S207) Otherwise, it is determined that the macroblock is a moving macroblock, and TRUE is assigned to M [i] [j]. (S206)
If NOT_CODED, the macro block is determined to be a static macro block, and FALSE is assigned to M [i] [j]. (S207)
The moving object determination unit 113 determines a moving object from the static motion determination information for each macroblock of the macroblock static motion determination unit 112. FIG. 4 is a specific flowchart thereof. As shown in FIG. 4, the processing content includes two processes, a noise removal process (S301) and a moving object inclusion process (S302). In the noise removal process (S301), in order to prevent erroneous detection as a moving macroblock due to fluctuations in small objects in the background image or noise during image capture, a moving macroblock in which all eight surrounding macroblocks are stationary is used. Removed. The moving object inclusion process (S302) performs a process of detecting a minimum rectangle including an area where a moving macroblock is adjacent to the result of the static motion determination after removing the noise. With this process, a rectangle that encompasses the moving object can be found.
[0027]
FIG. 5 shows the specific processing contents of the noise removal processing. As in FIG. 3, i and j represent the addresses of macroblocks in the vertical and horizontal directions in the frame, respectively, and V_NMB and H_NMB represent the numbers of macroblocks in the vertical and horizontal directions in the frame. The two-dimensional array M [i] [j] is an array for storing information indicating whether each macro block is a dynamic macro block. If TRUE, a dynamic macro block is indicated, and if it is FALSE, a static macro block is indicated.
[0028]
First, the static determination result for each macroblock is seen. (S403) If the value of the two-dimensional array M [i] [j] is FALSE, that is, if it is a static macro block, nothing is performed in the macro block, and the process proceeds to the next macro block. If the value of the two-dimensional array M [i] [j] is TURE, that is, a dynamic macroblock, the static motion determination result of 8 macroblocks surrounding the macroblock is checked (S405), and all are FALSE, that is, static. If it is a macro block, the macro block is determined to be noise and rewritten to a static macro block. (S406) If even one of the surrounding 8 macroblocks has TURE, it is not determined to be noise, and the process proceeds to the next macroblock. The outside of the screen is assumed to be a static macro block.
[0029]
6 to 8 show specific processing contents of the moving object inclusion processing. Here, n is a counter indicating the number of moving objects, S1 to S4 are parameters indicating a range in which a rectangle including the moving object is searched, and S1 and S2 are the start point and end point of the address in the vertical direction. Yes, S3 and S4 are the start point and end point of the address in the horizontal direction.
[0030]
The flowchart of FIG. 6 performs initialization so that the entire frame is designated as the search range. (S501) Next, a function Rectangular that searches for the smallest rectangle that encompasses the moving object in the designated search range is called. (S502)
The flowcharts of FIGS. 7 and 8 show the contents of the processing of the function Rectangular. The function Rectangular is a search range S1 to S4, n indicating the number of moving objects, and a two-dimensional array M storing the static motion determination results of each macroblock. The dimension arrays B1 to B4 and n indicating the number of moving objects are output.
[0031]
Here, the one-dimensional array HV is a working array for creating a histogram of the number of moving macroblocks in the vertical direction, and the one-dimensional array HH is for creating a histogram of the number of moving macroblocks in the horizontal direction. It is a working arrangement. The variable VFLAG is a flag that changes to TRUE when the value of the histogram in the horizontal direction is not 0, and FALSE when the value is 0, and the variable HFLAG has a value of 0 as the histogram in the vertical direction. It is a flag that is changed to become TRUE when it is not, and FALSE when the value is 0.
[0032]
First, the range of S1 to S2, which is the search range of the work array HV for creating a histogram of the number of moving macroblocks in the vertical direction, is initialized with a value of zero. (S601) In the next loop of LOOP1 and LOOP2, a histogram of the number of moving macroblocks in the vertical direction in the search range is created. That is, the value of the static motion determination result M [i] [j] for each macroblock is compared (S604), and if the value is TURE, that is, a dynamic macroblock, HV [i] is incremented by 1 (S605), If it is FALSE, the action is to do nothing.
[0033]
Next, a non-zero continuous portion is searched from the vertical histogram. First, set the flag VFLAG to FALSE. (S608) Next, in the order of the search range S1 to S2, it is checked whether the histogram HV is not 0 and VFLAG is FALSE. (S610) This condition applies to the start point of a continuous portion where the histogram is not zero. Therefore, since it becomes a candidate for the vertical start point of the rectangle being searched, the address i is stored in the one-dimensional array B1 [n], and VFLAG is set to TURE. (S611)
Next, it is checked whether the histogram HV is 0 or the end of the search range and VFLAG is TURE. (S612) This condition applies to the end point portion of the continuous portion where the histogram is not 0. Therefore, since it is a candidate for the vertical end point of the rectangle being searched, if the histogram HV is 0, the address i-1 is stored in the one-dimensional array B2 [n] (S614), otherwise Stores the address i in the one-dimensional array B2 [n]. (S615) Then, VFLAG is set to FALSE again. (S611)
FIG. 8 is a continuation of the flowchart of FIG. This time, the range from S3 to S4, which is the search range of the work array HV for creating a histogram of the number of moving macroblocks in the horizontal direction, is initialized with a value of zero. (S617) In the next loop of LOOP4 and LOOP5, a histogram of the number of horizontal moving macroblocks in the search range is created. That is, the value of the static motion determination result M [i] [j] for each macroblock is compared (S604). If the value is TURE, that is, if it is a dynamic macroblock, HH [i] is incremented by 1 (S605), If it is FALSE, the action is to do nothing.
[0034]
Next, a non-zero continuous portion is searched from the horizontal histogram. First, the flag HFLAG is set to FALSE. (S624) Next, in the order of the search range S3 to S4, it is checked whether the histogram HH is not 0 and HFLAG is FALSE. (S626) This condition applies to the start point portion of the continuous portion where the histogram is not zero. Accordingly, since it becomes a candidate for the starting point in the horizontal direction of the rectangle being searched, the address j is stored in the one-dimensional array B3 [n], and HFLAG is set to TURE. (S627)
Next, it is checked whether the histogram HH is 0 or whether the HFLAG is TURE at the end of the search range. (S628) This condition applies to the end point portion of the continuous portion where the histogram is not 0. Therefore, since it is a candidate for the horizontal end point of the rectangle being searched, if the histogram HH is 0, the address j-1 is stored in the one-dimensional array B4 [n] (S630), otherwise Stores the address j in the one-dimensional array B4 [n]. (S631) Then, HFLAG is set to FALSE again. (S632)
Here, the search using one vertical and horizontal histogram has been completed, and it is checked whether the search results B1 [n] to B4 [n] match the search ranges S1 to S4 (S633). If there is a match, it can be determined that the smallest rectangle has been obtained because there is no further search range. (S634) Then, n representing the number of moving objects is incremented by 1 (S635), and the next moving object is searched. If the search results B1 [n] to B4 [n] do not match the search ranges S1 to S4, there are still a plurality of moving objects in the search result range, so the search results B1 [n] to B4 [n ] Are transferred to S1 to S4 (S637), and the function Rectangular is called again. (S637)
FIG. 9 is an example of the determination result of the moving object determination unit 113. Here, two moving objects were determined. As shown in the figure, the respective determination results are as follows. In this example, the origin of the address of the macro book is the upper left of the frame, such as B1 [0] to B4 [0] and B1 [1] to B4 [1]. A moving object is determined with a simple arrangement.
[0035]
The moving object composition display unit 114 creates an image obtained by combining the moving object region determined by the moving object determination unit 113 and the reproduced moving image signal. FIG. 10 is a specific flowchart thereof. Here, n indicates the number of moving objects in the frame obtained by the moving object determination unit 113. As the flow of processing, for each moving object, B1 [i] to B4 [i] represent four-angle macroblocks of the moving object. Synthesize. (S602)
FIG. 11 is an example of an image created by the moving object composition display unit.
(Second Embodiment)
12 and 13 are block diagrams illustrating the configuration of the moving image moving object detection device according to the second embodiment of the present invention. In this embodiment, the moving object detection unit is combined with the moving image encoding unit.
[0036]
In FIG. 12, an input moving image signal is divided into macroblocks by a blocking circuit 201. The input moving image signal divided into macroblocks is input to the subtractor 202, and a difference from the predicted image signal is taken to generate a predicted residual signal. Either one of the prediction residual signal and the input moving image signal from the blocking circuit 201 is selected by a mode selection switch 203 and subjected to discrete cosine transform by a DCT (discrete cosine transform) circuit 204. The DCT coefficient data obtained by the DCT circuit 204 is quantized by the quantization circuit 205. The signal quantized by the quantizer 205 is branched into two, and one of them is variable-length encoded by the variable-length encoding circuit 215.
[0037]
On the other hand, the other of the signals that are quantized by the quantization circuit 205 and branched into two branches is processed by the inverse quantization circuit 206 and the IDCT (Inverse Discrete Cosine Transform) circuit 207 in the reverse process of the quantization circuit 205 and the DCT circuit 204. After receiving sequentially, it adds with the estimated image signal input via the switch 211 with the adder 208, and a local decoding signal is produced | generated. This local decoded signal is stored in the frame memory 209 and input to the motion compensation circuit 210. The motion compensation circuit 210 generates a predicted image signal and sends necessary information to the mode selection circuit 203.
[0038]
The mode selection circuit 212 selects a macroblock that performs interframe coding and a macroblock that performs intraframe coding based on the prediction information P from the motion compensation circuit 210 for each macroblock. When intra-frame coding (intra coding) is performed, mode selection switch information M is A, and switch information S is A. When performing inter-frame coding (inter-coding), mode selection switch information M is set to B, and switch information S is set to B. The mode selection switch 203 changes the switch based on the mode selection switch information P, and the switch 216 changes the switch based on the switch information S.
[0039]
Here, there are an intra mode (INTRA), an inter mode (INTER), and a non-coding mode (NOT_CODED) as modes, which are associated with each macroblock, and the INTRA macroblock is an intra-frame encoded image area. The INTER macroblock is an image region that is inter-frame encoded, and the NOT_CODED macroblock is an image region that does not require encoding.
[0040]
On the other hand, in the moving object detection unit 222, first, the mode information, motion vector information, and DCT coefficient information input to the variable length encoding unit 214 are input to the macroblock static motion determination unit, and the determination result is used as the moving object determination. Input to the unit 220. The result determined by the moving object determination unit 220 is input to the moving object composition display unit and also input to the multiplexing unit 215 of the moving image encoding unit 218. The moving object combining unit 221 generates an image obtained by combining the local decoding signal generated by the moving image encoding unit and the moving object, and outputs the image as a local reproduction signal. Note that the specific processing contents of the macroblock static motion determination unit 219, the moving object determination unit 220, and the moving object composition display unit 221 are the same as the processing in FIGS. 2 to 11 in the first embodiment.
[0041]
The encoding control circuit 214 controls the encoding unit 217 based on the encoding information of the encoding unit 218 and the buffer amount of the output buffer 216. The encoded data encoded by the variable length encoding circuit 214 is multiplexed by the multiplexing circuit 216 together with the moving object determination result from the moving object determination unit 220, the transmission rate is smoothed by the output buffer 217, and the code Sent to the transmission system or storage system as digitized data.
[0042]
FIG. 13 is a block diagram on the decoding side with respect to the encoding side in FIG.
[0043]
First, in the video decoding unit 310, first, the encoded data received from the transmission path or the storage system is stored once in the input buffer 301, and is demultiplexed by the demultiplexing unit 302 based on the syntax for each frame. And output to the variable length decoding unit 303. The variable length decoding unit 303 decodes the variable length code of each syntax information.
[0044]
In the variable length decoding unit 303, if the mode of the macroblock is INTRA, the mode changeover switch 309 is selected to be off, and the quantized DCT coefficient information decoded by the variable length decoding unit 303 is the inverse quantization unit. A reproduced image signal is generated by performing inverse quantization in 304 and performing an inverse discrete cosine transform process in the IDCT unit 305. The reproduced image signal is stored as a reference image in the frame memory 307 and is input to the moving object composition display unit 311 in the moving object detection unit 115.
[0045]
  In the variable length decoding unit 303, if the mode of the macroblock is INTER and NOT_CODED, the mode switch 309 is set.onThe quantized DCT coefficient information decoded by the variable length decoding unit 303 is inversely quantized by the inverse quantization unit 304 and subjected to the inverse discrete cosine transform processing by the IDCT unit 305 to perform variable length decoding. Based on the motion vector information decoded by the unit 303, the motion compensation unit 308 performs motion compensation on the reference image, and the adder 306 adds them to generate a reproduced image signal. The reproduced image signal is stored as a reference image in the frame memory 307 and is input to the moving object composition display unit 311.
[0046]
On the other hand, the moving object determination result separated by the demultiplexing unit is input to the moving object composition display unit 311 and operates according to the flowchart of FIG.
[0047]
【The invention's effect】
As described above, according to the present invention, it is possible to provide a moving image moving object detection apparatus and method capable of detecting a moving object at high speed, stably and accurately.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a moving image moving object detection device according to a first embodiment of the present invention.
FIG. 2 is a flowchart showing the operation of the moving object detection unit of the present invention.
FIG. 3 is a flowchart showing the operation of a macroblock static determination unit of the present invention.
FIG. 4 is a flowchart showing the operation of the moving object determination unit of the present invention.
FIG. 5 is a flowchart showing the noise processing operation of the moving object determination unit of the present invention.
FIG. 6 is a flowchart (part 1) illustrating an operation of moving object inclusion processing of the moving object determination unit of the present invention.
FIG. 7 is a flowchart (part 2) illustrating the operation of the moving object inclusion process of the moving object determination unit of the present invention.
FIG. 8 is a flowchart (part 3) illustrating the operation of the moving object inclusion processing of the moving object determination unit of the present invention.
FIG. 9 is a diagram illustrating an example of a determination result of a moving object determination unit according to the present invention.
FIG. 10 is a flowchart showing the operation of the moving object composition display unit of the present invention.
FIG. 11 is a diagram illustrating an example of a display result of a moving object determination unit of the present invention.
FIG. 12 is a block diagram illustrating a configuration on an encoding side of a moving image moving object detection device according to a second exemplary embodiment of the present invention.
FIG. 13 is a block diagram illustrating a configuration of a decoding side of a moving image moving object detection device according to a second exemplary embodiment of the present invention.
[Explanation of symbols]
101 ... Input buffer
102. Demultiplexing unit
103: Variable length decoding unit
104: Inverse quantization unit
105 ... IDCT section
106: Adder
107: Frame memory
108: Motion compensation unit
109 ... Mode selector switch
110: moving picture decoding unit
111 ... Macroblock static determination unit
112 ... Subtractor
113 ... Moving object determination unit
114 ... Moving object composition display unit
115 ... Moving object detection unit
201 ... Blocking circuit
202 ... Subtractor
203 ... Mode selection switch
204 ... DCT circuit
205 ... Quantization circuit
206: Inverse quantization circuit
207 ... IDCT circuit
208 ... Adder
209: Frame memory
210: Motion compensation circuit
211 ... Switch
212 ... Mode selection circuit
213: Encoding control circuit
214... Variable length encoding circuit
215: Multiplexing circuit
216: Output buffer
217: Encoding unit
218 ... Moving picture encoding unit
219: Macroblock static motion determination unit
220 ... Moving object determination unit
221 ... Moving object composition display unit
222: Moving object detection unit
301 ... Input buffer
302: Demultiplexing unit
303: Variable length decoding unit
304: Inverse quantization unit
305 ... IDCT section
306 ... Adder
307: Frame memory
308 ... Motion compensation unit
309 ... Mode selector switch
310 ... moving picture decoding unit
311: Moving object composition display unit

Claims (3)

Video data encoded for each macroblock in any one of the first mode for performing intraframe encoding, the second mode for performing interframe encoding, and the third mode for encoding without encoding And a moving object detection unit that determines whether or not the decoded image is a moving object and generates a rectangular image representing the area of the moving object. The moving image decoding unit decodes the moving image decoding unit. In the moving image moving object detection device that combines the image signal and the rectangular image to be displayed on the display unit,
The moving object detector is
It is determined whether the decoded image for each macroblock is in a stationary state or a moving state according to the type of the encoding mode, and when the image is encoded in the first mode, The static motion is determined based on the difference value from the image signal of the previous frame, and when encoded in the second mode, the static motion is determined based on the motion vector of the macroblock and the magnitude of the transform coefficient. Macroblock static motion determining means for determining motion and determining that the image of the macroblock is in a static state when encoded in the third mode;
Based on the determination result of the macroblock static motion determination means, a noise removal means for rewriting a single dynamic macroblock surrounded by static macroblocks as a static macroblock and performing noise removal processing;
Moving object inclusion processing means for searching for a macroblock in the frame after denoising and generating a minimum rectangular image including a region where a moving macroblock is adjacent to the frame;
A moving image moving object detection apparatus characterized in that the image signal decoded by the moving image decoding unit and the rectangular image are combined and displayed on a display unit. A code that encodes a moving picture for each macroblock in any one of a first mode that performs intra-frame coding, a second mode that performs inter-frame coding, and a third mode that performs coding when coding is unnecessary. An encoding unit, a moving image decoding unit that locally decodes the moving image data encoded by the encoding unit for each macroblock, and whether or not the image encoded by the encoding unit is a moving object A moving object detection unit that generates an image representing a moving object region; and the image signal decoded by the moving image decoding unit and an image representing the moving object region are combined and displayed on the display unit. In the moving image moving object detection device,
The moving object detector is
It is determined whether the image of each encoded macroblock is in a stationary state or a moving state according to the type of the encoding mode, and when the image is encoded in the first mode, the macroblock is the moving image. When the static motion is determined based on the magnitude of the difference value between the image signal decoded by the image decoding unit and the image signal of the previous frame, and encoded in the second mode, the macroblock Macroblock static determination means for determining static motion based on the motion vector and the size of the transform coefficient and determining that the image of the macroblock is in a static state when encoded in the third mode. ,
Based on the determination result of the macroblock static motion determination means, a noise removal means for rewriting a single dynamic macroblock surrounded by static macroblocks as a static macroblock and performing noise removal processing;
Moving object inclusion processing means for searching for a macroblock in the frame after denoising and generating a minimum rectangular image including a region where a moving macroblock is adjacent to the frame;
An apparatus for detecting a moving image moving object, wherein the image signal locally decoded by the moving image decoding unit and the rectangular image are combined and displayed on a display unit. Each macroblock is coded for each of the first mode for performing intraframe coding, the second mode for performing interframe coding, and the third mode for performing coding unnecessary. A moving image decoding step for decoding the encoded moving image data, and a moving object detection step for determining whether the decoded image is a moving object and generating a rectangular image representing a region of the moving object, In the moving image moving object detection method in which the image signal decoded by the moving image decoding unit and the rectangular image are combined and displayed on the display unit,
The moving object detection step includes:
When the decoded macroblock is encoded in the first mode in order to determine whether the image for each decoded macroblock is a stationary state or a moving state according to the type of the encoding mode. The static motion is determined based on the magnitude of the difference value between the decoded image signal and the image signal of the previous frame, and when the decoded macroblock is encoded in the second mode, When static motion is determined based on the motion vector of the macroblock and the size of the transform coefficient, and the decoded macroblock is encoded in the third mode, the image of the macroblock is in a static state. Macroblock static motion determination step for determining
Based on the determination result of the macroblock static motion determination means, rewriting noise removal processing with a single dynamic macroblock surrounded entirely by static macroblocks as a static macroblock; and
A moving object inclusion processing step of searching for a macroblock in the frame after denoising and generating a minimum rectangular image including a region where a moving macroblock is adjacent to the moving macroblock,
A moving image moving object detection method comprising: synthesizing the image signal decoded in the moving image decoding step and the rectangular image and displaying the synthesized image signal on a display unit.

Images