JPH0814848B2 - Displacement pattern removal device - Google Patents

Description

The present invention relates to a displacement pattern removing device for removing a moving part and extracting only a fixed part in video image processing, for example.

[Outline of Invention]

The present invention relates to a displacement pattern removing device, wherein accumulated data and input data are weighted and added, and the added data is used as output data and fed back as accumulated data to remove the displacement pattern with a simple configuration. This process can be continuously performed.

[Conventional technology]

For example, when detecting the movement of an object in image processing, it is necessary to first obtain a so-called background image from which the moving object is removed. In that case, in the conventional displacement pattern removing apparatus, a plurality of time-series data are stored, and one of those data that has a large number of appearances is a fixed pattern (background) and one that has a small number of appearances is a displacement pattern (animal object). Is being processed as.

However, this method requires a mechanism for storing a plurality of data, and particularly in the image processing as described above, the data amount becomes enormous and the configuration becomes extremely large. Further, in the case of continuously processing the data which is supplied one by one, it is necessary to repeat the measurement of the number of appearances every time the data is supplied, which requires extremely high-speed processing, which is difficult to realize.

By the way, the applicant of the present application has previously proposed a digital signal processing device (see Japanese Patent Laid-Open No. 58-215813) applicable to video image processing.

That is, FIG. 2 explains the outline of the apparatus,
In the figure, (21) is the input terminal, (22) is the input / output control (IO
C) system, (23) is an input image memory (VIM) system, (24) is a signal processing (PIP) system, (25) is an address generation (PVP) system,
(26) is the output image memory (VIM) system, (27) is the main control (T
C) system, (28) is an output terminal.

In this device, an input terminal (21) is supplied with an analog video signal from a video camera (not shown) or the like. This video signal is supplied to the IOC system (22) and converted into predetermined digital data by AD conversion or the like, and the VIM system (2
Written in 3). In addition to digital data, signals for controlling the VIM system (23) are supplied from the outside of the IOC system (22) such as clocks, control mode signals, addresses, and write control signals.

In addition, the VIM system (23) has a digital data address to be processed from the PVP system (25), a write control, a read mode,
A signal for controlling the VIM system (23) is supplied from the inside of data select or the like, and the data of this address is transferred to the PIP system (24) and processed. Furthermore PIP system (24)
The data processed by the VIM system (26) is supplied to this VIM system.
Addresses and the like from the PVP system (25) are supplied to the system (26). The processed digital data is written to the VIM system (26).

Further, the VIM system (26) is also supplied with an address and the like from the IOC system (22), whereby the read digital data is supplied to the IOC system (22) and converted into a predetermined analog video signal by DA conversion or the like. It is converted and taken out to the output terminal (28).

The TC system (27) supplies a designation signal such as a mode and system, a clock signal, etc. to each system (22) to (26).

Further, the start signal of the frame to be processed is supplied from the IOC system (22) to the PVP system (25), and the IVP system (25) starts the IOC.
A processing end signal is supplied to the system (22).

In this way, the video signal supplied to the input terminal (21) is digitally processed and output to the output terminal (28). According to the above-described apparatus, the functions necessary for the processing are provided to the respective systems. (22)-(26), each system (22)-
Since a control circuit can be provided independently for each (26) and control can be performed by independent microprograms, the load on software for each system is small and high-speed processing can be performed with a simple program. This makes it possible, for example, to process video signals in real time.

By the way, in the above-mentioned device, the contents of the process are PIP (2
Determined by the microprogram such as 4). Therefore, the contents of the processing can be changed by rewriting these microprograms.

That is, FIG. 3 shows a specific configuration of the PIP system (24). The PIP system (24) is actually formed by arranging a large number (for example, 60) of processor units (30) in parallel. However, in the figure, only two of them (30a) and (30b) are shown. In this figure, the digital data from the VIM system (23) or (26) is the processor unit (30a) (30b).
..Input registers (FRA) (31a) (31 provided for each
b) ... and these registers are PVP
The system (25) controls the read addresses of the VIM systems (23) and (26) according to the read addresses, and stores a predetermined amount of data required for each processor unit.

The data written in these registers (31a) (31b)... Are calculated by the operation units (32a) (33a), (32b) (33
b) is supplied to. Each of these arithmetic units is provided with an adder / subtractor, a multiplier, a coefficient memory, and a data memory, and performs linear and non-linear data conversion arithmetic operations according to control signals from the control units (34a) (34b).
Further, this calculation result is obtained by the calculation units (33a) (33b) ..., and these calculation units (33a) (33b) ..
Is controlled according to the write address of the VIM system (23) (26), and the operation result is written in the desired portion of the VIM system (23) (26).

In this case, the control signals from the control units (34a) (34b)... Are stored in the microprogram memory (MPM) (35a).
(35b) are formed in accordance with the microprogram written in. Therefore, the MPMs (35a) (35b) ... Have a so-called PAM structure, and a microprogram from the outside is written into the MPMs (35a) (35b) ... through the change units (36a) (36b). As a result, the contents of the processing can be changed by rewriting the microprogram.

 The inventor of the present application pays attention to this point.

[Problems to be solved by the invention]

The above-described conventional technique has a problem that a large-scale configuration is required to store data and continuous processing cannot be performed.

[Means for solving problems]

According to the present invention, the coefficient storage means (2) for outputting the coefficient A and the coefficient B and the coefficient A in the input image data (FRA (31)) are used.
A first multiplication means (1A) for multiplying and outputting
The addition means (4) for adding the output signal of the multiplication means and the output signal of the second multiplication means (1B), and the storage means (3) for storing the output signal of the addition means. The multiplying means is adapted to multiply the output signal of the storage means by the coefficient B and supply the output signal to the adding means, and the value a of the coefficient A stored in the coefficient storage means and the value of the coefficient a. The displacement pattern removing device is characterized in that the relationship of the value b of the coefficient B is selected so that a + b = 1.

[Action]

According to this, since the supplied data is accumulated and the displacement pattern is removed, only the accumulated data is required as the stored data, which simplifies the configuration and facilitates continuous processing.

〔Example〕

Figure 1 shows a PIP system (24) for realizing the device of the present application.
3 shows functional blocks of a processing processor section (30) in FIG.

In the figure, the input data Xn from the FPA (31) is supplied to the multiplier (1A), and the weighting coefficient A from the coefficient memory (2) is supplied.
And the accumulated data Yn _-1 from the data memory (3) is supplied to the multiplier (1B), which is also multiplied by the weighting coefficient B from the coefficient memory (2). Further, the signals from the multipliers (1A) and (1B) are supplied to the adder (4), and the added data is written in the data memory (3). The above weighting factors A and B are A + B = 1.

Therefore, in this device, the addition data Yn newly written in the data memory (3) becomes Yn = AXn + BYn ₋₁ , and this data Yn is further fielded back to the multiplier (1B) as cumulative data, and this is repeated. . This leaves only the fixed pattern in the input data Xn and removes the displacement pattern. Then, this data Yn is supplied as output data to the VIM system (23) (26).

That is, in the above-mentioned device, the portion of the invariant (fixed pattern) between the input data Xn and the cumulative data Yn _-1 is A +
Since B = 1, the next value of the accumulated data Yn remains unchanged.
It is said. On the other hand, the changed part (fixed pattern displacement pattern) is attenuated by the ratio of the weighting factors A and B to be the next accumulated data Yn, and this displacement pattern is the ratio of the time occupied by the pattern to the accumulated time. And the displacement pattern is removed.

Although the displacement pattern is removed in this manner, the above-described apparatus requires only accumulated data, so the configuration is extremely simple. In the case where the above-mentioned 60 processing processor units are provided, the amount of data in one processor unit is 1/20 of the image, assuming that the processing is performed independently for the three primary colors, and a very small memory is sufficient.

Furthermore, since data is accumulated and processed sequentially,
It is also suitable for continuous processing of data.

With respect to the values of the weighting factors A and B, if A is increased, the convergence becomes faster but the displacement pattern remains more, and if B is increased, the displacement pattern remains less but the convergence slows. Therefore, in the above device, for example, the number of times of accumulation is measured,
Accordingly, the weighting coefficient may be controlled so that A is increased at first and B is gradually increased as the accumulation progresses.

〔The invention's effect〕

According to the present invention, since the supplied data is accumulated and the displacement pattern is removed, only the accumulated data is required as the stored data, the configuration is simplified and continuous processing can be easily performed. It was like

[Brief description of drawings]

FIG. 1 is a configuration diagram of an example of the present invention, and FIGS. 2 and 3 are diagrams for explaining a conventional technique. (1A) and (1B) are multipliers, (2) is a coefficient memory, (3) is a data memory, and (4) is an adder.

Claims (1)

[Claims] 1. A coefficient storing means for outputting a coefficient A and a coefficient B, a first multiplying means for multiplying input image data by the coefficient A and outputting the same, an output signal of the first multiplying means and a second The addition means for adding the output signal of the multiplication means and the storage means for storing the output signal of the addition means are provided, and the second multiplication means multiplies the output signal of the storage means by the coefficient B. The output signal is supplied to the adding means, and the relationship between the value a of the coefficient A and the value b of the coefficient B stored in the coefficient storage means is selected so that a + b = 1. Displacement pattern removing device characterized in that.