JP2821072B2 - Color video camera - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a color video camera, and more particularly to a method for generating a luminance signal.

[0002]

2. Description of the Related Art FIG.
technical Report "(Vol. 31 N
o. 1 Feb. 1985) A diagram showing a color filter array of an image sensor shown on pages 76 to 82, published by Matsushita Techno Research Co., Ltd., and sold by Ohmsha Co., Ltd. In the figure, Mg is a pixel having a magenta color filter, G
Represents a pixel having a green color filter, Cy represents a pixel having a cyan color filter, and Ye represents a pixel having a yellow color filter. FIG. 2 is a diagram showing a part of a signal processing circuit of a color video camera using an image sensor in which these color filters are arranged. In the figure, 1 is a lens, 2 is an image sensor, 3 is a bandpass filter (BP)
F), 4 is a detection circuit, 5 is one horizontal scanning period delay circuit (1
HDLY), 6 is a switch circuit, and 45 is a low-pass filter (LPF).

Next, the operation will be described. In FIG. 2, light incident from a lens 1 forms an image on an image sensor 2. In FIG. 1, the signal output from the n-th line of the image sensor 2 where (Mg + Cy) and (G + Ye) are repeated is Sn.
, (Mg + Ye), and (G + Cy), assuming that the signal output from the (n + 1) th line of the image sensor 2 is Sn + 1, Sn and Sn + 1 are respectively represented by the following equations.

Sn = Yn + Cn · sin (ωt) + (1) Sn + 1 = Yn + 1 + Cn + 1 · sin (ωt) + (2) where ω is twice the horizontal pixel pitch. Delivery of corresponding color signals
This is the transmission frequency. In addition, Y in equations (1) and (2)
n and Yn + 1 represent the luminance signal components of the nth and n + 1th lines, and Cn and Cn + 1 represent the color difference signal components of the nth and n + 1th lines, and are represented by the following equations.

Yn = (Ye + G) + (Cy + Mg) = 2R + 3G + 2B (3) Yn + 1 = (Ye + Mg) + (Cy + G) = 2R + 3G + 2B (4) Cn = (Cy + Mg) − (Ye + G) = 2B-G (5) Cn + 1 = (Ye + Mg)-(Cy + G) = 2R-G (6)

[0006] The luminance signal components Yn and Yn + 1 are
Is passed through a low-pass filter 45. The color difference signal components Cn and Cn + 1 are obtained by passing the output of the image sensor 2 through a bandpass filter 3 having a center frequency ω and a detection circuit 4. In the output of the detection circuit 4, 2R-G and 2B-G appear every other line. This one
The 2R-G and 2B-G appearing every other line are synchronized by the one horizontal scanning period delay circuit 5 and the switch circuit 6.

In the above-described conventional color video camera, the signal output from the image sensor is passed through a low-pass filter to remove a modulation component of the color signal to obtain a luminance signal. Therefore, a high-frequency component of the luminance signal is attenuated. There was a problem. Therefore, aperture correction is performed by emphasizing the rising and falling edges of the signal to improve the resolution. However, there is a problem that the emphasis is unnatural.

FIG. 3 is a block circuit diagram showing a color video camera in a spatial pixel shift system of a three-panel imaging system disclosed in, for example, "Television Society Journal" (November 1986), pp. 1079 to 1085. . In the figure, 51 is a lens, 52 is a three-color separation prism, and 53 and 5
Reference numerals 4 and 55 denote image pickup devices, 56 denotes a red signal amplifier, and 57 denotes a red signal amplifier.
Is a green signal amplifier, 58 is a blue signal amplifier,
68 is a low-pass filter, 71 is an adder, and 73 is a demultiplexer. FIG. 4 is a diagram showing the configuration of an output signal in a conventional spatial pixel shifting method of a three-chip imaging method. In the figure, G indicates a signal of a green pixel, and RB indicates a mixed signal of red and blue pixels. In addition, p indicates the pixel pitch in the horizontal direction of the image sensor, and the green image sensor and the red and blue image sensors are horizontally shifted by a half pixel pitch.

Next, the operation will be described. In FIG. 3, light incident from a lens 51 is converted into a three-color separation prism 52.
Are split into red, green, and blue light, and the respective lights form images on the imaging devices 53, 54, and 55. The image pickup devices 53, 54, and 55 mix signals of two vertically adjacent pixels and output one signal. Image sensors 53, 5
The red, green, and blue signal amplifiers 56, 57, and 58 output the R, G, and B output signals R, G, and B, respectively. When the ratio of the output signals is NTSC, R: G: B = Amplification is performed so as to be 0.30: 0.59: 0.11 to obtain R ′, G ′, and B ′ signals.
R ′ and B ′ are mixed by the adder 71 to obtain a mixed signal R ′ and B ′. Then, G ′ and RB are alternately switched by the demultiplexer 73 and output as a luminance signal, and the output is passed through a low-pass filter 68 to obtain a luminance signal Y. That is, the luminance signal Y is expressed by the following equation (7).

Y = 0.30R + 0.59G + 0.11B = R ′ + G ′ + B ′ = G ′ + RB (7)

[0011]

The object of the present invention is to increase the resolution in the conventional spatial pixel shifting method of the three-chip imaging method. However, there is no problem in the case of a subject in which the ratio between the green signal and the red / blue mixed signal is substantially equal, but in the case of a subject in which the ratio is largely different, vertical stripes are generated. Therefore, conventionally, the green signal and the red
Although the generation of the vertical stripes is reduced by passing the mixed signals of blue and blue through a low-pass filter, there is a problem that the high-frequency component of the luminance signal is attenuated. Therefore, aperture correction is performed by enhancing the rising and falling edge portions of the signal to improve the resolution. However, there is a problem that the enhancement is unnatural.

One object of the present invention is to provide a color video camera capable of reducing attenuation of a high frequency component of a luminance signal. It is another object of the present invention to provide a color video camera capable of obtaining a good image with a low-cost circuit configuration with little attenuation of a high-frequency component of a luminance signal. Still another object of the present invention is to provide a color video camera capable of inexpensively performing aperture correction without unnatural enhancement with a simple circuit configuration.

[0013]

According to a first aspect of the present invention, a color video camera includes a two-dimensional photoelectric conversion element having one of the first to Nth N types of spectral sensitivity characteristics. In a color video camera that obtains a color image using an imaging device arranged on a plane, the outputs of photoelectric conversion devices having respective types of spectral sensitivity characteristics are input to a two-dimensional low-pass filter, so that the first to Nth N types of two types are output.
A dimensional low-pass filter output is obtained, and an output signal of a pixel having the J-th (J is any of the first to N-th) spectral sensitivity characteristics is added to the K-th (K-th is the first to N-th) coordinates at the pixel coordinates. Either of the two-dimensional low-pass filter output and the ratio of the J-th two-dimensional low-pass filter output at the coordinates of the pixel is multiplied to obtain a pixel having the K-th spectral sensitivity characteristic at the coordinates of the pixel. An output signal is calculated, and an output signal is calculated assuming that there is a pixel having a spectral sensitivity characteristic other than the Kth by the same calculation as necessary, and the above calculation is performed on the output signal of the pixel and the coordinates of the pixel. A luminance signal is calculated from the output signal thus obtained.

In a color video camera according to a second aspect of the present invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image with an image sensor, a low-pass filter to which the output of a photoelectric conversion element having each type of spectral sensitivity characteristic is input and takes out first to N-th N types of outputs; First
To the Nth) spectral sensitivity characteristic, the output signal of the pixel is multiplied by the ratio of the low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. And a calculating means for calculating the luminance signal component.

In a color video camera according to a third aspect of the present invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image pickup device, the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics are input to a low-pass filter to obtain first to N-th N types of low-pass filter outputs. (K is any of the first to N-th) spectral sensitivity characteristics obtained by adding a constant value to the output signal of a pixel and adding a constant value to the low-pass filter output of the image sensor output at the coordinates of the pixel. The luminance signal component is calculated by multiplying the ratio of the output of the K-th low-pass filter at the coordinates of the pixel and a value obtained by adding a constant value to reduce the constant value.

In a color video camera according to a fourth aspect of the present invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image sensor, in a portion where the spatial frequency of the image is high, the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to a low-pass filter, so that the first to Nth N types are output. And outputs the low-pass filter output of the image sensor output at the coordinates of the pixel and the coordinates of the pixel to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. , A luminance signal component is calculated by multiplying by a ratio with the output of the K-th low-pass filter. And it calculates the average value of the force.

In the color video camera according to the fifth invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image pickup device, the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics are input to a low-pass filter to obtain first to N-th N types of low-pass filter outputs. An output signal of a pixel having a spectral sensitivity characteristic of (Kth is any of the first to Nth) a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. The method of calculating the luminance signal component by multiplying the ratio and the method of calculating the averaging value of the outputs of the pixels having N kinds of spectral sensitivity characteristics around the pixel are described below. The difference between the outputs of adjacent pixels are those for switching by whether beyond a certain threshold.

In a color video camera according to a sixth aspect of the present invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image pickup device, the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics are input to a low-pass filter to obtain first to N-th N types of low-pass filter outputs. An output signal of a pixel having a spectral sensitivity characteristic of (Kth is any of the first to Nth) a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. When a luminance lookup component is calculated by multiplying the ratio by a ratio, a division lookup table is used. Is checked to see if the most significant bit is 1; if it is 0, it is checked sequentially to the lower bits, the check is stopped at the nth bit, and after this check, the bit shift is performed to remove the 0 portion Then, valid n bits are used for inputting a lookup table for division.

In the color video camera according to a seventh aspect of the present invention, in the sixth aspect, the content of the division look-up table used in the division portion when calculating the luminance signal component is n bits of the result of the division operation by bit shifting. Bigger ,
The integer part is obtained by truncating the decimal part, and the operation result using the value is reduced by n bits by bit shift and returned to the original digit, and the integer part is used as the operation result.

In a color video camera according to an eighth aspect of the present invention, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image pickup device, the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics are input to a low-pass filter to obtain first to N-th N types of low-pass filter outputs. An output signal of a pixel having a spectral sensitivity characteristic of (Kth is any of the first to Nth) a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. As a method of calculating the luminance signal component by multiplying the ratio, the multiplication / division part is logarithmically converted, and a logarithmic lookup table and a power-up lookup table are used. Is shall.

In the color video camera according to the ninth aspect, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. In a color video camera that obtains a color image using an image pickup device, the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics are input to a low-pass filter to obtain first to N-th N types of low-pass filter outputs. An output signal of a pixel having a spectral sensitivity characteristic of (Kth is any of the first to Nth) a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. a low-pass filter used in the circuit for calculating a luminance signal component by multiplying the ratio, pressurized to a plurality of bit shift circuits and an input signal the bit shift circuit output And it constitutes in the circuit.

The color video camera according to the tenth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of type K to the low-pass filter, and the K-th (K-th is any one of the first to N-th) outputs A signal obtained by adding a constant value to an output signal of a pixel having a spectral sensitivity characteristic of a certain value and a constant value added to a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. The luminance signal component is calculated by multiplying a ratio of the luminance signal component to a value obtained by adding a constant value.

The color video camera according to the eleventh invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of type K to the low-pass filter, and the K-th (K-th is any one of the first to N-th) outputs A signal obtained by adding a constant value to an output signal of a pixel having a spectral sensitivity characteristic of a certain value and a constant value added to a low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. As a method of calculating a luminance signal component by multiplying a ratio with a value obtained by adding a constant value, a logarithmic conversion of a multiplication / division portion is performed, and a logarithmic lookup table and a power-up lookup are used. Buru is to use a.

The color video camera according to the twelfth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, A two-dimensional low-pass filter to which the output of the photoelectric conversion element having the spectral sensitivity characteristic of the type is input to take out the first to N-th types of outputs;
(K is any of the first to N-th) spectral output signals of the pixel having the spectral sensitivity characteristic, and the output of the image sensor at the coordinates of the pixel is 2
-Dimensional low-pass filter output and the Kth coordinate in the pixel coordinates
And a calculating means for calculating a luminance signal component of the pixel by multiplying by a ratio with the two-dimensional low-pass filter output.

A color video camera according to a thirteenth aspect of the present invention
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. A) a signal obtained by adding a constant value to an output signal of a pixel having the spectral sensitivity characteristic of (a), a constant value added to a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel, and a second signal at the coordinates of the pixel. The luminance signal component is calculated by multiplying a ratio of the output of the two-dimensional low-pass filter of K to a value obtained by adding a constant value to reduce the constant value.

The color video camera according to the fourteenth aspect is
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, In the portion where the spatial frequency is high, the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to a two-dimensional low-pass filter, whereby the first
To obtain the Nth N types of two-dimensional low-pass filter outputs from
The output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics includes a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th two-dimensional output at the coordinates of the pixel. The luminance signal component is calculated by multiplying the ratio with the output of the dimensional low-pass filter, and the average value of the outputs of the pixels having N kinds of spectral sensitivity characteristics is calculated around the pixel in a portion where the spatial frequency is low.

The color video camera according to the fifteenth invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the output of the image sensor output at the coordinates of the pixel to the output of the two-dimensional low-pass filter at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. The method of calculating the luminance signal component and the method of calculating the average of the outputs of the pixels having N kinds of spectral sensitivity characteristics around the pixel are defined by the difference between the output of the two horizontal adjacent pixels of the pixel and the Either the difference between the outputs of the vertical adjacent pixels containing the one in which switching by whether beyond a certain threshold.

A color video camera according to a sixteenth aspect of the present invention
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the output of the image sensor output at the coordinates of the pixel to the output of the two-dimensional low-pass filter at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A method for calculating a luminance signal component and a method for calculating an average value of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel are described below. The difference between the output of Judges is for switching by whether beyond a certain threshold.

The color video camera according to the seventeenth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the output of the image sensor output at the coordinates of the pixel to the output of the two-dimensional low-pass filter at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. The method of calculating the luminance signal component and the method of calculating the average value of the outputs of the pixels having N kinds of spectral sensitivity characteristics around the pixel are defined by a diagonally upper left adjacent pixel and a diagonally lower right pixel of the pixel. Either the difference between the output of the lower left adjacent pixels and upper right adjacent pixel difference and the pixel of the output of the tangent pixel is for switching by whether beyond a certain threshold.

The color video camera according to the eighteenth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the output of the image sensor output at the coordinates of the pixel to the output of the two-dimensional low-pass filter at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. A division look-up table is used in a division portion when calculating a luminance signal component. Here, when the number of input bits of the table is n, the most significant bit of the input is 1. If the value is 0, the lower bits are sequentially inspected and the inspection is stopped at the nth bit. After this inspection, a bit shift is performed to remove the 0 portion and divide the effective n bits. This is used for inputting a look-up table.

The color video camera according to the nineteenth aspect is
In the eighteenth aspect, the content of a division look-up table used in a division part when calculating a luminance signal component is an integer obtained by increasing the operation result of the division by n bits by bit shifting and truncating the decimal part. And the operation result using that value is reduced by n bits by bit shifting.
Ku is returned to the original digits, it is an operation result integer part.

The color video camera according to the twentieth invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the output of the image sensor output at the coordinates of the pixel to the output of the two-dimensional low-pass filter at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. As a method of calculating the luminance signal component, the multiplication / division portion is logarithmically converted, and a logarithmic look-up table and an exponentiation look-up table are used.

The color video camera according to the twenty-first invention is
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. Is multiplied by the ratio of the two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th two-dimensional low-pass filter output at the coordinates of the pixel. A two-dimensional low-pass filter used in a circuit for calculating a luminance signal component is composed of a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal. It is intended to.

The color video camera according to the twenty-second invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. A) a signal obtained by adding a constant value to an output signal of a pixel having the spectral sensitivity characteristic of (a), a constant value added to a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel, and a second signal at the coordinates of the pixel. The luminance signal component is calculated by multiplying a ratio of the output of the two-dimensional low-pass filter of K to a value obtained by adding a constant value.

The color video camera according to the twenty-third aspect is
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, The first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of the photoelectric conversion elements having the two types of spectral sensitivity characteristics to the two-dimensional low-pass filter, and the K-th (K-th is the first to N-th) outputs. A) a signal obtained by adding a constant value to the output signal of a pixel having the spectral sensitivity characteristic of (a), a constant value added to a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel, and As a method of calculating a luminance signal component by multiplying a ratio of a two-dimensional low-pass filter output of K to a value obtained by adding a constant value, a logarithmic conversion of a multiplication / division portion is performed, and a logarithmic lookup table is used. Is to use a look-up table for power.

The color video camera according to the twenty-fourth invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And outputs the low-pass filter output of the K-th (K is any of the first to N-th) pixels the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the pixel The luminance signal component is calculated by multiplying the ratio with the output of the K-th low-pass filter in the coordinates.

A color video camera according to a twenty-fifth aspect of the present invention
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And a constant value is added to the output signal of the K-th pixel (K is any of the first to N-th) pixels, and a composite signal of each type of pixel at the coordinates of the pixel is obtained. A luminance signal component is calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter to a value obtained by adding a constant value to the output of the K-th low-pass filter at the coordinates of the pixel to reduce the constant value. .

The color video camera according to the twenty-sixth aspect is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a three-dimensional plane in a shifted manner, in a portion where the spatial frequency of the image is high, the output of each image sensor is input to a low-pass filter. , The first to N-th N types of low-pass filter outputs are obtained, and the output signals of the K-th (K is any of the first to N-th) pixels are combined with the respective types of pixels at the coordinates of the pixel. A luminance signal component is calculated by multiplying the ratio between the output of the low-pass filter of the signal and the output of the K-th low-pass filter in the coordinates of the pixel. A luminance signal component is calculated from the value.

The color video camera according to the twenty-seventh aspect is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And outputs the low-pass filter output of the K-th (K is any of the first to N-th) pixels the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the pixel A method of calculating a luminance signal component by multiplying the ratio with the output of the K-th low-pass filter in coordinates, and a method of calculating a luminance signal component from an averaging value of outputs of N types of pixels around the pixel. The switching is performed depending on whether or not the difference between the outputs of the two horizontal adjacent pixels of the pixel exceeds a specific threshold value.

The color video camera according to the twenty-eighth aspect of the present invention
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And outputs the low-pass filter output of the K-th (K is any of the first to N-th) pixels the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the pixel When calculating the luminance signal component by multiplying the ratio with the output of the K-th low-pass filter in the coordinates, a division look-up table is used in the division section. Here, when the number of input bits of the table is n, It is checked whether the most significant bit is 1, and if it is 0, it is checked sequentially to the lower bit, the check is stopped at the nth bit, and after this check, the bit shift is performed. No valid remove portions of the 0 n
The bits are used for inputting a lookup table for division.

The color video camera according to the twenty-ninth aspect is
In the twenty-eighth aspect, the content of a division look-up table used in a division part when calculating a luminance signal component is increased by n bits by the bit shift of the operation result of division
Ku to, the integer part of the truncated fractional part, only n bits by bit-shifting the operation result using the value small
And fence back to the original digits, it is an operation result integer part.

A color video camera according to a thirtieth aspect of the present invention comprises:
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And outputs the low-pass filter output of the K-th (K is any of the first to N-th) pixels the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the pixel As a method of calculating a luminance signal component by multiplying the ratio with the output of the K-th low-pass filter in coordinates, a multiplication / division portion is logarithmically converted, and a logarithmic lookup table and a power-up lookup table are used.

The color video camera according to the thirty-first invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And outputs the low-pass filter output of the K-th (K is any of the first to N-th) pixels the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the pixel A low-pass filter used in a circuit for calculating a luminance signal component by multiplying by a ratio with the output of a K-th low-pass filter in coordinates is constituted by a plurality of bit shift circuits and an adder circuit using the output of the bit shift circuit as an input signal. Things.

The color video camera according to the thirty-second invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a low-pass filter, and the first to N-th N types are obtained. And a constant value is added to the output signal of the K-th pixel (K is any of the first to N-th) pixels, and a composite signal of each type of pixel at the coordinates of the pixel is obtained. A luminance signal component is calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter and a value obtained by adding a constant value to the output of the K-th low-pass filter at the coordinates of the pixel.

The color video camera according to the thirty-third invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the outputs of the respective image sensors are input to a low-pass filter, and the first to N-th N types are obtained. And a constant value is added to the output signal of the K-th pixel (K is any of the first to N-th) pixels, and a composite signal of each type of pixel at the coordinates of the pixel is obtained. As a method of calculating a luminance signal component by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter and a value obtained by adding a constant value to the output of the K-th low-pass filter at the coordinates of the pixel, the multiplication / division portion is logarithmically calculated. After conversion, a logarithmic lookup table and a power-up lookup table are used.

The color video camera according to the thirty-fourth aspect is:
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. To calculate a luminance signal component.

The color video camera according to the thirty-fifth invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the N-th pixel), a fixed value is added to a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel, The luminance signal component is calculated by multiplying the ratio of the output of the K-th two-dimensional low-pass filter at the coordinates of the above by adding a constant value to reduce the constant value.

The color video camera according to the thirty-sixth invention is characterized in that
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, in a portion where the spatial frequency of the image is high, the output of each image sensor is input to a two-dimensional low-pass filter. As a result, the first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K is any of the first to N-th) filters is obtained.
Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. Is calculated, and in a portion where the spatial frequency is low, a luminance signal component is calculated from an average value of outputs of N types of pixels around the pixel.

A color video camera according to a thirty-seventh aspect of the present invention comprises:
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. And a method of calculating the luminance signal component from the average of the outputs of the N types of pixels around the pixel. The method of calculating the luminance signal component by multiplying The switching is performed depending on whether one of the output of the pixel and the difference between the outputs of the two vertically adjacent pixels exceeds a specific threshold value.

The color video camera according to the thirty-eighth aspect of the present invention
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. And a method of calculating a luminance signal component from the average of the outputs of N types of pixels around the pixel. Is switched depending on whether or not the output difference exceeds a specific threshold value.

The color video camera according to the thirty-ninth aspect is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. And a method of calculating the luminance signal component from the average of the outputs of the N types of pixels around the pixel. The switching is performed depending on whether or not one of the difference between the output of the adjacent pixel and the difference between the output of the lower left diagonal adjacent pixel and the output of the upper right diagonal pixel exceeds a specific threshold value. .

The color video camera according to the fortieth invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. When a luminance signal component is calculated by multiplying by 1, a division lookup table is used in a division portion, and the number of input bits of the table is n.
In this case, it is checked whether the most significant bit of the input is 1; if it is 0, the check is sequentially performed on the lower bits, the check is stopped at the nth bit, and after this check, the bit shift is performed. , 0 are removed, and valid n bits are used as an input to a lookup table for division.

The color video camera according to the forty-first aspect is
In the fortieth aspect, the content of a division look-up table used in a division part when calculating a luminance signal component is increased by n bits by a bit shift to the operation result of the division.
Ku to, the integer part of the truncated fractional part, only n bits by bit-shifting the operation result using the value small
In this case, the digit is returned to the original digit, and the integer part is used as the operation result.

The color video camera according to the forty-second aspect is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. In order to calculate a luminance signal component by multiplying by, the logarithmic conversion is performed on the multiplication / division portion, and a logarithmic look-up table and an exponentiation look-up table are used.

A color video camera according to a forty-third aspect is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth pixel), the ratio between the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th two-dimensional low-pass filter output at the coordinates of the pixel. , A two-dimensional low-pass filter used in a circuit that calculates a luminance signal component by multiplying by a plurality of bit shift circuits and a plurality of addition circuits that use the output of the bit shift circuit as an input signal.

The color video camera according to the forty-fourth invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the N-th pixel), a constant value added to the output signal of the pixel, and a fixed value added to the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel. The luminance signal component is calculated by multiplying the ratio of the output of the K-th two-dimensional low-pass filter at a coordinate of the K-th two-dimensional low-pass filter plus a constant value.

The color video camera according to the forty-fifth invention is
The light is split into N types of light by a prism,
In a color video camera that obtains a color image by displacing N image sensors arranged on a two-dimensional plane in a shifted manner, the output of each image sensor is input to a two-dimensional low-pass filter, so that the first to Nth N-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the N-th pixel), a fixed value is added to a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel, In order to calculate a luminance signal component by multiplying the ratio of the output of the K-th two-dimensional low-pass filter at the coordinates of the K-th two-dimensional low-pass filter and a constant value, the multiplication / division portion is logarithmically converted, a logarithmic lookup table, and This uses a riding look-up table.

The color video camera according to the forty-sixth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained. The output signal of the pixel having the (Nth) spectral sensitivity characteristic is multiplied by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. The first signal thus calculated is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are passed through a second low-pass filter to obtain a third signal. It is obtained so as to obtain the luminance signal component by combining the.

A color video camera according to a forty-seventh aspect of the present invention
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained, and the K-th (K-th is the first to the first). Either the (Nth) spectral sensitivity characteristic output signal of a pixel plus a constant value, the image sensor output at the pixel coordinates plus a constant value added to the first low-pass filter output, and the pixel coordinates , A first signal calculated by multiplying a ratio of the output of the K-th first low-pass filter to a value obtained by adding a constant value to reduce the constant value, passes through a band-pass filter to a second signal for aperture correction. Obtain a second signal and the imaging element output the second
A luminance signal component is obtained by synthesizing a third signal obtained through a low-pass filter.

A color video camera according to a forty-eighth aspect of the present invention comprises:
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, In the part where the spatial frequency is high, the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first low-pass filter, whereby the first
To N-th first low-pass filter outputs, and outputs the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics to the output of the image sensor at the coordinates of the pixel. Is multiplied by the ratio of the output of the first low-pass filter at the coordinates of the pixel to the output of the K-th low-pass filter at the coordinates of the pixel. The first signal is calculated from the average value of. Then, the first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to generate a luminance signal. The components are obtained.

The color video camera according to the forty-ninth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained. The output signal of the pixel having the (Nth) spectral sensitivity characteristic is multiplied by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. And the signal calculated from the average of the outputs of the N types of pixels around the pixel, by determining whether the difference between the outputs of the two horizontal adjacent pixels of the pixel exceeds a specific threshold value. Obtaining a first signal switched by. Then, the first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to generate a luminance signal. The components are obtained.

The color video camera according to the fiftieth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained. The output signal of the pixel having the (Nth) spectral sensitivity characteristic is multiplied by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. The first signal thus calculated is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are passed through a second low-pass filter to obtain a third signal. When a luminance signal component is obtained by synthesizing the above, a division look-up table is used in a division portion. Here, when the number of input bits of the table is n, it is checked whether the most significant bit of the input is 1 or not. And
If 0, the test is sequentially performed on the lower bits, the test is stopped at the n-th bit, and after this test, a bit shift is performed.
The valid n bits from which the 0 part has been removed are used as inputs to the lookup table for division.

The color video camera according to the fifty-first invention is
In the fiftieth invention, the content of a division look-up table used in a division part when a luminance signal component is obtained is obtained by increasing the operation result of the division by n bits by a bit shift and making the decimal part a truncated integer part. Operation result using value is reduced by n bits by bit shift
Ku is returned to the original digits, is obtained by the integer part as the operation result.

The color video camera according to the fifty-second invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained. The output signal of the pixel having the (Nth) spectral sensitivity characteristic is multiplied by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. The first signal thus calculated is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are passed through a second low-pass filter to obtain a third signal. To obtain the luminance signal component by combining the multiplication and division portion logarithmic transformation, it is obtained using logarithm lookup table, and the look-up table for power.

The color video camera according to the fifty-third invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained. The output signal of the pixel having the (Nth) spectral sensitivity characteristic is multiplied by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. The first signal thus calculated is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are passed through a second low-pass filter to obtain a third signal. A first low-pass filter used in the circuit to obtain a luminance signal component by combining the input signal a plurality of bit shift circuits and the bit shift circuit output
And an adder circuit for performing the operation .

The color video camera according to the fifty-fourth invention comprises:
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained, and the K-th (K-th is the first to the first). Either (Nth) spectral sensitivity characteristic output signal of a pixel to which a constant value has been added, and a coordinate obtained by adding a constant value to the first low-pass filter output of the image sensor output at the coordinates of the pixel; A second signal for aperture correction is obtained by passing a first signal calculated by multiplying a ratio of a result obtained by adding a constant value to the output of the K-th first low-pass filter through a band-pass filter to obtain a second signal Is obtained so as to obtain the luminance signal component by combining the third signal obtained through the image pickup device outputs the second low-pass filter.

The color video camera according to the fifty-fifth invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, By inputting the outputs of the photoelectric conversion elements having the spectral sensitivity characteristics of the first type to the first low-pass filter, the first to N-th N types of first low-pass filter outputs are obtained, and the K-th (K-th is the first to the first). Either (Nth) spectral sensitivity characteristic output signal of a pixel to which a constant value has been added, and a coordinate obtained by adding a constant value to the first low-pass filter output of the image sensor output at the coordinates of the pixel; A second signal for aperture correction is obtained by passing a first signal calculated by multiplying a ratio of a result obtained by adding a constant value to the output of the K-th first low-pass filter through a band-pass filter to obtain a second signal In order to obtain a luminance signal component by synthesizing an image sensor output with a third signal obtained by passing the image sensor output through a second low-pass filter, a multiplication / division portion is logarithmically converted, and a logarithmic lookup table and a power lookup table are used. Is used.

The color video camera according to the fifty-sixth invention is characterized in that
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. obtain a second signal for aperture correction through the first signal is calculated by multiplying the ratio of the two-dimensional low-pass filter output of 1 to the band-pass filter, the second signal and the imaging element output the second low-pass It is obtained so as to obtain the luminance signal component by combining the third signal obtained through filtering.

The color video camera according to the fifty-seventh aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. K is a value obtained by adding a constant value to an output signal of a pixel having any one of the first to Nth spectral sensitivity characteristics and a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel. The first signal calculated by multiplying the ratio of the sum of the output of the first two-dimensional low-pass filter at the coordinates of the pixel and the sum of the output of the K-th two-dimensional low-pass filter and the constant value to reduce the constant value is output to the band-pass filter. Obtain a second signal for aperture correction and, in which to obtain the luminance signal component by combining the third signal obtained through the second signal and the imaging element output to the second low-pass filter.

The color video camera according to the fifty-eighth aspect of the present invention
In a color video camera that obtains a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, In the portion where the spatial frequency is high, the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N types of first two-dimensional filters are provided. A low-pass filter output is obtained, and a first two-dimensional low-pass filter output of an image sensor output at coordinates of the pixel is added to an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. The first signal is calculated by multiplying by the ratio of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel. Calculating a first signal from a value to obtain a second signal for aperture correction through a first signal to the band-pass filter, the second signal and the imaging element output the second Ropasufu
The luminance signal component is obtained by synthesizing the third signal obtained through the filter .

The color video camera according to the fifty-ninth aspect is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. 1 and a signal calculated from the average of the outputs of N types of pixels around the pixel, and a signal calculated by multiplying the ratio of the two-dimensional low-pass filter output to the output of the two horizontal adjacent pixels of the pixel. difference The first signal is obtained by switching depending on whether or not the difference between the outputs of the two pixels adjacent to the pixel exceeds a specific threshold, and the second signal for aperture correction is passed through the band-pass filter. And a luminance signal component is obtained by combining the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter .

The color video camera according to the sixty aspect of the present invention
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. A signal calculated by multiplying by a ratio with the output of the two-dimensional low-pass filter of 1 and a signal calculated from the averaging value of outputs of N types of pixels around the pixel are output from the same type of pixels around the pixel. Difference to obtain a first signal switched by whether beyond a certain threshold to obtain a second signal for aperture correction through a first signal to the band-pass filter, the second signal and the imaging element output The luminance signal component is obtained by synthesizing the third signal obtained through the second low-pass filter .

The color video camera according to the sixty-first invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. 1 and a signal calculated from the average of the outputs of the N types of pixels in the vicinity of the pixel and a signal calculated by multiplying the output of the two types of two-dimensional low-pass filter by the ratio thereof. Slant The switched by whether the difference between the output of the lower left adjacent pixels and upper right adjacent pixel difference and the pixel of the output of the lower adjacent pixels are beyond a certain threshold 1
A first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal is combined with a third signal obtained by passing an image sensor output through a second low-pass filter. A luminance signal component is obtained.

The color video camera according to the sixty-second invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. obtain a second signal for aperture correction through the first signal is calculated by multiplying the ratio of the two-dimensional low-pass filter output of 1 to the band-pass filter, the second signal and the imaging element output the second low-pass Using a lookup table for division at the division portion in the case of obtaining the luminance signal component by combining the third signal obtained through the filter, wherein, when the number of input bits of the table is n, the input uppermost It is checked whether or not the upper bit is 1, and if it is 0, the lower bit is sequentially checked and the inspection is stopped at the nth bit. After this check, the bit shift is performed to remove the 0 part. The valid n bits are used for inputting the division look-up table.

The color video camera according to the sixty-third invention is
In the 62nd invention, the content of the division look-up table used in the division part when obtaining the luminance signal component is obtained by increasing the operation result of the division by n bits by a bit shift and making the decimal part a truncated integer part. Operation result using value is reduced by n bits by bit shift
Ku is returned to the original digits, is obtained by the integer part as the operation result.

The color video camera according to the sixty-fourth invention is:
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. obtain a second signal for aperture correction through the first signal is calculated by multiplying the ratio of the two-dimensional low-pass filter output of 1 to the band-pass filter, the second signal and the imaging element output the second low-pass By combining the third signal obtained through the filter in order to obtain the luminance signal component, a multiplication and division portion logarithmic transformation, is obtained using logarithm lookup table, and the look-up table for power.

The color video camera according to the sixty-fifth invention is
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. (K is any one of the first to N-th) spectral sensitivity characteristics, and outputs the first two-dimensional low-pass filter output of the imaging device output at the coordinates of the pixel and the K-th output signal at the coordinates of the pixel. obtain a second signal for aperture correction through the first signal is calculated by multiplying the ratio of the two-dimensional low-pass filter output of 1 to the band-pass filter, the second signal and the imaging element output the second low-pass Used in the circuit to obtain a luminance signal component by combining the third signal obtained through filter
The first two-dimensional low-pass filter is constituted by a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal.

The color video camera according to the sixty-sixth aspect of the present invention
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. K is a value obtained by adding a constant value to an output signal of a pixel having any one of the first to Nth spectral sensitivity characteristics and a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel. Is multiplied by the ratio of the sum of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel and a value obtained by adding a fixed value to the output of the first signal. Obtain a second signal for correction is obtained by so as to obtain the luminance signal component by a second signal and the imaging element output combines the third signal obtained through the second low-pass filter.

The color video camera according to the sixty-seventh aspect of the present invention
In a color video camera that obtains a color image using an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane, Are input to the first two-dimensional low-pass filter to obtain the first to N-th N types of first two-dimensional low-pass filter outputs. K is a value obtained by adding a constant value to an output signal of a pixel having any one of the first to Nth spectral sensitivity characteristics and a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel. Is multiplied by the ratio of the sum of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel and a value obtained by adding a fixed value to the output of the first signal. Obtain a second signal for correction, in order to obtain the luminance signal component by combining the third signal obtained through the second signal and the imaging element output to the second low-pass filter, the multiplication and division portion logarithmic transformation , A logarithmic look-up table, and a power-law look-up table.

A color video camera according to the sixty-eighth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (K-th) K is a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first signal at the coordinates of the pixel.
A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. A luminance signal component is obtained by synthesizing a synthesized signal with the adjusted N types of signals and a third signal obtained by passing the adjusted signal through a second low-pass filter.

The color video camera according to the sixty-ninth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (N-th) signal is output. K is a value obtained by adding a constant value to the output signal of any of the first to Nth pixels), and a constant value is added to the output of the first low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel. A first signal calculated by multiplying a ratio of a signal obtained by adding a constant value to the output of the first K-th low-pass filter at the coordinates of the pixel to reduce the constant value is passed through a band-pass filter to pass an aperture. A third signal obtained by obtaining a second signal for cha correction, and passing through a second low-pass filter a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters. Are combined to obtain a luminance signal component.

The color video camera according to the seventy aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N kinds of light by a spectral optical system and arranging N image pickup devices in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted, an image space is formed. In the portion where the frequency is high, N types of signals obtained by adjusting the outputs of the respective image pickup devices with N gain adjusters are input to the first low-pass filter. A filter output is obtained, and an output signal of a K-th (K is any of the first to N-th) pixels is added to a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and the output of the pixel. The first signal is calculated by multiplying the ratio with the output of the K-th low-pass filter in the coordinates. In a portion where the spatial frequency is low, the first signal is calculated from the average value of the outputs of the N types of pixels around the pixel. Calculating the signal to obtain a second signal for aperture correction through a first signal to the band-pass filter,
The luminance signal component is obtained by synthesizing the second signal and a synthesized signal of N kinds of signals obtained by adjusting the outputs of the respective image sensors by N gain adjusters and passing the second signal through a second low-pass filter. It is something that you get.

The color video camera according to the seventy-first invention is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (K-th) K is a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first signal at the coordinates of the pixel.
A signal calculated by multiplying by a ratio with the output of the low-pass filter and a signal calculated from the averaging value of the outputs of N types of pixels around the pixel are determined by determining the difference between the outputs of the two horizontal adjacent pixels of the pixel. A first signal is obtained by switching depending on whether or not the threshold value is exceeded. The first signal is passed through a band-pass filter to obtain a second signal for aperture correction. A luminance signal component is obtained by synthesizing a synthesized signal of N types of signals, gain-adjusted by the gain adjusting device, with a third signal obtained through a second low-pass filter.

The color video camera according to the seventy-second invention is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (K-th) K is a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first signal at the coordinates of the pixel.
A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. When a luminance signal component is obtained by combining a synthesized signal of the adjusted N types of signals with a third signal obtained by passing the adjusted signal through a second low-pass filter, a division look-up table is used in a division part. If the number of input bits of n is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bits, and the check is stopped at the n-th bit. Thereafter, a bit shift is performed, and the effective n bits from which the 0 part has been removed are used as inputs to the lookup table for division.

The color video camera according to the seventy-third invention is
In the seventy-second aspect, the content of a division look-up table used in a division part when a luminance signal component is obtained is an integer obtained by increasing the division operation result by n bits by bit shifting and cutting off a decimal part. And the operation result using that value is reduced by n bits by bit shifting.
Ku is returned to the original digits, is obtained by the integer part as the operation result.

The color video camera according to the seventy-fourth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (K-th) K is a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first signal at the coordinates of the pixel.
A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. In order to obtain a luminance signal component by synthesizing the adjusted synthesized signal of the N types of signals with a third signal obtained by passing the adjusted signal through a second low-pass filter, the multiplication / division portion is logarithmically converted, and a logarithmic lookup table is used. And a power-up look-up table.

The color video camera according to the seventy-fifth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (K-th) K is a first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first signal at the coordinates of the pixel.
A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. A first low-pass filter used in a circuit that obtains a luminance signal component by synthesizing a synthesized signal of the adjusted N types of signals and a third signal obtained by passing the adjusted signal through a second low-pass filter includes a plurality of bit shift circuits and a plurality of bit shift circuits. Addition using shift circuit output as input signal
And a circuit .

The color video camera according to the seventy-sixth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (N-th) signal is output. K is a value obtained by adding a constant value to the output signal of any of the first to Nth pixels), and a constant value is added to the output of the first low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel. A first signal calculated by multiplying a ratio of a signal obtained by adding a fixed value to the output of the K-th low-pass filter at the coordinates of the pixel and a K-th first low-pass filter is passed through a band-pass filter for aperture correction. Obtaining two signals, synthesizing a second signal and a synthesized signal of N types of signals obtained by adjusting the outputs of the respective image sensors by N gain adjusters, and passing it through a second low-pass filter to synthesize a third signal. Is used to obtain a luminance signal component.

The color video camera according to the seventy-seventh aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained, and the K-th (N-th) signal is output. K is a value obtained by adding a constant value to the output signal of any of the first to Nth pixels), and a constant value is added to the output of the first low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel. A first signal calculated by multiplying a ratio of a signal obtained by adding a fixed value to the output of the K-th low-pass filter at the coordinates of the pixel and a K-th first low-pass filter is passed through a band-pass filter for aperture correction. Obtaining two signals, synthesizing a second signal and a synthesized signal of N types of signals obtained by adjusting the outputs of the respective image sensors by N gain adjusters, and passing it through a second low-pass filter to synthesize a third signal. In order to obtain a luminance signal component, a logarithmic conversion is performed on a multiplication / division portion, and a logarithmic look-up table and an exponentiation look-up table are used.

The color video camera according to the seventy-eighth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. A second signal for aperture correction is obtained by passing a first signal, which is calculated by multiplying a ratio of the output of the K-th two-dimensional low-pass filter in the coordinate system, to a second signal for aperture correction. The combined signal Les N kinds of signals with the image pickup element output and the gain adjusted by the N gain adjustment device of a
A luminance signal component is obtained by synthesizing a third signal obtained through a two low-pass filter .

The color video camera according to the seventy-ninth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. The output signal of the K-th pixel (K is any one of the first to N-th) is obtained by adding a constant value to the first two-dimensional composite signal of the pixel of each type at the coordinates of the pixel. A first calculation is performed by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter to a value obtained by adding a constant value to the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel to reduce the constant value. signal Obtain a second signal for aperture correction through the band-pass filter, through a combined signal of the second signal and the N types of signal gain adjustment by each of the N gain control device image sensor output of the second low-pass filter The luminance signal component is obtained by synthesizing the third signal obtained by the above operation.

The color video camera according to the eighty aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted, an image space is obtained. In the portion where the frequency is high, N types of signals from the first to the Nth are input to a first two-dimensional low-pass filter by inputting N types of signals obtained by adjusting the outputs of the respective image pickup devices with N gain adjusters. A first two-dimensional low-pass filter output is obtained, and an output signal of a K-th (K is any of the first to N-th) pixels is added to a first signal of a composite signal of each type of pixel at the coordinates of the pixel. 2
-Dimensional low-pass filter output and the Kth coordinate in the pixel coordinates
Is multiplied by the ratio of the first two-dimensional low-pass filter output to the first two-dimensional low-pass filter output.
A signal is calculated, the first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the output of the second signal and each of the image sensors is adjusted for N types of signals by N gain adjustment devices. A luminance signal component is obtained by combining the combined signal with a third signal obtained by passing the combined signal through a second low-pass filter .

The color video camera according to the eighteenth aspect is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. The signal calculated by multiplying the ratio of the output of the K-th first two-dimensional low-pass filter in the coordinates and the signal calculated from the averaging value of the outputs of the N types of pixels around the pixel are defined as both signals of the pixel. A first signal is obtained by switching depending on whether or not one of a difference between outputs of a flat adjacent pixel and a difference between outputs of both vertical adjacent pixels of the pixel exceeds a specific threshold value. A second signal for aperture correction is obtained through a pass filter , and a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is passed through a second low-pass filter. The luminance signal component is obtained by combining the obtained third signal.

A color video camera according to the eighty-second invention is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. A signal calculated by multiplying the ratio of the output of the K-th first two-dimensional low-pass filter in the coordinates and a signal calculated from the averaging value of the outputs of the N types of pixels around the pixel are defined as A first signal is obtained by switching depending on whether or not an output difference between pixels having the same type of spectral sensitivity characteristic exceeds a specific threshold value, and the first signal is passed through a band-pass filter to obtain a second signal for aperture correction. And the second signal and the output of each image sensor are gain-adjusted by N gain adjusters, and a composite signal of N kinds of signals is subjected to a second low-pass filter.
A luminance signal component is obtained by synthesizing a third signal obtained through the data signal.

The color video camera according to the 83rd invention is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs have been gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are obtained. Then, the output signal of the K-th (K is any of the first to N-th) pixels is added to the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output of the pixel. A signal calculated by multiplying by a ratio of the output of the K-th first two-dimensional low-pass filter in coordinates and a signal calculated from the average of outputs of N types of pixels around the pixel are defined by Whether one of the difference between the output of the upper neighboring pixel and the lower right neighboring pixel and the difference of the output of the lower left neighboring pixel and the upper right neighboring pixel of the pixel exceeds a specific threshold value. To obtain the first signal,
The signal is passed through a band-pass filter to obtain a second signal for aperture correction.
A luminance signal component is obtained by synthesizing a synthesized signal of N types of signals, gain-adjusted by the gain adjustment devices, with a third signal obtained through a second low-pass filter .

A color video camera according to the eighty-fourth invention is:
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. A second signal for aperture correction is obtained by passing a first signal, which is calculated by multiplying a ratio of the output of the K-th two-dimensional low-pass filter in the coordinate system, to a second signal for aperture correction. The combined signal Les N kinds of signals with the image pickup element output and the gain adjusted by the N gain adjustment device of a
When a luminance signal component is obtained by synthesizing a third signal obtained through a 2 low-pass filter , a division look-up table is used in a division portion. Is the most significant bit of
Is checked, and if it is 0, the check is sequentially performed on the lower bits, and the check is stopped at the n-th bit. After this check, a bit shift is performed, and the effective n bits from which the zero part has been removed are used as inputs to the division look-up table.

A color video camera according to the 85th aspect of the present invention
In the eighty-fourth aspect, the content of the division look-up table used in the division part when obtaining the luminance signal component is obtained by increasing the operation result of the division by n bits by a bit shift and making the decimal part a truncated integer part. Operation result using value is reduced by n bits by bit shift
Ku is returned to the original digits, is obtained by the integer part as the operation result.

A color video camera according to the 86th aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. A second signal for aperture correction is obtained by passing a first signal, which is calculated by multiplying a ratio of the output of the K-th two-dimensional low-pass filter in the coordinate system, to a second signal for aperture correction. The combined signal Les N kinds of signals with the image pickup element output and the gain adjusted by the N gain adjustment device of a
In order to obtain a luminance signal component by synthesizing a third signal obtained through a 2 low-pass filter , a multiplication / division portion is logarithmically converted, and a logarithmic lookup table and an exponentiation lookup table are used. is there.

The color video camera according to the seventy-eighth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. Then, the first two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the output signal of the K-th (K is any one of the first to N-th) pixels are added to the output signal of the pixel. A second signal for aperture correction is obtained by passing a first signal, which is calculated by multiplying a ratio of the output of the K-th two-dimensional low-pass filter in the coordinate system, to a second signal for aperture correction. The combined signal Les N kinds of signals with the image pickup element output and the gain adjusted by the N gain adjustment device of a
A first signal used in a circuit for obtaining a luminance signal component by synthesizing a third signal obtained through a low-pass filter with a third signal .
The two-dimensional low-pass filter is constituted by a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal.

The color video camera according to the eighty-eighth aspect of the present invention
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. The output signal of the K-th pixel (K is any one of the first to N-th) is obtained by adding a constant value to the first two-dimensional composite signal of the pixel of each type at the coordinates of the pixel. A first signal calculated by multiplying the ratio of the output of the low-pass filter plus a constant value and the output of the K-th first two-dimensional low-pass filter plus a constant value at the coordinates of the pixel is multiplied by a band-pass filter. Obtain a second signal for aperture correction through filter, obtained through a synthesis signal of the second signal and the gain adjusted N kinds of signals each image pickup element output by the N gain adjustment device to a second low-pass filter The luminance signal component is obtained by combining the obtained third signal.

The color video camera according to the 89th aspect is
In a color video camera that obtains a color image by dispersing the light into N types of light by a spectral optical system and arranging N imaging elements in which photoelectric conversion elements are arranged on a two-dimensional plane optically shifted from each other, By inputting N kinds of signals whose element outputs are gain-adjusted by N gain adjusters to a first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are output. The output signal of the K-th pixel (K is any one of the first to N-th) is obtained by adding a constant value to the first two-dimensional composite signal of the pixel of each type at the coordinates of the pixel. A first signal calculated by multiplying the ratio of the output of the low-pass filter plus a constant value and the output of the K-th first two-dimensional low-pass filter plus a constant value at the coordinates of the pixel is multiplied by a band-pass filter. Obtain a second signal for aperture correction through filter, obtained through a synthesis signal of the second signal and the gain adjusted N kinds of signals each image pickup element output by the N gain adjustment device to a second low-pass filter In order to obtain a luminance signal component by combining the obtained third signal, the multiplication / division portion is logarithmically converted, and a logarithmic lookup table,
And a power-up look-up table.

[0102]

In the color video camera according to the first aspect of the invention, the outputs of the photoelectric conversion elements having N kinds of spectral sensitivity characteristics are inputted to the two-dimensional low-pass filter, so that the first to N-th N kinds of two-dimensional low-pass filter outputs are obtained. Then, the output signal of the pixel having the J-th (J is any one of the first to N-th) spectral sensitivity characteristics is
By multiplying the ratio of the output of the K-th (K is any of the first to N-th) two-dimensional low-pass filter at the coordinates of the pixel and the output of the J-th two-dimensional low-pass filter at the coordinates of the pixel, An output signal in the case where it is assumed that there is a pixel having the K-th spectral sensitivity characteristic in the coordinates is calculated, and an output signal in the case where it is assumed that there is a pixel having a spectral sensitivity characteristic other than the K-th is obtained by a similar operation as necessary. The luminance signal is calculated from the output signal of the pixel and the calculated output signal at the coordinates of the pixel.

In the color video camera according to the second aspect of the invention, the outputs of the first to N-th N types of low-pass filters are obtained by inputting the outputs of the photoelectric conversion elements having N types of spectral sensitivity characteristics to the low-pass filters, thereby obtaining the K-th output. The K-th is the ratio of the low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel in the output signal of the pixel having any one of the first to N-th spectral sensitivity characteristics. To calculate the luminance signal component of the pixel by multiplying,
As in the related art, when a luminance signal is obtained, a modulated portion of a color signal is not removed by a low-pass filter, and attenuation of a high-frequency component of the luminance signal can be reduced.

In the color video camera of the third invention, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
By inputting the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics to the low-pass filter, the first to N-th N types of low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the N-th) spectral sensitivity characteristic of the pixel, a fixed value added to the output signal of the pixel, a fixed value added to the low-pass filter output of the image sensor output at the coordinates of the pixel, and the coordinates of the pixel at the coordinates of the pixel. Since the luminance signal component is calculated by multiplying the ratio of the output of the K-th low-pass filter to a value obtained by adding a constant value to reduce the constant value, the calculation error can be reduced even if the divisor is small.

In the color video camera of the fourth invention, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
In the high spatial frequency portion of the image, the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the low-pass filter to obtain the first to N-th N types of low-pass filter outputs. Is any of 1st to Nth)
The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic of the above by the ratio of the low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. In the low-frequency portion, an average value of outputs of pixels having N kinds of spectral sensitivity characteristics is calculated around the pixel, so that false contours in a low-frequency portion that are emphasized when the number of calculation bits is reduced are reduced. Becomes possible.

In the color video camera of the fifth invention, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
By inputting the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics to the low-pass filter, the first to N-th N types of low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth spectral sensitivity characteristic, the luminance is obtained by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio between the low-pass filter output of the image sensor output at the coordinates of the pixel and the K-th low-pass filter output at the coordinates of the pixel. The method of calculating the signal component and the method of calculating the average of the outputs of the pixels having N kinds of spectral sensitivity characteristics around the pixel include a method in which the difference between the outputs of the two horizontal adjacent pixels of the pixel is a specific threshold value. Since the switching is performed depending on whether or not the frequency exceeds the threshold, it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal direction.

In the color video camera of the sixth invention, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
By inputting the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics to the low-pass filter, the first to N-th N types of low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth spectral sensitivity characteristic, the luminance is obtained by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio between the low-pass filter output of the image sensor output at the coordinates of the pixel and the K-th low-pass filter output at the coordinates of the pixel. Using a lookup table for division in the division part when calculating the signal component,
Here, if the number of input bits in the table is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to lower bits, and the check is stopped at the nth bit,
After this inspection, a bit shift is performed, a portion of 0 is removed, and valid n bits are used as an input to a division look-up table, so that an inexpensive circuit configuration can be provided.

In the color video camera of the seventh invention, the sixth
In the invention, the contents of the division look-up table used in the division part when calculating the luminance signal component are such that the result of the division operation is increased by n bits by a bit shift , the decimal part is rounded down to an integer part, and the value is set as the integer part. Since the used calculation result is reduced by n bits by bit shift and returned to the original digit, and the integer part is used as the calculation result, the calculation accuracy can be improved.

In the color video camera according to the eighth aspect, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
By inputting the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics to the low-pass filter, the first to N-th N types of low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth spectral sensitivity characteristic, the luminance is obtained by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio between the low-pass filter output of the image sensor output at the coordinates of the pixel and the K-th low-pass filter output at the coordinates of the pixel. As a method of calculating the signal component, the multiplication / division portion is logarithmically converted and a logarithmic look-up table and an exponentiation look-up table are used. Therefore, it is possible to provide a color video camera obtained with an inexpensive circuit configuration.

In the color video camera according to the ninth aspect, the first
To obtain a color image by an imaging device in which N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among the Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane,
By inputting the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics to the low-pass filter, the first to N-th N types of low-pass filter outputs are obtained, and the K-th (K-th is the first)
To the Nth spectral sensitivity characteristic, the luminance is obtained by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio between the low-pass filter output of the image sensor output at the coordinates of the pixel and the K-th low-pass filter output at the coordinates of the pixel. Addition of a low-pass filter used in a circuit for calculating a signal component to a plurality of bit shift circuits and the output of the bit shift circuit as an input signal
Since it is composed of a circuit, an inexpensive circuit configuration can be provided.

In the color video camera according to the tenth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics are input to the low-pass filter to obtain the first to N-th N types of low-pass filter outputs. Is a signal obtained by adding a constant value to an output signal of a pixel having any one of the first to Nth spectral sensitivity characteristics, and adding a constant value to a low-pass filter output of an image sensor output at coordinates of the pixel. Since the luminance signal component is calculated by multiplying the ratio of the output of the K-th low-pass filter at a coordinate of the K-th low-pass filter plus a constant value, it is possible to reduce the calculation error even if the divisor is small. That.

In the color video camera according to the eleventh aspect of the present invention, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics are input to the low-pass filter to obtain the first to N-th N types of low-pass filter outputs. Is a signal obtained by adding a constant value to an output signal of a pixel having any one of the first to Nth spectral sensitivity characteristics, and adding a constant value to a low-pass filter output of an image sensor output at coordinates of the pixel. As a method of calculating a luminance signal component by multiplying a ratio of the output of the K-th low-pass filter at a coordinate of the K-th low-pass filter plus a constant value, a logarithmic transformation of a multiplication / division portion is performed,
Since the logarithmic lookup table and the exponentiation lookup table are used, a color video camera obtained with an inexpensive circuit configuration can be provided.

In the color video camera according to the twelfth aspect, N
By inputting the outputs of the photoelectric conversion elements having the different types of spectral sensitivity characteristics to the two-dimensional low-pass filter, the first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is the first to N-th) outputs. The output signal of a pixel having any one of the spectral sensitivity characteristics described above is multiplied by the ratio of the two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th two-dimensional low-pass filter output at the coordinates of the pixel. Since the luminance signal component of the pixel is calculated, it is possible to reduce the attenuation of the high-frequency component of the luminance signal without removing the modulated portion of the color signal with a low-pass filter when obtaining the luminance signal as in the related art.

In the color video camera according to the thirteenth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the two-dimensional low-pass filter to obtain the first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
A constant value is added to a signal obtained by adding a constant value to an output signal of a pixel having the Kth (K is any of the first to Nth) spectral sensitivity characteristics and a two-dimensional low-pass filter output of an image sensor at the coordinates of the pixel. Is calculated by subtracting a constant value by multiplying a ratio of a value obtained by adding a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel and a constant value. Calculation errors can be reduced.

In the color video camera according to the fourteenth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and in a portion where the spatial frequency of the image is high, the outputs of the photoelectric conversion elements having the respective spectral sensitivity characteristics are input to a two-dimensional low-pass filter, thereby obtaining the first to N-th N types. A two-dimensional low-pass filter output is obtained, and an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is obtained as:
A luminance signal component is calculated by multiplying the ratio of the two-dimensional low-pass filter output of the image sensor at the coordinates of the pixel to the K-th two-dimensional low-pass filter output at the coordinates of the pixel. An average value of outputs of pixels having N kinds of spectral sensitivity characteristics is calculated in the periphery. As a result, the emphasis is on reducing the number of operation bits.
This makes it possible to reduce false contours in the low-frequency portion .

In the color video camera according to the fifteenth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the two-dimensional low-pass filter to obtain the first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
An output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics includes a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th two-dimensional filter output at the coordinates of the pixel. A method of calculating a luminance signal component by multiplying by a ratio with a dimensional low-pass filter output;
The method of calculating the average value of the outputs of the pixels having different types of spectral sensitivity characteristics is determined by determining one of the difference between the outputs of the two horizontally adjacent pixels of the pixel and the difference of the outputs of the two vertically adjacent pixels of the pixel. To switch depending on whether or not the threshold is exceeded,
It is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions.

In the color video camera according to the sixteenth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to a two-dimensional low-pass filter to obtain a first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
An output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics includes a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th two-dimensional filter output at the coordinates of the pixel. A method of calculating a luminance signal component by multiplying by a ratio with a dimensional low-pass filter output;
The method of calculating the average value of the outputs of the pixels of the different types of spectral sensitivity characteristics is switched depending on whether or not the difference between the outputs of the pixels of the same type of spectral sensitivity characteristics around the pixel exceeds a specific threshold value. Therefore, it is possible to reduce the attenuation of the high frequency component of the luminance signal in the single color image.

In the color video camera according to the seventeenth aspect, an N type photoelectric conversion element having one of the first to Nth N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the two-dimensional low-pass filter to obtain the first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
An output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics includes a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th two-dimensional filter output at the coordinates of the pixel. A method of calculating a luminance signal component by multiplying by a ratio with a dimensional low-pass filter output;
The method of calculating the average value of the outputs of the pixels having different types of spectral sensitivity characteristics is defined as the difference between the output of the pixel at the upper left and the pixel at the lower right and the pixel at the lower left and the right of the pixel. In order to switch depending on whether one of the outputs of the upper adjacent pixels exceeds a specific threshold value,
It is possible to reduce the attenuation of the high frequency component of the luminance signal in the vertical direction.

In the color video camera according to the eighteenth aspect, an N type photoelectric conversion element having one of the first to Nth N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the two-dimensional low-pass filter to obtain the first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
An output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is obtained by adding a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th 2 When the luminance signal component is calculated by multiplying by the ratio with the output of the dimensional low-pass filter, a division look-up table is used in the division part. Here, when the number of input bits of the table is n, the most significant bit of the input is It is checked whether it is 1; if it is 0, it is checked sequentially to the lower bits, and the check is stopped at the n-th bit. Is used as an input to the division look-up table, so that an inexpensive circuit configuration can be provided.

In the color video camera of the nineteenth aspect,
In the eighteenth aspect, the division unit for calculating the luminance signal component
The contents of the division lookup table used for
Calculation resultIncrease by n bits by bit shift
And use the value as the integer part with the fractional part truncated.
Calculation resultN bits smaller by bit shift
KuTo return to the original digit and make the integer part the result of the operation,
The calculation accuracy can be improved.

In the color video camera according to the twentieth aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to a two-dimensional low-pass filter to obtain a first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
A constant value is added to a signal obtained by adding a constant value to an output signal of a pixel having the Kth (K is any of the first to Nth) spectral sensitivity characteristics and a two-dimensional low-pass filter output of an image sensor at the coordinates of the pixel. Is multiplied by the ratio of the sum of the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel and the sum of the output of the K-th two-dimensional low-pass filter and a constant value.
Since the multiplication / division portion is logarithmically converted and the logarithmic look-up table and the exponentiation look-up table are used, it is possible to provide a color video camera obtained with an inexpensive circuit configuration.

In the color video camera according to the twenty-first aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the two-dimensional low-pass filter to obtain the first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
An output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics includes a two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel and a K-th two-dimensional filter output at the coordinates of the pixel. A two-dimensional low-pass filter used in a circuit for calculating a luminance signal component by multiplying the ratio with the output of a two-dimensional low-pass filter is constituted by a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal. Therefore, an inexpensive circuit configuration can be provided.

In the color video camera according to the twenty-second aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to a two-dimensional low-pass filter to obtain a first image.
To obtain the Nth N types of two-dimensional low-pass filter outputs from
A constant value is added to a signal obtained by adding a constant value to an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics and a two-dimensional low-pass filter output of an image sensor at the coordinates of the pixel. Is calculated by multiplying the ratio of the sum of the output of the two-dimensional low-pass filter and the sum of the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel and a constant value, so that the calculation error is reduced even if the divisor is small. It becomes possible.

In the color video camera according to the twenty-third aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. In a color video camera that obtains a color image by using elements, first to N-th N types of two-dimensional low-pass filter outputs are obtained by inputting the outputs of photoelectric conversion elements having respective types of spectral sensitivity characteristics to a two-dimensional low-pass filter. , K-th (K-th is any of first to N-th)
Of a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to a signal obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of As a method of calculating a luminance signal component by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value, a logarithmic conversion of a multiplication / division portion is performed, and a logarithmic lookup table and a power lookup table are used. It is possible to provide a color video camera obtained with a simple circuit configuration.

In the color video camera according to the twenty-fourth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements arranged in a two-dimensional plane with photoelectric conversion elements. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is added to the composite signal of each type of pixel at the coordinates of the pixel. To calculate the luminance signal component by multiplying the ratio of the output of the low-pass filter of the pixel and the output of the K-th low-pass filter at the coordinates of the pixel. Attenuation can be reduced.

In the color video camera according to the twenty-fifth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and a signal obtained by adding a constant value to the output signal of the K-th (K is any of the first to N-th) pixels is added to each of the coordinates of the pixel. The luminance is obtained by multiplying the ratio of the sum of the low-pass filter output of the composite signal of the pixel of the type and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel to reduce the constant value. Since the signal component is calculated, the calculation error can be reduced even if the divisor is small.

In the color video camera according to the twenty-sixth aspect, a color image is obtained by dispersing N types of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. In a portion where the spatial frequency of the image is high, the outputs of the respective image sensors are input to the low-pass filter to obtain the first to N-th N types of low-pass filter outputs, and the K-th (K-th is the first to the N-th) low-pass filter outputs. The brightness is obtained by multiplying the output signal of the (Nth) pixel by the ratio of the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th low-pass filter output at the coordinates of the pixel. Calculate the signal component,
In a portion where the spatial frequency is low, a luminance signal component is calculated from an average value of outputs of N types of pixels around the pixel. As a result, low frequencies emphasized when the number of bits of operation is reduced
It is possible to reduce the false contour of the part .

In the color video camera according to the twenty-seventh aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is added to the composite signal of each type of pixel at the coordinates of the pixel. Multiplying the ratio between the output of the low-pass filter of the pixel and the output of the K-th low-pass filter at the coordinates of the pixel; and calculating the luminance signal component from the averaging value of the outputs of the N types of pixels around the pixel. And the method of calculating according to whether or not the difference between the outputs of the two horizontal adjacent pixels of the pixel exceeds a specific threshold value, it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal direction Becomes

In the color video camera according to the twenty-eighth aspect, a color image is obtained by dispersing N types of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is added to the composite signal of each type of pixel at the coordinates of the pixel. When the luminance signal component is calculated by multiplying the ratio of the low-pass filter output of the pixel and the output of the K-th low-pass filter at the coordinates of the pixel, a division look-up table is used in the division, and the number of input bits of the table Is n, whether the most significant bit of the input is 1 is checked, and if it is 0, the check is sequentially performed on the lower bits, the check is stopped at the nth bit, and after this check, the bit shift is performed. Then, the portion of 0 is removed and the effective n bits are used for the input of the division look-up table. Therefore, it is possible to realize the circuit at a low cost with a simple circuit configuration.

In the color video camera according to the twenty-ninth aspect, in the twenty-eighth aspect, the content of the division look-up table used in the division part when calculating the luminance signal component is increased by n bits to increase the division operation result by n bits. The decimal part is rounded down to an integer part, and the operation result using the value is reduced by n bits by bit shift.
Ku is returned to the original digits, to the calculation result integer part,
The calculation accuracy can be improved.

In the color video camera according to the thirtieth aspect, a color image can be obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is added to the composite signal of each type of pixel at the coordinates of the pixel. As a method of calculating a luminance signal component by multiplying the ratio between the output of the low-pass filter of the pixel and the output of the K-th low-pass filter at the coordinates of the pixel, the multiplication / division part is logarithmically converted, a logarithmic lookup table, a power-up lookup Since a table is used, it can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the thirty-first aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is added to the composite signal of each type of pixel at the coordinates of the pixel. low pass filter output and a low-pass filter used in the circuit for calculating a luminance signal component by multiplying the ratio of the low-pass filter output of the K in pixel coordinates, a plurality of bit shift circuits and the bit shift circuit outputs an input signal for constitution with a summing circuit to, it is possible to inexpensively realize a simple circuit configuration.

In the color video camera according to the thirty-second aspect, the light is split into N types of light by the prism, and
A color image is obtained by displacing N image sensors arranged on a two-dimensional plane, and by inputting the output of each image sensor to a low-pass filter, the first to N-th N types of low-pass filters are obtained. A filter output is obtained, and a low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel is obtained by adding a constant value to the output signal of the K-th pixel (K is any of the first to N-th pixels). Since the luminance signal component is calculated by multiplying the ratio of the output obtained by adding a fixed value to the output of the K-th low-pass filter at the coordinates of the pixel and the fixed value, the calculation error is reduced even if the divisor is small. It is possible to reduce the size.

In the color video camera according to the thirty-third aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to a low-pass filter,
The first to N-th N types of low-pass filter outputs are obtained, and a signal obtained by adding a constant value to the output signal of the K-th (K is any of the first to N-th) pixels is added to each of the coordinates of the pixel. The luminance signal component is calculated by multiplying the ratio of the sum of the low-pass filter output of the composite signal of the pixel of the type and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. As a technique, since the multiplication / division portion is logarithmically converted and a logarithmic look-up table and a power-law look-up table are used, it is possible to realize a simple circuit configuration at low cost.

In the color video camera according to the thirty-fourth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to a two-dimensional low-pass filter, N types of first to N-th two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any one of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. Since the signal component is calculated, it is possible to reduce the attenuation of the high frequency component of the luminance signal which occurs in the case of suppressing the occurrence of vertical stripes by the conventional low-pass filter.

In the color video camera according to the thirty-fifth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements arranged in a two-dimensional plane with photoelectric conversion elements. By inputting the outputs of the respective image sensors to the two-dimensional low-pass filter, first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters A) a constant value added to the output signal of the pixel, a fixed value added to the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel, and a K-th signal at the coordinates of the pixel. The luminance signal component is calculated by multiplying the ratio of the output of the two-dimensional low-pass filter to a constant value and subtracting the constant value to reduce the calculation error even if the divisor is small. It can become.

In the color video camera according to the thirty-sixth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. In a portion where the spatial frequency of the image is high, the outputs of the respective image sensors are input to a two-dimensional low-pass filter, so that the first to Nth
N-dimensional low-pass filter outputs up to N
(Where K is any of the first to Nth pixels)
The luminance signal component is calculated by multiplying the ratio of the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. In the low part, the number of calculation bits was reduced in order to calculate the luminance signal component from the average of the outputs of the N types of pixels around the pixel.
In this case, it is possible to reduce the false contour of the low-frequency portion emphasized in the case .

In the color video camera of the thirty-seventh aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the outputs of the respective image sensors to the two-dimensional low-pass filter, first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A method of calculating a signal component and a method of calculating a luminance signal component from an average value of outputs of N types of pixels around the pixel include a method of calculating a difference between outputs of two horizontal adjacent pixels of the pixel. Since switching is performed depending on whether or not one of the outputs of the two pixels adjacent to the pixel exceeds a specific threshold value, it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions. Become.

[0139] In the color video camera of the thirty-eighth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the outputs of the respective image sensors to the two-dimensional low-pass filter, first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A method of calculating a signal component and a method of calculating a luminance signal component from an average value of outputs of N types of pixels around the pixel include a method of calculating the same type of spectral sensitivity characteristic around the pixel. Since the difference between the outputs of each other switched by whether beyond a certain threshold, it is possible to reduce the attenuation of the high frequency component of the luminance signal in a single color image.

In the color video camera according to the thirty-ninth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements arranged on a two-dimensional plane with photoelectric conversion elements shifted. By inputting the output of each image sensor to a two-dimensional low-pass filter, N types of first to N-th two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any one of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A method of calculating a signal component and a method of calculating a luminance signal component from an average value of outputs of N types of pixels around the pixel include a method of calculating a luminance signal component in a diagonally upper left pixel and a diagonally right direction of the pixel. In order to switch depending on whether or not one of the difference between the output of the adjacent pixel and the difference between the output of the pixel at the lower left and the pixel at the upper right of the pixel exceeds a specific threshold value, the horizontal and vertical directions are used. Thus, the attenuation of the high frequency component of the luminance signal can be reduced.

In the color video camera according to the fortieth aspect, a color image can be obtained by dispersing N types of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the output of each image sensor to a two-dimensional low-pass filter, N types of first to N-th two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any one of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. When calculating a signal component, a division look-up table is used in a division portion. Here, when the number of input bits of the table is n, the most significant bit of the input is 1. To check whether, if it is 0,
Inspection is performed sequentially on the lower bits, and the inspection is stopped at the n-th bit. After this inspection, a bit shift is performed to remove the zero portion and use the valid n bits for inputting the lookup table for division. It can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the forty-first aspect, in the forty-third aspect, the content of the division look-up table used in the division part when calculating the luminance signal component is increased by n bits by the bit shift to increase the division operation result. The decimal part is rounded down to an integer part, and the operation result using the value is reduced by n bits by bit shift.
Ku is returned to the original digits, to the calculation result integer part,
The calculation accuracy can be improved.

In the color video camera according to the forty-second aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to the two-dimensional low-pass filter, N types of first to N-th two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A simple circuit configuration to convert the multiplication / division portion to logarithmic calculation and to use a logarithmic look-up table and a power-up look-up table to calculate signal components It is possible to low cost.

In the color video camera according to the forty-third aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the output of each image sensor to the two-dimensional low-pass filter, N types of first to N-th two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters ) Is multiplied by the ratio between the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A two-dimensional low-pass filter used in a circuit for calculating a signal component is composed of a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal. To, it is possible to inexpensively realize a simple circuit configuration.

In the color video camera according to the forty-fourth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements having photoelectric conversion elements arranged on a two-dimensional plane. By inputting the outputs of the respective image sensors to the two-dimensional low-pass filter, first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters A) a constant value added to the output signal of the pixel, a fixed value added to the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel, and a K-th signal at the coordinates of the pixel. Since the luminance signal component is calculated by multiplying the ratio of the output of the two-dimensional low-pass filter to a value obtained by adding a constant value, the calculation error can be reduced even if the divisor is small.

In the color video camera according to the forty-fifth aspect, a color image is obtained by dispersing N kinds of light by a prism and displacing N image pickup elements in which photoelectric conversion elements are arranged on a two-dimensional plane. By inputting the outputs of the respective image sensors to the two-dimensional low-pass filter, first to N-th N types of two-dimensional low-pass filter outputs are obtained, and the K-th (K-th is any of the first to N-th) filters A) a constant value added to the output signal of the pixel, a fixed value added to the two-dimensional low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel, and a K-th signal at the coordinates of the pixel. In order to calculate a luminance signal component by multiplying a ratio of the output of the two-dimensional low-pass filter to a constant value, a multiplication / division portion is logarithmically converted, and a logarithmic lookup table is used. Since the use of look-up tables for Bibekijo, it is possible to inexpensively realize a simple circuit configuration.

[0147] In the color video camera according to the forty-sixth aspect, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter outputs, and the output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to the output of the image sensor at the coordinates of the pixel. A first signal calculated by multiplying a ratio of the first low-pass filter output of the pixel and the K-th first low-pass filter output at the coordinates of the pixel through a band-pass filter to obtain a second signal for aperture correction; In order to obtain a luminance signal component by synthesizing the two signals and the third signal obtained by passing the output of the image sensor through the second low-pass filter, the aperture correction is performed by enhancing the rising and falling edges of the conventional signal. It is possible to reduce unnatural emphasis that occurs when performing.

In the color video camera according to the forty-seventh aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter output, and outputs a signal obtained by adding a constant value to an output signal of a pixel having a K-th (K is any of the first to N-th) spectral sensitivity characteristics. A constant value is obtained by multiplying a ratio of a value obtained by adding a constant value to the first low-pass filter output of the image sensor output at the coordinates of the pixel and a value obtained by adding a constant value to the Kth low-pass filter output at the coordinates of the pixel. Passing a first signal calculated by subtraction through a band-pass filter to obtain a second signal for aperture correction, and combining the second signal with a third signal obtained by passing an image sensor output through a second low-pass filter. As a result, a calculation error can be reduced even when the divisor is small.

In the color video camera according to the forty-eighth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and in a portion where the spatial frequency of the image is high, the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, so that the first to Nth N-th elements are output. The first low-pass filter output of the type, and the K-th (K-th is the first
To the N-th) spectral sensitivity characteristic, the ratio between the first low-pass filter output of the image sensor output at the coordinates of the pixel and the K-th first low-pass filter output at the coordinates of the pixel is added to the output signal of the pixel having the spectral sensitivity characteristic. The first signal is calculated by multiplication, and in a portion where the spatial frequency is low, the first signal is calculated from an average value of outputs of N types of pixels around the pixel, and the first signal is passed through a band-pass filter to perform aperture correction. A second signal is obtained by combining the second signal with the third signal obtained by passing the output of the image sensor through a second low-pass filter to obtain a luminance signal component. As a result, it is possible to reduce false contours in a low-frequency portion that is emphasized when the number of calculation bits is reduced.

In the color video camera according to the forty-ninth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter outputs, and the output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to the output of the image sensor at the coordinates of the pixel. A signal calculated by multiplying a ratio between the first low-pass filter output of the pixel and the K-th first low-pass filter output at the coordinates of the pixel, and a signal calculated from the average of outputs of N types of pixels around the pixel Is switched depending on whether or not the difference between the outputs of the two horizontal adjacent pixels of the pixel exceeds a specific threshold value to obtain a first signal, and the first signal is passed through a band-pass filter to obtain a first signal for aperture correction. Get two signals,
Since the luminance signal component is obtained by synthesizing the second signal and the third signal obtained by passing the output of the image sensor through the second low-pass filter, it is possible to reduce the attenuation of the high-frequency component of the luminance signal in the horizontal direction. Become.

In the color video camera according to the fiftieth aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter outputs, and outputs the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics to the output of the image sensor at the coordinates of the pixel. A first signal calculated by multiplying a ratio of the first low-pass filter output of the pixel and the K-th first low-pass filter output at the coordinates of the pixel through a band-pass filter to obtain a second signal for aperture correction; When a luminance signal component is obtained by combining the two signals and the third signal obtained by passing the output of the image sensor through a second low-pass filter, a division lookup table is used in a division part. If the number is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bits, and the check is stopped at the n-th bit. Performs bets, for using an effective n bits obtained by removing the portion of 0 the input of the division for the lookup table, it is possible to inexpensively realize a simple circuit configuration.

In the color video camera of the fifty-first aspect, in the fifty-fifth aspect, the content of a division look-up table used in a division part for obtaining a luminance signal component is obtained by increasing the division operation result by n bits by bit shifting. The fractional part is rounded down to an integer part, and the operation result using that value is reduced by n bits by bit shifting.
Ku is returned to the original digits, to the integer part and the operation result, it is possible to improve the calculation accuracy.

In the color video camera according to the fifty-second aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter outputs, and the output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to the output of the image sensor at the coordinates of the pixel. A first signal calculated by multiplying a ratio between the first low-pass filter output of the pixel and the K-th first low-pass filter output at the coordinates of the pixel through a band-pass filter to obtain a second signal for aperture correction; In order to obtain a luminance signal component by synthesizing the two signals and the third signal obtained by passing the output of the image sensor through the second low-pass filter, the multiplication / division portion is logarithmically converted, and a logarithmic lookup table is used.
In addition, since the power-up lookup table is used, it can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the fifty-third aspect, imaging is performed by arranging, on a two-dimensional plane, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter outputs, and outputs the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics to the output of the image sensor at the coordinates of the pixel. A first signal calculated by multiplying a ratio of the first low-pass filter output of the pixel and the K-th first low-pass filter output at the coordinates of the pixel through a band-pass filter to obtain a second signal for aperture correction; A first low-pass filter used in a circuit that obtains a luminance signal component by synthesizing the two signals and a third signal obtained by passing the output of the image sensor through a second low-pass filter includes a plurality of bit shift circuits and an output of the bit shift circuit. And an adder circuit that uses the input signal as an input signal, and can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the fifty-fourth aspect, imaging is performed by arranging, on a two-dimensional plane, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics. A color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter output, and outputs a signal obtained by adding a constant value to an output signal of a pixel having a K-th (K is any of the first to N-th) spectral sensitivity characteristics. It is calculated by multiplying the ratio of the sum of the output of the first low-pass filter of the image sensor output at the pixel coordinates and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. The first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to obtain a luminance signal component. Therefore, even when the divisor is small, the calculation error can be reduced.

In the color video camera according to the fifty-fifth aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. The color image is obtained by the element, and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first low-pass filter, thereby obtaining the first image.
To N-th first low-pass filter output, and outputs a signal obtained by adding a constant value to an output signal of a pixel having a K-th (K is any of the first to N-th) spectral sensitivity characteristics. It is calculated by multiplying the ratio of the sum of the output of the first low-pass filter of the image sensor output at the pixel coordinates and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. The first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to obtain a luminance signal component. In order to obtain it, the multiplication / division portion is logarithmically converted and a logarithmic look-up table and a power-law look-up table are used.

In the color video camera according to the fifty-sixth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A two-dimensional low-pass filter output is obtained, and the first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel is added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. And a K-th first two-dimensional low-pass filter output at the coordinates of the pixel.
The signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are converted to a second low-pass signal.
In order to obtain a luminance signal component by combining the third signal obtained through the filter , the unnatural emphasis that occurs when performing aperture correction by emphasizing the rising and falling edges of the conventional signal is reduced. It is possible to do.

In the color video camera according to the fifty-seventh aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to a first two-dimensional low-pass filter. A dimensional low-pass filter output is obtained, and a value obtained by adding a constant value to an output signal of a pixel having the Kth (K is any of the first to Nth) spectral sensitivity characteristics is added to the output signal of the image sensor at the coordinates of the pixel 1 of 2
The second calculation is performed by multiplying a ratio of a value obtained by adding a fixed value to the output of the two-dimensional low-pass filter at the coordinates of the pixel and a value obtained by adding a certain value to the coordinates of the pixel to reduce the certain value. One signal is passed through a band-pass filter to obtain a second signal for aperture correction, and a luminance signal component is obtained by combining the second signal with a third signal obtained by passing an image sensor output through a second low-pass filter. Therefore, even when the divisor is small, the calculation error can be reduced.

In the color video camera according to the fifty-eighth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the element, and in a portion where the spatial frequency of the image is high, the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to the first two-dimensional low-pass filter, so that the first to Nth To obtain N kinds of first two-dimensional low-pass filter outputs,
The first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and the output signal of the pixel at the coordinates of the pixel are added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. The first signal is calculated by multiplying the ratio of K to the output of the first two-dimensional low-pass filter. In a portion where the spatial frequency is low, the first signal is calculated from the average of the outputs of N types of pixels around the pixel. I do. Then, the first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to generate a luminance signal. to obtain the component strength when reducing the number of bits calculation
It is possible to reduce the false contour of the low frequency part to be adjusted .

In the color video camera according to the fifty-ninth aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to a first two-dimensional low-pass filter. A two-dimensional low-pass filter output is obtained, and an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to a first two-dimensional low-pass filter output of an image sensor output at coordinates of the pixel. And a signal calculated by multiplying a ratio of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel and a signal calculated from the average of the outputs of the N types of pixels around the pixel. The Obtain a first signal switched by whether the difference between the outputs of the vertical adjacent pixel difference and the pixel output of both the horizontal adjacent pixels containing that beyond a certain threshold,
The first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the third signal obtained by passing the output of the image sensor through a second low-pass filter are combined to obtain a luminance signal component. Therefore, the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced.

In the color video camera according to the sixtieth aspect, an N type photoelectric conversion element having one of the first to Nth N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to a first two-dimensional low-pass filter. A two-dimensional low-pass filter output is obtained, and an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to a first two-dimensional low-pass filter output of an image sensor output at coordinates of the pixel. And a signal calculated by multiplying a ratio of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel and a signal calculated from the average of the outputs of the N types of pixels around the pixel. The A first signal is obtained by switching depending on whether or not the difference between the outputs of pixels having the same kind of spectral sensitivity characteristics around the element exceeds a specific threshold value, and the first signal is passed through a band-pass filter for aperture correction. Get a second signal,
In order to obtain a luminance signal component by synthesizing the second signal and the third signal obtained by passing the output of the image sensor through the second low-pass filter , it is possible to reduce attenuation of a high-frequency component of the luminance signal in a single-color image. It becomes possible.

In the color video camera of the sixty-first aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A two-dimensional low-pass filter output is obtained, and the first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel is added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. And a signal calculated by multiplying the ratio of the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel and a signal calculated from the average of the outputs of the N types of pixels around the pixel. The The difference between the output of the pixel at the upper left and the pixel at the lower right and the output of the pixel at the lower left and the pixel at the upper right exceeds the specific threshold value. Switch to obtain a first signal, pass the first signal through a band-pass filter to obtain a second signal for aperture correction, and connect the second signal and the image sensor output to a second low- pass filter.
Since the luminance signal component is obtained by combining the third signal obtained through the filter , it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions.

In the color video camera according to the sixty-second aspect, an N-type photoelectric conversion element having one of the first to N-th N types of spectral sensitivity characteristics is arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A two-dimensional low-pass filter output is obtained, and the first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel is added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. And a K-th first two-dimensional low-pass filter output at the coordinates of the pixel.
The signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are converted to a second low-pass signal.
When a luminance signal component is obtained by synthesizing a third signal obtained through a filter , a division lookup table is used in a division part. It is checked whether or not the upper bit is 1, and if it is 0, the lower bit is sequentially checked and the inspection is stopped at the nth bit. After this check, the bit shift is performed to remove the 0 part. Since the effective n bits are used for inputting the division look-up table, the circuit can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the sixty- third aspect,
In the 62nd invention , the contents of the division look-up table used in the division part when obtaining the luminance signal component are obtained by increasing the operation result of the division by n bits by a bit shift and making the decimal part a truncated integer part. Calculation result using n is reduced by n bits by bit shift
Ku is returned to the original digits, to the integer part and the operation result, it is possible to improve the calculation accuracy.

In the color video camera according to the sixty-fourth aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A two-dimensional low-pass filter output is obtained, and the first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel is added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. And a K-th first two-dimensional low-pass filter output at the coordinates of the pixel.
The signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are converted to a second low-pass signal.
In order to obtain a luminance signal component by synthesizing the third signal obtained through the filter , a logarithmic conversion is performed on the multiplication / division portion, and a logarithmic look-up table and an exponentiation look-up table are used. With the configuration, it can be realized at low cost.

In the color video camera according to the sixty-fifth aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A two-dimensional low-pass filter output is obtained, and the first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel is added to the output signal of the pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics. And a K-th first two-dimensional low-pass filter output at the coordinates of the pixel.
The signal is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and the output of the image sensor are converted to a second low-pass signal.
A first two-dimensional row used in a circuit that obtains a luminance signal component by synthesizing a third signal obtained through a filter.
Since the pass filter is composed of a plurality of bit shift circuits and a plurality of adders using the output of the bit shift circuit as an input signal, it is possible to realize a simple circuit configuration at a low cost.

In the color video camera according to the sixty-sixth aspect, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A dimensional low-pass filter output is obtained, and a value obtained by adding a constant value to an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to the output of the image sensor at the coordinates of the pixel. 1 of 2
A first signal calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the dimensional low-pass filter and a value obtained by adding a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel is band-passed. A second signal for aperture correction is obtained through a filter, and the second signal and the output of the image sensor are converted to a second signal .
Since the luminance signal component is obtained by combining the third signal obtained through the two low-pass filters , it is possible to reduce the calculation error even when the divisor is small.

In the color video camera according to the sixty-seventh aspect, imaging is performed by arranging N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics on a two-dimensional plane. A color image is obtained by the elements, and the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to the first two-dimensional low-pass filter, so that the first to N-th N first 2 A dimensional low-pass filter output is obtained, and a value obtained by adding a constant value to an output signal of a pixel having the K-th (K is any of the first to N-th) spectral sensitivity characteristics is added to the output of the image sensor at the coordinates of the pixel. 1 of 2
A first signal calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the dimensional low-pass filter and a value obtained by adding a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel is band-passed. A second signal for aperture correction is obtained through a filter, and the second signal and the output of the image sensor are converted to a second signal .
In order to obtain a luminance signal component by synthesizing the third signal obtained through the 2 low-pass filter , a logarithmic conversion of the multiplication / division portion is performed, and a logarithmic lookup table and a power lookup table are used. It can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the sixty-eighth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signals of the K-th (K-th is any of the first to N-th) pixels are obtained. The first signal calculated by multiplying the ratio between the first low-pass filter output of the composite signal of each type of pixel at the pixel coordinates and the Kth first low-pass filter output at the pixel coordinates is passed through a band-pass filter. A second signal for aperture correction is obtained, and a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices is supplied to a second low-pass filter. In order to obtain a luminance signal component by synthesizing a third signal obtained by performing the above-described process, the unnatural emphasis that occurs when aperture correction is performed by emphasizing the rising and falling edges of the conventional signal is reduced. Becomes possible.

In the color video camera according to the sixty-ninth aspect, the light is separated into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signal of the K-th (K-th is any of the first to N-th) pixels is a fixed value. And the first of the composite signals of the respective types of pixels at the coordinates of the pixel.
The first signal calculated by multiplying the ratio of the output of the low-pass filter by adding a constant value to the output of the K-th low-pass filter at the coordinates of the pixel and adding the constant value to reduce the constant value is a band. A second signal for aperture correction is obtained through a pass filter, and a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is passed through a second low-pass filter. Since the luminance signal component is obtained by synthesizing the obtained third signal, it is possible to reduce the calculation error even when the divisor is small.

In the color video camera according to the seventieth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other. In a portion where the spatial frequency of the image is high, the output of each image sensor is controlled by N gain adjusters. By inputting the N kinds of signals whose gains have been adjusted to the first low-pass filter, N kinds of first to N-th first low-pass filter outputs are obtained,
A first low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th output signal at the coordinates of the pixel are added to the output signal of the Kth (Kth is any of the first to Nth) pixels. The first signal is calculated by multiplying by the ratio with the output of the first low-pass filter. In a portion where the spatial frequency is low, the first signal is calculated from the average of the outputs of N types of pixels around the pixel. Is passed through a band-pass filter to obtain a second signal for aperture correction, and a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is provided to a second low-pass filter. The luminance signal component is obtained by synthesizing the third signal obtained by passing through. As a result, when the number of operation bits is reduced
It is possible to reduce the false contour of the low-frequency portion to be emphasized .

In the color video camera according to the seventy-first aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the one low-pass filter, N types of first to N-th first low-pass filter outputs are obtained, and the output signal of the K-th (K is any of the first to N-th) pixels is obtained. A signal calculated by multiplying a ratio of a first low-pass filter output of a composite signal of each type of pixel at the pixel coordinates to a K-th first low-pass filter output at the pixel coordinates, and N types of signals around the pixel A first signal is obtained by switching a signal calculated from the averaging value of the outputs of the pixels according to whether or not the difference between the outputs of the two horizontal adjacent pixels of the pixel exceeds a specific threshold value. path A second signal for aperture correction is obtained through a filter, and a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is obtained through a second low-pass filter. The third
In order to obtain a luminance signal component by combining with the signal,
It is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal direction.

In the color video camera according to the seventy-second aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signals of the K-th (K-th is any of the first to N-th) pixels are obtained. The first signal calculated by multiplying the ratio between the first low-pass filter output of the composite signal of each type of pixel at the pixel coordinates and the Kth first low-pass filter output at the pixel coordinates is passed through a band-pass filter. A second signal for aperture correction is obtained, and a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices is supplied to a second low-pass filter. When a luminance signal component is obtained by synthesizing the third signal obtained by the above operation, a division look-up table is used in a division part. Here, when the number of input bits of the table is n, the most significant bit of the input is used. Is 1
Is checked, and if it is 0, the test is sequentially performed on lower bits, the test is stopped at the n-th bit, and after this test, a bit shift is performed to remove the 0 portion, thereby valid n bits Is used as an input to the division look-up table, so that it can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the seventy-seventh aspect, in the seventy-second aspect, the contents of the division look-up table used in the division part when obtaining the luminance signal component are such that the result of the division operation is increased by n bits by bit shifting. The fractional part is rounded down to an integer part, and the operation result using that value is reduced by n bits by bit shifting.
Ku is returned to the original digits, to the integer part and the operation result, it is possible to improve the calculation accuracy.

In the color video camera according to the seventy-fourth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signals of the K-th (K-th is any of the first to N-th) pixels are obtained. The first signal calculated by multiplying the ratio between the first low-pass filter output of the composite signal of each type of pixel at the pixel coordinates and the Kth first low-pass filter output at the pixel coordinates is passed through a band-pass filter. A second signal for aperture correction is obtained, and a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices is supplied to a second low-pass filter. In order to obtain a luminance signal component by synthesizing the third signal obtained by performing the above operation, the multiplication / division portion is logarithmically converted, and a logarithmic lookup table and a power lookup table are used. It can be realized at low cost.

In the color video camera according to the seventy-fifth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signals of the K-th (K-th is any of the first to N-th) pixels are obtained. The first signal calculated by multiplying the ratio between the first low-pass filter output of the composite signal of each type of pixel at the pixel coordinates and the Kth first low-pass filter output at the pixel coordinates is passed through a band-pass filter. A second signal for aperture correction is obtained, and a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices is supplied to a second low-pass filter. First b used in the circuit to obtain a luminance signal component by combining the third signal obtained by
Since the low-pass filter is composed of a plurality of bit shift circuits and an adder circuit that uses the output of the bit shift circuit as an input signal, it is possible to realize a simple circuit configuration at low cost.

In the color video camera according to the seventy-sixth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signal of the K-th (K-th is any of the first to N-th) pixels is a fixed value. And the first of the composite signals of the respective types of pixels at the coordinates of the pixel.
A first signal, which is calculated by multiplying a ratio of a low-pass filter output obtained by adding a constant value to the K-th first low-pass filter output at the coordinates of the pixel and a fixed value, is passed through a band-pass filter. A second signal for aperture correction is obtained, and a third signal obtained by passing through a second low-pass filter a combined signal of N kinds of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices. Since the luminance signal component is obtained by synthesizing と and と, it is possible to reduce the calculation error even when the divisor is small.

In the color video camera according to the seventy-seventh aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. By inputting to the 1 low-pass filter, first to N-th N types of first low-pass filter outputs are obtained, and the output signal of the K-th (K-th is any of the first to N-th) pixels is a fixed value. And the first of the composite signals of the respective types of pixels at the coordinates of the pixel.
A first signal calculated by multiplying the ratio of the output of the low-pass filter plus a constant value and the output of the K-th low-pass filter plus a constant value at the coordinates of the pixel is passed through a band-pass filter. A second signal for aperture correction is obtained, and a second signal obtained by passing through a second low-pass filter a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjustment devices. In order to obtain a luminance signal component by combining
In addition, since the power-up lookup table is used, it can be realized at a low cost with a simple circuit configuration.

In the color video camera according to the seventy-eighth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. In order to obtain a luminance signal component by synthesizing the adjusted synthesized signal of the N types of signals and the third signal obtained by passing the adjusted signal through the second low-pass filter , the rising and falling edges of the conventional signal are emphasized. It is possible to reduce unnatural emphasis that occurs when performing aperture correction.

In the color video camera according to the seventy-ninth aspect, the light is separated into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel) plus a fixed value to the output signal of the first two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel, A first signal calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the K-th first two-dimensional low-pass filter at the coordinates of the pixel to reduce the constant value, passes through a band-pass filter to perform aperture correction. And a combined signal of N kinds of signals obtained by subjecting the second signal and the output of each image sensor to gain adjustment by N gain adjusters.
Since the luminance signal component is obtained by combining the third signal obtained through the second low-pass filter , the calculation error can be reduced even when the divisor is small.

In the color video camera according to the eighteenth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane optically shifted from each other. In a portion where the spatial frequency of the image is high, the output of each image sensor is controlled by N gain adjusters. By inputting the N kinds of signals whose gains have been adjusted to the first two-dimensional low-pass filter, the first to N-th N kinds of first two-dimensional low-pass filter outputs are obtained, and the K-th (K is the first) To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel The first signal is calculated by multiplying by a ratio with the output of the low-pass filter, and in a portion where the spatial frequency is low, the first signal is calculated from an average value of outputs of N types of pixels around the pixel.
Then, the first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and a combined signal of N kinds of signals obtained by subjecting the second signal and the output of each image sensor to gain adjustment by N gain adjusters is obtained. Since a luminance signal component is obtained by combining the third signal obtained through the second low-pass filter , the luminance signal component is emphasized when the number of calculation bits is reduced.
It becomes possible to reduce the false contour of the low frequency part .

In the color video camera according to the eighteenth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A signal calculated by multiplying by a ratio with the output of the low-pass filter and a signal calculated from the average of the outputs of N types of pixels around the pixel are obtained by calculating the difference between the output of both horizontal adjacent pixels of the pixel and the pixel The first signal is obtained by switching depending on whether or not one of the outputs of the two vertically adjacent pixels exceeds a specific threshold value, and the first signal is passed through a band-pass filter to obtain a second signal for aperture correction. A signal obtained, the second signal and the output of each image sensor are gain-adjusted by N gain adjusters, and a composite signal of N types of signals is converted to a second row.
Since the luminance signal component is obtained by combining the third signal obtained through the pass filter , it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions.

In the color video camera according to the eighty-second aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A signal calculated by multiplying by a ratio with the output of the low-pass filter and a signal calculated from the average of the outputs of N types of pixels around the pixel are output between pixels having the same type of spectral sensitivity characteristic around the pixel. A first signal is obtained by switching whether or not the difference exceeds a specific threshold value,
The first signal is passed through a band-pass filter to obtain a second signal for aperture correction, and a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is converted to a second signal . Since a luminance signal component is obtained by combining the third signal obtained through the low-pass filter , it is possible to reduce attenuation of a high-frequency component of the luminance signal in a single-color image.

In the color video camera according to the 83rd aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A signal calculated by multiplying by a ratio with the output of the low-pass filter and a signal calculated from the averaging value of the outputs of N types of pixels in the vicinity of the pixel are defined by a pixel on the upper left and a pixel on the lower right of the pixel. The first signal is obtained by switching depending on whether or not one of the output difference of the pixel and the output difference of the lower left diagonally adjacent pixel and the right diagonally upper adjacent pixel exceeds a specific threshold value. One signal is passed through a band-pass filter to obtain a second signal for aperture correction, and a combined signal of N types of signals obtained by adjusting the gain of the second signal and the output of each image sensor by N gain adjusters is converted to a second low-pass signal .
Since the luminance signal component is obtained by synthesizing the third signal obtained through the filter , the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced.

In the color video camera according to the eighty-fourth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. When a luminance signal component is obtained by combining a synthesized signal of the adjusted N types of signals with a third signal obtained by passing the adjusted signal through a second low-pass filter , a division look-up table is used in a division part. If the number of input bits of n is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to lower bits, and the check is stopped at the nth bit, After the test, performs bit shifting, for using an effective n bits obtained by removing the portion of 0 the input of the division for the lookup table, it is possible to inexpensively realize a simple circuit configuration.

In the color video camera according to the 85th aspect, the
In the 84th invention , the content of the division look-up table used in the division part when obtaining the luminance signal component is obtained by increasing the operation result of the division by n bits by a bit shift and making the decimal part a truncated integer part. Calculation result using n is reduced by n bits by bit shift
Ku is returned to the original digits, to the integer part and the operation result, it is possible to improve the calculation accuracy.

In the color video camera according to the eighty-sixth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. In order to obtain a luminance signal component by synthesizing the adjusted synthesized signal of the N types of signals with a third signal obtained by passing the adjusted signal through a second low-pass filter , the multiplication / division portion is logarithmically converted, and a logarithmic lookup table is used. In addition, since the power-up lookup table is used, it can be realized at a low cost with a simple circuit configuration.

In the color video camera of the eighty-seventh aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel), a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first two-dimensional filter at the coordinates of the pixel A first signal calculated by multiplying by a ratio with a low-pass filter output is passed through a band-pass filter to obtain a second signal for aperture correction, and the second signal and each image sensor output are gained by N gain adjusters. A plurality of first two-dimensional low-pass filters used in a circuit that obtains a luminance signal component by combining a synthesized signal of the adjusted N types of signals with a third signal obtained by passing the adjusted signal through a second low -pass filter are provided. Since it is composed of a bit shift circuit and a plurality of adders using the output of the bit shift circuit as an input signal, it is possible to realize a simple circuit configuration at low cost.

In the color video camera of the eighty-eighth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel) plus a fixed value to the output signal of the first two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel, A first signal calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel and a second signal for aperture correction through a band-pass filter , And a combined signal of N kinds of signals obtained by subjecting the second signal and the output of each image sensor to gain adjustment by N gain adjusters is used as a second low-pass filter.
Since the luminance signal component is obtained by combining the third signal obtained through the filter , the calculation error can be reduced even when the divisor is small.

In the color video camera according to the ninety-eighth aspect, the light is split into N types of light by the spectral optical system, and
A color image is obtained by arranging N image sensors arranged on a three-dimensional plane so as to be optically shifted from each other, and outputs N types of signals obtained by adjusting the output of each image sensor by N gain adjusters. 1 to the N-th two-dimensional low-pass filter.
Of the two-dimensional low-pass filter of the Kth (the Kth is the first
To the N-th pixel) plus a fixed value to the output signal of the first two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel, A first signal calculated by multiplying a ratio of a value obtained by adding a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel and a second signal for aperture correction through a band-pass filter , And a combined signal of N kinds of signals obtained by subjecting the second signal and the output of each image sensor to gain adjustment by N gain adjusters is used as a second low-pass filter.
A simple circuit for converting a multiplication / division portion into a logarithm and using a logarithmic look-up table and an exponentiation look-up table to obtain a luminance signal component by combining the third signal obtained through the filter with a third signal. With the configuration, it can be realized at low cost.

[0191]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below in detail with reference to the drawings showing the embodiments.

(Embodiment 1) FIG. 5 is a block circuit diagram showing a color video camera in Embodiment 1. In the figure, 1 is a lens, 2 is an image sensor, 3 is a band-pass filter (BPF), 4 is a detection circuit, 5 is a horizontal scanning period delay circuit (1HDLY), 6 is a switch circuit, and 7 is an A / D.
A converter, 8 is a field memory, 9 is a multiplexer,
10, 11, 12, 13 are two-dimensional memories, 14, 15,
16 and 17 are two-dimensional low-pass filters (two-dimensional LP
F) and 42 are operation circuits, and 43 is a matrix circuit.

Next, the operation will be described. In FIG. 5, light incident from a lens 1 forms an image on an image sensor 2 in which photoelectric conversion elements having different spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the image sensor 2 is A /
A / D conversion is performed by the D converter 7 and the field memory 8
Is input to The image sensor 2 shown in FIG. 5 mixes and outputs signals of two vertically adjacent pixels. The mixed signal is written into the field memory 8 as one signal. FIG. 6 shows a part of how the signal from the image sensor 2 is written in the field memory 8. In the figure, MC is a signal obtained by mixing a magenta pixel signal and a cyan pixel signal, GY is a signal obtained by mixing a green pixel signal and a yellow pixel signal, and MY is a signal obtained by mixing a magenta pixel signal and a yellow pixel signal. Is a mixed signal, and GC is a signal obtained by mixing a green pixel signal and a cyan pixel signal. MC, GY, M
The Y and GC signals are separately stored in the two-dimensional memories 10, 1
1, 12, and 13. Two-dimensional memory 10, 1
FIGS. 7, 8, 9 and 10 show how signals are written in 1, 12, and 13. FIG. The signals shown in these figures are two-dimensional low-pass filters 14, 15, 16, 1
7 for smoothing. 11, 12, 13, and 1
4 shows the outputs of the two-dimensional low-pass filters 14, 15, 16, and 17. The LPF in the figure indicates a low-pass filter output.

The operation in the operation circuit 42 will be described. In FIG. 6, for example, M
Assuming that there are C, GY, and MY color filters, the method of calculating the output signal value is as shown in the following equations (8) to (10). MC (s, t) = GC (s, t) × (MCLPF (s, t) / GCLPF (s, t)) (8) GY (s, t) = GC (s, t) × (GYLPF ( (s, t) / GCLPF (s, t)) (9) MY (s, t) = GC (s, t) × (MYLPF (s, t) / GCLPF (s, t)) (10) , GC (s, t) are as shown in equation (11).
There is no need to calculate.

GC (s, t) = GC (s, t) (11) At the position (s, t) of the color filter type J (J is any of MC, GY, MY, and GC), Type K (K is MC,
GY, MY, or GC), the color signal K (s, t) is calculated by the following equation (1).
It is represented by 2). Where (s, t) is
7 shows the coordinates of the field memory 8 shown in FIG.

K (s, t) = J (s, t) × (KLPF (s, t) / JLPF (s, t)) (12) The matrix operation in the matrix circuit 43 will be described. The luminance signal component Y at the GC position in the s-th row and the t-th column in FIG. 6 is calculated by the following equation (13). Y = (MC (s, t) + GY (s, t) + MY (s, t) + GC (s, t)) / 4 (13)

The principle of the method for calculating the Y signal in this embodiment will be described. When the output signal of the image sensor is passed through a low-pass filter to remove the modulation component of the color signal as in the conventional case, the high-frequency component of the luminance signal is attenuated. In the method of the present embodiment, it is assumed that there is little change in color in a local area. That is, each color signal (MC, GY, MY, G
It can be said that the ratio C) is almost equal in the local region. The ratio of each color signal MC, GY, MY, GC in the local area is
It is given by the ratio of the two-dimensional low-pass filter outputs of MC, GY, MY, and GC. For example, as shown in Expression (8), when there is a color filter of MC at the position of GC at s row and t column, the value of MC and GC in the local area is represented by GC (s, t). It is obtained by multiplying the ratio (the ratio between the two-dimensional low-pass filter output of the MC signal and the two-dimensional low-pass filter output of the GC signal). Equations (9), (10), (1
1) can be obtained by a similar concept. Then, M obtained by the equations (8), (9), (10), and (11)
When the Y signal is calculated by the equation (13) using C, GY, MY, and GC, it becomes possible to remove the modulation component of the color signal without using a low-pass filter. As described above, since the modulation component of the color signal is not removed by the low-pass filter, the attenuation of the high-frequency component of the luminance signal can be reduced.

(Embodiment 2) FIG. 15 shows Embodiment 2 of the present invention.
In FIG. 15, portions denoted by the same reference numerals as those in FIG. 5 indicate the same or corresponding portions. 15, 18 and 19 are one-dimensional memories, 20, 21 and 22 are one-dimensional low-pass filters (LPFs), and 23 is an arithmetic circuit. FIG. 16 shows an internal configuration of the arithmetic circuit 23. The arithmetic circuit 23 includes a demultiplexer 24, a divider 25, and a multiplier 26.

Next, the operation will be described. As in the first embodiment, as shown in FIG. 6, a signal from the image sensor 2 is written to the field memory 8. The multiplexer 9 outputs signals of MC, GY and MY, GC to n lines, n +
The data is alternately input to the memories 18 and 19 in one line. FIGS. 17 and 18 show how signals are written to the memories 18 and 19. FIG. The signals shown in these figures are smoothed by the low-pass filters 20 and 21. FIG.
FIG. 20 shows the outputs of the low-pass filters 20 and 21. Also, the output of the image sensor 2 is A / D converted, and the digital signal output is passed through a low-pass filter 22 to obtain a Y signal.
Obtain the low-pass filter output of the signal. FIG. 21 shows the output of the low-pass filter 22. In the figure, LPF is a symbol indicating that it is a low-pass filter output.

Next, the operation of the arithmetic circuit 23 will be described. The output of the low-pass filter of the Y signal is input to the divider 25 as a dividend. Also, when the demultiplexer 24 has n lines, if the pixel is an MC pixel, it outputs a low-pass filter output of MC, if it is a GY pixel, it outputs a low-pass filter of GY.
If the output is a Y low-pass filter or a GC pixel, the output is switched to a GC low-pass filter output, and the output is input to the divider 25 as a divisor. The output of the divider 25 is used as the input of the multiplier 26. The output signal of this pixel is input to the multiplier 26. As a result, the output of the multiplier 26 is obtained as the Y signal at the pixel.

In FIG. 17, for example, the calculation formula of the luminance signal component Y (t) at the position of the color filter GC in the t-th column is the following formula (14). Y (t) = GC (t) × (YLPF (t) / GCLPF (t)) (14) Luminance signal at position t of color filter type K (K is any of MC, GY, MY, and GC) The method of calculating the component Y (t) is represented by the following equation (15). However, in the case of this embodiment, t is
If the pixel is a GC or GY color filter, the coordinates of the memory 18 shown in FIG. 17 are shown. If the pixel is MY or MC, the coordinates of the memory 19 shown in FIG. 18 are shown. Y (t) = K (t) × (YLPF (t) / KLPF (t)) (15)

The principle of the method for calculating the Y signal in the second embodiment will be described. This method assumes that there is little change in color in a local area. That is, it can be said that the ratio between each color signal (MC, GY, MY, GC) and the Y signal is substantially equal in a local region. The ratio between each of the color signals MC, GY, MY, GC and the Y signal in the local area is represented by MC, G
It is given by the ratio between the low-pass filter outputs of Y, MY, and GC and the low-pass filter outputs of the Y signal.

For example, as shown in Expression (14), the luminance signal component Y (t) at the position of GC in the t-th column is represented by GC (t)
Is multiplied by the ratio of Y to GC (the ratio of the low-pass filter output of the Y signal to the low-pass filter output of the GC signal) in the local region. As described in the first embodiment, the high frequency component of the luminance signal is attenuated in the conventional example, but the modulation component of the color signal is removed without reducing the high frequency component of the luminance signal in the second embodiment, as in the first embodiment. It is possible to do.

(Embodiment 3) The configuration of a color video camera in Embodiment 3 is the same as that of Embodiment 2 (FIG. 15).
The method of calculating the Y signal in the arithmetic circuit 23 is different. The operation in the operation circuit 23 will be described. In FIG. 17, for example, if each signal has 256 gradations of 8 bits and LSB (Least Significant Bit) of 1 is adopted as a constant value, the luminance signal component Y (t) at the position of the color filter GC in the t-th column becomes It is calculated as in the following equation (16). Y (t) = (GC (t) +1) × ((YLPF (t) +1) / (GCLPF (t) +1)) − 1 (16)

Color filter type K (K is MC, GY, M
The calculation method of the luminance signal component Y (t) at the position t of any one of Y and GC is represented by the following equation (17). Y (t) = (K (t) +1) × ((YLPF (t) +1) / (KLPF (t) +1)) −1 (17) If the denominator is 0 in the division part, it is impossible to calculate. Becoming
When the number of bits of the calculation is small, the calculation error may increase even if the denominator is near zero. In such a case, the calculation error can be reduced by adopting LSB 1 as in the third embodiment.

(Embodiment 4) FIG. 22 is a block circuit diagram showing a color video camera according to Embodiment 4. FIG.
15, the same reference numerals as those in FIG. 15 indicate the same parts, and 27 is a threshold value comparison circuit. Next, the operation will be described. An output signal of an appropriate pixel around the corresponding pixel is input from the field memory 8 to the threshold value comparison circuit 27. If the difference between the output signals of pixels of the same type exceeds a specific threshold value, the spatial frequency of the image is Is determined to be high, and if it does not exceed a specific threshold, it is determined that the spatial frequency of the image is low. Then, in a portion where the spatial frequency of the image is high, a luminance signal is calculated in the same manner as in the second embodiment. I do.

The arithmetic circuit 23 operates as in the second embodiment in a portion where the spatial frequency is high, and in a portion where the spatial frequency is low, for example, the position of the GC color filter in column t in FIG. The luminance signal component Y (t) at the position where there is no output signal is calculated by the following equation (18). Y (t) = MY (t-1) / 4 + GC (t) / 2 + MY (t + 1) / 4 (18)

Assuming that the position of the pixel is t, the type of the color filter of the pixel is J (J is any of MC, GY, MY, and GC), and the type of the color filter of both horizontally adjacent pixels of the pixel is K.
(K is any one of MC, GY, MY, and GC), the luminance signal component Y (t) is calculated as in the following equation (19). Y (t) = K (t-1) / 4 + J (t) / 2 + K (t + 1) / 4 (19) As described above, the method of calculating the luminance signal between the high spatial frequency portion and the low spatial frequency portion is as follows. By making them different, it is possible to reduce false contours of low-frequency components that are emphasized when the number of calculation bits is reduced.

(Embodiment 5) The configuration of the color video camera in Embodiment 5 is Embodiment 4.
This is the same as (FIG. 22), but the signal processing in the arithmetic circuit 23 and the threshold value comparing circuit 27 is different. In Example 5,
Compared the difference between the output signals of both the horizontal adjacent pixels of the corresponding pixel and the particular threshold, it is judged that the high spatial frequency portion if the difference is greater than the certain threshold of the output signal, before
When the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the fourth embodiment is performed.

The operation of the threshold value comparing circuit 27 will be described. For example, assuming that the color filter at the position of the s row and the t column in FIG. 6 is GC and the color filter at the position of both horizontally adjacent pixels of the pixel is MY, the calculation result of the following expression (20) and a specific threshold And selects the two luminance signal generation methods. | MY (t−1) −MY (t + 1) | (20) The position of the pixel is t, and the type of the color filter of both horizontally adjacent pixels of the pixel is K (K is MC, GY, MY, GC Either)
Then, the calculation result of the following equation (21) is compared with a threshold value, and both luminance signal generation methods are selected. | K (t-1)-K (t + 1) | ... (21)

(Embodiment 6) FIG. 23 is a block circuit diagram showing a color video camera according to Embodiment 6. FIG.
15, the same reference numerals as those in FIG. 15 denote the same parts, and reference numeral 28 denotes a lookup table for division. Since the arithmetic expressions described in the second embodiment include division, the sixth embodiment uses the division look-up table 28. For example, as shown in FIG. 24, the input is 8 bits and 55 (00110111), 13
(00001101), when 55/13 is obtained by setting the input of the division look-up table 28 to 5 bits, it is sequentially checked from the most significant bit to the 5th bit of each input whether it is 1 or not. This bit is set as the most significant bit and the upper 5 bits are input. In other words, input 27
Bit shift to the most significant 5 bits such as (11011) and 13 (01101) to obtain the output 2 (00010) corresponding to the division result of 2 inputs from the division look-up table 28 and obtain the number of bits of the numerator The number of bits is increased by the amount of decreasing. That is, 4 is obtained as the calculation result.

If the input is m bits and x, y, and the input of the division look-up table 28 is n bits (m
> N) Check whether the most significant bit of the input is 1; if it is 0, check sequentially for lower bits, and stop checking at the nth bit. Therefore, when 1 exists at the a-th bit in x (m ≧ a ≧ n), and when 1 exists at the b-th bit (m ≧ b ≧ n) in y, the bit is set as the most significant bit and the upper n
The bits x 'and y' are obtained. That is, x 'and y' are the most effective n bits obtained by truncating bits with small weights as in the following equations (22) and (23). x ′ = x >> (a−n) (22) y ′ = y >> (b−n) (23) z ′ = x ′ / y ′ (24) where >>> is a bit shift. x is an an-n bit, y is a bit number reduced by b-n bits, x 'and y' are input and an output z 'is obtained from the lookup table 28, and the numerator and denominator bits are shifted. Bit shift is performed by the amount. That is, the calculation of the following equation (25) is performed to obtain the calculation result z. z = z ′ >> (ba) (25)

For example, the lookup table for division 28
Is 8 bits, the division of the upper 7 bits of 2 inputs requires 131072 bits of the capacity of the lookup table 28, and the division using the most effective 5 bits for the input requires the lookup lookup table. Table 28
A similar effect can be obtained with a capacity of 8192 bits. Therefore, in the sixth embodiment, the circuit configuration is further simplified.

(Embodiment 7) The configuration of a color video camera in Embodiment 7 is the same as that of Embodiment 6 (FIG. 23).
The signal processing in the arithmetic circuit 23 and the signal processing in the lookup table for division 28 are different.

Next, the operation will be described. The configuration of the division look-up table 28 according to the seventh embodiment has an integer part of 5 bits and a decimal part of 5 bits. For example, as shown in FIG. 25, the input is 8 bits and 55 (00110111), 13 (000011
01), and the input of the division lookup table 28 is 5
To obtain 55/13 as a bit, input 27 (11
011), 13 (01101), and shifts to the most significant 5 bits, and outputs 6 corresponding to the result of division of 2 inputs.
6 (0001000010) is obtained from the division look-up table 28, and the number of bits is increased by the reduced number of bits of the numerator. That is, 132 is obtained as the calculation result. Thereafter, using the operation result, the multiplication of the operation expression described in the second embodiment is performed, and the value is reduced by 5 bits in order to discard the decimal part of the division look-up table 28. Here, if the value of the multiplication unit is 11, an operation result 45 is obtained.

When the input is m bits and x, y, the input is n bits in the division look-up table 28, the output is 2 n bits of an integer part n bits and a decimal part n bits (m> n). There is 1 in the eye (m ≧ a ≧
n), when 1 exists at the b-th bit in y (m ≧ b ≧
n), the most significant n bits are x ', y',
Lookup table for division 2 with x 'and y' as inputs
Assume that an output z 'is obtained from 8 and the bit shift is performed by the amount by which the number of bits of the numerator and denominator are shifted, thereby obtaining an operation result z. Thereafter, using the result of the operation, the multiplication of the operation expression described in the second embodiment is performed, and the number is reduced by n bits in order to discard the decimal part of the division look-up table 28. Assuming that the value of the multiplication unit is p, an operation result q is obtained as in the following equation (26). q = (p × z) >> n (26) In this way, the number of output bits of the division look-up table 28 is doubled as the number of input bits, and a decimal part is output. By performing multiplication, the calculation accuracy can be improved.

(Embodiment 8) The configuration of a color video camera in Embodiment 8 is the same as that of Embodiment 2 (FIG. 15).
In the eighth embodiment, a low-pass filter is used as a digital filter. Here, for example, the number of horizontal taps is 5, and the tap coefficients are 1/8, 1/4, 1/4, 1/4, 1/8, and can be configured only by bit shift. FIG.
6 is a diagram showing the configuration of the one-dimensional low-pass filter, in which 101 to 104 are one-clock delay circuits (1CLKDLY), 105 and 109 are three-bit shift circuits, 110
Is an adder.

It is assumed that the image sensor output S (t + 2) is input to the one-dimensional low-pass filter having such a configuration. 3
S (t + 2) / 8 is input to the adder 110 by the bit shift circuit 105. The image sensor output S (t + 1) one clock before is input to the 2-bit shift circuit 106 via the one-clock delay circuit 101, and the output S (t + 1) / 4 is obtained. Similarly, outputs S (t) / 4 and S (t) are output from 2-bit shift circuits 107 and 108 and 3-bit shift circuit 109.
-1) / 4 and S (t-2) / 8 are obtained. Therefore, adder 1
The output of 10 becomes an output as shown in Expression (27), and a low-pass filter output YLPF (t) of the image sensor output at the position t of the corresponding pixel can be obtained. YLPF (t) = S (t + 2) / 8 + S (t + 1) / 4 + S (t) / 4 + S (t-1) / 4 + S (t-2) / 8 (27)

The above is the output of the low-pass filter of the image sensor. The low-pass filter of the pixel of the J-th color filter at the position t of the corresponding pixel has the J-th color filter arranged every other pixel. Therefore, a two-clock delay circuit may be used instead of the one-clock delay circuit.

(Embodiment 9) The configuration of a color video camera in embodiment 9 is the same as that of embodiment 2 (FIG. 15), and the method of calculating the luminance signal in the arithmetic circuit 23 is different. In the third embodiment, (16),
From the calculation result obtained by adding 1 to the multiplier, the divisor, and the dividend, as shown in the equation (17) , in order to minimize the calculation error, 1
Is subtracted to obtain a luminance signal. However, this 1 is L
Since it is SB and has almost no effect on the operation result, it is not necessary to reduce 1 at the end in order to simplify the circuit configuration. An example in which this is done is Example 9, where t
The luminance signal component Y at the position of the GC color filter in the column
(t) is calculated as in the following equation (28). Y (t) = (GC (t) +1) × ((YLPF (t) +1) / (GCLPF (t) +1)) (28) Kind of color filter K (K is MC, GY, MY, GC The calculation method of the luminance signal component Y (t) at the position t in any one of the positions is represented by the following equation (29). Y (t) = (K (t) +1) × ((YLPF (t) +1) / (KLPF (t) +1)) (29) In the ninth embodiment, as in the third embodiment, the calculation error is reduced. it can.

(Embodiment 10) FIG. 27 is a block circuit diagram showing a color video camera according to Embodiment 10. 27, the same reference numerals as those in FIG. 15 denote the same parts, and 29 denotes a logarithmic lookup table.
Is a power-up lookup table. Next, the operation will be described. The method of calculating the luminance signal component Y (t) when the type of the color filter of the pixel at the position t is K (K is any of MC, GY, MY, and GC) is described in, for example, Embodiment 9.
As described above, this is represented by equation (29). Here, equation (2)
In 9), logarithmic conversion is performed with the base being x as shown in equation (30). Here, ＾ indicates a power. Y (t) = x ＾ log x ｛(K (t) +1) × ((YLPF (t) +1) / (KLPF (t) +1))｝ = x ＾ ｛log x (K (t) +1) + log x (YLPF (t) +1) −log x (KLPF (t) +1)｝ (30)

When the coefficients used in the above equation (30) are all 8 bits and the number of output bits of the logarithmic lookup table 29 is 10 bits, the capacity is 2560 bits. Further, after calculating the logarithmic portion using the logarithmic look-up table 29, a power multiplier for performing addition and subtraction is calculated. Since this power multiplier can be sufficiently expressed by 11 bits, if the output of the power-up lookup table 30 is 8 bits, the capacity is 16384 bits. Therefore, it is possible to calculate the operation expression of Expression (29) using the lookup table having a total capacity of 18944 bits, and the circuit configuration can be further simplified. The first embodiment
In the case of 0, the case where the luminance signal is calculated based on the calculation formula of the ninth embodiment has been described. Of course.

(Embodiment 11) FIG. 28 is a block circuit diagram showing a color video camera according to Embodiment 11. In FIG. 28, portions denoted by the same reference numerals as those in FIG. In FIG. 28, reference numeral 31 denotes a two-dimensional low-pass filter (L
PF) and 32 are operation circuits. FIG. 29 shows the internal configuration of the arithmetic circuit 32. The arithmetic circuit 32 includes a demultiplexer 33, a divider 34, and a multiplier 35.

Next, the operation will be described. The basic operation is the same as in the first embodiment. An image sensor output from the field memory 8 is input to the two-dimensional low-pass filter 31,
A two-dimensional low-pass filter output YLPF as shown in FIG.
Is obtained. The operation in the operation circuit 32 will be described. The output of the two-dimensional low-pass filter of the Y signal is input to the divider 34 as a dividend. Demultiplexer 3
According to 3, if the pixel is an MC pixel, a two-dimensional low-pass filter output of MC, a GY pixel, a two-dimensional low-pass filter output of GY, a MY two-dimensional low-pass filter output, and a GC if GC pixel. , And the output is input to the divider 34 as a divisor. The output of the divider 34 is used as a multiplier 3
5 is input. Further, the output signal of the pixel is multiplied by a multiplier 35.
To enter. As a result, the output of the multiplier 35 is obtained as the luminance signal Y in the pixel. The eleventh embodiment is an example in which a two-dimensional low-pass filter is used instead of the one-dimensional low-pass filter in the second embodiment. In FIG. 6, for example, the luminance signal component Y (s, t) at the position of the color filter GC in the s row and the t column is calculated by Expression (31). Y (s, t) = GC (s, t) × (YLPF (s, t) / GCLPF (s, t)) (31)

Color filter type K (K is MC, GY, M
Y (either Y or GC), the luminance signal component Y (s,
The calculation method of t) is represented by the following equation (32). However,
(s, t) indicates the coordinates of the field memory 8. Y (s, t) = K (s, t) × (YLPF (s, t) / KLPF (s, t)) (32) The principle of the method of calculating the Y signal in the present embodiment is described in the second embodiment.
This is basically the same as above, and it is possible to remove the modulation component of the chrominance signal without reducing the high frequency component of the luminance signal.

(Embodiment 12) The configuration of a color video camera in Embodiment 12 is the same as that of Embodiment 11 (FIG. 28), but the method of calculating the Y signal in the arithmetic circuit 32 is different. The operation in the operation circuit 32 will be described. FIG.
For example, if each signal has 256 gradations of 8 bits and LSB of 1 is adopted as a constant value, the luminance signal component Y at the position of the color filter GC in the s-th row and the t-th column is obtained.
(s, t) is calculated as in the following equation (33). Y (s, t) = (GC (s, t) +1) × ((YLPF (s, t) +1) / (GCLPF (s, t) +1)) −1 (33) Color filter type K ( (K is any one of MC, GY, MY, and GC) The method of calculating the luminance signal component Y (s, t) at the position (s, t) is represented by the following equation (34). Y (s, t) = (K (s, t) +1) × ((YLPF (s, t) +1) / (KLPF (s, t) +1)) −1 (34)

(Thirteenth Embodiment) FIG. 31 is a block circuit diagram showing a color video camera according to a thirteenth embodiment. 31, the same reference numerals as those in FIG. 28 denote the same parts, and reference numeral 27 denotes a threshold value comparison circuit similar to FIG. 22 (Embodiment 4). Next, the operation will be described. As in the fourth embodiment, the level of the spatial frequency of the image is determined by comparing the difference between the output signals of the same kind of pixels input from the field memory 8 to the threshold value comparison circuit 27 with a specific threshold value. . Then, in a portion where the spatial frequency is high, a luminance signal is calculated in the same manner as in the eleventh embodiment. In a portion where the spatial frequency is low, a luminance signal is calculated from the weighted average value of outputs of N types of pixels around this pixel.

The arithmetic circuit 32 operates as in the eleventh embodiment in the portion where the spatial frequency is high, and in the portion where the spatial frequency is low, for example, the luminance signal component at the position of the GC color filter in the s row and the t column in FIG. Y (s, t) is calculated as in equation (35). Y (s, t) = MC (s-1, t-1) / 16 + GY (s-1, t) / 8 + MC (s-1, t + 1) / 16 + MY (s, t-1) / 8 + GC ( (s, t) / 4 + MY (s, t + 1) / 8 + MC (s + 1, t-1) / 16 + GY (s + 1, t) / 8 + MC (s + 1, t + 1) / 16 (35 )

When the position of the pixel is (s, t), the type of the color filter of the pixel is J (J is any one of MC, GY, MY, and GC), and the color filter of the two horizontal adjacent pixels of the pixel is The type is K (K is any of MC, GY, MY, and GC), and the type of the color filter of both vertically adjacent pixels of the pixel is L (L is MC, G
Y, MY, or GC), and a luminance signal component Y (s, t) when the type of a color filter of a pixel obliquely adjacent to the pixel is M (M is any of MC, GY, MY, or GC). Is given by the following equation (3
It is calculated as in 6). Y (s, t) = M (s-1, t-1) / 16 + L (s-1, t) / 8 + M (s-1, t + 1) / 16 + K (s, t-1) / 8 + J ( (s, t) / 4 + K (s, t + 1) / 8 + M (s + 1, t-1) / 16 + L (s + 1, t) / 8 + M (s + 1, t + 1) / 16 (36 )

(Embodiment 14) The configuration of a color video camera in Embodiment 14 is the same as that of Embodiment 13 (FIG. 31), but the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27 is different. Example 14
Then, the difference between the output signals of the two adjacent pixels or the difference between the output signals of the two adjacent pixels of the corresponding pixel is compared with a specific threshold, and when the difference between the output signals is larger than the specific threshold, Is determined to be a part where the spatial frequency is high.
11 is performed, and when the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 13 is performed.

For example, in FIG. 6, the following calculation result is compared with a specific threshold value at the position of the GC color filter in the s-th row and the t-th column, and the two luminance signal generation methods are selected. | MY (s, t-1)-MY (s, t + 1) | ... (37) | GY (s-1, t) -GY (s + 1, t) | ... (38) Position of the pixel Is (s, t), and the color
The type of the filter is J (J is any of MC, GY, MY, and GC), and the type of the color filter of both vertically adjacent pixels of the pixel is K.
As (K is any of MC, GY, MY, and GC), the following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | J (s, t-1)-J (s, t + 1) | ... (39) | K (s-1, t) -K (s + 1, t) | ... (40)

(Embodiment 15) The configuration of a color video camera in Embodiment 15 is the same as that of Embodiment 13 (FIG. 31), but the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27 is different. Example 15
Then, the difference between the output signals of the pixels of the same type of spectral sensitivity characteristic around the relevant pixel is compared with a specific threshold value, and if the difference is larger than the specific threshold value, the portion with a higher spatial frequency is Judgment is made and the above-described embodiment 11 is performed, and the output signal
If the difference is smaller than the specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 13 is performed.

For example, as shown in FIG. 6, the coordinates (s,
The color filter at the position t) is GC, the color filter at the position of both horizontally adjacent pixels of the pixel is MY, the color filter at the position of both vertically adjacent pixels of the pixel is GY, and the color at the position of the pixel obliquely adjacent to the pixel. Assuming that the filter is MC, the following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | MY (s, t-1)-MY (s, t + 1) | ... (41) | GY (s-1, t) -GY (s + 1, t) | ... (42) | MC (s -1, t-1) -MC (s + 1, t + 1) | ... (43) | MC (s-1, t + 1) -MC (s + 1, t-1) | ... (44)

Assuming that the position of the pixel is (s, t), the type of the color filter of both horizontally adjacent pixels of the pixel is J (J is MC, G
Y, MY, or GC), the type of the color filter of both vertically adjacent pixels of the pixel is K (K is any of MC, GY, MY, or GC), and the type of the color filter of the pixel obliquely adjacent to the pixel Is set to L (L is any of MC, GY, MY, and GC), the following calculation result is compared with a threshold value, and both luminance signal generation methods are selected. | J (s, t-1)-J (s, t + 1) | ... (45) | K (s-1, t) -K (s + 1, t) | ... (46) | L (s -1, t-1) -L (s + 1, t + 1) | ... (47) | L (s-1, t + 1) -L (s + 1, t-1) | ... (48)

(Embodiment 16) The configuration of a color video camera according to Embodiment 16 is the same as that of Embodiment 13 (FIG. 31), but the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27 is different. Example 16
In the corresponding comparing the difference with a specific threshold value of the output signals of both diagonal adjacent pixels interposing the pixel, determine the high spatial frequency portion if the difference between the output signal is greater than a certain threshold
Then, the above-described embodiment 11 is performed. If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 13 is performed. For example, in FIG. 6, the following calculation result is compared with a specific threshold value at the position of the GC color filter in the s-th row and the t-th column, and both luminance signal generation methods are selected. | MC (s-1, t-1)-MC (s + 1, t + 1) | ... (49) | MC (s + 1, t-1) -MC (s-1, t + 1) | … (50)

The position of the pixel is (s, t), and the type of the diagonally adjacent pixel of the color filter of the pixel is J (J is MC, GY, MY,
GC), the following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | J (s-1, t-1) -J (s + 1, t + 1) | ... (51) | J (s + 1, t-1) -J (s-1, t + 1) | … (52)

(Embodiment 17) FIG. 32 is a block circuit diagram showing a color video camera in embodiment 17. 32, the same reference numerals as those in FIG. 28 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 18) Embodiment 7 with respect to Embodiment 6
The eighteenth embodiment is an embodiment in which the calculation method of is applied to the seventeenth embodiment. The operation of the eighteenth embodiment is the same as that of the seventh embodiment, and a description thereof will be omitted.

(Embodiment 19) The configuration of a color video camera in embodiment 19 is the same as that of embodiment 11 (FIG. 28). In the nineteenth embodiment, a two-dimensional low pass filter is used as a digital filter. Here, for example, the number of horizontal taps is 5, the number of vertical taps is 3, and the tap coefficients are 1/8, 1/4, 1 /
4, 1/4, 1/8 and vertical can be constituted only by bit shifts, such as 1/4, 1/2, 1/4. FIG.
3 is a diagram showing the configuration of the two-dimensional low-pass filter, reference numeral 201 is one horizontal scanning period delay circuit (1HDLY), 204 is 1-bit shift circuit (1
B shift), 203 , 205 , 219-221 , 224
To 226, 229 to 231 are 2-bit shift circuits (2B
Shift), 218, 222, 223, 227, 228,
232 is a 3-bit shift circuit (3B shift);
217 is a one clock delay circuit (DLY) , 233 to 23
6 is an adder.

It is assumed that the image sensor output S (s + 1, t + 2) is input to the two-dimensional low-pass filter having such a configuration. The output of the 2-bit shift circuit 203 is S (s + 1, t + 2)
/ 4, and the output of the 3-bit shift circuit 218 is S (s
+ 1, t + 2) / 32. Also, one clock delay circuit 20
6, the image sensor output S (s + 1, t + 1) / one clock before
4 is input to the 2-bit shift circuit 219, and the output S (s +
(1, t + 1) / 16 is obtained. Similarly, the outputs S (s + 1, t) / 16, S (s + 1, t-1) / 16, S (s + 1, t) of the 2-bit shift circuits 220 and 221 and the 3-bit shift circuit 222 are output.
-2) / 32 is obtained. Therefore, the output of the adder 233 is obtained as Y'LPF (s + 1, t) shown in Expression (53). Y'LPF (s + 1, t) = S (s + 1, t + 2) / 32 + S (s + 1, t + 1) / 16 + S (s + 1, t) / 16 + S (s + 1, t-1) / 16 + S (s + 1, t-2) / 32 ... (53)

Similarly, the output of the adder 234 is obtained as Y'LPF (s, t) shown in the equation (54). Y'LPF (s, t) = S (s, t + 2) / 16 + S (s, t + 1) / 8 + S (s, t) / 8 + S (s, t-1) / 8 + S (s, t -2) / 16 (54) Similarly, the output of the adder 235 is obtained as Y'LPF (s-1, t) shown in Expression (55). Y'LPF (s-1, t) = S (s-1, t + 2) / 32 + S (s-1, t + 1) / 16 + S (s-1, t) / 16 + S (s-1, t-1) / 16 + S (s-1, t-2) / 32 ... (55)

Therefore, in the adder 236, the expression (5)
As shown in 6), a two-dimensional low-pass filter output YLPF (s, t) of the image sensor output at the position (s, t) of the pixel can be obtained. YLPF (s, t) = Y'LPF (s + 1, t) + Y'LPF (s, t) + Y'LPF (s-1, t) (56) The above is the two-dimensional low-pass filter of the image sensor output. Although the output is a two-dimensional low-pass filter of the pixel of the J-th color filter at the position (s, t) of the corresponding pixel, the J-th color filter is arranged every other pixel both horizontally and vertically. A two-clock delay circuit may be used instead of the one-clock delay circuit, and a two-horizontal scanning period delay circuit may be used instead of the one-horizontal scanning period delay circuit.

(Embodiment 20) The configuration of a color video camera in embodiment 20 is the same as that of embodiment 11 (FIG. 28), and the calculation method of the luminance signal in the arithmetic circuit 32 is different. In Example 12, the expression (3)
As described in (3) and (34), the luminance signal is obtained by finally subtracting 1 from the operation result obtained by adding 1 to the multiplier, divisor, and dividend to minimize the operation error. However, this 1
Is an LSB and has almost no effect on the operation result. Therefore, it is not necessary to reduce 1 at the end in order to simplify the circuit configuration. Such an example is the twentieth embodiment, in which the luminance signal component Y (s, t) at the position of the GC color filter in the s-th row and the t-th column is calculated as in the following equation (57). Y (s, t) = (GC (s, t) +1) × ((YLPF (s, t) +1) / ( GCLPF (s, t) +1)) (57)

Color filter type K (K is MC, GY, M
Y (either Y or GC), the luminance signal component Y (s,
The calculation method of t) is expressed by the following equation (58). Y (s, t) = (K (s, t) +1) × ((YLPF (s, t) +1) / (KLPF (s, t) +1)) (58)

(Embodiment 21) FIG. 34 is a block circuit diagram showing a color video camera according to Embodiment 21. In FIG. 34, the same reference numerals as those in FIG. 28 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (Embodiment 10).

Next, the operation will be described. The type of the color filter of the pixel at the position (s, t) is K (K is MC, G
Y, MY, or GC), the luminance signal component Y (s,
The calculation method of t) is expressed by Expression (58), for example, as described in the twentieth embodiment. Here, in equation (58), logarithmic transformation is performed with the base being x as shown in equation (59). Here, ＾ indicates a power. Y (s, t) = x ＾ log x ｛(K (s, t) +1) × ((YLPF (s, t) +1) / (KLPF (s, t) +1))｝ = x ＾ ｛log x (K (s, t) +1) + log x (YLPF (s, t) +1) −log x (KLPF (s, t) +1)｝ (59)

In the twenty-first embodiment, as in the tenth embodiment, calculations can be performed using a low-capacity lookup table. Although the case where the luminance signal is calculated based on the calculation formula of the twentieth embodiment has been described, it is needless to say that the calculation method using the logarithmic lookup table and the exponentiation lookup table may be applied to the eleventh embodiment. It is.

(Embodiment 22) FIG. 35 is a block circuit diagram showing a color video camera according to Embodiment 22. In the figure, 51 is a lens, 52 is a three-color separation prism, 5
Reference numerals 3, 54, and 55 denote imaging elements, 56 denotes a red signal amplifier, 57 denotes a green signal amplifier, 58 denotes a blue signal amplifier, 59, 60, and 61 denote A / D converters, and 62 and 6.
Reference numerals 3 and 64 denote memories, 65, 66, and 67 low-pass filters (LPFs), 69 an adder, 72 a demultiplexer, and 75 an arithmetic circuit. FIG. 36 shows the operation circuit 7
5 shows an internal configuration, and the arithmetic circuit 75 has demultiplexers 80 and 81, a divider 82, and a multiplier 83.

Next, the operation will be described. In FIG. 35, light incident from a lens 51 is reflected by a three-color separation prism 5.
2, the light is split into red, green, and blue light.
An image is formed at 55. The image pickup devices 53, 54, and 55 mix signals of two vertically adjacent pixels and output one signal. The output signals of the image pickup devices 53, 54, 55 are respectively converted by a red signal amplifier 56, a green signal amplifier 57, and a blue signal amplifier 58 into a ratio of the respective output signals.
For example, in the case of the NTSC system, R: G: B = 0.30:
Amplify to be 0.59: 0.11. The amplified signals are A / D-converted by A / D converters 59, 60, 61 to obtain R, G, B signals, respectively.
R is a red pixel signal, G is a green pixel signal, and B is a blue pixel signal. The G signal is input to the memory 62, and the R and B signals are mixed by the adder 69 and
3 is input. The G signal and the R / B mixed signal are alternately switched by the demultiplexer 72 and input to the memory 64 as a composite signal Y ′. FIGS. 37, 38, and 39 show a part of how the G signal, the R / B mixed signal, and the Y 'signal are written in the memories 62, 63, and 64. In the figure, RB indicates an R / B mixed signal. Then, the signals shown in these figures are applied to the low-pass filters 65 and 6.
6,67. 40, 41, 42
Shows the outputs of the low-pass filters 65, 66 and 67. In the figure, LPF indicates a low-pass filter output.

Next, the operation of the arithmetic circuit 75 will be described. The output of the low-pass filter of the synthesized signal Y ′ is input to the divider 82 as a dividend. Demultiplexer 8
When the pixel is a green pixel, the signal is switched to a low-pass filter output of a G signal, and when the pixel is a red and blue pixel, the output is switched to a low-pass filter output of an R / B mixed signal. You. The output of the divider 82 is used as the input of the multiplier 83. When the pixel is a green pixel by the demultiplexer 80, G
If the pixel is a red or blue pixel, the signal is switched to an R / B mixed signal, and the output is input to the multiplier 83. As a result, the output of the multiplier 83 is obtained as a Y signal at the pixel.

In FIG. 37, for example, the luminance signal component Y (t) at the position of the green pixel in the t-th column is calculated as in equation (60). Y (t) = G (t) × (Y ′ LPF (t) / GLPF (t)) (60) The luminance signal component Y () at the position t of the pixel type K (K is either G or RB) The calculation method of t) is expressed by the following equation (61). Where t is the coordinates of the memory 64 shown in FIG. 39 in the case of the present embodiment, the coordinates of the memory 62 shown in FIG. 37 if the pixel is G, and the coordinates of the memory 63 shown in FIG. 38 if the pixel is RB. Indicates coordinates. Y (t) = K (t) × (Y'LPF (t) / KLPF (t)) (61)

(Embodiment 23) FIG. 43 is a block circuit diagram showing a color video camera according to Embodiment 23. 43, the same reference numerals as those in FIG. 35 denote the same parts, and reference numeral 85 denotes an arithmetic circuit whose internal configuration is shown in FIG. The arithmetic circuit 85 has a demultiplexer 80, a divider 82, and a multiplier 83.

Next, the operation will be described. Example 2
In 3, the G signal and the R / B mixed signal are input from the demultiplexer 72 to the arithmetic circuit 85. The output of the low-pass filter of the synthesized signal Y ′ is input to the divider 82 as a dividend. When the pixel is a green pixel, the demultiplexer 80 switches the output to a low-pass filter output of a G signal, and when the pixel is a red or blue pixel, switches to a low-pass filter output of an R / B mixed signal. 82 is input. The output of the divider 82 is used as the input of the multiplier 83. The G signal is input to the multiplier 83 when the pixel is a green pixel, and the R and B mixed signal is input when the pixel is a red and blue pixel. As a result, the output of the multiplier 83 is obtained as a Y signal at the pixel.
Other operations are the same as those of the twenty-second embodiment.

The principle of the method of calculating the Y signal in the above-mentioned embodiments 22 and 23 will be described. This method assumes that there is little change in color in a local area. That is, it can be said that the ratio between each color signal (G, RB) and the Y ′ signal is substantially equal in a local region. The ratio between each color signal G, RB and the Y ′ signal in the local area is given by the ratio between the G, RB low-pass filter output and the Y ′ low-pass filter output. For example, as shown in equation (60), at the position of G in the t-th column, G (t) represents the ratio of Y ′ to G in the local region (the low-pass filter output of the Y ′ signal and the G
Y (t) is obtained by multiplying by the ratio of the signal to the low-pass filter output.

The spatial pixel shift method of the conventional three-chip image pickup method aims at increasing the resolution. However, there is no problem in the case of a subject in which the ratio between the green signal and the red / blue mixed signal is substantially equal, but in the case of a subject in which the ratio is largely different, vertical stripes are generated. Therefore, conventionally, the generation of the vertical stripes is reduced by passing the luminance signal through a low-pass filter, but the high-frequency component of the luminance signal is attenuated. However, in the present invention, G
(t) shows the ratio of Y 'to G in the local region (Y'
By multiplying by the ratio of the low-pass filter output of the signal and the low-pass filter output of the G signal), the Y signal is obtained. Therefore, it is possible to reduce the occurrence of vertical stripes without attenuating the high-frequency component of the luminance signal.

(Embodiment 24) The configuration of a color video camera according to Embodiment 24 of the present invention is the same as that of FIG. 35, and the signal processing in the arithmetic circuit 75 is different. Is used to calculate the Y signal. Specifically, Y (t) at the position of G in the t-th column is calculated as in equation (62). Y (t) = (G (t) +1) × ((Y′LPF (t) +1) / (GLPF (t) +1)) − 1 (62) Pixel type K (K is either G or RB) The method of calculating the luminance signal component Y (t) at the position t in the above (1) is expressed by the following equation (63). Where t is the coordinates of the memory 64 shown in FIG. 39 in the case of the present embodiment, the coordinates of the memory 62 shown in FIG. 37 if the pixel is G, and the coordinates of the memory 63 shown in FIG. 38 if the pixel is RB. Indicates coordinates. Y (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) − 1 (63)

(Embodiment 25) FIG. 45 is a block circuit diagram showing a color video camera in embodiment 25. In FIG. 45, portions denoted by the same reference numerals as in FIG. 35 indicate the same portions, and 27 is a threshold value comparison circuit similar to that in FIG. 22 (Example 4). Next, the operation will be described. An output signal of an appropriate pixel around the pixel is input from the memories 62 and 63 to the threshold value comparison circuit 27. If the difference between output signals of pixels of the same type exceeds a specific threshold value, the spatial frequency of the image is Is determined to be high, and if the threshold value is not exceeded, the spatial frequency of the image is determined to be low. Then, in a portion where the spatial frequency of the image is high, a luminance signal is calculated in the same manner as in Embodiment 22, and in a portion where the spatial frequency is low, the G signal and the G signal are calculated.
A luminance signal is calculated from the weighted average value of the RB signals.

The operation circuit 75 operates as in the twenty-second embodiment in a portion where the spatial frequency is high, and in a portion where the spatial frequency is low, for example, the position of G in column t in FIG. 37 and the output signal in column t in FIG. The luminance signal component Y (t) at the position where there is no is calculated as in the following equation (64). Y (t) = RB (t-1) / 4 + G (t) / 2 + RB (t + 1) / 4 (64) When the position of the pixel is t, the type of the pixel is J (J is G,
RB), the type of both horizontally adjacent pixels of the pixel is K
(K is either G or RB) and the luminance signal component Y
(t) is calculated as in the following equation (65). Y (t) = K (t-1) / 4 + J (t) / 2 + K (t + 1) / 4 (65)

(Embodiment 26) The configuration of a color video camera in embodiment 26 is the same as that of embodiment 25 (FIG. 45), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 26
Then, the difference between the output signals of both horizontally adjacent pixels of the corresponding pixel is compared with a specific threshold value. If the difference between the output signals is larger than the specific threshold value, it is determined that the spatial frequency is high.
Then, the above-described embodiment 22 is performed. If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 25 is performed.

For example, in FIG. 37, the position of G in column t,
In FIG. 38, at the position where there is no output signal in the t-th column, the following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | RB (t−1) −RB (t + 1) | (66) The position of the pixel is t, and the type of both horizontally adjacent pixels of the pixel is K
(K is one of G and RB), the following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | K (t-1)-K (t + 1) | ... (67)

(Embodiment 27) FIG. 46 is a block circuit diagram showing a color video camera according to Embodiment 27. 46, the same reference numerals as those in FIG. 35 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 28) Embodiment 7 with respect to Embodiment 6
The twenty-eighth embodiment is an embodiment in which the calculation method of is applied to the twenty-seventh embodiment. The operation of the division look-up table 28 in the twenty-eighth embodiment is the same as that of the seventh embodiment, and a description thereof will be omitted.

(Embodiment 29) The structure of a color video camera in embodiment 29 is the same as that of embodiment 22 (FIG. 35). In the twenty-ninth embodiment, a one-dimensional low-pass filter including only bit shifts such as tap coefficients of 1/8 and 1/4 is used as a digital filter. The specific configuration of the one-dimensional low-pass filter is described in Example 8 (FIG.
Since it is the same as 6), its description is omitted.

(Embodiment 30) The configuration of a color video camera in embodiment 30 is the same as that of embodiment 22 (FIG. 35), and the calculation method of the luminance signal in the arithmetic circuit 75 is different. In Example 24, as in Expressions (62) and (63),
The luminance signal is finally obtained by subtracting 1 from the operation result obtained by adding 1 to the multiplier, divisor, and dividend in order to minimize the operation error. However, since this 1 is the LSB and has little effect on the operation result, it is not necessary to subtract 1 at the end in order to simplify the circuit configuration. An example in this way is the working example 30 in which the luminance signal component Y (t) at the position of G in the t-th column is calculated as in the following equation (68). Y (t) = (G (t) +1) × ((Y′LPF (t) +1) / (GLPF (t) +1)) (68) Pixel type K (K is either G or RB) The method of calculating the luminance signal component Y (t) at the position t is expressed by the following equation (69). Y (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) (69)

(Embodiment 31) FIG. 47 is a block circuit diagram showing a color video camera in embodiment 31. In FIG. 47, the same reference numerals as those in FIG. 35 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (Embodiment 10).

Next, the operation will be described. For example, t
The method of calculating the luminance signal component Y (t) when the type of pixel at the position is K (K is either G or RB) is expressed by the equation (69) as described in the thirtieth embodiment. Here, in equation (69), logarithmic conversion is performed with the base being x as shown in equation (70). Here, ＾ indicates a power. Y (t) = x ＾ log x ｛(K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1))｝ = x ＾ ｛log x (K (t) +1 ) + Log x (Y′LPF (t) +1) −log x (KLPF (t) +1)｝ (70) In the thirty-first embodiment, as in the tenth embodiment described above, calculation is performed using a low-capacity lookup table. Is possible. Although the case where the luminance signal is calculated based on the calculation formula of the thirty-third embodiment has been described, the calculation method using the logarithmic lookup table and the exponentiation lookup table may of course be applied to the twenty-second embodiment. It is.

(Embodiment 32) FIG. 48 is a block circuit diagram showing a color video camera in embodiment 32. In FIG. 48, the portions denoted by the same reference numerals as those in FIG. 35 indicate the same portions, and thus description thereof will be omitted. In FIG. 48, reference numerals 92, 93, and 94 denote two-dimensional memories;
Reference numeral 7 denotes a two-dimensional low-pass filter (LPF). next,
The operation will be described. The basic operation is the same as in the twenty-second embodiment. FIGS. 49, 50, and 51 show a part of how the G signal, the R / B mixed signal, and the Y 'signal are written in the two-dimensional memories 92, 93, and 94. The signals shown in these figures are two-dimensional low-pass filters 95, 9
6,97. FIG. 52, FIG. 53, FIG.
Shows the outputs of the two-dimensional low-pass filters 95, 96 and 97. The LPF in the figure indicates a low-pass filter output.

Embodiment 32 is an example in which a two-dimensional low-pass filter is used in place of the one-dimensional low-pass filter in the twenty-second embodiment. In FIG. 49, for example, s row t
The luminance signal component Y (s, t) at the position of the green pixel in the column is
It is calculated by equation (71). Y (s, t) = G (s, t) × (Y′LPF (s, t) / GLPF (s, t)) (71) Pixel type K (K is either G or RB) The method of calculating the luminance signal component Y (s, t) at the position (s, t) is represented by the following equation (72). Here, (s, t) is the coordinates of the two-dimensional memory 94 shown in FIG. 51, and the coordinates of the two-dimensional memory 92 shown in FIG. 49 when the pixel is G, and is shown in FIG. 50 when the pixel is RB. The coordinates of the two-dimensional memory 93 are shown. Y (s, t) = K (s, t) × (Y′LPF (s, t) / KLPF (s, t)) (72)

(Embodiment 33) FIG. 55 is a block circuit diagram showing a color video camera in embodiment 33. In FIG. 55, the portions denoted by the same reference numerals as those in FIG. 48 indicate the same portions, and therefore description thereof will be omitted. The arithmetic circuit 85 in FIG. 55 is the same as the configuration of the arithmetic circuit 85 in Embodiment 23 described above (see FIG. 44). Example 3
In 3, the G signal and the R / B mixed signal are input from the demultiplexer 72 to the arithmetic circuit 85. In Example 33,
In the twenty-third embodiment, a two-dimensional low-pass filter is used instead of a one-dimensional low-pass filter. Example 3
The principle of the method of calculating the Y signal in the second and third embodiments is described in the second embodiment.
Basically the same as 2, 23, it is possible to remove the modulation component of the chrominance signal without reducing the high frequency component of the luminance signal.

(Embodiment 34) The configuration of a color video camera in embodiment 34 is the same as that of embodiment 32 (FIG. 48), but the method of calculating the Y signal in the arithmetic circuit 75 is different. The operation in the operation circuit 75 will be described. For example, if each signal has 256 gradations of 8 bits and LSB of 1 is adopted as a constant value, the luminance signal component Y (s, t) is obtained at the position of G in the s row and the t column.
Is calculated as in the following equation (73). Y (s, t) = (G (s, t) +1) × ((Y′LPF (s, t) +1) / (GLPF (s, t) +1)) − 1 (73) Pixel type K The method of calculating the luminance signal component Y (s, t) at the position (s, t) at (K is either G or BR) is represented by the following equation (74). Y (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) − 1 (74)

(Embodiment 35) FIG. 56 is a block circuit diagram showing a color video camera in embodiment 35. 56, the same reference numerals as those in FIG. 48 denote the same parts, and reference numeral 27 denotes a threshold value comparison circuit similar to that of FIG. 22 (Example 4). Next, the operation will be described. The level of the spatial frequency of the image is determined by comparing the difference between the output signals of the same kind of pixels input from the two-dimensional memories 92 and 93 to the threshold value comparison circuit 27 with a specific threshold value. Then, in a portion where the spatial frequency of the image is high, a luminance signal is calculated in the same manner as in Embodiment 32, and in a portion where the spatial frequency is low, a luminance signal is calculated from the weighted average value of the G and RB signals around this pixel. I do.

The operation circuit 75 operates as in the embodiment 32 in the portion where the spatial frequency is high, and operates in the portion where the spatial frequency is low, for example, in the position of G in the s row and the t column in FIG.
The luminance signal component Y (s, t) at the position where there is no output signal at s row and t column at 0 is calculated as in equation (75). Y (s, t) = RB (s-1, t-1) / 16 + G (s-1, t) / 8 + RB (s-1, t + 1) / 16 + RB (s, t-1) / 8 + G ( (s, t) / 4 + RB (s, t + 1) / 8 + RB (s + 1, t-1) / 16 + G (s + 1, t) / 8 + RB (s + 1, t + 1) / 16 (75 The position of the pixel is (s, t), the type of the pixel is J (J is either G or RB), and the type of both horizontally adjacent pixels of the pixel is K (K is any of G or RB). ), The luminance signal component Y (s, t) is calculated as in the following equation (76). Y (s, t) = K (s-1, t-1) / 16 + J (s-1, t) / 8 + K (s-1, t + 1) / 16 + K (s, t-1) / 8 + J ( s, t) / 4 + K (s, t + 1) / 8 + K (s + 1, t-1) / 16 + J (s + 1, t) / 8 + K (s + 1, t + 1) / 16 (76 )

(Embodiment 36) The configuration of a color video camera in embodiment 36 is the same as that of embodiment 35 (FIG. 56), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 36
Then, the difference between the output signals of the two adjacent pixels or the difference between the output signals of the two adjacent pixels of the corresponding pixel is compared with a specific threshold, and when the difference between the output signals is larger than the specific threshold, Is determined to be a part where the spatial frequency is high.
32, and when the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 35 is performed.

For example, in FIG. 49, at the position of G in the s row and t column, and in FIG.
The following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | RB (s, t-1) -RB (s, t + 1) | ... (77) | G (s-1, t) -G (s + 1, t) | ... (78) Position of the pixel Is (s, t), and the type of the pixel is J (J is G, R
B), the type of both horizontally adjacent pixels of the pixel is K (K
Is either G or RB), and compares the following calculation result with a specific threshold value, and selects both luminance signal generation methods. | K (s, t-1)-K (s, t + 1) | ... (79) | J (s-1, t) -J (s + 1, t) | ... (80)

(Embodiment 37) The configuration of a color video camera in embodiment 37 is the same as that of embodiment 35 (FIG. 56), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 37
In compares the difference with a specific threshold value between pixels of the same type around the relevant pixel, if the difference is greater than the certain threshold to determine determines that the high spatial frequency portion, before
The above-described embodiment 32 is performed, and when the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low,
Example 35 described above is performed.

For example, in FIG. 49, at the position of G in the s row and t column, and in FIG.
The following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | RB (s, t-1)-RB (s, t + 1) | ... (81) | G (s-1, t) -G (s + 1, t) | ... (82) | RB (s -1, t-1) -RB (s + 1, t + 1) | ... (83) | RB (s-1, t + 1) -RB (s + 1, t-1) | ... (84)

The position of the pixel is (s, t) and the type of the pixel is J
(J is either G or RB), the type of both horizontally adjacent pixels of the pixel is K (K is either G or RB), and the following calculation result is compared with a specific threshold value. Select the luminance signal generation method. │K (s, t-1) -K (s, t + 1) │ (85) │J (s-1, t) -J (s + 1, t) │ (86) │K (s −1, t−1) −K (s + 1, t + 1) | (87) | K (s−1, t + 1) −K (s + 1, t−1) | (88)

(Embodiment 38) The configuration of a color video camera in embodiment 38 is the same as that of embodiment 35 (FIG. 56), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 38
In the corresponding comparing the difference with a specific threshold value of the output signals of both diagonal adjacent pixels interposing the pixel, determine the high spatial frequency portion if the difference between the output signal is greater than a certain threshold
Then, the above-described embodiment 32 is performed. If the difference between the output signals is smaller than the specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 35 is performed.

For example, in FIG. 49, at the position of G in the s row and t column, and in FIG.
The following calculation result is compared with a specific threshold value, and both luminance signal generation methods are selected. | RB (s-1, t-1)-RB (s + 1, t + 1) | ... (89) | RB (s + 1, t-1) -RB (s-1, t + 1) | ... (90) Assuming that the position of the pixel is (s, t) and the type of the diagonally adjacent pixel to the pixel is J (J is either G or RB), the following calculation result is compared with a specific threshold value Then, the two luminance signal generation methods are selected. | J (s-1, t-1)-J (s + 1, t + 1) | ... (91) | J (s + 1, t-1) -J (s-1, t + 1) | … (92)

(Embodiment 39) FIG. 57 is a block circuit diagram showing a color video camera in embodiment 39. 57, the same reference numerals as in FIG. 48 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 40) Embodiment 7 relative to Embodiment 6
Embodiment 40 is an embodiment in which the calculation method of is applied to Embodiment 39 described above. The operation of the division lookup table 28 in the fortieth embodiment is the same as that of the seventh embodiment, and a description thereof will be omitted.

(Embodiment 41) The structure of a color video camera in embodiment 41 is the same as that of embodiment 32 (FIG. 48). In the forty-first embodiment, tap coefficients of 1/8, 1/4, and 1/4 are used as digital filters.
A two-dimensional low-pass filter composed of only a bit shift such as 1/2 is used. The specific configuration of the two-dimensional low-pass filter is the same as that of the nineteenth embodiment (FIG. 33).
Two-dimensional low-pass filter output Y 'LPF (s,
Since t) is obtained, the description is omitted. However, in the two-dimensional low-pass filter of the K-th pixel at the position (s, t) of the corresponding pixel, the K-th pixel is arranged horizontally every other pixel, so that two clocks are used instead of the one-clock delay circuit.
A delay circuit may be used.

(Embodiment 42) The configuration of a color video camera in embodiment 42 is the same as that of embodiment 32 (FIG. 48), and the calculation method of the luminance signal in the arithmetic circuit 75 is different. In Example 34, the expression (7)
As described in (3) and (74), the luminance signal is obtained by finally subtracting 1 from the operation result obtained by adding 1 to the multiplier, divisor, and dividend to minimize the operation error. However, this 1
Is an LSB and has almost no effect on the operation result. Therefore, it is not necessary to reduce 1 at the end in order to simplify the circuit configuration. An example in this way is the embodiment 42, in which the luminance signal component Y (s, t) at the position of G in the s row and the t column.
Is calculated as in the following equation (93). Y (s, t) = (G (s, t) +1) × ((Y′LPF (s, t) +1) / (GLPF (s, t) +1)) (93) Pixel type K (K Is either G or RB ). The method of calculating the luminance signal component Y (s, t) at the position (s, t) is expressed by the following equation (94). Y (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) (94)

(Embodiment 43) FIG. 58 is a block circuit diagram showing a color video camera in embodiment 43. In FIG. 58, the same reference numerals as those in FIG. 48 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (the tenth embodiment).

Next, the operation will be described. The method of calculating the luminance signal component Y (s, t) when the pixel type at the position of (s, t) is K (K is either G or RB) is calculated by, for example, using the equation as described in the forty-second embodiment. (94). Here, in equation (94), logarithmic conversion is performed with the base being x as shown in equation (95). Here, ＾ indicates a power. Y (s, t) = x ＾ log x ｛(K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1))｝ = x ＾ ｛ log x (K (s, t) +1) + log x (Y ′ LPF (s, t) +1) −log x (K LPF (s, t) +1)｝ (95) As in the case of Example 10, calculation can be performed using a low-capacity lookup table. Although the case where the luminance signal is calculated based on the calculation formula of the forty-second embodiment has been described, a calculation method using a logarithmic look-up table or a power look-up table may be applied to the thirty-second embodiment.

(Embodiment 44) FIG. 59 is a block circuit diagram showing a color video camera in embodiment 44. In FIG. 59, portions denoted by the same reference numerals as those in FIG. 15 indicate the same portions. In FIG. 59, 45 is a low-pass filter (LPF), 46 is a band-pass filter (BPF), and 47 is an adder.

Next, the operation will be described. The basic operation from the lens 1 to the arithmetic circuit 23 is the same as in the second embodiment. The output of the image sensor 2 is input to the low-pass filter 45, and an YL signal is obtained as an output signal. This YL signal is a signal similar to the luminance signal obtained by the conventional technique (see FIG. 2). The operation of the arithmetic circuit 23 will be described. When the low-pass filter output of the Y 'signal is input to the divider 25 as a dividend (see FIG. 16), the same arithmetic processing as in the second embodiment is performed, and the output of the multiplier 26 is changed to the YH' signal of the pixel. Is obtained as

In FIG. 17, for example, the formula for calculating the YH ′ signal at the position of the color filter GC in the t-th column is as follows:
6) YH ′ (t) = GC (t) × (Y′LPF (t) / GCLPF (t)) (96) The position t of the color filter type K (K is any of MC, GY, MY, and GC) Is calculated by the following equation (97), as in the second embodiment. YH '(t) = K (t) .times. (Y'LPF (t) / KLPF (t)) (97) A high-frequency component YH is extracted from the YH' signal by the band-pass filter 46, and the high-frequency components YH and YL signals are obtained. Are mixed by an adder 47 to obtain a luminance signal Y, thereby performing aperture correction.

The principle of the method of calculating the YH 'signal in the forty-fourth embodiment is the same as the principle of the method of calculating the Y signal in the second embodiment. By calculating the YH 'signal in this way, it is possible to remove the modulation component of the color signal without reducing the high frequency component of the luminance signal. Therefore, by extracting the high frequency component YH of the YH 'signal and mixing it with the YL signal, it is possible to perform aperture correction without unnatural emphasis.

(Embodiment 45) The configuration of a color video camera in embodiment 45 is the same as that of embodiment 44 (FIG. 59), but the method of calculating the YH 'signal in the arithmetic circuit 23 is different. The operation in the operation circuit 23 will be described. For example, if each signal has 256 gradations of 8 bits and LSB of 1 is adopted as a constant value, the YH 'signal at the position of the color filter GC in the t-th column is calculated as in the following equation (98). YH ′ (t) = (GC (t) +1) × ((Y′LPF (t) +1) / (GCLPF (t) +1)) −1 (98) Type of color filter K (K is MC, GY , MY, or GC), the method of calculating the YH ′ signal at the position t is as follows:
9). YH ′ (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) − 1 (99)

(Embodiment 46) FIG. 60 is a block circuit diagram showing a color video camera according to Embodiment 46. 60, the same reference numerals as in FIG. 59 denote the same parts, and reference numeral 27 denotes a threshold value comparison circuit similar to that in FIG. 22 (Example 4). Next, the operation will be described. An output signal of an appropriate pixel around the relevant pixel is input from the field memory 8 to the threshold value comparison circuit 27. In a portion where the spatial frequency of the image is high, a YH 'signal is calculated in the same manner as in the forty-fourth embodiment. Is low, the YH 'signal is calculated from the weighted average of the outputs of the N types of pixels around this pixel.

The operation circuit 23 operates as in the embodiment 44 in a portion where the spatial frequency is high, and in a portion where the spatial frequency is low, for example, the position of the GC color filter in column t in FIG. The YH 'signal at the position where there is no output signal is calculated by the following equation (100), as in the fourth embodiment. YH ′ (t) = MY (t−1) / 4 + GC (t) / 2 + MY (t + 1) / 4 (100) Assuming that the position of the pixel is t, the type of the color filter of the pixel is J and the pixel is J Assuming that the type of the color filter for both horizontally adjacent pixels is K, the YH ′ signal is expressed by the following equation (1) as in the fourth embodiment.
01). YH '(t) = K (t-1) / 4 + J (t) / 2 + K (t + 1) / 4 (101)

(Embodiment 47) The configuration of a color video camera in embodiment 47 is the same as that of embodiment 46 (FIG. 60), but the signal processing in the arithmetic circuit 23 and the threshold value comparison circuit 27 is different. Example 47
Then, the difference between the output signals of both horizontally adjacent pixels of the corresponding pixel is compared with a specific threshold value. If the difference between the output signals is larger than the specific threshold value, it is determined that the spatial frequency is high.
Then, the embodiment 44 is performed, and when the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the embodiment 46 is performed. The calculation results of equations (20) and (21), which are the same as those in the fifth embodiment, are compared with a specific threshold value, and the YH 'signal calculation method is selected according to the comparison result.

(Embodiment 48) FIG. 61 is a block circuit diagram showing a color video camera in embodiment 48. 61, the same reference numerals as in FIG. 59 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 49) Embodiment 7 relative to Embodiment 6
The forty-ninth embodiment is an embodiment in which the calculation method of is applied to the forty-eighth embodiment. The operation of the division look-up table 28 in the forty-ninth embodiment is the same as that of the seventh embodiment, and a description thereof will be omitted.

(Embodiment 50) The structure of a color video camera in embodiment 50 is the same as that in embodiment 44 (FIG. 59). In the fiftieth embodiment, a one-dimensional low-pass filter including only bit shifts such as tap coefficients of １ ／ and ４ is used as a digital filter. The specific configuration of the one-dimensional low-pass filter is described in Example 8 (FIG.
The description is omitted because it is the same as 6).

(Embodiment 51) The configuration of a color video camera in embodiment 51 is the same as that of embodiment 44 (FIG. 59), and the method of calculating the YH 'signal in the arithmetic circuit 23 is different. In the forty-fifth embodiment, the multiplier, the divisor, and the dividend are equal to 1 as in Expressions (98) and (99).
In order to minimize the calculation error from the calculation result to which
Finally, the YH 'signal is obtained by subtracting one. However,
This 1 is the LSB and has almost no effect on the operation result, so that 1 does not have to be subtracted at the end in order to simplify the circuit configuration. An example of this is the fifth embodiment.
1, YH 'at the position of the color filter GC in the t-th column.
The signal is calculated as in the following equation (102). YH ′ (t) = (GC (t) +1) × ((Y′LPF (t) +1) / (GCLPF (t) +1)) (102) of the YH ′ signal at the position t of the color filter type K The calculation method is represented by the following equation (103). YH ′ (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) (103)

(Embodiment 52) FIG. 62 is a block circuit diagram showing a color video camera in embodiment 52. In FIG. 62, the same reference numerals as those in FIG. 59 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (Embodiment 10).

Next, the operation will be described. For example, the method of calculating the YH 'signal when the type of the color filter at the position t is K is obtained by using the equation (103) as described in the fifty-first embodiment.
Indicated by Here, in Expression (103), Expression (10)
As shown in 4), logarithmic conversion is performed with the base being x. Here, ＾ indicates a power. YH ′ (t) = x ＾ log x ｛(K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1))｝ = x ＾ ｛log x (K (t) +1) + log x (Y′LPF (t) +1) −log x (KLPF (t) +1)｝ (104)

In the present embodiment 52, as in the case of the above-described embodiment 10, the calculation can be performed using a low-capacity look-up table. Although the case where the YH 'signal is calculated based on the calculation formula of the fifty-first embodiment has been described, the calculation method using the logarithmic look-up table and the exponentiation look-up table may be applied to the forty-fourth embodiment. Of course.

(Embodiment 53) FIG. 63 is a block circuit diagram showing a color video camera according to Embodiment 53. 63, portions denoted by the same reference numerals as those in FIG. 59 or FIG. 28 indicate the same portions, and a description thereof will be omitted. Next, the operation will be described. Example 53 is different from Example 44 in that
Is an example in which a two-dimensional low-pass filter is used in place of the one-dimensional low-pass filter. In FIG.
For example, YH 'at the position of the color filter GC in the s row and the t column
The signal is calculated by equation (105). YH ′ (s, t) = GC (s, t) × (Y′LPF (s, t) / GCLPF (s, t)) (105)

YH 'at position (s, t) of color filter type K
The signal calculation method is represented by the following equation (106). YH ′ (s, t) = K (s, t) × (Y′LPF (s, t) / KLPF (s, t)) (106) The principle of the method of calculating the YH ′ signal in the present embodiment is as follows. This is basically the same as the embodiment 44, and similarly to the embodiment 44, it is possible to remove the modulation component of the color signal without reducing the high frequency component of the luminance signal, and to perform the aperture correction without the unnatural emphasis. be able to.

(Embodiment 54) The structure of a color video camera in embodiment 54 is the same as that of embodiment 53 (FIG. 63), but the method of calculating the Y signal in the arithmetic circuit 32 is different. The operation in the operation circuit 32 will be described. For example, if each signal has 256 gradations of 8 bits and LSB of 1 is adopted as a constant value, the YH 'signal at the position of the color filter GC in the s-th row and the t-th column is calculated as in the following equation (107). You. YH ′ (s, t) = (GC (s, t) +1) × ((Y′LPF (s, t) +1) / (GCLPF (s, t) +1)) − 1 (107) The method of calculating the YH 'signal at the position (s, t) of type K is represented by the following equation (108). YH ′ (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) − 1 (108)

(Embodiment 55) FIG. 64 is a block circuit diagram showing a color video camera according to Embodiment 55. 64, the same reference numerals as those in FIG. 63 denote the same parts, and reference numeral 27 denotes a threshold value comparison circuit similar to that of FIG. 22 (Example 4). Next, the operation will be described. An output signal of an appropriate pixel around the relevant pixel is input from the field memory 8 to the threshold value comparison circuit 27. In a portion where the spatial frequency of the image is high, the YH 'signal is calculated in the same manner as in the embodiment 53, and the spatial frequency is calculated. Is low in the area around this pixel.
The YH 'signal is calculated from the weighted average value of the outputs of the different types of pixels.

The operation circuit 32 operates as in the embodiment 53 in the portion where the spatial frequency is high, and in the portion where the spatial frequency is low, for example, the YH 'signal at the position of the GC color filter in the s row and the t column in FIG. Is calculated as in equation (109). YH '(s, t) = MC (s-1, t-1) / 16 + GY (s-1, t) / 8 + MC (s-1, t + 1) / 16 + MY (s, t-1) / 8 + GC ( (s, t) / 4 + MY (s, t + 1) / 8 + MC (s + 1, t-1) / 16 + GY (s + 1, t) / 8 + MC (s + 1, t + 1) / 16 (109 )

Assuming that the position of the pixel is (s, t), the type of the color filter of the pixel is J, the type of the color filter of both horizontal adjacent pixels of the pixel is K, and the color filter of both vertical adjacent pixels of the pixel is Is L and the type of the color filter of the pixel obliquely adjacent to the pixel is M, the YH ′ signal is calculated as in the following equation (110). YH '(s, t) = M (s-1, t-1) / 16 + L (s-1, t) / 8 + M (s-1, t + 1) / 16 + K (s, t-1) / 8 + J (s, t) / 4 + K (s, t + 1) / 8 + M (s + 1, t-1) / 16 + L (s + 1, t) / 8 + M (s + 1, t + 1) / 16 ( 110)

Embodiment 56 The configuration of a color video camera according to Embodiment 56 is the same as that of Embodiment 55 (FIG. 64), except for the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27. Example 56
Then, the difference between the output signals of the two adjacent pixels or the difference between the output signals of the two adjacent pixels of the corresponding pixel is compared with a specific threshold, and when the difference between the output signals is larger than the specific threshold, Is determined to be a part where the spatial frequency is high.
If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 55 is performed. The same (37) to (4) as in the above-described embodiment 14
The calculation result of equation (0) is compared with a specific threshold value, and the calculation method of the YH 'signal is selected according to the comparison result.

(Embodiment 57) The configuration of a color video camera in embodiment 57 is the same as that of embodiment 55 (FIG. 64), but the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27 is different. Example 57
In compares the difference with a specific threshold value between pixels of the spectral sensitivity characteristics of the same kind of peripheral corresponding pixel, determines that a high spatial frequency portion if the difference is greater than a certain threshold
Then, the above-described embodiment 53 is performed. If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 55 is performed. The calculation results of equations (41) to (48), which are the same as those in the fifteenth embodiment, are compared with a specific threshold value, and the YH 'signal calculation method is selected according to the comparison result.

(Embodiment 58) The configuration of a color video camera in embodiment 58 is the same as that of embodiment 55 (FIG. 64), but the signal processing in the arithmetic circuit 32 and the threshold value comparison circuit 27 is different. Example 58
In the corresponding comparing the difference with a specific threshold value of the output signals of both diagonal adjacent pixels interposing the pixel, determine the high spatial frequency portion if the difference between the output signal is greater than a certain threshold
Then, the above-described embodiment 53 is performed. If the difference between the output signals is smaller than the specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 55 is performed. Example 16 described above
Then, the calculation results of equations (49) to (52) are compared with a specific threshold value, and the YH 'signal calculation method is selected according to the comparison result.

(Embodiment 59) FIG. 65 is a block circuit diagram showing a color video camera in embodiment 59. 65, the same reference numerals as those in FIG. 63 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 60) Embodiment 7 relative to Embodiment 6
Embodiment 60 is an embodiment in which the calculation method of is applied to Embodiment 59 described above. The operation of the division look-up table 28 in the embodiment 60 is the same as that of the embodiment 7, and the description thereof is omitted.

(Embodiment 61) The structure of a color video camera in embodiment 61 is the same as that of embodiment 53 (FIG. 63). In the embodiment 61, a two-dimensional low-pass filter composed of only bit shifts such as tap coefficients of ８, ４ ，, １ ／ is used as a digital filter. The specific configuration of the two-dimensional low-pass filter is the same as that of the nineteenth embodiment (FIG. 33), and the description thereof is omitted.

Embodiment 62 The configuration of a color video camera according to Embodiment 62 is the same as that of Embodiment 53 (FIG. 63), and the method of calculating the YH 'signal in the arithmetic circuit 32 is different. In Example 54, (1
07) and (108) , the luminance signal is obtained by finally subtracting 1 from the operation result obtained by adding 1 to the multiplier, divisor, and dividend to minimize the operation error. However, since 1 is an LSB and has almost no effect on the operation result, in order to simplify the circuit configuration,
Finally, 1 does not have to be reduced. Such an example is Example 62, in which the YH 'signal at the GC position in the s-th row and the t-th column is calculated as in the following equation (111). YH '(s, t) = (GC (s, t) +1) × ((Y' LPF (s, t) +1) / (GC LPF (s, t) +1)) (111) Color of the pixel The method of calculating the YH 'signal at the position (s, t) of the filter type K is represented by the following equation (112). YH ′ (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) (112)

(Embodiment 63) FIG. 66 is a block circuit diagram showing a color video camera in embodiment 63. In FIG. 66, the same reference numerals as those in FIG. 63 denote the same parts, and reference numerals 29 and 30 denote a logarithmic look-up table and a power look-up table similar to those in FIG. 27 (Embodiment 10).

Next, the operation will be described. The method of calculating the YH ′ signal when the type of the color filter of the pixel at the position of (s, t) is K is calculated by using the equation (11) as described in the embodiment 62.
Indicated by 2). Here, in equation (112), logarithmic transformation is performed with the base being x as shown in equation (113).
Here, ＾ indicates a power. YH ′ (s, t) = x ＾ log x ｛(K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1))｝ = x ＾ {Log x (K (s, t) +1) + log x (Y ′ LPF (s, t) +1) −log x (KLPF (s, t) +1)} (113) In the 63rd embodiment, As in the tenth embodiment, the calculation can be performed using a low-capacity lookup table. Although the case where the YH ′ signal is calculated based on the calculation formula of the embodiment 62 has been described, a calculation method using a logarithmic lookup table or a power-up lookup table may be applied to the embodiment 53.

(Embodiment 64) FIG. 67 is a block circuit diagram showing a color video camera according to Embodiment 64. In FIG. 67, portions denoted by the same reference numerals as those in FIG. 35 indicate the same portions. In FIG. 67, 68 is a low pass filter (LPF), 70 and 71 are adders, 73 is a demultiplexer, and 74 is a band pass filter (BPF).
Next, the operation will be described. The basic operation from the lens 51 to the arithmetic circuit 75 is the same as in the twenty-second embodiment. A
The output signals of the / D converters 59 and 61 are mixed by an adder 71, and the mixed signal and the output signal of the A / D converter 60 are alternately switched by a demultiplexer 73, input to a low-pass filter 68, and output. A YL signal is obtained as a signal. This YL signal is a signal similar to the luminance signal obtained by the conventional technique (see FIG. 3).

The operation of the arithmetic circuit 75 will be described. The configuration of the arithmetic circuit 75 is the same as that of the embodiment 22 (see FIG. 36). When the output of the low-pass filter of the Y 'signal is input to the divider 82 as a dividend, the same arithmetic processing as in the twenty-second embodiment is performed, and the output of the multiplier 83 is obtained as the YH' signal of the pixel. In FIG. 37, for example, the calculation formula of the YH ′ signal at the position of the green pixel in the t-th column is the following formula (114). YH ′ (t) = G (t) × (Y′LPF (t) / GLPF (t)) (114) The method of calculating the YH ′ signal at the position t of the pixel type K is the same as in the twenty-second embodiment. , And is expressed by the following equation (115). YH '(t) = K (t) .times. (Y'LPF (t) / KLPF (t)) (115) A high-frequency component YH is extracted from the YH' signal by the band-pass filter 74, and the high-frequency components YH and YL signals are obtained. Are mixed by an adder 70 to obtain a luminance signal Y, thereby performing aperture correction.

(Embodiment 65) FIG. 68 is a block circuit diagram showing a color video camera in embodiment 65. In FIG. 68, portions denoted by the same reference numerals as those in FIG. 67 or FIG. 43 indicate the same portions. The configuration of the arithmetic circuit 85 is the same as that of the embodiment 23 (see FIG. 44). Also in the present embodiment, the arithmetic circuit 85 obtains the same YH 'signal as in the embodiment 64, and thereafter, the aperture correction is executed in the same manner as in the embodiment 64.

The principle of the method of calculating the YH 'signal in the embodiments 64 and 65 is the same as the principle of the method of calculating the Y signal in the embodiments 22 and 23. When the YH 'signal is calculated,
The modulation component of the color signal can be removed without reducing the high frequency component of the luminance signal. Therefore, by extracting the high frequency component YH of the YH 'signal and mixing it with the YL signal, it is possible to perform aperture correction without unnatural emphasis.

Embodiment 66 The configuration of a color video camera according to Embodiment 66 of the present invention is the same as that of FIG. 67, and the signal processing in the arithmetic circuit 75 is different. Specifically, at the position of G in the t-th column, YH '(t) is calculated by the equation (116).
It is calculated as follows. YH ′ (t) = (G (t) +1) × ((Y′LPF (t) +1) / (GLPF (t) +1)) − 1 (116) YH ′ signal at position t of pixel type K Is calculated by the following equation (117). YH ′ (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) − 1 (117)

(Embodiment 67) FIG. 69 is a block circuit diagram showing a color video camera in embodiment 67. In FIG. 69, portions denoted by the same reference numerals as in FIG. 67 indicate the same portions, and 27 is a threshold value comparison circuit similar to that in FIG. 22 (Example 4). Next, the operation will be described. An output signal of an appropriate pixel around the pixel is input to the threshold comparison circuit 27 from the memories 62 and 63. Then, in the portion where the spatial frequency of the image is high, the YH 'signal is calculated in the same manner as in the embodiment 64, and in the portion where the spatial frequency is low, the G signal and the R signal are calculated.
The YH 'signal is calculated from the weighted average value of the B signal.

The operation circuit 75 operates as in the embodiment 64 in the portion where the spatial frequency is high, and in the portion where the spatial frequency is low, for example, the position of G in column t in FIG. 37 and the output signal in column t in FIG. The YH 'signal at the position where there is no is calculated as in the following equation (118). YH '(t) = RB (t-1) / 4 + G (t) / 2 + RB (t + 1) / 4 (118) Assuming that the position of the pixel is t, the type of the pixel is J, and both horizontals of the pixel The YH 'signal when the type of the adjacent pixel is K is calculated as in the following equation (119). YH '(t) = K (t-1) / 4 + J (t) / 2 + K (t + 1) / 4 (119)

(Embodiment 68) The configuration of a color video camera in embodiment 68 is the same as that of embodiment 67 (FIG. 69), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 68
Then, the difference between the output signals of both horizontally adjacent pixels of the corresponding pixel is compared with a specific threshold value. If the difference between the output signals is larger than the specific threshold value, it is determined that the spatial frequency is high.
Then, the embodiment 64 is performed. If the difference between the output signals is smaller than the specific threshold value, it is determined that the spatial frequency is low, and the embodiment 67 is performed. The calculation results of equations (66) and (67), which are the same as those of the twenty-sixth embodiment, are compared with a specific threshold value, and the YH 'signal calculation method is selected according to the comparison result.

(Embodiment 69) FIG. 70 is a block circuit diagram showing a color video camera in embodiment 69. 70, the same reference numerals as in FIG. 67 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 70) Embodiment 7 with respect to Embodiment 6
This embodiment is an embodiment in which the calculation method of is applied to the embodiment 69. The operation of the division look-up table 28 in the embodiment 70 is the same as that of the embodiment 7, and the description thereof is omitted.

(Embodiment 71) The structure of a color video camera in embodiment 71 is the same as that of embodiment 64 (FIG. 67). In the seventy-first embodiment, a one-dimensional low-pass filter composed of only bit shifts such as tap coefficients of タ ッ プ and ４ is used as a digital filter. The specific configuration of the one-dimensional low-pass filter is described in Example 8 (FIG.
The description is omitted because it is the same as 6).

(Embodiment 72) The structure of a color video camera in embodiment 72 is the same as that of embodiment 64 (FIG. 67), and the calculation method of the YH 'signal in the arithmetic circuit 75 is different. In Example 66, as shown in Expressions (116) and (117), the operation result obtained by adding 1 to the multiplier, divisor, and dividend is given by
In order to minimize the operation error, one is finally subtracted and YH '
Seeking a signal. However, since this 1 is the LSB and has little effect on the operation result, it is not necessary to subtract 1 at the end in order to simplify the circuit configuration. An example in this way is Example 72, in which the YH 'signal at the position of G in the t-th column is calculated as in the following equation (120). YH ′ (t) = (G (t) +1) × ((Y′LPF (t) +1) / (GLPF (t) +1)) (120) Calculation of YH ′ signal at position t of pixel type K The method is represented by the following equation (121). YH ′ (t) = (K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1)) (121)

(Embodiment 73) FIG. 71 is a block circuit diagram showing a color video camera in embodiment 73. In FIG. 71, the same reference numerals as those in FIG. 67 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (the tenth embodiment).

Next, the operation will be described. For example, t
The method of calculating the YH 'signal when the type of pixel at position K is K is expressed by equation (121) as described in the seventy-second embodiment. Here, in Expression (121), Expression (122)
The logarithmic transformation with x as the base is performed as shown in FIG. However, ＾
Indicates a power. YH ′ (t) = x ＾ log x ｛(K (t) +1) × ((Y′LPF (t) +1) / (KLPF (t) +1))｝ = x ＾ ｛log x (K (t) +1) + log x (Y′LPF (t) +1) −log x (KLPF (t) +1)｝ (122) Also in the thirty-third embodiment, a low-capacity lookup table is used as in the tenth embodiment. Operation is possible. Although the case where the YH ′ signal is calculated based on the calculation formula of the embodiment 72 has been described, the calculation method using the logarithmic look-up table and the exponentiation look-up table may be applied to the embodiment 64. Of course.

Embodiment 74 FIG. 72 is a block circuit diagram showing a color video camera in embodiment 74. In FIG. 72, the portions denoted by the same reference numerals as those in FIG. 67 indicate the same portions, and therefore description thereof will be omitted. In FIG. 72, 92, 93, and 94 are two-dimensional memories, and 95, 96, and 97 are two-dimensional low-pass filters (LPFs). The configuration of the arithmetic circuit 75 is similar to that of the
(See FIG. 36). Next, the operation will be described. The basic operation is the same as that of the embodiment 64. Also,
As in the embodiment 32, each of the two-dimensional memories 92, 93, 94
, A G signal, an R / B mixed signal, and a Y ′ signal are written therein (see FIGS. 49, 50, and 51). Two-dimensional low-pass filters 95, 96, and 97 output two-dimensional low-pass filters. (See FIGS. 52, 53 and 54).

The seventy-fourth embodiment is an example in which a two-dimensional low-pass filter is used in place of the one-dimensional low-pass filter in the sixty-fourth embodiment. In FIG. 49, for example, s row t
The YH 'signal at the position of the green pixel in the column is (123)
It is calculated by the formula. YH ′ (s, t) = G (s, t) × (Y′LPF (s, t) / GLPF (s, t)) (123) Pixel type K (K is either G or RB) The method of calculating the YH 'signal at the position (s, t) is expressed by the following equation (124), as in the thirty-second embodiment. YH ′ (s, t) = K (s, t) × (Y′LPF (s, t) / KLPF (s, t)) (124)

(Embodiment 75) FIG. 73 is a block circuit diagram showing a color video camera in embodiment 75. In FIG. 73, the portions denoted by the same reference numerals as those in FIG. 72 indicate the same portions, and therefore description thereof will be omitted. The configuration of the arithmetic circuit 85 in FIG. 73 is the same as the configuration of the arithmetic circuit 85 in Embodiment 23 (see FIG. 44). Example 7
In 5, the G signal and the R / B mixed signal are input from the demultiplexer 72 to the arithmetic circuit 85. In Example 75,
In the embodiment 65, a two-dimensional low-pass filter is used instead of a one-dimensional low-pass filter. Example 7
The principle of the method of calculating the Y signal in 4, 75 is described in the sixth embodiment.
It is basically the same as 4, 65 etc., and removes the modulation component of the color signal without reducing the high frequency component of the luminance signal,
The YH 'signal can be calculated, and the high-frequency component YH of the YH' signal is taken out and mixed with the YL signal, thereby enabling aperture correction without unnatural emphasis.

(Embodiment 76) The configuration of a color video camera in embodiment 76 of the present invention is the same as that of FIG. 72, and the signal processing in the arithmetic circuit 75 is different. Specifically, at the position of G of (s, t), YH '(s, t) is calculated by the equation (12).
It is calculated as in 5). YH ′ (s, t) = (G (s, t) +1) × ((Y′LPF (s, t) +1) / (GLPF (s, t) +1)) −1 (125) Pixel Type The method of calculating the YH 'signal at the position (s, t) of K is as follows.
This is represented by the following equation (126). YH ′ (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) −1 (126)

(Embodiment 77) FIG. 74 is a block circuit diagram showing a color video camera in embodiment 77. 74, the same reference numerals as those in FIG. 72 denote the same parts, and reference numeral 27 denotes a threshold value comparison circuit similar to FIG. 22 (Embodiment 4). Next, the operation will be described. 2
An output signal of an appropriate pixel around the corresponding pixel from the dimensional memories 92 and 93 is input to the threshold value comparison circuit 27, and in a portion where the spatial frequency of the image is high, a luminance signal is calculated in the same manner as in the 74th embodiment. In the portion where the frequency is low, the YH 'signal is calculated from the weighted average value of the outputs of the N types of pixels around this pixel.

The operation circuit 75 operates as in Embodiment 74 in the portion where the spatial frequency is high, and in the portion where the spatial frequency is low, for example, the position of G in s row and t column in FIG.
Y at a position where there is no output signal of s row and t column at 0
The H ′ signal is calculated as in equation (127). YH '(s, t) = RB (s-1, t-1) / 16 + G (s-1, t) / 8 + RB (s-1, t + 1) / 16 + RB (s, t-1) / 8 + G (s, t) / 4 + RB (s, t + 1) / 8 ++ RB (s + 1, t-1) / 16 + G (s + 1, t) / 8 + RB (s + 1, t + 1) / 16 ( 127)

When the position of the pixel is (s, t), the type of the pixel is J, and the type of both horizontally adjacent pixels of the pixel is K, the YH 'signal is calculated as in the following equation (128). Is done. YH '(s, t) = K (s-1, t-1) / 16 + J (s-1, t) / 8 + K (s-1, t + 1) / 16 + K (s, t-1) / 8 + J (s, t) / 4 + K (s, t + 1) / 8 + K (s + 1, t-1) / 16 + J (s + 1, t) / 8 + K (s + 1, t + 1) / 16 ... ( 128)

(Embodiment 78) The configuration of a color video camera in embodiment 78 is the same as that of embodiment 77 (FIG. 74), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 78
Then, the difference between the output signals of the two adjacent pixels or the difference between the output signals of the two adjacent pixels of the corresponding pixel is compared with a specific threshold, and when the difference between the output signals is larger than the specific threshold, Is determined to be a part where the spatial frequency is high.
If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 77 is performed. The same (77) to (8) as in the aforementioned embodiment 36.
The calculation result of equation (0) is compared with a specific threshold value, and the calculation method of the YH 'signal is selected according to the comparison result.

(Embodiment 79) The configuration of a color video camera in embodiment 79 is the same as that of embodiment 77 (FIG. 74), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 79
In compares the difference with a specific threshold value between pixels of the spectral sensitivity characteristics of the same kind of peripheral corresponding pixel, determines that a high spatial frequency portion if the difference is greater than a certain threshold
Then, the above-described embodiment 74 is performed. If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 77 is performed. The calculation results of the equations (81) to (88), which are the same as those of the above-described embodiment 37, are compared with a specific threshold value, and the YH 'signal calculation method is selected according to the comparison result.

(Embodiment 80) The configuration of a color video camera in embodiment 80 is the same as that in embodiment 77 (FIG. 74), but the signal processing in the arithmetic circuit 75 and the threshold value comparison circuit 27 is different. Example 80
In the corresponding comparing the difference with a specific threshold value of the output signals of both diagonal adjacent pixels interposing the pixel, determine the high spatial frequency portion if the difference between the output signal is greater than a certain threshold
Then, the above-described embodiment 74 is performed. If the difference between the output signals is smaller than a specific threshold value, it is determined that the spatial frequency is low, and the above-described embodiment 77 is performed. Example 38 described above
A comparison is made between the calculation results of equations (89) to (92), which are the same as above, and a specific threshold value, and the calculation method of the YH 'signal is selected according to the comparison result.

(Embodiment 81) FIG. 75 is a block circuit diagram showing a color video camera in embodiment 81. 75, the same reference numerals as those in FIG. 72 denote the same parts, and reference numeral 28 denotes a division lookup table similar to that in FIG. 23 (Embodiment 6). The operation in the division look-up table 28 is the same as in the sixth embodiment, and a description thereof will be omitted.

(Embodiment 82) Embodiment 7 relative to Embodiment 6
This embodiment is an embodiment in which the calculation method of is applied to the embodiment 81. The operation of the division look-up table 28 in the embodiment 82 is the same as that of the embodiment 7, and the description thereof is omitted.

Embodiment 83 The configuration of a color video camera according to Embodiment 83 is the same as that of Embodiment 74 (FIG. 72) . In the embodiment 83, tap coefficients of 係数, ４ ，, 4 are used as digital filters.
A two-dimensional low-pass filter composed of only a bit shift such as 1/2 is used. The specific configuration of the two-dimensional low-pass filter is the same as that of the nineteenth embodiment (FIG. 33).
Two-dimensional low-pass filter output Y 'LPF (s,
Since t) is obtained, the description is omitted. However, in the two-dimensional low-pass filter of the K-th pixel at the position (s, t) of the corresponding pixel, since the K-th pixel is horizontally arranged every other pixel, one-clock delay is performed instead of the one-clock delay circuit. A circuit may be used.

(Embodiment 84) The configuration of a color video camera in embodiment 84 is the same as that of embodiment 74 (FIG. 72), and the method of calculating the YH 'signal in the arithmetic circuit 75 is different. In Example 76, (1
As in Equations ( 25) and (126) , the luminance signal is obtained by finally subtracting 1 from the operation result obtained by adding 1 to the multiplier, divisor, and dividend to minimize the operation error. However, since 1 is an LSB and has almost no effect on the operation result, in order to simplify the circuit configuration,
Finally, 1 does not have to be reduced. Such an example is Example 84, in which the YH 'signal at the position of G in the s row and the t column is calculated as in the following equation (129). YH ′ (s, t) = (G (s, t) +1) × ((Y′LPF (s, t) +1) / (GLPF (s, t) +1)) (129) Pixel type K The method of calculating the YH 'signal at the position (s, t) is as follows:
It is expressed by the following equation (130). YH ′ (s, t) = (K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1)) (130)

(Embodiment 85) FIG. 76 is a block circuit diagram showing a color video camera in embodiment 85. In FIG. 76, the same reference numerals as those in FIG. 72 denote the same parts, and reference numerals 29 and 30 denote a logarithmic lookup table and an exponentiation lookup table similar to those in FIG. 27 (Embodiment 10).

Next, the operation will be described. The method of calculating the YH ′ signal when the type of pixel at the position of (s, t) is K is expressed by Expression (130), for example, as described in Embodiment 84. Here, in Expression (130), Expression (131)
The logarithmic transformation with x as the base is performed as shown in FIG. However, ＾
Indicates a power. YH ′ (s, t) = x ＾ log x ｛(K (s, t) +1) × ((Y′LPF (s, t) +1) / (KLPF (s, t) +1))｝ = x ＾ {Log x (K (s, t) +1) + log x (Y'LPF (s, t) +1) -log x (KLPF (s, t) +1)} (131)

In the eighty-fifth embodiment, as in the tenth embodiment described above, calculations can be performed using a low-capacity lookup table. Although the case where the YH ′ signal is calculated based on the calculation formula of the embodiment 84 has been described, a calculation method using a logarithmic lookup table or a power-up lookup table may be applied to the embodiment 74. Note that the image sensor in each of the embodiments is of a type in which two pixels adjacent in the vertical direction are mixed and read, but may be of a type in which each pixel is independently read out one by one. The criterion for judging the level of the spatial frequency of the image is not limited to the above-described embodiment, but may be another method.

With respect to the types of color filters in the embodiment using a single image pickup element, in the above embodiment, the complementary color filter has been described. However, even if the primary color filter or the combination of the primary color and the complementary color is used. Good. Also,
Although an example in which a field memory is used as a memory for color separation has been described, a line memory having the number of lines required for low-pass filter processing may be used. In the embodiment using the three types of image pickup devices, the combined signal Y 'of the G signal and the R / B mixed signal is combined by the demultiplexer, but may be combined by another method such as using an adder. . In the embodiment in which the aperture correction is performed, the high-frequency component of the luminance signal is extracted by the band-pass filter. Alternatively, a high-pass filter may be used, and an example in which the YL signal is digitally processed has been described. Is also good.

[0348]

As described above in detail, according to the first to twenty-third inventions, the modulation component of the chrominance signal is not removed by the low-pass filter when the luminance signal is obtained as in the prior art. There is an effect that it is possible to provide a good image with little attenuation by an inexpensive circuit configuration.

According to the third, tenth, thirteenth, and twenty-second aspects of the present invention, the denominator becomes zero in the division part, and the operation becomes impossible, or if the number of bits of the operation is small, the denominator becomes near zero. This has the effect of preventing the calculation error from becoming too large and reducing the calculation error. According to the fourth and fourteenth aspects, the luminance signal is transmitted between the high and low spatial frequency portions of the image.
By switching the signal generation method according to a specific threshold, the low frequency emphasized when the number of operation bits is reduced
There is an effect that the false contour of the wave portion can be reduced.

According to the fifth aspect of the present invention, the difference between the output of the pixel and the horizontal adjacent pixel of the pixel is compared with a specific threshold to generate a luminance signal.
The switching of the generation method has an effect that the attenuation of the high frequency component of the luminance signal in the horizontal direction can be reduced. According to the sixth and eighteenth aspects, the calculation can be performed using the small-capacity division look-up table, and there is an effect that an inexpensive circuit configuration can be provided.

According to the seventh and nineteenth aspects, the sixth and eighteenth aspects are provided.
In the present invention, for example, when the output bit number of the division look-up table is twice as large as the input bit number and the fractional part is output, the multiplication is performed later using this output, whereby the operation accuracy can be improved. There is. 8th, 1st
According to the first, twentieth and twenty-third inventions, a color video camera obtained with an inexpensive circuit configuration can be provided by using a logarithmic look-up table and a power-law look-up table instead of the multiplication / division IC. effective.

According to the ninth aspect, a low-pass filter to be used can be constituted by a plurality of bit shift circuits and an adder circuit, and it is possible to provide an inexpensive circuit configuration. According to the fifteenth invention, the luminance signal generation method is switched by comparing the difference between the outputs of the two horizontal adjacent pixels of the pixel and the difference between the outputs of the two vertical adjacent pixels of the pixel with a specific threshold value. This has the effect that the attenuation of the high frequency component of the luminance signal in the vertical direction can be reduced.

According to the sixteenth aspect, the luminance signal generation method is switched by comparing the output difference between pixels having the same kind of spectral sensitivity characteristic around the pixel with a specific threshold value. There is an effect that the attenuation of the high frequency component of the luminance signal can be reduced. According to the seventeenth aspect, the difference between the output of the pixel at the upper left and the lower right of the pixel and the difference between the output of the pixel at the lower left and the upper right of the pixel and the specific threshold value And how to generate a luminance signal
Since the expression is switched, there is an effect that the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced.

According to the twenty-first aspect, the two-dimensional low-pass filter to be used can be constituted by a plurality of bit shift circuits and a plurality of addition circuits, so that an inexpensive circuit structure can be provided. .

According to the twenty-fourth to forty-fifth aspects, a luminance signal is generated by passing a composite signal of a green signal and a red / blue mixed signal through a low-pass filter as in the conventional spatial pixel shift method of the three-chip imaging method. Therefore, it is possible to reduce the vertical stripes that occur in a subject in which the ratio of the green signal and the red / blue mixed signal is greatly different without attenuating the high frequency component of the luminance signal, and realize a simple circuit configuration at a low cost. There is a possible effect. 25th, 32nd,
According to the thirty-fifth and forty-fourth aspects, the denominator becomes 0 in the division part and the operation becomes impossible, or the denominator becomes close to 0 and the operation error increases when the number of bits of the operation is small. This has the effect of preventing calculation errors.

According to the twenty-sixth and thirty-sixth aspects, the luminance signal generation method is switched between a high spatial frequency part and a low spatial frequency part of an image according to a specific threshold value, thereby enhancing the case where the number of calculation bits is reduced. It is possible to reduce the false contour of the low frequency component to be generated . In other words, in order to obtain the R, G, and B compositions of the luminance signal in the low frequency component as in the related art,
There is an effect that good color reproducibility can be obtained. 27th
According to the invention, since the luminance signal generation method is switched by comparing the difference between the outputs of the two horizontal adjacent pixels of the pixel and a specific threshold value, it is possible to reduce the attenuation of the high frequency component of the luminance signal in the horizontal direction. There is a possible effect.

According to the twenty-eighth and fortieth aspects, the operation can be performed using a small-capacity division look-up table, so that an inexpensive circuit configuration can be provided. According to the twenty-ninth and forty-first aspects, in the twenty-eighth and forty-fourth aspects, for example, when the number of output bits of the division look-up table is twice the number of input bits and the fractional part is output, this output is used later. Performing the multiplication has the effect that the calculation accuracy can be improved.

According to the thirty-third, thirty-third, forty-second, and forty-fifth inventions, an inexpensive circuit configuration can be obtained by using a logarithmic lookup table and a power lookup table instead of the multiplication / division IC. There is an effect that a color video camera can be provided. According to the thirty-first aspect, a low-pass filter to be used is added to a plurality of bit shift circuits.
It is possible to provide an inexpensive circuit configuration with an arithmetic circuit .

According to the thirty-seventh aspect, the luminance signal generation method is switched by comparing the difference between the outputs of the two horizontally adjacent pixels of the pixel and the difference between the outputs of the two vertically adjacent pixels of the pixel with a specific threshold value. Therefore, there is an effect that the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced. According to the thirty-eighth aspect, the luminance signal generation method is switched by comparing the output difference between pixels having the same kind of spectral sensitivity characteristic around the pixel with a specific threshold value. There is an effect that the attenuation of the high frequency component can be reduced.

According to the thirty-ninth aspect, the difference between the output of the pixel on the upper left and the pixel on the lower right of the pixel and the difference between the output of the pixel on the lower left and the pixel on the upper right of the pixel is determined by the specific difference. Since the luminance signal generation method is switched by comparing with the threshold value, there is an effect that the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced. According to the forty-third aspect, the two-dimensional low-pass filter to be used can be constituted by a plurality of bit shift circuits and a plurality of addition circuits, and there is an effect that it can be realized at a low cost with a simple circuit configuration.

According to the forty-sixth to sixty-seventh aspects, since a luminance signal with little attenuation of high-frequency components can be obtained, aperture correction without unnatural emphasis can be performed at a low cost with a simple circuit configuration by using the high-frequency components. There is an effect that can be realized. According to the forty-seventh, fifty-fourth, fifty-seventh, and sixty-sixth inventions, the denominator becomes 0 in the division part and the operation becomes impossible, or the denominator becomes close to 0 when the number of bits of the operation is small. This has the effect of preventing the error from increasing and reducing the calculation error.

According to the forty-eighth and fifty-eighth inventions, aperture correction is performed by switching the luminance signal generation method between a high spatial frequency part and a low spatial frequency part according to a specific threshold value, thereby reducing the number of calculation bits. Emphasized when reduced
False contours of low-frequency components can be reduced. According to the forty-ninth aspect, since the difference between the output of the two horizontal adjacent pixels of the pixel and the specific threshold value are compared to switch the luminance signal generation method and perform the aperture correction, there is no unnatural enhancement in the horizontal direction. There is an effect that aperture correction can be performed.

According to the fiftieth and sixty-second inventions, the operation can be performed using a small-capacity division look-up table, and there is an effect that an inexpensive circuit configuration can be provided. According to the fifty-first and thirty-third inventions, in the fifty-second and sixty-second inventions, for example, when the output bit number of the division look-up table is twice the input bit number and the fractional part is output, this output is used later. Performing the multiplication has the effect that the calculation accuracy can be improved.

According to the fifty-second, fifty-fifth, sixty-fourth, and sixty-sixth inventions, an inexpensive circuit configuration can be obtained by using a logarithmic lookup table and a power lookup table instead of the multiplication / division IC. There is an effect that a color video camera can be provided. According to the fifty-third aspect, a low-pass filter to be used is added to a plurality of bit shift circuits.
It can be composed of an arithmetic circuit and has an effect that it can be realized at a low cost with a simple circuit configuration.

According to the fifty-ninth aspect, the difference between the output of the horizontal and vertical adjacent pixels of the pixel and a specific threshold value are compared to switch the luminance signal generation method to perform aperture correction. There is an effect that it is possible to perform aperture correction that is not unnatural emphasis in the direction. According to the sixtieth aspect, a difference between outputs of pixels having the same kind of spectral sensitivity characteristic around the pixel and a specific threshold value are compared to switch the luminance signal generation method to perform aperture correction. There is an effect that it is possible to perform aperture correction that is not unnatural emphasis in an image.

According to the sixty-first aspect, the difference between the output of the pixel on the upper left and the pixel on the lower right and the difference between the output of the pixel on the lower left and the pixel on the upper right is determined by the specific difference. Since aperture correction is performed by comparing the luminance signal generation method by comparing the threshold value with the threshold value, there is an effect that it is possible to perform aperture correction without unnatural enhancement in the horizontal and vertical directions. According to the sixty-fifth aspect, the two-dimensional low-pass filter to be used can be composed of a plurality of bit shift circuits and a plurality of addition circuits, and has an effect that it can be realized at a low cost with a simple circuit configuration.

According to the 68th to 89th aspects, a luminance signal is generated by passing a composite signal of a green signal and a red / blue mixed signal through a low-pass filter as in a conventional spatial pixel shift method of a three-chip image pickup method. A simple circuit that does not attenuate the high-frequency components of the luminance signal, reduces vertical stripes that occur in subjects where the ratio of the green signal and the red / blue mixed signal greatly differs, and corrects aperture without unnatural enhancement There is an effect that the configuration can be realized at low cost. According to the 69th, 76th, 79th, and 88th inventions, the denominator becomes 0 in the division part and the operation becomes impossible, or the denominator becomes close to 0 when the number of bits of the operation is small and the operation is performed. This has the effect of preventing the error from increasing and reducing the calculation error.

According to the 70th and 80th inventions, aperture correction is performed by switching the luminance signal generation method between a high spatial frequency portion and a low spatial frequency portion of an image according to a specific threshold value, thereby reducing the number of calculation bits. Emphasized when reduced
False contours of low-frequency components can be reduced. In other words, in the low-frequency component, the luminance signals R, G,
Since the composition of B is obtained, there is an effect that good color reproducibility can be obtained. According to the seventy-first aspect, the aperture difference is corrected by comparing the difference between the outputs of the two horizontally adjacent pixels of the pixel with a specific threshold value and switching the luminance signal generation method to perform aperture correction. This has the effect of reducing the attenuation of.

According to the seventy-second and eighty-fourth inventions, it is possible to perform an operation using a small-capacity division look-up table, and it is possible to provide an inexpensive circuit configuration. According to the 73rd and 85th inventions, in the 72nd and 84th inventions, for example, if the output bit number of the division look-up table is twice as large as the input bit number and the fractional part is output, this output is used later. Performing the multiplication has the effect that the calculation accuracy can be improved.

According to the seventy-fourth, seventy-seventh, eighty-sixth, and eighty-ninth inventions, an inexpensive circuit configuration can be obtained by using a logarithmic lookup table or a power lookup table instead of the multiplication / division IC. There is an effect that a color video camera can be provided. According to the seventy-fifth aspect, the low-pass filter to be used is added to the plurality of bit shift circuits.
It can be composed of an arithmetic circuit and has an effect that it can be realized at a low cost with a simple circuit configuration.

According to the eighteenth aspect, the luminance signal generation method is switched by comparing the difference between the output of both horizontal neighboring pixels of the pixel and the difference between the output of both vertical neighboring pixels of the pixel and a specific threshold value. Since the aperture correction is performed, the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced. According to the 82nd invention, the aperture difference is corrected by comparing the output difference between pixels of the same type of spectral sensitivity characteristic around the pixel with a specific threshold value and switching the luminance signal generation method to perform aperture correction. There is an effect that the attenuation of the high frequency component in the image can be reduced.

According to the 83rd aspect, the difference between the output of the pixel on the upper left and the pixel on the lower right of the pixel and the difference between the output of the pixel on the lower left and the pixel on the upper right are determined by the specific difference. Since the aperture correction is performed by switching the luminance signal generation method by comparing the threshold value with the threshold value, the attenuation of the high frequency component of the luminance signal in the horizontal and vertical directions can be reduced. According to the eighty-seventh aspect, the two-dimensional low-pass filter to be used can be composed of a plurality of bit shift circuits and a plurality of addition circuits, and there is an effect that it can be realized at a low cost with a simple circuit configuration.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an example of a color filter array of an image sensor used in a color video camera.

FIG. 2 is a diagram showing a part of a signal processing circuit of a conventional color video camera.

FIG. 3 is a block circuit diagram showing a color video camera in a conventional spatial pixel shift system of a three-panel imaging system.

FIG. 4 is a diagram illustrating a configuration of an output signal in a conventional spatial pixel shifting method of a three-chip imaging method.

FIG. 5 is a block circuit diagram showing a color video camera according to the present invention.

FIG. 6 is a diagram showing signals written in a field memory.

FIG. 7 is a diagram showing signals written in a two-dimensional memory.

FIG. 8 is a diagram showing signals written in a two-dimensional memory.

FIG. 9 is a diagram showing signals written in a two-dimensional memory.

FIG. 10 is a diagram showing signals written in a two-dimensional memory.

FIG. 11 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 12 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 13 is a diagram showing an output signal of a two-dimensional low-pass filter.

FIG. 14 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 15 is a block circuit diagram showing another color video camera according to the present invention.

FIG. 16 is a block circuit diagram illustrating a configuration of an arithmetic circuit.

FIG. 17 is a diagram illustrating signals written in a one-dimensional memory.

FIG. 18 is a diagram illustrating signals written in a one-dimensional memory.

FIG. 19 is a diagram showing an output signal of a one-dimensional low-pass filter.

FIG. 20 is a diagram illustrating an output signal of a one-dimensional low-pass filter.

FIG. 21 is a diagram illustrating an output signal of a one-dimensional low-pass filter.

FIG. 22 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 23 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 24 is a diagram showing a configuration of a division lookup table.

FIG. 25 is a diagram showing a configuration of a division lookup table.

FIG. 26 is a diagram illustrating a configuration of a one-dimensional low-pass filter.

FIG. 27 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 28 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 29 is a block circuit diagram illustrating a configuration of an arithmetic circuit.

FIG. 30 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 31 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 32 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 33 is a diagram illustrating a configuration of a two-dimensional low-pass filter.

FIG. 34 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 35 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 36 is a block circuit diagram showing a configuration of an arithmetic circuit.

FIG. 37 is a diagram illustrating signals written in a one-dimensional memory.

FIG. 38 is a diagram showing signals written in a one-dimensional memory.

FIG. 39 is a diagram showing signals written in a one-dimensional memory.

FIG. 40 is a diagram illustrating an output signal of a one-dimensional low-pass filter.

FIG. 41 is a diagram illustrating an output signal of a one-dimensional low-pass filter.

FIG. 42 is a diagram illustrating an output signal of a one-dimensional low-pass filter.

FIG. 43 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 44 is a block circuit diagram showing a configuration of an arithmetic circuit.

FIG. 45 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 46 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 47 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 48 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 49 is a diagram illustrating signals written in a two-dimensional memory.

FIG. 50 is a diagram showing signals written in a two-dimensional memory.

FIG. 51 is a diagram showing signals written in a two-dimensional memory.

FIG. 52 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 53 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 54 is a diagram illustrating an output signal of a two-dimensional low-pass filter.

FIG. 55 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 56 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 57 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 58 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 59 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 60 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 61 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 62 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 63 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 64 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 65 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 66 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 67 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 68 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 69 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 70 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 71 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 72 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 73 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 74 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 75 is a block circuit diagram showing still another color video camera according to the present invention.

FIG. 76 is a block circuit diagram showing still another color video camera according to the present invention.

[Explanation of symbols]

2,53,54,55 Image sensor 10,11,12,13 Two-dimensional memory 14,15,16,17,31 Two-dimensional low-pass filter (LPF) 23,32,42,75,85 Arithmetic circuit 18,19, 62,63,64 Memory 20,21,22,45,65,66,67,68 Low-pass filter (LP
F) 27 Threshold value comparison circuit 28 Lookup table for division 29 Lookup table for logarithm 30 Lookup table for exponentiation 46,74 Bandpass filter (BPF)

──────────────────────────────────────────────────続 き Continued on the front page (31) Priority claim number Japanese Patent Application Hei 4-71181 (32) Priority date Hei 4 (1992) March 27 (33) Priority claim country Japan (JP) (31) Priority Claim number: Japanese Patent Application No. 4-85287 (32) Priority Date Hei 4 (1992) April 7, (33) Priority claiming country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-152140 (32) Priority Japan, Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-161056 (32) Priority day Japan, 19 June 1992 (33) ) Priority claiming country Japan (JP) (31) Priority claim number Japanese Patent Application No. Hei 4-1699367 (32) Priority date Hei 4 (June 26, 1992) (33) Priority claiming country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-169368 (32) Priority Date Hei 4 (1992) June 26 (33) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-183744 (32) ) Japan 4 (1992) July 10, 1933 (33) Priority claiming country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-183745 (32) Priority day Hei 4 (1992) July 10, (33) ) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-186841 (32) Priority date Hei 4 (1992) July 14, (33) Priority claim country Japan (JP) (31) Priority claim number Japanese Patent Application No. 4-186842 (32) Priority date Hei 4 (1992) July 14, (33) Priority claiming country Japan (JP) (58) Field of investigation (Int. Cl. ⁶ , DB name) ) H04N 9/04-9/11

Claims (89)

(57) [Claims] In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The input of the image sensor and the output of the photoelectric conversion element having each type of spectral sensitivity characteristic is input to the first
And a two-dimensional low-pass filter that obtains N-th N types of two-dimensional low-pass filter outputs from the output signal of the pixel having the J-th (1 ≦ J ≦ N) spectral sensitivity characteristic, By multiplying the ratio between the output of the two-dimensional low-pass filter (K ≦ N) and the output of the J-th two-dimensional low-pass filter at the coordinates of the pixel, it is assumed that there is a pixel having the K-th spectral sensitivity characteristic at the coordinates of the pixel. The output signal in the case is calculated, and the output signal in the case where it is assumed that there is a pixel having a spectral sensitivity characteristic other than the K-th is calculated by the same calculation as necessary.
Means for calculating a luminance signal component from the output signal of the pixel and the output signal calculated at the coordinates of the pixel. 2. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting N-th N types of outputs from a pixel and an output signal of a pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, a low-pass filter output of an image sensor output at coordinates of the pixel and a low-pass filter output of the pixel. Means for calculating a luminance signal component by multiplying a ratio with the output of the K-th low-pass filter in the coordinates. 3. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter that extracts the N-th N types of outputs from a pixel and a signal obtained by adding a constant value to an output signal of a pixel having a K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, and an image sensor output at coordinates of the pixel. Means for calculating a luminance signal component by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter and a value obtained by adding a constant value to the output of the Kth low-pass filter at the coordinates of the pixel to reduce the constant value. A color video camera, comprising: 4. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting the N-th N types of outputs from the low-pass filter and the K-th (1 ≦ K ≦
Means for calculating a luminance signal component by multiplying the output signal of the pixel having the spectral sensitivity characteristic of N) by the ratio of the low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel And a means for calculating a luminance signal component from an average of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel in a portion where the spatial frequency of the image is low. 5. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting N-th N types of outputs from a pixel and an output signal of a pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, a low-pass filter output of an image sensor output at coordinates of the pixel and a low-pass filter output of the pixel. First calculating means for calculating a luminance signal component by multiplying the ratio with the output of the K-th low-pass filter in coordinates, and calculating a luminance signal component from an average of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel. The second calculating means for calculating, and the first calculating means and the second calculating means are switched depending on whether or not the difference between the outputs of the two horizontally adjacent pixels of the pixel exceeds a specific threshold value. And a color video camera. 6. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting N-th N types of outputs from a pixel and an output signal of a pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, a low-pass filter output of an image sensor output at coordinates of the pixel and a low-pass filter output of the pixel. Calculating means for calculating a luminance signal component by multiplying the ratio with the output of the K-th low-pass filter in the coordinates, wherein the division part of the calculation means is constituted by a division look-up table, If the number of bits is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bits, and the check is stopped at the nth bit. A color video camera wherein a shift is performed, and effective n bits from which a zero part is removed are used as an input to a division look-up table. 7. The content of the division look-up table is obtained by increasing the operation result of division by n bits by bit shifting, converting the decimal part into an integer part with truncation, and calculating the operation result using the value by bit shifting. 7. The color video camera according to claim 6, wherein the number is reduced by n bits, returned to the original digit, and the integer part is used as a calculation result. 8. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting N-th N types of outputs from a pixel and an output signal of a pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, a low-pass filter output of an image sensor output at coordinates of the pixel and a low-pass filter output of the pixel. Calculating means for calculating a luminance signal component by multiplying a ratio with the output of the K-th low-pass filter in the coordinates, wherein the calculating means performs logarithmic conversion of the multiplication / division portion, and provides a logarithmic lookup table and an exponentiation lookup table. A color video camera characterized in that it is configured to use a color video camera. 9. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. The output of the imaging device formed as described above and the output of the photoelectric conversion device having each type of spectral sensitivity characteristic is input to the first device.
And a low-pass filter for extracting N-th N types of outputs from a pixel and an output signal of a pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic, a low-pass filter output of an image sensor output at coordinates of the pixel and a low-pass filter output of the pixel. Means for calculating a luminance signal component by multiplying a ratio with the output of the K-th low-pass filter in the coordinates, the low-pass filter comprising: a plurality of bit shift circuits; A color video camera comprising: 10. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. Image sensor, a low-pass filter to which the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to take out first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) spectral A constant value is added to a signal obtained by adding a constant value to the output signal of the pixel having the sensitivity characteristic, and a constant value is added to a low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. Means for calculating a luminance signal component by multiplying by a ratio of the color video camera to a color video camera. 11. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. Image sensor, a low-pass filter to which the output of the photoelectric conversion element of each type of spectral sensitivity characteristic is input to take out first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) spectral A constant value is added to a signal obtained by adding a constant value to the output signal of the pixel having the sensitivity characteristic, and a constant value is added to a low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th low-pass filter output at the coordinates of the pixel. Calculating means for calculating a luminance signal component by multiplying the luminance signal component by a ratio of a value obtained by multiplying a logarithmic look-up table and an exponential look-up table. A color video camera characterized in that it is configured to use a table. 12. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A color video camera. 13. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) Of a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to a signal obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of Means for calculating a luminance signal component by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value to reduce the constant value. 14. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. And a two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a portion where the spatial frequency of the image is high, The K (1
.Ltoreq.K.ltoreq.N) multiplied by the ratio of the two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th two-dimensional low-pass filter output at the coordinates of the pixel. Means for calculating a luminance signal component, and in a portion where the spatial frequency of the image is low, N
Means for calculating a luminance signal component from an average value of outputs of pixels having different types of spectral sensitivity characteristics. 15. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. First calculating means, a second calculating means for calculating a luminance signal component from an average value of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel, the first calculating means, and the second calculating means. Means of calculating Means for switching between one of a difference between outputs of two horizontally adjacent pixels of the pixel and a difference between outputs of two vertically adjacent pixels of the pixel, whether or not the difference exceeds a specific threshold value. A color video camera characterized by the following. 16. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. First calculating means, a second calculating means for calculating a luminance signal component from an average value of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel, the first calculating means, and the second calculating means. Means of calculating Means for switching between the two depending on whether or not the difference between the outputs of pixels having the same type of spectral sensitivity characteristics around the pixel exceeds a specific threshold value. 17. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. First calculating means, a second calculating means for calculating a luminance signal component from an average value of outputs of pixels having N kinds of spectral sensitivity characteristics around the pixel, the first calculating means, and the second calculating means. Means of calculating One of the difference between the output of the pixel at the upper left and the pixel at the lower right and the difference of the output of the pixel at the lower left and the pixel at the upper right. Means for switching depending on whether or not the value is exceeded. 18. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. Calculating means, the dividing part of the calculating means is constituted by a division look-up table. When the number of input bits of the table is n in the dividing part, the most significant bit of the input is 1 Inspection is performed, and if it is 0, it is sequentially inspected to the lower bit, the inspection is stopped at the n-th bit, and after this inspection, the bit shift is performed, and the effective n bits from which the 0 part is removed are divided. A color video camera configured to be used for inputting a lookup table. 19. The contents of the division look-up table are obtained by increasing the operation result of division by n bits by bit shifting, making the decimal part a truncated integer part, and converting the operation result using the value by bit shifting. 19. The color video camera according to claim 18, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer portion as a calculation result. 20. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of spectral sensitivity characteristics among first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. Calculating means for performing logarithmic conversion of the multiplication / division portion, and using a logarithmic look-up table and an exponentiation look-up table. Ra video camera. 21. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) The luminance signal component is calculated by multiplying the output signal of the pixel having the spectral sensitivity characteristic by the ratio of the output of the two-dimensional low-pass filter of the image sensor at the coordinates of the pixel to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. And a low-pass filter,
A color video camera, comprising: a plurality of bit shift circuits; and a plurality of adders each having an output from the bit shift circuit as an input signal. 22. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) Of a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to a signal obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of Means for calculating a luminance signal component by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value to the low-pass filter output. 23. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input and extract the first to Nth N types of outputs, and the Kth (1 ≦ K ≦ N) Of a two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel to a signal obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of Calculating means for calculating a luminance signal component by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value;
A color video camera, wherein the calculating means is configured to logarithmically convert a multiplication / division portion and use a logarithmic look-up table and an exponentiation look-up table. 24. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting first to N-th N types of outputs; a low-pass filter output of a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel; Means for calculating a luminance signal component by multiplying the ratio of the pixel coordinate with the output of the K-th low-pass filter. 25. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel; A luminance signal component is calculated by multiplying the ratio of the sum of the low-pass filter output of the composite signal and a constant output to the K-th low-pass filter output at the coordinates of the pixel to reduce the constant value. And a color video camera. 26. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
In the low-pass filter for extracting the first to N-th N types of outputs, and in the part where the spatial frequency of the image is high, the K-th (1 ≦ K
≦ N) to calculate a luminance signal component by multiplying the output signal of the pixel by the ratio of the low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel And a means for calculating a luminance signal component from an average value of outputs of N types of pixels around the pixel in a portion where the spatial frequency of the image is low. 27. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N types of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting first to N-th N types of outputs; a low-pass filter output of a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel; First calculating means for calculating a luminance signal component by multiplying a ratio of the output of the K-th low-pass filter at the coordinates of the pixel, and calculating a luminance signal component from an average value of outputs of N types of pixels around the pixel Switching means, and means for switching between the first calculation means and the second calculation means depending on whether or not the difference between the outputs of the two horizontally adjacent pixels of the pixel exceeds a specific threshold value. And a color video camera. 28. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting first to N-th N types of outputs; a low-pass filter output of a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel; Calculating means for calculating a luminance signal component by multiplying by a ratio with the K-th low-pass filter output at the coordinates of the pixel, wherein the dividing part of the calculating means is constituted by a division look-up table. If the number of input bits in the table is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to lower bits, and the check is stopped at the nth bit. rear,
A color video camera wherein a bit shift is performed, and effective n bits from which a zero part is removed are used as an input of a division look-up table. 29. The contents of the division look-up table are obtained by increasing the operation result of division by n bits by bit shifting, making the fractional part a truncated integer part, and performing the operation result using the value by bit shifting. 29. The color video camera according to claim 28, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer part as a calculation result. 30. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N types of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting first to N-th N types of outputs; a low-pass filter output of a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel; Calculating means for calculating a luminance signal component by multiplying by a ratio with the output of the K-th low-pass filter at the coordinates of the pixel, wherein the calculating means performs logarithmic conversion of the multiplication / division portion, and performs a look-up table for logarithm A color video camera characterized by using a look-up table. 31. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting first to N-th N types of outputs; a low-pass filter output of a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel; Means for calculating a luminance signal component by multiplying by a ratio of the output of the K-th low-pass filter at the coordinates of the pixel, wherein the low-pass filter has a plurality of bit shift circuits and outputs of the bit shift circuits as input signals. A color video camera comprising an adder. 32. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel; Means for calculating a luminance signal component by multiplying the ratio of the sum of a low-pass filter output of the composite signal and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. A color video camera characterized by the following. 33. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel; Calculating means for calculating a luminance signal component by multiplying a ratio of a value obtained by adding a constant value to the output of the low-pass filter of the synthesized signal and a value obtained by adding a constant value to the output of the Kth low-pass filter at the coordinates of the pixel; A color video camera, wherein the calculation means is configured to logarithmically convert the multiplication / division portion and use a logarithmic look-up table and an exponentiation look-up table. 34. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
Means for calculating a luminance signal component by multiplying a ratio of a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel to a K-th two-dimensional low-pass filter output at the coordinates of the pixel A color video camera characterized by the following. 35. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter for extracting the first to N-th N types of outputs, a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel, and the respective types in the coordinates of the pixel By subtracting the constant value by multiplying the ratio of the sum of the output of the two-dimensional low-pass filter of the composite signal of the pixel and a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel, Means for calculating a luminance signal component. 36. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and photoelectric conversion elements are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter for extracting the first to N-th N types of outputs, and a K-th filter in a portion where the spatial frequency of the image is high.
The ratio of the output signal of a pixel (1 ≦ K ≦ N) to the output of the two-dimensional low-pass filter of the composite signal of each type of pixel at the coordinates of the pixel and the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel And a means for calculating a luminance signal component from an averaging value of outputs of N types of pixels around the pixel in a part where the spatial frequency of the image is low. Color video camera. 37. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
First calculating means for calculating a luminance signal component by multiplying a ratio between a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th two-dimensional low-pass filter output at the coordinates of the pixel And N around the pixel
A second calculating means for calculating a luminance signal component from an average value of outputs of the pixels of the type, the first calculating means, and the second calculating means.
Means for calculating whether or not one of the difference between the outputs of the two horizontally adjacent pixels of the pixel and the difference between the outputs of the two vertically adjacent pixels of the pixel exceeds a specific threshold value. A color video camera comprising: 38. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
First calculating means for calculating a luminance signal component by multiplying a ratio between a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th two-dimensional low-pass filter output at the coordinates of the pixel And N around the pixel
A second calculating means for calculating a luminance signal component from an average value of outputs of the pixels of the type, the first calculating means, and the second calculating means.
A color video camera comprising: a calculation unit configured to determine whether an output difference between pixels of the same type around the pixel exceeds a specific threshold value. 39. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
First calculating means for calculating a luminance signal component by multiplying a ratio between a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th two-dimensional low-pass filter output at the coordinates of the pixel And N around the pixel
A second calculating means for calculating a luminance signal component from an average value of outputs of the pixels of the type, the first calculating means, and the second calculating means.
One of the difference between the output of the pixel at the upper left and the pixel at the lower right and the output of the pixel at the lower left and the pixel at the upper right. Means for switching depending on whether or not the threshold value is exceeded. 40. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
Calculating means for calculating a luminance signal component by multiplying a ratio between a two-dimensional low-pass filter output of a composite signal of each type of pixel at the pixel coordinates and a K-th two-dimensional low-pass filter output at the pixel coordinates; , The division part of the calculation means is constituted by a lookup table for division, and when the number of input bits of the table is n in this division part,
It is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bit, the check is stopped at the nth bit, and after this check, the bit shift is performed and A color video camera, wherein the effective n bits that have been removed are used to input a lookup table for division. 41. The contents of the division look-up table are as follows: the operation result of division is increased by n bits by bit shifting, a decimal part is truncated to an integer part, and the operation result using the value is subjected to bit shifting. 41. The color video camera according to claim 40, wherein the color video camera is configured to reduce by n bits, return to the original digit, and use the integer portion as a calculation result. 42. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
Calculating means for calculating a luminance signal component by multiplying a ratio between a two-dimensional low-pass filter output of a composite signal of each type of pixel at the pixel coordinates and a K-th two-dimensional low-pass filter output at the pixel coordinates; A color video camera, wherein the calculation means is configured to logarithmically convert the multiplication / division portion and use a logarithmic look-up table and an exponentiation look-up table. 43. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter that extracts first to N-th N types of outputs, and an output signal of a K-th (1 ≦ K ≦ N) pixel,
Means for calculating a luminance signal component by multiplying a ratio of a two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel to a K-th two-dimensional low-pass filter output at the coordinates of the pixel, The color video camera according to claim 1, wherein the two-dimensional low-pass filter includes a plurality of bit shift circuits and a plurality of adders that receive an output of the bit shift circuit as an input signal. 44. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter for extracting the first to N-th N types of outputs, a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel, and the respective types in the coordinates of the pixel The luminance signal component is calculated by multiplying the ratio of the sum of the output of the two-dimensional low-pass filter of the composite signal of the pixel and a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A color video camera. 45. In a color video camera for obtaining a color image, a spectral optical system for separating incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A two-dimensional low-pass filter for extracting the first to N-th N types of outputs, a signal obtained by adding a constant value to the output signal of the K-th (1 ≦ K ≦ N) pixel, The luminance signal component is calculated by multiplying the ratio of the sum of the output of the two-dimensional low-pass filter of the composite signal of the pixel and a constant value to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel. A color video camera, wherein the calculation means performs logarithmic conversion of the multiplication / division portion and uses a logarithmic look-up table and a power-law look-up table. 46. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) Output signal of the pixel having the spectral sensitivity characteristic of the first low-pass filter output of the image sensor at the coordinates of the pixel and the first K-th output of the pixel at the coordinates of the pixel.
By multiplying the ratio with the output of the low-pass filter, the first
Means for calculating a signal, a band-pass filter that receives the calculated first signal to obtain a second signal for aperture correction, a second low-pass filter that receives an output of the image sensor to obtain a third signal, Means for combining the obtained second signal and third signal to obtain a luminance signal component. 47. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) And a K-th first signal at the coordinates of the pixel obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of (i) and adding a constant value to the output of the first low-pass filter of the image sensor output at the coordinates of the pixel. Means for calculating a first signal by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value to reduce the constant value, and inputting the calculated first signal to obtain a second signal for aperture correction Band pass And a second low-pass filter that receives the output of the image sensor and obtains a third signal, and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. Color video camera. 48. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. And a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a portion where the spatial frequency of the image is high, The Kth (1 ≦
K ≦ N) by multiplying the output signal of a pixel having spectral sensitivity characteristics by the ratio of the first low-pass filter output of the image sensor output at the coordinates of the pixel to the K-th low-pass filter output at the coordinates of the pixel. In the part for calculating the first signal and the part where the spatial frequency of the image is low, N
Means for calculating a first signal from the average value of the outputs of the pixel types, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, and an image sensor output A second low-pass filter for obtaining a third signal;
Means for combining the obtained second signal and third signal to obtain a luminance signal component. 49. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) Output signal of the pixel having the spectral sensitivity characteristic of the first low-pass filter output of the image sensor at the coordinates of the pixel and the first K-th output of the pixel at the coordinates of the pixel.
By multiplying the ratio with the output of the low-pass filter, the first
First calculating means for calculating a signal; and second calculating means for calculating a first signal from an average value of outputs of N types of pixels around the pixel.
And the first calculation means and the second calculation means are switched based on whether or not the difference between the outputs of the two horizontally adjacent pixels of the pixel exceeds a specific threshold value, and the first signal , A band-pass filter that inputs the obtained first signal to obtain a second signal for aperture correction, and a second low-pass filter that receives an image sensor output to obtain a third signal. Means for combining the second signal and the third signal to obtain a luminance signal component. 50. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) Output signal of the pixel having the spectral sensitivity characteristic of the first low-pass filter output of the image sensor at the coordinates of the pixel and the first K-th output of the pixel at the coordinates of the pixel.
By multiplying the ratio with the output of the low-pass filter, the first
Calculating means for calculating a signal, a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction, and a second low-pass filter for inputting an image sensor output to obtain a third signal. Means for synthesizing the obtained second signal and third signal to obtain a luminance signal component, wherein the division part of the calculation means is constituted by a division look-up table, and the division part includes input bits of the table. If the number is n, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bits, and the check is stopped at the nth bit. Wherein the effective n bits from which the zero part has been removed are used as inputs to the division look-up table. 51. The contents of the division look-up table are as follows: the operation result of division is increased by n bits by bit shifting, a decimal part is rounded down to an integer part, and the operation result using the value is shifted by bit shifting. 51. The color video camera according to claim 50, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer portion as a calculation result. 52. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) Output signal of the pixel having the spectral sensitivity characteristic of the first low-pass filter output of the image sensor at the coordinates of the pixel and the first K-th output of the pixel at the coordinates of the pixel.
By multiplying the ratio with the output of the low-pass filter, the first
Calculating means for calculating a signal, a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction, and a second low-pass filter for inputting an image sensor output to obtain a third signal. Means for synthesizing the obtained second signal and third signal to obtain a luminance signal component, wherein the calculating means performs logarithmic conversion of the multiplication / division part, and generates a logarithmic lookup table and a power-law lookup table. A color video camera characterized in that it is configured to be used. 53. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) Output signal of the pixel having the spectral sensitivity characteristic of the first low-pass filter output of the image sensor at the coordinates of the pixel and the first K-th output of the pixel at the coordinates of the pixel.
By multiplying the ratio with the output of the low-pass filter, the first
Means for calculating a signal, a band-pass filter that receives the calculated first signal to obtain a second signal for aperture correction, a second low-pass filter that receives an output of the image sensor to obtain a third signal, Means for synthesizing the obtained second signal and third signal to obtain a luminance signal component, wherein the first low-pass
A color video camera, wherein the filter includes a plurality of bit shift circuits and an adder that receives an output of the bit shift circuit as an input. 54. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) And a K-th first signal at the coordinates of the pixel obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of (i) and adding a constant value to the output of the first low-pass filter of the image sensor output at the coordinates of the pixel. Means for calculating a first signal by multiplying a ratio of a low-pass filter output to a value obtained by adding a constant value; a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction; Imaging element A color video camera comprising: a second low-pass filter that receives a child output to obtain a third signal; and a unit that combines the obtained second signal and the third signal to obtain a luminance signal component. 55. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract first to N-th N types of outputs, and a K-th (1 ≦ K ≦ N) And a K-th first signal at the coordinates of the pixel obtained by adding a constant value to the output signal of the pixel having the spectral sensitivity characteristic of (i) and adding a constant value to the output of the first low-pass filter of the image sensor at the coordinates of the pixel. Calculating means for calculating a first signal by multiplying the output of the low-pass filter by adding a constant value thereto; a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction; , Shooting A second low-pass filter that receives an image element output to obtain a third signal; and a unit that combines the obtained second signal and the third signal to obtain a luminance signal component; A color video camera, wherein parts are logarithmically converted to use a logarithmic look-up table and a power-law look-up table. 56. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. Means for calculating a first signal by multiplying by a ratio, a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction, and inputting an output of the image sensor to obtain a third signal Second A low-pass filter and the resulting second
Means for synthesizing the signal and the third signal to obtain a luminance signal component. 57. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) .Ltoreq.N), a signal obtained by adding a constant value to an output signal of a pixel having a spectral sensitivity characteristic, a value obtained by adding a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel, and the coordinates of the pixel. Kth in
Means for calculating a first signal by multiplying a ratio of the output of the first two-dimensional low-pass filter to a constant value and subtracting the constant value, and inputting the calculated first signal for aperture correction A band-pass filter that obtains a second signal of
A second low-pass filter that receives an image sensor output and obtains a third signal
A color video camera comprising: a filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 58. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. An image sensor, a first two-dimensional low-pass filter that receives the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics and extracts first to N-th types of outputs, and a high spatial frequency of the image. In the portion, the output signal of the pixel having the K-th (1 ≦ K ≦ N) spectral sensitivity characteristic includes:
Means for calculating a first signal by multiplying a ratio between a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel; In a portion where the spatial frequency of the image is low, means for calculating a first signal from an average of outputs of N types of pixels around the pixel, and a second signal for aperture correction by inputting the calculated first signal And a third signal obtained by inputting an image sensor output
A color video camera comprising: a second low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 59. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. A first calculating means for calculating a first signal by multiplying the ratio, a second calculating means for calculating a first signal from an average of outputs of N types of pixels around the pixel, Calculating means and the second The calculation means is switched based on whether one of the difference between the outputs of the two horizontally adjacent pixels of the pixel and the difference between the outputs of the two vertically adjacent pixels of the pixel exceeds a specific threshold value, and Means for obtaining a signal, a band-pass filter for inputting the obtained first signal to obtain a second signal for aperture correction, and inputting an image sensor output to obtain a third signal
A color video camera comprising: a second low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 60. A color video camera for obtaining a color image, wherein N types of photoelectric conversion elements having one of the first to Nth N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. A first calculating means for calculating a first signal by multiplying the ratio, a second calculating means for calculating a first signal from an average of outputs of N types of pixels around the pixel, Calculating means and the second Calculating means for obtaining a first signal by switching whether or not an output difference between pixels of the same type around the pixel exceeds a specific threshold value; and inputting the obtained first signal. A band-pass filter that obtains a second signal for aperture correction, a second low-pass filter that receives an image sensor output to obtain a third signal, and a luminance signal component obtained by combining the obtained second and third signals. Means for obtaining a color video camera. 61. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. A first calculating means for calculating a first signal by multiplying the ratio, a second calculating means for calculating a first signal from an average of outputs of N types of pixels around the pixel, Calculating means and the second One of the output difference between the upper left diagonal adjacent pixel and the lower right diagonal adjacent pixel and the difference between the output of the lower left diagonal adjacent pixel and the upper right diagonal adjacent pixel of the pixel is specified. Means for obtaining a first signal by switching depending on whether or not the threshold value is exceeded, a band-pass filter for receiving the obtained first signal to obtain a second signal for aperture correction, and inputting an image sensor output the second b to obtain a third signal Te
A color video camera, comprising: a low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 62. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. Calculating means for calculating the first signal by multiplying the ratio;
A second signal for aperture correction is input by inputting the calculated first signal.
A band-pass filter that obtains a signal, a second low-pass filter that receives an image sensor output to obtain a third signal, and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. The division part of the calculating means is constituted by a division look-up table. In this division part, if the number of input bits of the table is n, it is checked whether the most significant bit of the input is 1 and if it is 0, For example, the lower bits are sequentially inspected, and the inspection is stopped at the nth bit. After this inspection, a bit shift is performed, and the effective n bits from which the 0 part is removed are used as the input of the division lookup table. A color video camera characterized in that: 63. The contents of the division look-up table are as follows: the operation result of division is increased by n bits by bit shifting, a decimal part is rounded down to an integer part, and the operation result using the value is shifted by bit shifting. 63. The color video camera according to claim 62, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer portion as a calculation result. 64. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. Calculating means for calculating the first signal by multiplying the ratio;
A second signal for aperture correction is input by inputting the calculated first signal.
A band-pass filter that obtains a signal, a second low-pass filter that receives an image sensor output to obtain a third signal, and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. A color video camera, wherein the calculation means is configured to logarithmically convert the multiplication / division portion and use a logarithmic look-up table and an exponentiation look-up table. 65. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of N types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) ≦ N), a first two-dimensional low-pass filter output of the image sensor output at the coordinates of the pixel and a K-th first two-dimensional low-pass filter output at the coordinates of the pixel. Means for calculating a first signal by multiplying by a ratio, a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction, and inputting an output of the image sensor to obtain a third signal Second A low-pass filter and the resulting second
Means for synthesizing a signal and a third signal to obtain a luminance signal component, wherein the first two-dimensional low-pass filter includes a plurality of bit shift circuits and a plurality of addition circuits using an output of the bit shift circuit as an input signal. A color video camera, comprising: 66. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) .Ltoreq.N), a signal obtained by adding a constant value to an output signal of a pixel having a spectral sensitivity characteristic, and a value obtained by adding a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel, Kth in
Means for calculating a first signal by multiplying the output of the first two-dimensional low-pass filter by adding a constant value to the first signal, and inputting the calculated first signal to generate a second signal for aperture correction A band-pass filter to obtain an output of the image sensor, a second low-pass filter to obtain a third signal by inputting an output of the imaging device, and a unit for combining the obtained second signal and the third signal to obtain a luminance signal component. Characteristic color video camera. 67. In a color video camera for obtaining a color image, N types of photoelectric conversion elements having one type of first to Nth types of spectral sensitivity characteristics are arranged on a two-dimensional plane. A first two-dimensional low-pass filter to which the outputs of the photoelectric conversion elements having the respective types of spectral sensitivity characteristics are input to extract the first to Nth N types of outputs, and a K-th (1 ≦ K) .Ltoreq.N), a signal obtained by adding a constant value to an output signal of a pixel having a spectral sensitivity characteristic, and a value obtained by adding a constant value to a first two-dimensional low-pass filter output of an image sensor output at the coordinates of the pixel, Kth in
Calculating means for calculating a first signal by multiplying the output of the first two-dimensional low-pass filter by adding a fixed value to the output of the first two-dimensional low-pass filter, and a second signal for aperture correction by inputting the calculated first signal And a second low-pass filter that receives an image sensor output and obtains a third signal.
Means for synthesizing the obtained second signal and third signal to obtain a luminance signal component, wherein the calculating means performs logarithmic conversion of the multiplication / division part, and generates a logarithmic lookup table and a power-law lookup table. A color video camera characterized in that it is configured to be used. 68. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; and an output signal of the K-th (1 ≦ K ≦ N) pixel, a first low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel. The low-pass filter output and the K-th pixel at the coordinates of the pixel
Means for calculating a first signal by multiplying by a ratio of the first low-pass filter output, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, A second low-pass filter that receives a synthesized signal of N types of signals whose outputs have been adjusted in gain and obtains a third signal; and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. A color video camera, comprising: 69. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel; By subtracting the constant value by multiplying the ratio of the sum of the output of the first low-pass filter of the composite signal of the pixel and the constant value added to the output of the K-th low-pass filter at the coordinates of the pixel, Means for calculating a first signal, a band-pass filter that receives the calculated first signal to obtain a second signal for aperture correction, and a combined signal of N types of signals obtained by adjusting the output of each image sensor. A color video camera comprising: a second low-pass filter that obtains a third signal by input; and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. 70. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and photoelectric conversion elements are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
In the first low-pass filter for extracting the first to N-th N types of outputs, and in the portion where the spatial frequency of the image is high, the K (1
≦ K ≦ N) is multiplied by the ratio between the first low-pass filter output of the composite signal of each type of pixel at the coordinates of the pixel and the K-th first low-pass filter output at the coordinates of the pixel. Means for calculating the first signal in this way, means for calculating the first signal from the averaging value of the outputs of N types of pixels around the pixel in a portion where the spatial frequency of the image is low, and And a second low-pass filter for obtaining a third signal by inputting a composite signal of N types of signals obtained by adjusting the gain of the output of each image sensor, and obtaining a third signal by inputting a second signal for aperture correction. Means for combining the obtained second signal and third signal to obtain a luminance signal component. 71. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; and an output signal of the K-th (1 ≦ K ≦ N) pixel, a first low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel. The low-pass filter output and the K-th pixel at the coordinates of the pixel
A first calculating means for calculating a first signal by multiplying a ratio of the first low-pass filter output to a first low-pass filter, and a second calculating means for calculating a first signal from an average value of outputs of N kinds of pixels around the pixel. Calculating means, and switching between the first calculating means and the second calculating means depending on whether or not the difference between the outputs of the two horizontally adjacent pixels of the pixel exceeds a specific threshold value.
Means for obtaining a signal, a band-pass filter for inputting the obtained first signal to obtain a second signal for aperture correction, and a composite signal of N types of signals obtained by adjusting the output of each image sensor. A color video camera comprising: a second low-pass filter that obtains a third signal; and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal. 72. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; and an output signal of the K-th (1 ≦ K ≦ N) pixel, a first low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel. The low-pass filter output and the K-th pixel at the coordinates of the pixel
Calculating means for calculating the first signal by multiplying the first signal by the ratio of the first low-pass filter output, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, A second low-pass filter for obtaining a third signal by inputting a synthesized signal of N types of signals whose gains have been adjusted, and means for synthesizing the obtained second signal and the third signal to obtain a luminance signal component And the division part of the calculation means is constituted by a division look-up table. In this division part, when the number of input bits of the table is n, it is checked whether the most significant bit of the input is 1 and 0 If,
Inspection is performed sequentially to the lower bits, the inspection is stopped at the n-th bit, and after this inspection, a bit shift is performed, and the effective n bits from which the 0 part is removed are used as an input to the lookup table for division. A color video camera characterized by: 73. The contents of the division look-up table are obtained by increasing the operation result of division by n bits by bit shifting, making the decimal part a truncated integer part, and converting the operation result using the value by bit shifting. 73. The color video camera according to claim 72, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer portion as a calculation result. 74. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; and an output signal of the K-th (1 ≦ K ≦ N) pixel, a first low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel. The low-pass filter output and the K-th pixel at the coordinates of the pixel
Calculating means for calculating the first signal by multiplying the first signal by the ratio of the first low-pass filter output, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, A second low-pass filter for obtaining a third signal by inputting a synthesized signal of N types of signals whose gains have been adjusted, and means for synthesizing the obtained second signal and the third signal to obtain a luminance signal component And the calculating means comprises:
A color video camera, wherein a logarithmic conversion is performed on a multiplication / division portion and a logarithmic look-up table and an exponentiation look-up table are used. 75. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; and an output signal of the K-th (1 ≦ K ≦ N) pixel, a first low-pass filter of a composite signal of each type of pixel at the coordinates of the pixel. The low-pass filter output and the K-th pixel at the coordinates of the pixel
Calculating means for calculating the first signal by multiplying the first signal by the ratio of the first low-pass filter output, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, A second low-pass filter for obtaining a third signal by inputting a synthesized signal of N types of signals whose gains have been adjusted, and means for synthesizing the obtained second signal and the third signal to obtain a luminance signal component The first low-pass
A color video camera, wherein the filter includes a plurality of bit shift circuits and an adder that receives an output of the bit shift circuit as an input signal. 76. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel; The first signal is calculated by multiplying the ratio of the sum of the output of the first low-pass filter of the composite signal of the pixel and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. Means for inputting a calculated first signal, a band-pass filter for obtaining a second signal for aperture correction, and a third signal obtained by inputting a combined signal of N types of signals obtained by adjusting the output of each image sensor. Second to get the signal
A color video camera, comprising: a low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 77. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first low-pass filter for extracting the first to N-th N types of outputs; a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel; The first signal is calculated by multiplying the ratio of the sum of the output of the first low-pass filter of the composite signal of the pixel and a constant value to the output of the K-th low-pass filter at the coordinates of the pixel. Calculating means for inputting a calculated first signal, a band-pass filter for obtaining a second signal for aperture correction, and a combined signal of N types of signals obtained by adjusting the output of each image sensor. A second low-pass filter that obtains three signals; and a unit that obtains a luminance signal component by combining the obtained second signal and the third signal, wherein the calculation unit performs logarithmic conversion of the multiplication / division portion, and performs logarithmic conversion. Lookup tables and tables Color video camera, characterized by being configured to use a ride-up table. 78. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting the first to N-th N types of outputs; and a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel. Means for calculating a first signal by multiplying a ratio of the first two-dimensional low-pass filter output of the first pixel to the K-th first two-dimensional low-pass filter output at the coordinates of the pixel, and inputting the calculated first signal A band-pass filter that obtains a second signal for aperture correction, and a second low-pass filter that obtains a third signal by inputting a composite signal of N types of signals obtained by adjusting the output of each image sensor. Means for combining the second signal and the third signal to obtain a luminance signal component. 79. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting first to N-th N types of outputs, and a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel, respectively, at the coordinates of the pixel. Ratio of the sum of the output of the first two-dimensional low-pass filter of the composite signal of the pixel of the type of the above and a certain value added to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel Means for calculating a first signal by multiplying by a predetermined value, a band-pass filter for inputting the calculated first signal to obtain a second signal for aperture correction, and gain adjustment of the output of each image sensor A second low-pass filter that receives a synthesized signal of the N types of signals obtained as described above and obtains a third signal
A color video camera comprising: a filter; and a unit for combining the obtained second and third signals to obtain a luminance signal component. 80. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
In a first two-dimensional low-pass filter for extracting the first to N-th N types of outputs, and in a portion where the spatial frequency of the image is high,
The output signal of the K-th (1 ≦ K ≦ N) pixel includes a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th first output at the coordinates of the pixel. Means for calculating a first signal by multiplying by a ratio with a two-dimensional low-pass filter output, and calculating a first signal from an average value of outputs of N types of pixels around the pixel in a portion where the spatial frequency of the image is low. Means for inputting a calculated first signal, a band-pass filter for obtaining a second signal for aperture correction, and a third signal obtained by inputting a combined signal of N types of signals obtained by adjusting the output of each image sensor. Second to get the signal
A color video camera, comprising: a low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 81. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional log that extracts the first to N-th N types of outputs
And a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th output at the coordinates of the pixel in the output signal of the K-th (1 ≦ K ≦ N) pixel. First calculating means for calculating a first signal by multiplying a ratio of the first two-dimensional low-pass filter output to a first two-dimensional low-pass filter; and calculating a first signal from an average of outputs of N types of pixels around the pixel. 2, the first calculating means and the second calculating means are provided with one of a difference between outputs of two horizontally adjacent pixels of the pixel and a difference of outputs of two vertically adjacent pixels of the pixel. Means for obtaining a first signal by switching whether or not exceeds a specific threshold value, a band-pass filter for inputting the obtained first signal to obtain a second signal for aperture correction, and each image sensor Of N kinds of signals whose output is Second obtaining a third signal to input signal
A color video camera, comprising: a low-pass filter; and means for combining the obtained second and third signals to obtain a luminance signal component. 82. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional log that extracts the first to N-th N types of outputs
And a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th output at the coordinates of the pixel in the output signal of the K-th (1 ≦ K ≦ N) pixel. First calculating means for calculating a first signal by multiplying a ratio of the first two-dimensional low-pass filter output to a first two-dimensional low-pass filter; and calculating a first signal from an average of outputs of N types of pixels around the pixel. 2 and the first calculation means and the second calculation means are switched based on whether or not the difference in output between pixels of the same type around the pixel exceeds a specific threshold value. Means for obtaining one signal, a band-pass filter for receiving the obtained first signal to obtain a second signal for aperture correction, and a combined signal of N types of signals obtained by adjusting the output of each image sensor. Second low-pass filter to obtain a third signal Filter and the obtained second signal and the color video camera, characterized in that it comprises a third signal and means for obtaining a synthesized and luminance signal component. 83. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional log that extracts the first to N-th N types of outputs
And a first two-dimensional low-pass filter output of a composite signal of each type of pixel at the coordinates of the pixel and a K-th output at the coordinates of the pixel in the output signal of the K-th (1 ≦ K ≦ N) pixel. First calculating means for calculating a first signal by multiplying a ratio of the first two-dimensional low-pass filter output to a first two-dimensional low-pass filter; and calculating a first signal from an average of outputs of N types of pixels around the pixel. 2, the first calculating means and the second calculating means, the difference between the output of the pixel on the upper left and the pixel on the lower right of the pixel adjacent to the diagonally lower right adjacent pixel of the pixel, Means for obtaining a first signal by switching depending on whether or not one of the outputs of the upper right oblique pixels exceeds a specific threshold value; and inputting the obtained first signal for aperture correction. A band-pass filter for obtaining a second signal of A second low-pass filter that receives a composite signal of N types of signals obtained by adjusting the output of the image element to obtain a third signal, and combines the obtained second signal and the third signal to obtain a luminance signal component And a color video camera. 84. In a color video camera for obtaining a color image, a spectroscopic optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are optically displaced from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting the first to N-th N types of outputs; and a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel. Calculating means for calculating a first signal by multiplying a ratio between the first two-dimensional low-pass filter output of the first pixel and the K-th first two-dimensional low-pass filter output at the coordinates of the pixel; A band-pass filter for inputting to obtain a second signal for aperture correction, and a second low-pass filter for obtaining a third signal by inputting a synthesized signal of N types of signals obtained by adjusting the output of each image sensor. The second
Means for synthesizing the signal and the third signal to obtain a luminance signal component, wherein the division part of the calculation means is constituted by a division look-up table, and the number of input bits of the table is n in this division part. In this case, it is checked whether the most significant bit of the input is 1; if it is 0, it is checked sequentially to the lower bits,
a color video apparatus characterized in that the inspection is stopped at the n-th bit, and after this inspection, the bit shift is performed, and the effective n bits from which the zero part has been removed are used as the input of the lookup table for division. camera. 85. The contents of the division look-up table are as follows: the operation result of division is increased by n bits by bit shifting, the decimal part is rounded down to an integer part, and the operation result using the value is shifted by bit shifting. 85. The color video camera according to claim 84, wherein the color video camera is configured to reduce the number by n bits, return to the original digit, and use the integer portion as a calculation result. 86. In a color video camera for obtaining a color image, a spectral optical system for dispersing incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting the first to N-th N types of outputs; and a composite signal of each type of pixel at the coordinates of the K-th (1 ≦ K ≦ N) pixel. Calculating means for calculating a first signal by multiplying a ratio between the first two-dimensional low-pass filter output of the first pixel and the K-th first two-dimensional low-pass filter output at the coordinates of the pixel; A band-pass filter for inputting to obtain a second signal for aperture correction, and a second low-pass filter for obtaining a third signal by inputting a synthesized signal of N types of signals obtained by adjusting the output of each image sensor. The second
Means for synthesizing the signal and the third signal to obtain a luminance signal component, wherein the calculation means is configured to logarithmically convert the multiplication / division portion and use a logarithmic look-up table and a power-law look-up table. A color video camera characterized in that: 87. A color video camera for obtaining a color image
, A spectral optical system that splits incident light into N types of light
And the photoelectric conversion elements are arranged on a two-dimensional plane.
N image sensors that are optically offset from each other
N types of signals obtained by adjusting the output of the image element are input,
Extract the first to Nth N types of outputsFirst two-dimensional b
-Pass filterAnd the output signal of the K-th (1 ≦ K ≦ N) pixel
Indicates the sum of each type of pixel at the coordinates of the pixel.
The first two-dimensional low-pass filter output of the synthesized signal and the pixel
Kth first two-dimensional low-pass filter output in coordinates
Calculation means for calculating the first signal by multiplying by the ratio
Stage and inputting the calculated first signal for aperture correction
And a band-pass filter for obtaining a second signal of
Input the synthesized signal of N kinds of signals whose output is gain adjusted
A second two-dimensional low-pass filter for obtaining a third signal;
Combining the obtained second and third signals to obtain a luminance signal component
Means,The first two-dimensional low-pass filter
Are a plurality of bit shift circuits and outputs of the bit shift circuits.
And a plurality of adders that use force as an input signal.
Color video camera. 88. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting first to N-th N types of outputs, and a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel, respectively, at the coordinates of the pixel. Ratio of the sum of the output of the first two-dimensional low-pass filter of the composite signal of the pixel of the type of the above and a certain value added to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel Means for calculating a first signal by multiplying by N, a band-pass filter for receiving the calculated first signal to obtain a second signal for aperture correction, and N kinds of signals obtained by adjusting the output of each image sensor. A second low-pass filter for inputting a combined signal of the first and second signals to obtain a third signal; and a unit for combining the obtained second signal and the third signal to obtain a luminance signal component. . 89. In a color video camera for obtaining a color image, a spectral optical system for splitting incident light into N kinds of light and a photoelectric conversion element are arranged on a two-dimensional plane, and are arranged optically shifted from each other. N kinds of signals obtained by adjusting the output of each of the N image sensors and the gain of each image sensor are input,
A first two-dimensional low-pass filter for extracting first to N-th N types of outputs, and a signal obtained by adding a constant value to an output signal of a K-th (1 ≦ K ≦ N) pixel, respectively, at the coordinates of the pixel. Ratio of the sum of the output of the first two-dimensional low-pass filter of the composite signal of the pixel of the type of the above and a certain value added to the output of the K-th two-dimensional low-pass filter at the coordinates of the pixel Multiplying the first signal, a band-pass filter that receives the calculated first signal to obtain a second signal for aperture correction, and N types of gain-adjusted outputs of the respective image sensors. A second low-pass filter for inputting a synthesized signal of the signals to obtain a third signal; and a unit for synthesizing the obtained second signal and the third signal to obtain a luminance signal component. Logarithmic conversion of the arithmetic part and logarithm Color video camera, characterized by being configured to use a click-up table and the look-up table for power.