JPH0553244B2 - - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Object of the Invention] (Industrial Field of Application) The present invention relates to an electronic endoscope apparatus that modulates spatial data of three color attributes.

(Prior art) Conventionally, when it is desired to observe the inside of the stomach with high precision using an endoscope, a dye dispersion tube is introduced into the stomach through the mouth of the forceps, and a syringe is used to enter the dye dispersion tube from the outside. Alternatively, by supplying dyes such as methylene blue and toluidine blue, the dyes were dispersed inside the stomach.

However, dispersing the dye inside the stomach may cause the dye itself to be toxic, and there are also problems such as the need for washing after use of the dye, which is time-consuming.

On the other hand, with the recent progress in image processing technology, various electronic endoscope devices applying this image processing technology have been proposed and put into practical use.

However, when observing the inside of the stomach using a conventional electronic endoscope, if you want to clarify the difference between the normal part of the stomach and the abnormal part to improve the diagnostic ability of the doctor, The dye was often sprayed inside the stomach.

(Problems to be solved by the invention) Conventionally, when observing the inside of a body cavity such as the stomach using an endoscope, dyes are often sprinkled into the body cavity to improve the diagnostic ability of doctors. . Spraying the dye in this manner causes problems such as consideration of the toxicity of the dye itself and the need for cleaning measures after spraying.

The present invention has been made to solve the above-mentioned problems, and its purpose is to provide an electronic endoscope device that can improve a doctor's diagnostic ability without dye scattering.

[Structure of the Invention] (Means for Solving the Problems) In order to achieve the above object, the electronic endoscope device of the present invention converts a video signal obtained by imaging a subject into three-attribute spatial data of color. a data converting means for converting the hue image data in the three attribute space data of the color obtained by the data converting means into either other brightness image data or chroma image data or three primary color space data from the video signal; using a hue modulation means that performs modulation control based on the hue modulation means, hue image data modulated by the hue modulation means, and each image data of brightness and saturation in the three attribute spatial data of the color obtained by the data conversion means. and image data restoring means for restoring image data in a three primary color space.

(Function) With this configuration, by controlling the hue data in the three-attribute spatial data obtained by the data conversion means in various ways using the hue modulation means, it is possible to prevent halation and image blurring. Feature-enhanced image data in the three primary color space can be obtained by the image data restoring means. Therefore, the region of interest observed as a subject can be observed with its features emphasized so as to prevent halation and blurring of the image.

(Embodiment) FIG. 1 is a block diagram schematically showing an electronic endoscope apparatus according to an embodiment of the present invention.

The electronic endoscope device of this embodiment captures an image of a subject and outputs three video signals of red (R), green (G) and blue (B).
Camera 1 outputs primary color space signals (hereinafter referred to as RGB signals) and NTSC, and the image data of the RGB signals from camera 1 is converted into a three-attribute space of hue (H), saturation (S), and brightness (I). HSI conversion circuit 2 that converts to data
and an inverse HSI conversion circuit 3 that converts the three color attribute space data into RGB signals.

Furthermore, various circuits for performing HSI modulation processing are provided between the HSI conversion circuit 2 and the inverse HSI conversion circuit 3.

Various circuits for performing this HSI modulation processing are:
There are 4 H frame memories for temporarily storing hue (H) image data for each frame, and 1 for saturation (S) image data.
In addition to an S frame memory 5 for temporarily storing each frame and a 1 frame memory 6 for temporarily storing brightness (I) image data for each frame, a two-dimensional digital filtering device 7, a filter coefficient register 8, It includes an adder 9, a switch 10, and a timing circuit 11.

The two-dimensional digital filtering device 7 filters the brightness (I) image data in the I frame memory 6, and uses digital filters such as a two-dimensional high-pass filter, a two-dimensional differential filter, and a two-dimensional Hilbert transform filter. Select and use as appropriate.

The filter coefficient register 8 holds the filter coefficients of the two-dimensional filtering device, and the filter coefficients can be set as appropriate.

The adder 9 is for adding the filtering result by the two-dimensional digital filtering device 7 to the H frame memory 4.

The switch 10 is for inputting the filtering result by the two-dimensional digital filtering device 7 to the H frame memory 4 as it is.

The timing circuit 11 controls the operation timing of each component described above.

Next, the operation of the electronic endoscope apparatus of one embodiment shown in FIG. 1 will be described.

By imaging the inside of the body cavity with the camera 1, an RGB signal is output from the camera 1, and this RGB signal is applied to the HSI conversion circuit 2.

The HSI conversion circuit 2 that receives the RGB signal converts hue (H), saturation (S), and brightness (I) based on the red (R) data, green (G) data, and blue (B) data of the RGB signal. Conversion processing is performed to select three types of images to be assigned to.

Therefore, hue (H) image data, saturation (S) image data, and brightness (I) image data are stored in the H frame memory 4, S frame memory 5, and I frame memory 6 for each frame, respectively.

On the other hand, the two-dimensional digital filtering device 7, whose filter coefficients are set by the filter coefficient register 8, takes in brightness (I) image data from the I frame memory 6 and performs filtering of this brightness (I) image data. When the adder 9 is selected by the switch 10, the filtering result by the two-dimensional digital filtering device 7 is added to the hue (H) image data in the H frame memory 4 through the adder 9. . Also,
When the switch 10 is switched and the two-dimensional digital filtering device 7 and the H frame memory 4 are directly connected, the result of filtering by the two-dimensional digital filtering device 7 is directly transferred to the H frame memory 4. . When such an operation is performed, the hue (H) image data in the H frame memory 4 is modulated and controlled while the brightness (I) image data and the saturation (S) image data are kept constant.

Therefore, new hue (H) image data subjected to modulation control is added to the inverse HSI conversion circuit 3 from the H frame memory 4, and this new hue (H) image data and the S frame memory not subjected to modulation control are added. Saturation of 5 (S)
HSI/RGB conversion using the image data and the brightness (I) image data in the I frame memory 6 is performed by the inverse HSI conversion circuit 3.

As a result, the conversion output of the inverse HSI conversion circuit 3 is
The RGB signal is subjected to feature enhancement processing according to the modulation control described above so as to prevent halation and blurring of the image.

For this reason, when observing the inside of a body cavity using a display device such as a CRT (not shown), when the region of interest is, for example, the gastric mucosa, it is possible to It is possible to obtain an image similar to that obtained when various dyes are dispersed inside, that is, an image that appears colored between the folds of the gastric mucosa.

Furthermore, instead of the two-dimensional digital filtering device used in the electronic endoscope device of the above-mentioned embodiment, a one-dimensional digital filtering device only in the horizontal or vertical direction can be used as an electronic endoscope device. good. In this case, the filtering results are inferior to two-dimensional digital filtering. However, it is superior from the viewpoint of reducing manufacturing costs. Furthermore, if the values in the I-frame memory are processed using a two-dimensional differential filter, the hue of the outline of the image can be changed, but if the brightness of the part where the hue has been changed decreases, the outline becomes darker. The image becomes blurry.

FIG. 2 is a block diagram schematically showing an electronic endoscope device according to another embodiment of the present invention.

In the electronic endoscope device of the other embodiment, the camera 1, HSI conversion circuit 2, inverse HSI conversion circuit 3, H frame memory 4, S frame memory 5, I frame memory 6, and timing circuit 11 are as shown in FIG. It has the same functional configuration as the device of one embodiment.

And between camera 1 and HSI conversion circuit 2,
As a preprocessing system, luminance (Y)/color difference (I,
Q) Signal (hereinafter referred to as YIQ signal) separation circuit 21
A matrix circuit 22 is provided for restoring RGB signals from the YIQ signals.

In addition, in order to perform HSI modulation processing between the HSI conversion circuit 2 and the inverse HSI conversion circuit 3, in addition to the H frame memory 4, the S frame memory 5, and the I frame memory 6, an average median mode calculation circuit 23 and an , S/H conversion calculation circuit 24, and adder 2
5 and a switch 26.

The average median mode calculation circuit 23 calculates the average median or mode of each of the lesioned area and the normal area from the saturation (S) image data in the S frame memory 5.

The S/H conversion circuit 24 converts the saturation (S) image data into hue (H) image data based on the calculation result of the average median mode calculation circuit 24.

The adder 25 is for adding the conversion result by the S/H conversion calculation circuit 24 to the H frame memory 4.

The switch 26 is for inputting the conversion result by the S/H conversion calculation circuit 24 as it is to the H frame memory 4.

Next, the operation of the electronic endoscope apparatus of another embodiment shown in FIG. 2 will be explained.

By imaging the inside of the body cavity with the camera 1, NTSC is output from the camera 1, and this NTSC is added to the separation circuit 21. Then, from the separation circuit 21
The YIQ signal is sent to the matrix circuit 22, and the RGB signal is restored by the matrix circuit 22.
It is added to the HSI conversion circuit 21.

The HSI conversion circuit 2 that receives the RGB signal converts the RGB data into image data of hue (H), saturation (S), and brightness (I), and stores the H frame memory 4 corresponding to each frame of the RGB data. Transfer to S frame memory 5 and I frame 6.

On the other hand, in the average median mode calculation circuit 23,
From the density distribution of the saturation (S) data stored in the S frame memory 5, for example, the average median or mode of each density of a lesion area due to gastric cancer and a normal area is calculated, and this calculation result is applied to the S/H conversion calculation circuit. Transfer to 24.

Then, the S/H conversion calculation circuit 24, based on the calculation result of the average median mode calculation circuit 23,
For example, saturation (S) image data is converted to hue (H) image data so that a diseased area has red color data and a normal area has green color data. In addition, regarding the color, the color that intuitively indicates that the lesion is a lesion,
Any color that intuitively indicates that the normal part is a normal part may be used.

When the adder 25 is selected by the switch 26, the hue is calculated by the S/H conversion calculation circuit 24.
The (H) image data is added to the hue (H) image data in the H frame memory 4 through the adder 25. Further, when the switch 26 is switched and the S/H conversion calculation circuit 24 and the H frame memory 4 are connected, the hue (H) image data from the S/H conversion calculation circuit 24 is transferred to the H frame memory 4. be done. Even in this case, the hue (H) image data in the H frame memory 4 is modulated and controlled while the brightness (I) image data and the saturation (S) image data remain constant.

Therefore, similar to the embodiment described based on FIG. 1, the RGB signals output from the inverse HSI conversion circuit 3 are subjected to feature enhancement processing, and as a result, in the image on the display device, it appears that there are various kinds of things inside the stomach. It will be colored in the same way as when dye is sprinkled.

FIG. 3 is a block diagram schematically showing an electronic endoscope apparatus according to another embodiment of the present invention.

In the electronic endoscope of this other embodiment, a camera 1, an HSI conversion circuit 2, an inverse HSI modulation circuit 3, an H frame memory 4, an S frame memory 5, an I frame memory 6, and a timing circuit 11 are shown in FIG. The functional configuration is the same as that of each of the embodiments shown in FIG. However, the H frame memory 4 takes in hue (H) image data from a G/H conversion circuit 33, which will be described later.
In addition, a separation circuit 21 and a matrix circuit 22
has the same functional configuration as the other embodiment device shown in FIG.

In order to perform HSI modulation processing between the HSI conversion circuit 2 and the inverse HSI conversion circuit 3, in addition to the H frame memory 4, the S frame memory 5, and the I frame memory 6, a G frame memory 31,
Parameter calculation circuit 32 and G/H conversion circuit 33
Equipped with.

The G frame memory 31 temporarily stores green (G) image data of RGB signals for each frame.

The parameter calculation circuit 32 calculates the average median or mode of each of the lesioned part and the normal part from the green (G) image data in the G frame memory 31, and transfers the calculation results to the G/H conversion circuit 33.

The G/H conversion circuit 33 is a parameter calculation circuit 3
Based on the calculation results in step 2, change the hue of the green (G) image data.
(H) Convert to image data.

Next, the operation of the electronic endoscope apparatus of another embodiment shown in FIG. 3 will be explained.

The separation circuit 21 obtains a YIQ signal from the NTSC output from the camera 1, and the matrix circuit 22 obtains an RGB signal from this YIQ signal.

The HSI conversion circuit 2 that receives this RGB signal,
The RGB data is converted into image data of hue (H), saturation (S) and brightness (I), and the saturation (S) image data is transferred to the S frame memory 5 for each frame, and the brightness (I) is transferred to the S frame memory 5. Transfer the image data to the I frame memory 6.

On the other hand, green (G) image data is written and stored in the G frame memory 31 for each frame. At this time, the parameter calculation circuit 32 calculates the average median or mode of each density of a lesion area caused by gastric cancer and a normal area, for example, based on the density distribution of the green (G) image data stored in the G frame memory 31, and calculates the calculated result. is transferred to the G/H conversion circuit 33.

Then, based on the calculation result of the parameter calculation circuit 32, the G/H conversion circuit 33 converts the green (G) image so that, for example, the lesion area has red-based color data and the normal area has green-based color data. Convert the data to hue (H) image data. Then, the hue (H) image data obtained through this conversion process is transferred to the H frame memory 4. Therefore, the hue (H) image data in the H frame memory 4 is modulated and controlled based on the green (G) image data.

Therefore, similarly to each of the embodiments described based on FIGS. 1 and 2, the inverse HSI conversion circuit 3 outputs
The RGB signal is subjected to feature enhancement processing, and as a result,
In the image on the display device, halation and blurring of the image can be prevented, and the image will be colored in the same way as when various dyes are sprinkled inside the stomach.

For this reason, according to the apparatuses of the embodiments of the present invention, small lesions etc. are not overlooked.
In addition, early detection of gastric cancer becomes easier, which in turn can contribute to improving the diagnostic ability of doctors.

[Effects of the Invention] As explained above, according to the electronic endoscope device to which the present invention is applied, modulation control of hue image data as HSI modulation processing is performed on any of other brightness image data and chroma image data. Alternatively, since it is performed based on three primary color space data, only the hue can be changed while keeping the brightness and saturation constant. Therefore, if the image data in the three primary color spaces is restored and used for recording, halation and blurring of the image can be prevented, and a colored image similar to that obtained by dispersing dye into a body cavity can be obtained. Therefore, the difference between the normal part and the abnormal part in the body cavity becomes clear through electrical processing, which improves the diagnostic ability of the doctor, which is also suitable from the operational point of view.

[Brief explanation of the drawing]

FIGS. 1, 2, and 3 are block diagrams schematically showing electronic endoscope apparatuses according to embodiments of the present invention. 1...Camera, 2...HSI conversion circuit, 3...Reverse
HSI conversion circuit, 4...H frame memory, 5...
S frame memory, 6...I frame memory, 7
...Two-dimensional digital filtering device, 8...
...Filter coefficient register, 9...Adder, 10...
...Switch, 11...Timing circuit, 21...
Separation circuit, 22... Matrix circuit, 23... Average median mode calculation circuit, 24... S/H conversion calculation circuit, 25... Adder, 26... Switch,
31...G frame memory, 32...Parameter calculation circuit, 33...G/H conversion circuit.

Claims (1)

[Claims] 1 A data conversion means for converting a video signal obtained by imaging a subject into three-attribute space data of color, and a data conversion means for converting the hue image data in the three-attribute space data of color obtained by this data conversion means into other brightness images. a hue modulation means for performing modulation control based on either data or chroma image data or three primary color space data from the video signal; An electronic endoscope apparatus comprising an image data restoring means for restoring image data in a three primary color space using image data of brightness and saturation in three color attribute space data.