JP5483522B2 - Image acquisition device - Google Patents

Description

  The present invention relates to an image acquisition method and apparatus for acquiring an image signal output from an image pickup device by picking up an image of the observation target by irradiating the observation target with light, and in particular, for an observation target. The present invention relates to an image acquisition method and apparatus for acquiring a narrowband image signal representing a narrowband image.

  Conventionally, endoscope apparatuses for observing tissue in a body cavity are widely known. A normal image is obtained by imaging an observation target in a body cavity illuminated by white light, and the normal image is displayed on a monitor screen. Electronic endoscope devices have been widely put into practical use.

  As the electronic endoscope apparatus as described above, the biological mucous membrane of the digestive organ (for example, the stomach) is imaged through a plurality of types of narrow-band bandpass filters that transmit light in a narrow wavelength band, and a plurality of types of the biological mucosa There is known an electronic endoscope apparatus (Narrow Band Imaging-NBl) that obtains a narrow-band image and displays these narrow-band images as diagnostic images. As such an apparatus, for example, Japanese Patent Application Laid-Open No. H10-228667 proposes a device that includes a rotary filter that combines three types of narrow-band bandpass filters that transmit light in different wavelength bands and that performs imaging in a frame sequential manner. Has been.

On the other hand, regarding an electronic endoscope apparatus that arranges RGB mosaic filters composed of a plurality of types of wideband bandpass filters on an image pickup device and picks up a color normal image in a simultaneous manner, for example, An image obtained by estimating the narrowband image obtained by using the narrowband bandpass filter is obtained by performing arithmetic processing on the normal image obtained by imaging the mucous membrane, and the above diagnostic image is displayed. Things have been proposed.
JP 2002-95635 A JP 2006-341077 A

  However, for example, in the electronic endoscope apparatus described in Patent Document 1, the rotary filter has a double structure centered on the rotation axis, and a wideband filter for normal image capturing is provided at the outer diameter portion. And a narrow band filter for picking up a narrow band image is provided in the inner diameter portion. Then, by moving the rotation axis of the rotary filter to the diameter method of the rotary filter, the normal image pickup and the narrowband image pickup can be switched. However, in the electronic endoscope device described in Patent Document 1, an observation mode is selected. Is switched, and it is not assumed that the normal image and the narrowband image are displayed simultaneously.

  In an actual medical field, there is a need to display a normal image and a narrowband image at the same time, and compare these to make a diagnosis. In the electronic endoscope device described in Patent Document 1, however, I can't respond.

  Further, in the electronic endoscope apparatus described in Patent Document 2, since the narrowband image is acquired by performing arithmetic processing on the normal image, the normal image and the narrowband image can be displayed simultaneously. However, since the narrowband image acquired by the calculation process is an estimated image, there is a limit to the estimation accuracy thereof, and the diagnostic accuracy compared with the narrowband image acquired by the electronic endoscope apparatus described in Patent Document 1 Will result in a low image.

  The present invention has been made in view of the above problems, and provides an image acquisition method and apparatus capable of simultaneously displaying a normal image and a narrowband image and acquiring a narrowband image with high diagnostic accuracy. The purpose is to provide.

    A first image acquisition method of the present invention includes an imaging device that receives reflected light reflected from an observation target by irradiating the observation target with light and picks up an image of the observation target, and outputs an image output from the imaging device. In the image acquisition method for acquiring a signal, a plurality of lights of different wavelength bands are sequentially irradiated to at least one color of light of at least three wavelength bands, and the wavelengths of colors other than the at least one color are sequentially irradiated Irradiates the observation target with light in a band, sequentially acquires image signals of a plurality of wavelength components sequentially output from the imaging device by irradiating the observation target with a plurality of lights in different wavelength bands, and the plurality of wavelength components Spectral image processing is performed on each of the image signals using different estimation matrix data, and a monochrome image signal of a color component to which the image signals of the plurality of wavelength components belong is sequentially generated. The image signals of the plurality of wavelength components are respectively acquired as narrowband image signals representing the narrowband image to be observed, and output from the image sensor by irradiation with light of a wavelength band other than the at least one color. A normal image signal representing a normal image to be observed is sequentially obtained by combining the image signal and each monochrome image signal. The second image acquisition method of the present invention includes an imaging device that receives reflected light reflected from the observation target by irradiating the observation target with light and picks up an image of the observation target, and is output from the imaging device. In the image acquisition method for acquiring an image signal, the light to be observed is irradiated with light having a narrowband wavelength for at least one of the light in the wavelength bands of at least three colors, and the light in the wavelength band of a color other than the at least one color is used. The image signal of the wavelength component output from the image sensor by irradiating the observation target with light of a narrow band wavelength is obtained, and the image signal of the wavelength component is spectrally analyzed using the estimated matrix data. When image processing is performed to generate a monochrome image signal of a color component to which the image signal of the wavelength component belongs, and the image signal of the wavelength component is acquired as a narrowband image signal representing a narrowband image to be observed In addition, a normal image signal representing a normal image to be observed is obtained by combining the image signal output from the image pickup element by irradiation with light in a wavelength band of a color other than at least one color and a monochrome image signal. And

    A first image acquisition device according to the present invention includes an imaging device that receives reflected light reflected from an observation target by irradiating the observation target with light and captures an image of the observation target, and outputs an image output from the imaging device. In the image acquisition device for acquiring a signal, the observation target is sequentially irradiated with a plurality of lights in different wavelength bands for at least one of the lights in the wavelength bands of at least three colors, and the wavelengths of the colors other than the at least one color Sequentially acquiring image signals of a plurality of wavelength components sequentially output from the imaging device by irradiating the observation target with a plurality of lights in different wavelength bands, and a light irradiation unit that irradiates the observation target with light in a band; Spectral image processing is applied to image signals of a plurality of wavelength components using different estimation matrix data, and a monochrome image of a color component to which the image signals of the plurality of wavelength components belong A spectral image processing unit that sequentially generates a signal, and a plurality of wavelength component image signals as narrowband image signals representing a narrowband image to be observed, and light in a wavelength band other than the at least one color An image signal acquisition unit that sequentially acquires a normal image signal representing a normal image to be observed by combining the image signal output from the image sensor by the irradiation of the single-color image signal sequentially output from the spectral image processing unit. It is characterized by having. A second image acquisition device of the present invention includes an image sensor that receives reflected light reflected from an observation object by irradiating the observation object with light and captures an image of the observation object, and outputs an image output from the image sensor. In the image acquisition device for acquiring a signal, the observation target is irradiated with light having a narrowband wavelength for at least one of the light in the wavelength bands of at least three colors, and the light in the wavelength bands of colors other than the at least one color is irradiated. A light irradiating unit for irradiating the observation target, and acquiring an image signal of the wavelength component output from the imaging device by irradiating the observation target with light of a narrow band wavelength, and estimating matrix data for the image signal of the wavelength component A spectral image processing unit that performs spectral image processing to generate a monochrome image signal of a color component to which the image signal of the wavelength component belongs, and a narrowband image that represents the narrowband image to be observed. Obtained as a gamut image signal and combined with an image signal output from the image sensor by irradiation with light in a wavelength band other than at least one color and a monochromatic image signal output from the spectral image processing unit An image signal acquisition unit that acquires a normal image signal representing a normal image is provided.

  In the first and second image acquisition devices of the present invention, a display unit for displaying the narrowband image based on the narrowband image signal and the normal image based on the normal image signal at the same frame timing is further provided. can do.

  In the first image acquisition apparatus of the present invention, the display unit can display a plurality of narrowband images based on a plurality of narrowband image signals sequentially at different frame timings.

  In the first and second image acquisition devices of the present invention, the at least one color can be blue.

  In the first image acquisition device of the present invention, different wavelength bands for blue can be set to around 430 nm and around 500 nm.

  According to the first image acquisition method and apparatus of the present invention, image signals of a plurality of wavelength components sequentially output from the imaging device by irradiation of a plurality of lights in different wavelength bands for at least one color are sequentially applied. Acquiring and performing spectral image processing on the image signals of the plurality of wavelength components using different estimation matrix data, respectively, and sequentially generating monochromatic image signals of the color components to which the image signals of the plurality of wavelength components belong, The image signals of the plurality of wavelength components are respectively acquired as narrowband image signals representing narrowband images to be observed, and image signals output from the imaging device by irradiation with light of a wavelength band other than the at least one color Since the normal image signal representing the normal image to be observed is sequentially obtained by combining each monochrome image signal with each monochrome image signal, the diagnostic accuracy is high. It is possible to obtain a narrowband image signal can be displayed narrowband image and the normal image at the same time.

  In addition, since a single monochrome image signal of the normal image signal is sequentially generated by performing spectral image processing on a plurality of narrowband image signals, a normal image that is easy to see for an observer without flickering for each frame is obtained. Can be displayed.

  According to the second image acquisition method and apparatus of the present invention, an image signal of wavelength components sequentially output from the image sensor by irradiating an observation target with light of a narrowband wavelength for at least one color is acquired, and the wavelength component Spectral image processing is performed on the image signal using the estimated matrix data to generate a monochromatic image signal of the color component to which the image signal of the wavelength component belongs, and the image signal of the wavelength component is converted into a narrowband image to be observed. A normal image that is obtained as a narrowband image signal to be represented and represents a normal image to be observed by combining the image signal output from the imaging element by irradiation with light of a wavelength band other than the at least one color and the monochromatic image signal Since the image signal is acquired, it is possible to acquire a narrowband image signal with high diagnostic accuracy and simultaneously display the narrowband image and the normal image. Door can be.

  Hereinafter, an endoscope system using an embodiment of an image acquisition device of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a schematic configuration of an endoscope system 1 using an embodiment of the present invention.

  As shown in FIG. 1, an endoscope system 1 is inserted into a body cavity of a subject and a scope unit 20 for observing an observation target, and a processor unit 30 to which the scope unit 20 is detachably connected, A scope unit 20 is optically detachably connected, and includes an illumination light unit 10 in which a xenon lamp that emits illumination light L0 is housed. Note that the processor unit 30 and the illumination light unit 10 may be configured integrally or may be configured separately.

  A detailed configuration of the illumination light unit 10 is shown in FIG. As shown in FIG. 2, the illumination light unit 10 includes a xenon lamp 12 that emits white light, a diaphragm device 13 that controls the amount of white light emitted from the xenon lamp 12, and converts the white light into frame sequential light. Rotating filter 14, condensing lens 15 for condensing surface sequential light via the rotating filter on the incident surface of light guide 11 connected to scope unit 20, rotating filter motor 16 for rotating rotating filter 14, and rotation A filter moving motor 17 is provided for moving the filter 14 in the radial direction (the arrow direction shown in FIG. 2 and the direction perpendicular to the optical path of the rotary filter 14).

  The configuration of the rotary filter 14 is shown in FIG. As shown in FIG. 3, the rotary filter 14 includes a G filter 14a that transmits green component light (hereinafter referred to as G component) and an R filter 14b that transmits red component light (hereinafter referred to as R component). And a B1 filter 14c that transmits light of a first blue component (hereinafter referred to as B1 component), a B2 filter 14d that transmits light of a second blue component (hereinafter referred to as B2 component), and light A light shielding portion 14e for shielding light.

  FIG. 4 shows the spectral characteristics of the surface sequential light emitted from the rotary filter 14. In FIG. 4, R represents light transmitted through the R filter 14b, G represents light transmitted through the G filter 14a, B1 represents light transmitted through the B1 filter 14c, and B2 represents light transmitted through the B2 filter 14d.

  Further, Rs, Gs, and Bs in FIG. 4 represent spectral sensitivity characteristics of the image sensor 22 described later. The filters 14a to 14d of the rotary filter 14 are configured such that light transmitted through the filters 14a to 14d is detected by the image sensor 22 having spectral sensitivity characteristics as shown in FIG.

  The B1 filter 14c and the B2 filter 14d are provided for capturing a narrowband image. As an example of specific spectral characteristics, for example, as the B1 filter 14c, an absorption peak of hemoglobin is used. And having a bandpass characteristic with a half-value width of 20 to 40 nm is used, and the B2 filter 14d having a bandpass characteristic with a half-value width of 20 to 40 nm including 430 nm which is an absorption peak of hemoglobin is used. can do.

  In the present embodiment, the filter configuration is as described above in order to capture a blue component narrow band image. However, the type of the narrow band image is not limited to this, and for example, a red component or a green component is narrow. A band image may be captured, and in that case, a filter corresponding to the narrow band image may be provided.

  The scope unit 20 includes an imaging optical system 21, an image sensor 22, a CDS / AGC circuit 23, an A / D converter 24, and a CCD driver 25, and each component is controlled by a scope controller 26. The imaging element 22 is made of, for example, a CCD or a CMOS, and obtains image information by photoelectrically converting the observation target image formed by the imaging optical system 21. As the image sensor 22, for example, a primary color image sensor having an RGB color filter having spectral sensitivity characteristics as shown in FIG. 4 can be used. The operation of the image sensor 22 is controlled by the CCD drive unit 25. When the image sensor 22 acquires an image signal, a CDS / AGC (correlated double sampling / automatic gain control) circuit 23 samples and amplifies the signal, and an A / D converter 24 is output from the CDS / AGC circuit 23. The obtained image signal is A / D converted, and the image signal is output to the processor unit 30.

  An illumination window 28 is provided at the distal end of the scope unit 20, and the other end of the light guide 11 whose one end is connected to the illumination light unit 10 faces the illumination window 28.

  The processor unit 30 acquires image signals of R component, G component, B1 component, and B2 component generated based on the image captured by the imaging element 22 of the scope unit 20 by irradiation of the illumination light L0 to the observation target. An RGB signal acquisition unit 31, a spectral image generation unit 32 that performs spectral image processing on the image signal acquired by the RGB signal acquisition unit 31 using estimation matrix data to generate a spectral estimation image signal of a predetermined wavelength; A storage unit 33 that stores estimation matrix data used for performing spectral image processing in the spectral image generation unit 32, an image signal acquired in the RGB signal acquisition unit 31, and a spectral generated in the spectral image generation unit 32. A narrowband image signal representing two narrowband images and a normal image signal representing a normal image based on the estimated image signal; An image signal acquisition unit 34 to be acquired, a display signal generation unit 35 that generates a display image signal by performing various processes on the narrowband image signal and the normal image signal acquired by the image signal acquisition unit 34, and a processor And a control unit 36 that controls the unit 30, the scope unit 20, and the illumination light unit 10. The operation of each part will be described in detail later.

  The storage unit 33 of the processor unit 30 stores first estimation matrix data and second estimation matrix data as shown in FIG. The first estimation matrix data is a blue component having a spectral characteristic as shown by a broken line in FIG. 4, for example, of a first narrowband image signal acquired by irradiation with light of B1 component (hereinafter referred to as B1 light). It is converted into a B component normal image signal presumed to be acquired when the B light is irradiated. The second estimation matrix data is a blue component having a spectral characteristic as shown by a broken line in FIG. 4, for example, of a second narrowband image signal acquired by irradiation with B2 component light (hereinafter referred to as B2 light). It is converted into a B component normal image signal presumed to be acquired when the B light is irradiated.

  For the first estimation matrix data and the second estimation matrix data, specifically, when a predetermined observation target is irradiated with B1 light, R light and G light, B2 light, R light and G light, respectively. Measurement data relating to the spectral reflection intensity distribution is acquired, and a matrix for estimating the spectral reflection intensity distribution of the observation target under the observation conditions is obtained based on Winner estimation.

  The display device 2 includes a liquid crystal display device, a CRT, and the like, and displays a normal image, a first narrowband image, a second narrowband image, and the like based on a display image signal output from the processor unit 30. Is.

  Next, the operation of the endoscope system of this embodiment will be described.

  First, after the insertion portion of the scope unit 20 is inserted into the body cavity, the xenon lamp 12 of the illumination light unit 10 is driven based on a control signal from the control unit 36 of the processor unit 30, and white light is emitted from the xenon lamp 12. Is ejected.

  At the same time as the white light is emitted from the xenon lamp 12, the rotary filter 14 is rotated by the rotary filter motor 16. Here, the rotation speed of the rotary filter 14 is controlled so that the time during which the rotary filter rotates once corresponds to the frame rate of the imaging device 22 of the scope unit 20. That is, when the frame rate is 60 fps, the rotation speed of the rotation filter 14 is controlled so that the time for one rotation of the rotation filter 14 is 1/60 second.

  In addition, the rotation of the rotary filter 14 is started as described above, and the movement of the rotary filter 14 in the radial direction by the filter moving motor 17 is started. Specifically, the rotation filter 14 is moved in the radial direction every time the rotation filter 14 makes one rotation, and the white light irradiation to the B1 filter 14c and the white light irradiation to the B2 filter 14d are performed every rotation. Can be switched.

  By the operation of the xenon lamp 12 and the rotary filter 14 as described above, surface sequential light (B1 light, G light, R light, and B2 light) having an irradiation pattern as shown in FIG. 6 is sequentially emitted from the rotary filter 14 and collected. The light is incident on one end of the light guide 11 through the optical lens 15. That is, B1 light, G light, and R light are sequentially incident, and then B2 light, G light, and R light are sequentially incident, and then the same pattern (B1 light → G light → R light → B2 light → G light → R light) is repeatedly incident.

Then, the surface sequential light guided by the light guide 11 is emitted from the other end of the light guide 11 and irradiated onto the observation target through the illumination window 28. Then, the reflected lights L _R , L _G , L _B1 , and L _B2 reflected from the observation object by the irradiation of the surface sequential light are incident on the imaging optical system 21 of the scope unit 20. An image to be observed is formed on the imaging surface. Then, the image pickup element 22 driven by the CCD drive unit 25 picks up an image to be observed, and outputs R component, G component, B1 component, and B2 component image signals. This image signal is subjected to correlated double sampling and amplification by automatic gain control in the CDS / AGC circuit 23, and then A / D converted by the A / D converter 24 and input to the processor unit 30 as a digital signal.

The R component, G component, B1 component, and B2 component image signals output from the scope unit 20 are acquired by the RGB signal acquisition unit 31 of the processor unit 30. More specifically, as shown in FIG. 7, first, an image signal B1 _{1 of the} B1 component based on the reflected light L _B1 is acquired by irradiation with the surface sequential light of the irradiation pattern as shown in FIG. , the image signal G ₁ of the G component based on the reflected light L _G is acquired, then the image signals R ₁ of the R component based on the reflected light L _R is obtained.

Then, the image signal B _{1 1} , the image signal G ₁ , and the image signal R ₁ acquired by the RGB signal acquisition unit 31 are output to the image signal acquisition unit 34 and the spectral image generation unit 32.

Then, the spectral image generation unit 32 performs spectral image processing on the input image signals B1 ₁ , G ₁ , R ₁ using the first estimated matrix data. Specifically, the spectral image processing is performed by calculating the following expression.

Then, the spectral image generation unit 32 generates the B component normal image signal B ₁ by performing the spectral image processing as described above, and outputs the B component normal image signal B ₁ to the image signal acquisition unit 34. .

Then, the image signal acquisition unit 34 acquires an image signal B1 ₁ output from the RGB signal acquisition unit 31 as the first narrowband image signal, the image signal _{G 1} output from the RGB signal acquisition unit 31, _{R 1} the G component, and acquires a normal image signal B ₁ of the B component output from the spectral image generation unit 32 acquires a normal image signal of the R component.

Then, the image signal acquisition unit 34 outputs the first narrowband image signal B1 ₁ obtained as described above, the normal image signals R _1, G _1, B ₁ display signal generation unit 35 a.

The display signal generator 35 first narrowband image signal B1 ₁ and the normal image signals R _1, G _1, B ₁ and on which performs various kinds of signal processing, respectively inputted, the luminance signal Y and color difference A Y / C signal composed of the signal C is generated, and further, various signal processing such as I / P conversion and noise removal is performed on the Y / C signal, and the first narrowband image display signal and the normal image Display signals are generated and output to the display device 2. The display device 2 simultaneously displays the first narrowband image of the first frame and the normal image of the first frame based on the input first narrowband image display signal and normal image display signal. .

Next, as shown in FIG. 7, the image signal B2 ₁ to acquire the B2 component based on the reflected light _{L B2,} then, the image signal _{G 2} of the G component based on the reflected light _{L G} is obtained, then, image signals R ₂ of the R component is obtained based on the reflected light L _R.

Then, the image signal B 2 ₁ , the image signal G ₂ , and the image signal R ₂ acquired by the RGB signal acquisition unit 31 are output to the image signal acquisition unit 34 and the spectral image generation unit 32.

The spectral image generation unit 32 performs spectral image processing on the input image signals B2 ₁ , G ₂ , R ₂ using the second estimated matrix data. Specifically, the spectral image processing is performed by calculating the following expression.

The spectral image generation unit 32 generates the B component normal image signal B ₂ by performing the spectral image processing as described above, and outputs the B component normal image signal B ₂ to the image signal acquisition unit 34. .

Then, the image signal acquisition unit 34 acquires an image signal B2 ₁ that is output from the RGB signal acquisition unit 31 as the second narrowband image signals, the image signal _{G 2} outputted from the RGB signal acquisition unit 31, _{R 2} the G component, and acquires a normal image signal B ₂ and B components output from the spectral image generation unit 32 acquires a normal image signal of the R component.

Then, the image signal acquisition unit 34 outputs the second narrowband image signals B2 ₁ obtained as described above, the normal image signals R _2, G _2, B ₂ display signal generation unit 35 a.

The display signal generation unit 35, the second narrowband image signals B2 ₁ and the normal image signals R _2, G _2, B ₂ and on which performs various kinds of signal processing, respectively inputted, the luminance signal Y and color difference A Y / C signal composed of the signal C is generated, and further, various signal processing such as I / P conversion and noise removal is performed on the Y / C signal, and the second narrowband image display signal and the normal image Display signals are generated and output to the display device 2. The display device 2 simultaneously displays the second narrowband image of the first frame and the normal image of the second frame based on the input second narrowband image display signal and normal image display signal. .

Next, as shown in FIG. 7, again, the RGB signal acquisition unit 31, an image signal B1 ₂ of B1 component based on the reflected light _{L B1} is obtained, then the image signal of the G component based on the reflected light _{L G} G ₃ is obtained, then the image signals _{R 3} of the R component based on the reflected light _{L R} is obtained.

In the same manner as described above, the spectral image processing on the image signal B1 ₂ in the spectral image generation unit 32 is performed, normal image signals B ₃ and B components is generated.

Then, the image signal acquisition unit 34 acquires an image signal B1 ₂ output from the RGB signal acquisition unit 31 as the first narrowband image signal, the image signal _{G 3} that is output from the RGB signal acquisition unit 31, _{R 3} the G component, and acquires a normal image signal B ₃ and B components output from the spectral image generation unit 32 acquires a normal image signal of the R component.

Then, the image signal acquisition unit 34 outputs the first narrowband image signals B1 ₂ obtained as described above, the normal image signals R _3, G _3, B ₃ display signal generation unit 35 a.

The display signal generator 35 generates the first narrowband image display signal based on the first narrowband image signals B1 ₂ input, based on the ordinary image signal R _3, G _3, B ₃ Thus, normal image display signals are generated and output to the display device 2. Then, the display device 2 displays both the first narrowband image of the second frame and the normal image of the third frame based on the input first narrowband image display signal and normal image display signal. .

Next, as shown in FIG. 7, again, the RGB signal acquisition unit 31, the image signal B2 ₂ of B2 component based on the reflected light _{L B2} is acquired, then the image signal of the G component based on the reflected light _{L G} G ₄ is acquired, then the image signals _{R 4} of the R component based on the reflected light _{L R} is obtained.

In the same manner as described above, the spectral image processing on the image signal B2 ₂ is carried out in the spectral image generation unit 32, normal image signals B ₄ of the B component is generated. Then, the image signal acquisition unit 34 acquires an image signal B2 ₂ that is output from the RGB signal acquisition unit 31 as the second narrowband image signals, the image signal _{G 4} that is output from the RGB signal acquisition unit 31, _{R 4} the G component, and acquires a normal image signal B ₄ of the B component outputted from the spectral image generation unit 32 acquires a normal image signal of the R component.

Then, the display signal generation unit 35 generates a second narrowband image display signal based on the second narrowband image signal B22 ₂ and a normal image display signal based on the normal image signals R ₄ , G ₄ , and B _4. Then, the display device 2 displays both the second narrowband image of the second frame and the normal image of the fourth frame based on the first narrowband image display signal and the normal image display signal.

  Then, by repeating the same processing as described above, three images of the first narrowband image, the second narrowband image, and the normal image are simultaneously displayed on the display device 2. However, since the first narrowband image and the second narrowband image are displayed every other frame, their frame rate is half that of the normal image. That is, when the frame rate of the normal image is 60 fps, the frame rate of the first narrowband image and the second narrowband image is 30 fps.

Table 1 below shows the relationship between the image displayed on the display device 2 and the frame.

  Further, in the endoscope system 1 of the above embodiment, the rotary filter 14 in the illumination light unit 10 is configured as shown in FIG. 3, but the present invention is not limited to this, and for example, the rotary filter shown in FIG. 18, two R filters 18 c, two G filters 18 b, one B1 filter 18 a, and one B2 filter 18 b are used, and these are used as a B1 filter 18 a, a G filter 18 b, and an R filter. You may make it irradiate the surface sequential light of an irradiation pattern as shown in FIG. 6 by arranging in order of the filter 18c, B2 filter 18d, G filter 18b, and R filter 18c. Reference numeral 18e denotes a light shielding portion.

  In the endoscope system 1 of the above embodiment, the illumination light is irradiated to the observation target by providing the light guide 11 in the illumination light unit 10 and the scope unit 20 as shown in FIG. For example, as in the endoscope system 5 shown in FIG. 9, LEDs 40 a to 40 d and irradiation lenses that respectively emit B1 light, G light, R light, and B2 light at the distal end of the insertion portion of the scope unit 20. 41, and the LEDs 40a to 40d may be driven and controlled by the LED driving unit 40 to irradiate the observation target with B1 light, G light, R light, and B2 light in an irradiation pattern as shown in FIG. . In the endoscope system 5 shown in FIG. 9, not only the irradiation pattern as shown in FIG. 6, but the R light and the B light are always continuously irradiated, and only the B1 light and the B2 light are different. You may make it irradiate by frame timing alternately. About another structure, it is the structure similar to the endoscope system 1 shown in FIG.

  In the endoscope system of the above-described embodiment, two filters, a B1 filter 14c that transmits B1 component light and a B2 filter 14d that transmits B2 component light, are provided as blue component filters. However, only one of the filters may be provided. Since the operation in this case is almost the same as that of the above embodiment, it will be briefly described below.

  First, at the same time when white light is emitted from the xenon lamp 12, the rotary filter 14 is rotated by the rotary filter motor 16.

  For example, when only the B1 filter 14 that transmits the B1 component light is provided by the rotation operation of the rotary filter 14, B1 light, G light, and R light are sequentially emitted from the rotary filter 14 and collected. The light is incident on one end of the light guide 11 through the optical lens 15.

Then, the surface sequential light guided by the light guide 11 is emitted from the other end of the light guide 11 and irradiated onto the observation target through the illumination window 28. Then, the reflected lights L _R , L _G , and L _B1 reflected from the observation target by the irradiation of the surface sequential light are incident on the imaging optical system 21 of the scope unit 20, and are applied to the imaging surface of the imaging element 22 by the imaging optical system 21. An image to be observed is formed. Then, the image pickup element 22 driven by the CCD drive unit 25 picks up an image to be observed, and outputs R component, G component, and B1 component image signals. This image signal is subjected to correlated double sampling and amplification by automatic gain control in the CDS / AGC circuit 23, and then A / D converted by the A / D converter 24 and input to the processor unit 30 as a digital signal.

  Then, the R component, G component, and B1 component image signals output from the scope unit 20 are acquired by the RGB signal acquisition unit 31 of the processor unit 30.

Then, the image signal B _{1 1} , the image signal G ₁ , and the image signal R ₁ acquired by the RGB signal acquisition unit 31 are output to the image signal acquisition unit 34 and the spectral image generation unit 32.

Then, the spectral image generation unit 32 performs spectral image processing on the input image signals B1 ₁ , G ₁ , R ₁ using the first estimated matrix data. The calculation method of the spectral image processing is the same as in the above embodiment.

Then, the spectral image generation unit 32 generates the B component normal image signal B ₁ by performing the spectral image processing as described above, and outputs the B component normal image signal B ₁ to the image signal acquisition unit 34. .

Then, the image signal acquisition unit 34 acquires an image signal B1 ₁ output from the RGB signal acquisition unit 31 as a narrow-band image signals, the image signal _{G 1} output from the RGB signal acquisition unit 31, the _{R 1} G component The B component normal image signal B ₁ output from the spectral image generation unit 32 is acquired as well as the R component normal image signal.

Then, the image signal acquisition unit 34 outputs the narrow-band image signal B1 ₁ acquired as described above and the normal image signals R ₁ , G ₁ , B ₁ to the display signal generation unit 35.

The display signal generator 35 performs various signal processing on the input narrowband image signal B1 ₁ and normal image signals R ₁ , G ₁ , B ₁ , respectively, and uses the luminance signal Y and the color difference signal C as a result. The generated Y / C signal is generated, and further, various signal processing such as I / P conversion and noise removal is performed on the Y / C signal, and the first narrowband image display signal and the normal image display signal Are output to the display device 2. Then, the display device 2 simultaneously displays the narrowband image of the first frame and the normal image of the first frame based on the input narrowband image display signal and normal image display signal.

  Then, the same processing as described above is repeated, and the narrowband image and the normal image are updated and displayed for each frame.

  Further, in the endoscope systems 1 and 5 of the above-described embodiment, the primary color type image pickup device having RGB color filters is used as the image pickup device of the scope unit 20; May be used.

  In the above description, an example in which an embodiment of the image acquisition device of the present invention is applied to an endoscope system has been described. However, the present invention is not limited thereto, and can be applied to, for example, a laparoscope and a colposcope. . In addition, if an LED is used as a light source as in the endoscope system 5 shown in FIG. 9, it can be applied to a capsule endoscope.

The block diagram which shows schematic structure of the endoscope system using one Embodiment of the image acquisition apparatus of this invention. The figure which shows the detailed structure of the illumination light unit in the endoscope system shown in FIG. The figure which shows the structure of the rotation filter in the illumination light unit shown in FIG. The figure which shows the spectral characteristic of the surface sequential light inject | emitted from the rotary filter shown in FIG. The figure for demonstrating the estimation matrix data memorize | stored in the memory | storage part of the endoscope system shown in FIG. The figure which shows an example of the irradiation pattern of a field sequential light The figure which shows the acquisition timing of each image signal The figure which shows the other structure of a rotation filter The block diagram which shows schematic structure of the endoscope system using other embodiment of the image acquisition apparatus of this invention.

Explanation of symbols

1,5 Endoscope system 2 Display device 10 Illumination light unit 11 Light guide 12 Xenon lamp 13 Aperture device 14 Rotating filter 14a G filter 14b R filter 14c B1 filter 14d B2 filter 14e Light shielding unit 15 Condensing lens 16 Rotating filter motor 17 Filter moving motor 18 Rotating filter 18a B1 filter 18b G filter 18c R filter 18d B2 filter 20 Scope unit 21 Imaging optical system 22 Image sensor 23 CDS / AGC circuit 24 A / D converter 25 CCD drive unit 26 Scope controller 28 Illumination window 30 processor unit 31 RGB signal acquisition unit 32 spectral image generation unit (spectral image processing unit)
33 Storage Unit 34 Image Signal Acquisition Unit 35 Display Signal Generation Unit 36 Control Unit 40 LED Drive Unit 41 Irradiation Lens

Claims (6)

In an image acquisition device that includes an imaging device that receives reflected light reflected from the observation target by irradiating the observation target and captures an image of the observation target, and acquires an image signal output from the imaging device ,
The observation object is sequentially irradiated with a plurality of lights having different wavelength bands with respect to at least one of the light of at least three wavelength bands, and the light having a wavelength band other than the at least one color is applied to the observation object. A light irradiation unit for irradiation
Image signals of a plurality of wavelength components sequentially output from the imaging device by irradiating the observation target with a plurality of lights in different wavelength bands are sequentially acquired, and each of the image signals of the plurality of wavelength components is mutually acquired. A spectral image processing unit that performs spectral image processing using different estimation matrix data, and sequentially generates a monochrome image signal of a color component to which the image signals of the plurality of wavelength components belong;
The image signals of the plurality of wavelength components are respectively acquired as narrowband image signals representing the narrowband image to be observed, and are output from the imaging device by irradiation with light of a wavelength band other than the at least one color An image signal acquisition unit that sequentially acquires normal image signals representing the normal image to be observed by combining the image signal and each monochrome image signal sequentially output from the spectral image processing unit. Image acquisition device. In an image acquisition device that includes an imaging device that receives reflected light reflected from the observation target by irradiating the observation target and captures an image of the observation target, and acquires an image signal output from the imaging device ,
Light irradiation for irradiating the observation object with light of a narrow band wavelength for at least one color of light in the wavelength bands of at least three colors and irradiating the observation object with light of a wavelength band other than the at least one color And
An image signal of a wavelength component output from the imaging device is acquired by irradiating the observation target with light of the narrowband wavelength, and spectral image processing is performed on the image signal of the wavelength component using estimated matrix data. A spectral image processing unit that generates a monochrome image signal of a color component to which the image signal of the wavelength component belongs;
The image signal of the wavelength component is acquired as a narrowband image signal representing the narrowband image of the observation target, and the image signal output from the imaging device by irradiation with light of a wavelength band other than the at least one color An image acquisition apparatus comprising: an image signal acquisition unit that acquires a normal image signal representing the normal image to be observed in combination with a monochrome image signal output from the spectral image processing unit. Image acquisition apparatus according to claim 1, wherein further comprising a display unit further displaying a normal image based on narrow-band image and the normal image signal based on the narrowband image signal at the same frame timing. A display unit for displaying a narrowband image based on the narrowband image signal and a normal image based on the normal image signal at the same frame timing;
The display unit, an image acquisition apparatus according to claim 1, wherein a is for displaying sequentially different frame timing a plurality of narrow-band image based on a plurality of the narrow-band image signal. Wherein the at least one color, an image acquisition apparatus according to claim 1 to 4 any one of claims, characterized in that the blue. The at least one color is blue;
Mutually different wavelength bands of the blue is an image acquisition apparatus according to claim 1 or 4, wherein that in the 430nm near and 500nm near.

Images