JP6505072B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing method for processing an image of a subject.

  Optical coherence tomography (hereinafter referred to as "OCT") using multi-wavelength light wave interference can obtain a tomographic image of a sample (in particular, a fundus) with high resolution.

  Recently, in an ophthalmic OCT apparatus, in addition to a normal OCT image for imaging the shape of the fundus tissue, a polarized OCT image for imaging using a polarization parameter (retardation and orientation) which is one of the optical characteristics of the fundus tissue It has been acquired.

  Polarized OCT can use polarization parameters to construct a polarized OCT image to distinguish or segment fundus tissue. Polarized OCT uses light modulated into circularly polarized light as measurement light for observing a sample, divides and detects interference light as two orthogonal linear polarized lights, and generates a polarized OCT image (see Patent Document 1).

WO 2010/122118 A1

  However, Patent Document 1 does not disclose diagnostic support, which is the original purpose of polarized OCT, specifically, a method for automatically detecting a retinal layer of an eye from a polarized OCT image.

  One of the objects of the present invention is to enable a user to effectively confirm an image showing a polarization state.

One of the image processing apparatuses according to the present invention is
A planar image obtaining means for obtaining a planar image of the test eye,
And the tomographic image obtaining means for obtaining a plurality of polarization tomographic image indicating the different polarization properties of the test eye,
A display means for displaying at least one of the plurality of polarization tomographic images is displayed on a display means, and the planar image and the selected at least one polarization tomographic image are displayed side by side on the display means, the display Display control means for causing the display means to display a display mode indicating the type of at least one polarization tomographic image corresponding to the displayed at least one polarization tomographic image;
The plurality of polarization tomographic images include a retardation image and a DOPU image, and the display mode for the selection is a display mode for selecting at least one of the retardation image and the DOPU image.

  According to one of the present invention, it is possible to allow a user to effectively confirm an image showing a polarization state.

BRIEF DESCRIPTION OF THE DRAWINGS Schematic of the whole structure of the image processing apparatus in this embodiment. The example of the image produced | generated by the signal processing part 190. FIG. Processing flow in the present embodiment. 6 is a display example on the display screen of the display unit of the image processing apparatus according to the present embodiment. The figure for demonstrating the retinal layer detection which concerns on this embodiment. The figure for demonstrating the retinal layer detection which concerns on this embodiment. 6 is a display example on the display screen of the display unit of the image processing apparatus according to the present embodiment. The example of a display on the display screen of the display part of the image processing apparatus which concerns on another embodiment.

Imaging device according to the present invention can be applied to the subject eye is subject body. As the imaging apparatus according to the present invention, for example, an ophthalmic equipment. Hereinafter, an ophthalmologic apparatus according to the present embodiment will be described in detail as an example of the present invention with reference to the drawings.

[Overall configuration of device]
FIG. 1 is a schematic view of the entire configuration of an “ophthalmologic apparatus” which is an example of the imaging apparatus according to the present embodiment. Note that at least a part of the signal processing unit 190 described later can be regarded as an "image processing apparatus", and in this case, the entire "ophthalmologic apparatus" or the "imaging system" It can also be regarded as

  This device includes polarized OCT (Polarization Sensitive OCT; hereinafter, PS-OCT) 100, Polarization Sensitive Scanning Laser Ophthalmoscope (hereinafter, PS-SLO) 140, anterior segment imaging unit 160, internal A fixation lamp 170 and a control unit 200 are provided.

  With the internal fixation lamp 170 turned on and focused on the subject's eye, alignment of the apparatus is performed using the image of the anterior segment of the subject observed by the anterior segment observation unit 160. After alignment is completed, imaging of the fundus by PS-OCT 100 and PS-SLO 140 is performed.

<Configuration of PS-OCT 100>
The configuration of the PS-OCT 100 will be described.

  The light source 101 is an SLD light source (Super Luminescent Diode) which is a low coherent light source, and emits, for example, light having a central wavelength of 850 nm and a bandwidth of 50 nm. Although the SLD is used as the light source 101, any light source that can emit low coherent light such as an ASE light source (Amplified Spontaneous Emission) may be used.

  The light emitted from the light source 101 is guided to a fiber coupler 104 having a polarization maintaining function through a PM (Polarization Maintaining) fiber 102 and a polarization controller 103, and the measurement light (hereinafter, "measurement light for tomographic image") And “OCT measurement light”) and reference light corresponding to the measurement light.

  The polarization controller 103 adjusts the polarization state of the light emitted from the light source 101, and is adjusted to linear polarization. The branching ratio of the fiber coupler 104 is 90 (reference light): 10 (measurement light).

  The measurement light is emitted from the collimator 106 as parallel light through the PM fiber 105. The emitted measurement light comprises an X scanner 107 consisting of a galvano mirror that scans the measurement light in the horizontal direction on the fundus Er, lenses 108 and 109, and a galvano mirror that scans the measurement light in the vertical direction on the fundus Er The light reaches the dichroic mirror 111 via the Y scanner 110. The X scanner 107 and the Y scanner 110 are controlled by the drive control unit 180, and can scan the measurement light in a desired range of the fundus Er. The range on the fundus in which the measurement light is scanned can be regarded as the acquisition range of the tomographic image, the acquisition position of the tomographic image, and the irradiation position of the measurement light. The X scanner 107 and the Y scanner 110 are an example of a scanning unit for PS-OCT, and may be configured as a common XY scanner. The dichroic mirror 111 has a characteristic of reflecting light of 800 nm to 900 nm and transmitting light other than that.

  The measurement light reflected by the dichroic mirror 111 passes through the lens 112 and passes through the λ / 4 polarizing plate 113 disposed at an angle of 45 ° with respect to the S-polarization from the P-polarization with the optical axis as the rotation axis. Is 90 ° out of phase, and is polarization controlled to circularly polarized light. The λ / 4 polarizing plate 113 is an example of a polarization adjusting member for measuring light which adjusts the polarization state of the measuring light. Here, in the case of applying a PS-SLO optical system described later, the λ / 4 polarizing plate 113 can be provided on a common optical path between a part of the PS-OCT optical system and a part of the PS-SLO optical system. Thereby, the dispersion | variation in the polarization state which arises in the image acquired by PS-SLO optical system, and the image acquired by PS-OCT optical system can be suppressed comparatively. At this time, the scanning unit for PS-SLO and the scanning unit for PS-OCT are provided at mutually conjugate positions, and can be provided at positions conjugate to the pupil of the eye to be examined. The inclination of the λ / 4 polarizing plate 113 is an example of the state of the λ / 4 polarizing plate 113. For example, the inclination of the λ / 4 polarizing plate 113 is a predetermined angle with the optical axis of the polarization splitting surface of the fiber coupler 123 incorporating the polarization beam splitter It is the angle from the position.

  Also, the λ / 4 polarizing plate 113 can be configured to be insertable into and removable from the optical path. For example, a mechanical configuration may be considered in which the λ / 4 polarizing plate 113 is rotated with the optical axis or an axis parallel to the optical axis as a rotation axis. As a result, it is possible to realize a compact device that can easily switch between the SLO optical system and the PS-SLO optical system. In addition, a compact device capable of easily switching between the OCT optical system and the PS-OCT optical system can be realized.

  Here, light incident on the eye to be examined is polarization-controlled to circularly polarized light by setting the λ / 4 polarizing plate at an angle of 45 °, but it is not circularly polarized at the fundus Er due to the characteristics of the eye to be examined There is. Therefore, by the control of the drive control unit 180, the inclination of the λ / 4 polarizing plate can be finely adjusted.

  The measurement light whose polarization is controlled to be circularly polarized light is focused on the retinal layer of the fundus oculi Er by the focusing lens 114 mounted on the stage 116 via the anterior eye Ea of the eye as the object. The measurement light irradiated to the fundus Er is reflected and scattered by each retinal layer, and the above optical path is returned to the fiber coupler 104.

  On the other hand, the reference light branched by the fiber coupler 104 is emitted from the collimator 118 as parallel light through the PM fiber 117. Like the measurement light, the emitted reference light is polarization controlled by a λ / 4 polarizing plate 119 disposed at an angle of 22.5 ° from P polarization to S polarization with the optical axis as the rotation axis. The λ / 4 polarizing plate 119 is an example of a polarization adjusting member for reference light which adjusts the polarization state of the reference light. The reference light is reflected by the mirror 122 on the coherence gate stage 121 through the dispersion compensation glass 120 and returns to the fiber coupler 104. The reference light passes through the λ / 4 polarizing plate 119 twice so that the linearly polarized light returns to the fiber coupler 104.

  The coherence gate stage 121 is controlled by the drive control unit 180 in order to cope with the difference in the axial length of the subject and the like. The coherence gate is a position corresponding to the optical path length of the reference light in the optical path of the measurement light. In the present embodiment, the optical path length of the reference light is changed, but the optical path length difference between the optical path of the measurement light and the optical path of the reference light may be changed.

  The return light returned to the fiber coupler 104 and the reference light are multiplexed to become interference light (hereinafter, also referred to as “multiplexed light”), which is incident on the fiber coupler 123 incorporating a polarization beam splitter and is light of different polarization directions The light is split into light of a certain P polarization and light of S polarization with a branching ratio of 50:50.

  The P-polarized light is split by the grating 131 through the PM fiber 124 and the collimator 130, and is received by the lens 132 and the line camera 133. Similarly, S-polarized light is dispersed by the grating 127 through the PM fiber 125 and the collimator 126 and received by the lens 128 and the line camera 129. The gratings 127 and 131 and the line cameras 129 and 133 are disposed in alignment with the direction of each polarization.

  The light received by each of the line cameras 129 and 133 is output as an electrical signal according to the intensity of the light, and is received by a signal processing unit 190 which is an example of a tomographic image generation unit.

  The tilt of the λ / 4 polarizing plates 113 and 119 can be automatically adjusted on the basis of the tilt of the polarization splitting surface of the polarization beam splitter, but it is automatic with respect to the straight line connecting the optic disc center of the fundus and the macular center. You may adjust it. At this time, it is preferable to have an inclination detection unit (not shown) that detects the inclination of the λ / 4 polarizing plates 113 and 119. The inclination detection unit can detect that the current inclination and the predetermined inclination have been achieved. Of course, the inclination of the λ / 4 polarizing plates 113 and 119 may be detected based on the intensity of the received light, and the inclination may be adjusted to be a predetermined intensity. Note that, as described later, an object indicating inclination may be displayed on the GUI, and the user may make adjustment using the mouse. Also, the same effect can be obtained by adjusting the polarization beam splitter and the λ / 4 polarizing plates 113 and 119 based on the vertical direction as the polarization reference.

<Configuration of PS-SLO 140>
The configuration of the PS-SLO 140 will be described.

  The light source 141 is a semiconductor laser, and emits, for example, light having a central wavelength of 780 nm in the present embodiment. The measurement light (hereinafter also referred to as “measurement light for fundus image” or “SLO measurement light”) emitted from the light source 141 is polarization controlled by the polarization controller 145 via the PM fiber 142 so as to be linearly polarized It is emitted from 143 as parallel light. The emitted measurement light passes through the perforated portion of the perforated mirror 144 and passes through the lens 155 to scan the measurement light in the horizontal direction on the fundus Er by the X scanner 146 composed of a galvano mirror, lenses 147 and 148, and the fundus The light beam reaches the dichroic mirror 154 via the Y scanner 149 configured of a galvano mirror that scans the measurement light in the vertical direction at Er. The X scanner 146 and the Y scanner 149 are controlled by the drive control unit 180, and can scan a desired range with the measurement light on the fundus. The X scanner 146 and the Y scanner 149 are an example of a scanning unit for PS-SLO, and may be configured as a common XY scanner. The dichroic mirror 154 has a characteristic of reflecting 760 nm to 800 nm and transmitting light other than that.

  The linearly polarized measurement light reflected by the dichroic mirror 154 passes through the same optical path as that of the PS-OCT 100 and reaches the fundus Er.

  The measurement light irradiated to the fundus Er is reflected and scattered by the fundus Er, follows the above optical path, and reaches the perforated mirror 144. The light reflected by the perforated mirror 144 is divided into light of different polarization directions (in the present embodiment, light of P polarization and light of S polarization) by the polarization beam splitter 151 via the lens 150, and an avalanche photodiode The light is received by the (APD) 152 and 153, converted into an electric signal, and received by the signal processing unit 190 which is also an example of a fundus image generation unit.

  Here, the position of the perforated mirror 144 is conjugate to the pupil position of the eye to be examined, and of the light reflected and scattered from the measurement light emitted to the fundus Er, the light passing through the pupil peripheral portion is It is reflected by the perforated mirror 144.

  Although PM fibers are used for both PS-OCT and PS-SLO in this embodiment, the same configuration and effects can be obtained by controlling the polarization using a polarization controller even in a single mode fiber (SMF).

Anterior Eye Imaging Unit 160
The anterior eye imaging unit 160 will be described.

  The anterior segment imaging unit 160 illuminates the anterior segment Ea with an illumination light source 115 including LEDs 115-a and 115-b that emit illumination light having a wavelength of 1000 nm. The light reflected by the anterior segment Ea reaches the dichroic mirror 161 via the lens 114, the polarizing plate 113, the lens 112, and the dichroic mirrors 111 and 154. The dichroic mirror 161 has a characteristic of reflecting light of 980 nm to 1100 nm and transmitting light other than that. The light reflected by the dichroic mirror 161 is received by the anterior eye camera 165 through the lenses 162, 163, and 164. The light received by the anterior eye camera 165 is converted into an electrical signal and received by the signal processing unit 190.

<Internal fixation lamp 170>
The internal fixation lamp 170 will be described.

  The internal fixation lamp 170 includes an internal fixation lamp display section 171 and a lens 172. A plurality of light emitting diodes (LDs) arranged in a matrix is used as the internal fixation lamp display section 171. The lighting position of the light emitting diode is changed in accordance with the part to be imaged by the control of the drive control unit 180. The light from the internal fixation lamp display section 171 is guided to the subject's eye through the lens 172. The light emitted from the internal fixation lamp display unit 171 is 520 nm, and the control unit 180 displays a desired pattern.

<Control unit 200>
The control unit 200 for controlling the entire apparatus will be described.

  The control unit 200 includes a drive control unit 180, a signal processing unit 190, a display control unit 191, and a display unit 192.

  The drive control unit 180 controls each unit as described above.

  The signal processing unit 190 includes an image generation unit 193 and an image analysis unit 194. The signal processing unit 190 generates an image, analyzes the generated image, and generates visualization information of an analysis result based on the signals respectively output from the line cameras 129 and 133, the APDs 152 and 153, and the anterior segment camera 165. . The details of generation and analysis of the image will be described later.

  The display control unit 191 displays, for example, an image obtained by acquiring an image generated by the tomographic image generation unit and the fundus image generation unit by the fundus image acquisition unit (not illustrated) and the tomographic image acquisition unit (not illustrated). Display on the display screen of. Here, the display unit 192 is, for example, a display such as liquid crystal. The image data generated by the signal processing unit 190 may be transmitted to the display control unit 191 by wire or may be transmitted wirelessly. In this case, the display control unit 191 can be regarded as an image processing apparatus. As the imaging system, the fundus image acquisition unit may include the SLO optical system, and the tomographic image acquisition unit may include the OCT optical system. In the present specification, in the case of a subject other than the eye to be examined, "fundus oculi image (fundus oculi luminance image)" can be translated into "planar image (planar luminance image)", and "fundus oculi image acquisition unit". In other words, “planar image acquisition unit” can be used.

  Under the control of the display control unit 191, the display unit 192 displays a display mode indicating various information as described later. The image data from the display control unit 191 may be transmitted to the display unit 192 by wire or may be transmitted wirelessly. Although the display unit 192 and the like are included in the control unit 200, the present invention is not limited to this, and may be provided separately from the control unit 200. Moreover, the tablet which is an example of the apparatus which the user comprised by which the display control part 191 and the display part 192 were comprised integrally may be sufficient. In this case, it is preferable that the display unit be equipped with a touch panel function so that operations such as movement of display position of an image, enlargement / reduction, change of an image to be displayed, etc. can be performed on the touch panel.

[Image processing]
Next, image generation in the image generation unit 193 constituting the signal processing unit 190 will be described.

  The image generation unit 193 performs reconstruction processing used for general SD-OCT (Spectral Domain OCT) on each interference signal output from the line cameras 129 and 133, based on each polarization component. A tomographic image corresponding to the first polarization, which is two tomographic images, and a tomographic image corresponding to the second polarization are generated.

  First, the image generation unit 193 performs fixed pattern noise removal from the interference signal. Fixed pattern noise removal is performed by extracting fixed pattern noise by averaging a plurality of detected A scan signals and subtracting the same from an input interference signal.

  Next, the image generation unit 193 converts the interference signal from wavelength to wave number and performs Fourier transform to generate a tomographic signal indicating a polarization state.

  Two tomographic images are generated by performing the above processing on the interference signal of two polarization components.

  In addition, the image generation unit 193 aligns the signals output from the APDs 152 and 153 in synchronization with the driving of the X scanner 146 and the Y scanner 149 to form two fundus images based on respective polarization components. And a fundus image corresponding to the second polarized light.

<Generation of tomographic luminance image or fundus luminance image>
The image generation unit 193 generates a tomographic luminance image from the two tomographic signals described above.

The tomographic brightness image is basically the same as the tomographic image in the conventional OCT, and the pixel value r thereof is calculated by the tomographic signal A _H and A _V obtained from each of the line sensors 129 and 133 by Equation 1 .

  Similarly, a fundus luminance image is generated from two fundus images.

  FIG. 2A shows an example of the luminance image of the optic disc.

  Note that the display control unit 191 may cause the display unit 192 to display a tomographic luminance image acquired by the conventional OCT method when the λ / 4 polarizing plate 113 is removed from the optical path. The fundus oculi luminance image acquired by the method may be displayed on the display unit 192.

<Generation of retardation image>
The image generation unit 193 generates a retardation image from tomographic images of polarization components orthogonal to each other.

The value δ of each pixel of the retardation image is a value indicating the ratio of the vertical polarization component and the horizontal polarization component to be affected by the eye at the position of each pixel constituting the tomographic image, and each tomographic signal A _H and It is calculated from A _V by (equation 2).

  FIG. 2 (b) shows an example of the retardation image of the optic nerve papilla thus generated, which can be obtained by calculating (Equation 2) for each B-scan image. Here, as described above, the retardation image is a tomographic image that shows the difference in the influence of the two polarized lights on the subject's eye. In FIG. 2 (b), the value indicating the above ratio is displayed in color as a tomographic image, where the dark and light places indicate small values indicating the above ratio, and the light and dark places indicate large values indicating the above ratio. It represents. Therefore, by generating a retardation image, it is possible to grasp a layer having birefringence. The details are as described in "E. Gotzinger et al., Opt. Express 13, 10217, 2005".

  Similarly, the signal processing unit 190 can also generate a retardation image in the plane direction of the fundus based on the outputs from the APDs 152 and 153.

<Generation of retardation map>
The image generation unit 193 generates a retardation map from the retardation images obtained for a plurality of B-scan images.

  First, the image generation unit 193 detects retinal pigment epithelium (hereinafter, also referred to as “RPE”) in each B scan image. Since RPE has the property of depolarizing, each A scan is examined for the distribution of retardation in the range not including RPE from the inner boundary film (hereinafter also referred to as “ILM”) along the depth direction, and its maximum The value is taken as a representative value of retardation in the A scan.

  The image generation unit 193 generates a retardation map by performing the above processing on all retardation images.

  An example of a retardation map of the optic disc is shown in FIG. The dark and light places indicate that the value indicating the above ratio is small, and the light and dark places indicate that the value indicating the above ratio is large. In the optic nerve head, a layer having birefringence is a retinal nerve fiber layer (hereinafter also referred to as "RNFL"), and in the retardation map, two polarizations are received by RNFL birefringence and RNFL thickness. It is an image which shows the difference in influence. Therefore, the value indicating the above ratio becomes large at a portion where RNFL is thick, and the value indicating the above ratio becomes small at a portion where RNFL is thin. Therefore, the thickness of the RNFL of the entire fundus can be grasped by the retardation map, and can be used for diagnosis of glaucoma.

<Generation of birefringence map>
The image generation unit 193 linearly approximates the value of retardation δ in the range from ILM to RNFL in each A scan image of the retardation image generated earlier, and the inclination thereof is the position of the A scan image on the retina. Determined as birefringence. That is, since the retardation is the product of the distance and birefringence in the RNFL, a linear relationship can be obtained by plotting the values of depth and retardation in each A-scan image. Therefore, linear approximation is performed on this plot by the method of least squares or the like, and the inclination thereof is obtained, which becomes the value of RNFL birefringence in the A-scan image. By performing this process on all acquired retardation images, a map representing birefringence is generated.

  An example of a birefringence map of the optic disc is shown in FIG. 2 (d). The birefringence map maps the value of birefringence directly, so even if the thickness of the RNFL does not change, it can be depicted as a change in birefringence if the fiber structure changes.

<DOPU image generation>
The image generation unit 193 calculates a Stokes vector S for each pixel according to (Expression 3) from the acquired tomographic signals A _{H and} A _V and the phase difference ΔΦ between them.

However, ΔΦ is calculated from the phases _{H H} and _{V V of} each signal obtained when calculating two tomographic images, as ΔΦ = _{V V} −Φ _H.

  Next, the image generation unit 193 sets windows of about 70 μm and about 18 μm in the main scanning direction and in the depth direction of each B-scan image in the main scanning direction of the measurement light, and is calculated for each pixel by several C in each window. Each element of the Stokes vector is averaged, and the uniformity of polarization DOPU (Degree Of Polarization Uniformity) in the window according to (Equation 4) is calculated according to (Equation 4).

However, Q _m , U _m and V _m are values obtained by averaging the elements Q, U and V of the Stokes vector in each window. By performing this process on all windows in the B-scan image, a DOPU image of the optic papilla shown in FIG. 2E is generated. Here, as described above, the DOPU image is a tomographic image showing the uniformity of two polarizations.

  DOPU is a numerical value representing the uniformity of polarization, and is close to 1 at a place where polarization is maintained, and is smaller than 1 at a place where polarization is canceled (not maintained). . In the structure in the retina, the RPE has the property of depolarizing the light, so the portion corresponding to the RPE in the DOPU image has a smaller value than other regions. In the figure, the light and dark areas 210 indicate the RPE, and the dark and light areas 220 indicate the retinal layer area where the change is maintained. Since the DOPU image is formed into an image of a depolarizing layer such as RPE, the RPE can be imaged more reliably than the change in luminance even when the RPE is deformed due to a disease or the like.

  Similarly, the signal processing unit 190 can also generate a DOPU image in the plane direction of the fundus based on the outputs from the APDs 152 and 153.

  In the present specification, the tomographic image, the retardation image, the DOPU image and the like corresponding to the first and second polarized light described above are also referred to as a tomographic image showing a polarization state. Further, in the present specification, the above-described retardation map, birefringence map, and the like will also be referred to as a fundus image showing a polarization state.

[Processing operation]
Next, the processing operation of the image processing apparatus will be described.

  FIG. 3 is a flowchart showing the processing operation of the present image processing apparatus.

<Adjustment>
First, in step S101, in a state in which the eye to be examined is disposed in the present apparatus, alignment between the present apparatus and the eye to be examined is performed. Regarding the description of alignment, processing specific to the present embodiment will be described, and alignment of the working distance and the like in the XYZ directions, focusing, adjustment of the coherence gate, and the like are general, and thus the description thereof will be omitted.

(Adjustment of PS-OCT imaging position)
FIG. 4 shows a window 400 displayed on the display unit 192 at the time of adjustment. In the display area 410 which is an example of the first display area, the fundus image 411 captured by the PS-SLO 140 and generated by the signal processing unit 190 is displayed, and the imaging range of the PS-OCT 100 is displayed on the fundus image 411. A frame 412 shown is superimposed and displayed.

  The operator designates with a cursor displayed on the window 400 using a pointing device (not shown) such as a mouse, and gives an instruction by clicking operation, dragging operation, etc., under the control of the drive control unit 180, the imaging range Settings are made. That is, the frame 412 can be moved by specifying the frame 412 with the cursor and performing a drag operation. Thus, the drive control unit 180 sets the imaging range by controlling the drive angle of the scanner. Note that the mouse of this embodiment includes, for example, a sensor that detects a movement signal when the mouse body is moved in a two-dimensional manner by the user's hand, and left and right for detecting that the user's hand has pressed it. There are provided two mouse buttons and a wheel mechanism which can be rotated back and forth and right and left between the two left and right mouse buttons. In addition, the pointing device may have a touch panel function mounted on the display unit, and specify an acquisition position on the touch panel.

(Adjustment of λ / 4 polarizing plate)
The adjustment of the λ / 4 polarizing plate 113 will be described.

  In FIG. 4, the instruction units 413 and 414 are displays for adjusting the angle of the λ / 4 polarizing plate 113, and under the control of the drive control unit 180 when the operator instructs using the instruction device, The angle of the λ / 4 polarizing plate 113 is adjusted. The instruction unit 413 is a display for instructing adjustment in the counterclockwise direction, and the instruction unit 414 is for instructing adjustment in the clockwise direction. The numerical values displayed beside the indication portions 413 and 414 represent the current angle of the λ / 4 polarizing plate 113. The display control unit 191 may display an instruction unit for adjusting the angle of the λ / 4 polarizing plate 119 side by side with the instruction unit 413 on the display unit 192, or may display it instead of the instruction unit 413. .

  The operator uses the mouse so that the luminance of the tomographic image of each polarization displayed in the display area 430, which is an example of the third display area, and the display area 440, which is an example of the fourth display area, are the same. Use the cursor to indicate. The peak luminance value may be displayed together with the tomographic images 431 and 441 of each polarization, or the waveform itself of each interference signal may be displayed, and adjustment may be performed while looking at that. Here, tomographic images 431 and 441 of respective polarizations are examples of tomographic images corresponding to the first polarization and tomographic images corresponding to the second polarization. In the tomographic images 431 and 441 (or tomographic images 531 and 541 described later) of each polarization, a display form indicating the type of each image, for example, a letter “P” indicating P polarization or S polarization It is preferable to display the letter "S" superimposed on the image. This can prevent the user from mistakenly recognizing the image. Of course, the image may be displayed on the upper side or the side of the image without overlapping the image, or may be displayed in correspondence with the image.

  Further, in the display area 420 which is an example of the second display area, nothing may be displayed at this stage, and in the case of an automatic adjustment or the like, a display form indicating the current adjustment state, for example, “λ A message such as “in adjustment of 4/4 polarizing plate” may be displayed. Further, the window 400 may display a display form indicating patient information such as left and right eyes of an eye to be examined and a display form indicating imaging information such as an imaging mode. It is preferable to repeat the insertion and removal of the λ / 4 polarizing plate 113 with respect to the optical path so as to alternately acquire a fundus luminance image and a tomographic image showing a polarization state. Thus, in the ophthalmologic apparatus as small as possible, the display control unit 191 can display, for example, a fundus luminance image in the display area 410 and display a tomographic image indicating a polarization state in the display area 420.

  Here, the order of adjustment is alignment adjustment using an anterior segment image or a corneal bright spot, focus adjustment using a fundus image indicating a polarization state, coherence gate adjustment using a tomographic image indicating a polarization state, λ / 4 The order of adjustment of the polarizing plates is preferred. Although it is preferable to determine the acquisition position of the tomographic image showing the polarization state before coherence gate adjustment using the tomographic image showing the polarization state, it is decided by the initial setting to acquire the central region of the fundus image showing the polarization state. You may do so. As a result, it is possible to easily adjust the tomographic image showing the polarization state targeting the narrow range more finely than the fundus image showing the polarization state so as to be acquired accurately. At this time, the λ / 4 polarizing plate may be automatically adjusted according to the completion of the coherence gate adjustment, or the λ / 4 polarizing plate may be automatically operated according to the input of a signal for acquiring an image showing the polarization state. You may adjust it. Of course, the λ / 4 polarizing plate may be previously adjusted on the initial setting screen or the like when the ophthalmologic apparatus is started, and may not be adjusted for each photographing.

  When the λ / 4 polarizing plate is configured to be insertable into and removable from the optical path, the order of adjustment is alignment adjustment using an anterior segment image or a corneal bright spot, and focus adjustment using an SLO fundus image. The order of adjustment of coherence gate adjustment using an OCT tomographic image, insertion of a λ / 4 polarizing plate into an optical path, and adjustment of the λ / 4 polarizing plate is preferable. Thereby, adjustment before acquisition of the image which shows a polarization state can be performed using the normal SLO fundus image and OCT tomographic image which a user intuitively gets used to. However, after the focus adjustment, after the λ / 4 polarizing plate is inserted, coherence gate adjustment may be performed using a tomographic image showing a polarization state of PS-OCT. At this time, the λ / 4 polarizing plate may be automatically inserted into the optical path according to the completion of the coherence gate adjustment or the focus adjustment, or according to the input of a signal for acquiring an image showing the polarization state. The λ / 4 polarizing plate may be automatically inserted into the light path.

  The focus adjustment may be fine focus adjustment using an OCT tomographic image after coarse focus adjustment using an SLO fundus image.

  In addition, these adjustments may be all automatically adjusted in the above order, or a cursor may be placed on a slider corresponding to each adjustment displayed on the display unit to perform a drag operation or the like. When the λ / 4 polarizing plate is inserted or removed, an icon may be displayed on the display unit for inserting the λ / 4 polarizing plate into the optical path or instructing separation from the optical path.

<Imaging> to <Image generation>
In steps S102 to S103, the measurement light is emitted from the light source 101 and the light source 141, and the return light from the retina Er is received by the line cameras 129 and 133 and the APDs 152 and 153, and the image generation unit 193 Follow the steps to generate each image.

<Analysis>
In the case of a tomographic image of a diseased eye as compared with a tomographic image of a normal eye, the luminance value of the tomographic image may be dark due to the influence of a disease, and the retinal layer may be overlooked or erroneously detected. Therefore, in step S104, the image analysis unit 194 detects each layer of the retina using the information on the portion to cancel the polarization state calculated by the image generation unit 193 in step S103.

  By calculating DOPU of (Equation 4), the RPE cancels the polarization state in the retinal layer, so the position of the RPE 210 can be detected. In addition, the entire retinal layer 220 which does not cancel the polarization state can also be detected. Thus, the luminance value of the RPE for each tomographic image can be known by referring to the luminance value of the portion corresponding to the RPE in the luminance image. Therefore, even in a tomographic image in which the overall luminance value is lowered due to the influence of a disease, the region of the entire retina layer and the position of the RPE and the luminance value corresponding to the RPE are known. Can be reduced.

  As a boundary detection method of each layer of the retina, for example, a luminance value obtained from a position obtained by DOPU calculation of (Equation 4) is used as a threshold value in layer detection. For example, a threshold used in determining boundaries of each layer in a normal eye is set in advance. Then, the RPE and the average luminance value of the entire retinal layer region are also set in advance. Compare the luminance value of RPE obtained from the position calculated by (Equation 4), the luminance value of the entire retinal layer region, and the average luminance value set in advance, and there is a% difference in luminance value In accordance with the level, the threshold value used in finding the boundary of each layer set in advance is adjusted. For example, if the luminance value of the luminance image corresponding to the RPE 210 and the retinal layer region 220 in FIG. 2E is 10% lower than the average luminance value set in advance, the threshold is lowered by 10%. Then, the image analysis unit 194 applies a median filter as one type of smoothing and a Sobel filter as one type of edge detection to the tomographic image to be processed, and the respective images (hereinafter referred to as “median” Create images (also referred to as "Sobel images"). Next, a profile is created for each A scan from the created median image and Sobel image. It is a profile of luminance values in the median image and a profile of gradients in the Sobel image. Then, the peaks in the profile created from the Sobel image are detected. The boundary of each region of the retinal layer is extracted by referring to the profile of the median image corresponding to the front and back of the detected peak and between the peaks and comparing with the threshold obtained above. Here, the boundaries of the respective regions of the retinal layer are, for example, the inner limiting membrane / ILM, the ganglion cell layer / GCL, the inner plexiform layer / IPL, the outer limiting membrane / ELM, the intraganglionic segmental junction / ISOS Etc.

  Besides, for example, the RPE 210 and the retinal layer region 220 in FIG. 2E may be used as the initial position of the graph cut which is an example of the layer boundary detection method. The graph cut is to detect an object by giving a label of an object ("obj") or a background ("bkg") to an image and performing energy function minimization with respect to regions and boundaries. The graph cut will be described with reference to FIG. FIG. 5A shows an example of the object label 510 and the background label 520. In the tomographic luminance image 500, an object label 510 is assigned to an area of the RPE 210 and a part of the retinal layer 220 in FIG. Then, the background label 520 is assigned to a partial region of several tens of pixels below the RPE 210. The graph cut is divided into an object and a background using minimum cut / maximum flow algorithm when the object and background labels are assigned to some pixels of the image. FIG. 5 (b) shows an example of area division by graph cut. In FIG. 5B, the black area 511 indicates the result of detection as an object ("obj"), and the hatched area 521 indicates the result of detection as a background ("bkg"). The layer boundary inside is detected in the object ("obj") region thus obtained. As a result, since the object area can be detected in advance, false detection and oversight can be prevented.

  The image analysis unit 194, which is an example of an extraction unit, can extract (detect) a region in which the polarization has been canceled, for example, a layer such as RPE from the DOPU image. The depolarized area is, for example, an area where the difference in the influence of the two polarized lights on the subject's eye is relatively large. When the RPE is disturbed due to atrophy or the like, the disturbed portion is not detected as an RPE by the DOPU, so that there is an advantage that the atrophy portion of the RPE can be detected. In addition, the atrophy place of RPE shows the location where RPE is discontinuous or a missing place (abnormal place in RPE). At this time, for the purpose of analyzing the shape of the retinal layer, it is desirable to detect the Bruch's membrane boundary line under the RPE. Usually, since the RPE and the Bruch's membrane are in close contact, the shape of the retinal layer can be grasped by detecting the RPE. If the shape of the RPE is irregular, the shape of the retinal layer can be grasped by detecting the Bruch's membrane boundary. At this time, the Bruch film boundary is detected by interpolating the area under the place where the RPE is not detected using the surrounding RPE information. An example of this is shown in FIG. In FIG. 6 (a), 600 is a tomographic luminance image, and a region surrounded by a broken-line ellipse of 610 represents a shrinking point of RPE. In FIG. 6B, 601 is an example in which the RPE 621 detected from the DOPU is superimposed and displayed on the tomographic luminance image, and the area enclosed by the dashed ellipse of 611 can not be detected from the DOPU. Shows the area for detecting the boundary line of That is, when the shape analysis of the retinal layer is used, the Bruch's membrane boundary is detected in the area shown in FIG. As a method of detecting the Bruch film boundary, for example, an edge in a direction adjacent to the end of the region where RPE is continuous is searched for and detected. Alternatively, a Bruch's membrane is detected by performing functional approximation using a robust estimation such as M estimation using points in a region where RPE is changing smoothly. Whether or not the RPE changes smoothly can be identified by calculating the curvature at each point of the RPE. Specifically, for example, as described later, it is possible to determine whether or not the retinal layer is smoothly changed by obtaining the change of the curvature value at each point of the layer boundary. Further, by displaying the region where the polarization is canceled on the tomographic luminance image, for example, the user can easily confirm the positional relationship between the retinal layer and the abnormal part such as RPE, so that diagnosis of the eye to be examined is performed. Can be done effectively.

  Further, in the case of a retardation image, the image analysis unit 194 can also extract, for example, an RNFL. From this, the image analysis unit 194 can extract a layer corresponding to the type of the tomographic image from the tomographic image showing polarization. In addition, when the image analysis unit 194 extracts the RPE from the DOPE image and extracts the RNFL from the retardation image, the display control unit 191 can cause the display unit 192 to display these layers superimposed on the tomographic luminance image. . At this time, RPE and RNEL can be superimposed on the tomographic luminance image and displayed in different display forms, for example, different colors. It is also preferable to selectively display these layers three-dimensionally and to calculate the distance between these layers. Thus, the user can effectively diagnose the subject's eye based on the information.

<Output>
Next, output processing step S105 of each generated image and analysis result will be described.

  When generation and analysis of each image are completed in the image generation unit 193 and the image analysis unit 194 in the signal processing unit 190, the control unit 191 generates output information based on the result and outputs it to the display unit 192. Display.

  FIG. 7 is a display example on the display unit 192 in the present embodiment.

  In FIG. 8, reference numeral 700 denotes a window displayed on the display unit 192, which includes display areas 710, 720, 730, and 740.

  A fundus oculi image 711 is displayed in a display area 710 which is a first display area, and a rectangular frame 712 indicating the position of a tomographic image is superimposed. Although a fundus oculi luminance image is displayed as the fundus oculi image 711, it may be a fundus oculi image based on a polarization signal.

  A tomographic image 721 is displayed in a display area 720 which is a second display area. Furthermore, in the display area 720, buttons 722 to 725, which are an example of a selection unit for selecting the type of tomographic image to be displayed, are displayed. The type of tomographic image may be selected from the menu instead of the buttons 722 to 725. FIG. 7 shows a state in which the button 725 is selected, and shows an example in which the segmentation result is superimposed and displayed on the tomographic luminance image and the RPE is highlighted. The other buttons 722 to 724 and their displays will be described. When the operator selects the button 722, a tomographic luminance image is displayed on the display area 720. When the button 723 is selected, a retardation image is displayed in the display area 720. When the button 724 is selected, the DOPU image is displayed in the display area 720.

  In the segmentation image 721, tomographic luminance image, retardation image to be described later, DOPU image, etc., a display form indicating the type of each image, for example, a character of "Segmentation", a character of "Intensity", "Retardation" It is preferable to superimpose the character of "DOPU" on the image. This can prevent the user from mistakenly recognizing the image. Of course, the image may be displayed on the upper side or the side of the image without overlapping the image, or may be displayed in correspondence with the image.

  Thickness information 731 of the selected layer may be displayed in the display area 730 which is an example of the third display area. At 731 the thickness of the selected layer is represented by the difference in color. The integrated image may be displayed by changing the thickness of the selected layer indicated by 731. The integrated image may be an integrated image based on a specific layer or the entire PS-OCT. Also, although the case of changing the displayed image according to the instruction of the operator has been described, information on the disease to be diagnosed, for example, an image prioritized with respect to the disease by selecting the disease name from the menu It may be displayed in each area. Further, in the display area 740 which is an example of the fourth display area, a graph 741 indicating the layer thickness may be displayed. Thereby, for example, the user can associate and confirm the structural change in PS-OCT and the structure of the retinal layer, so that the diagnosis of the eye to be examined can be effectively performed.

  The display control unit 191 may display a retardation map or a birefringence map in any of the display regions of the display unit 192 instead of the various images described above. In addition, the display control unit 191 may superimpose a retardation map or a birefringence map on the fundus luminance image 711 and display it. At this time, it is preferable to display a retardation map or a birefringence map so as to overlap the area indicated by the frame 712.

  As described above, according to the present embodiment, the retinal layer can be accurately detected from the tomographic image acquired by the polarization OCT.

  The position of the display area for displaying these images is not limited to the present embodiment, and for example, a fundus oculi image may be displayed on the display area on the left side of the display screen. Further, the number of images to be displayed is not limited to this embodiment, and for example, at the time of adjustment, a total of two images of a fundus image and a tomographic image are displayed side by side on a display screen. Besides, a plurality of tomographic images showing different polarization states may be displayed side by side on the display screen. Further, the order, the position, and the like of the buttons 722 to 725 are not limited to the present embodiment.

(When there are places where the polarization state has been eliminated above and below the reference line, respectively)
Next, as another embodiment, the case where there are places where the polarization state has been canceled with respect to the reference line will be described with reference to FIG. 6C and FIG. Here, FIG. 8 is a display example on the display screen of the display unit of the image processing apparatus according to another embodiment.

  First, the image analysis unit 194 detects each layer of the retina, and identifies a lesion area using information on a part where the polarization state has been eliminated. In FIG. 6C, a reference line 640 detected by the image analysis unit 194 based on the information of RPE detected by the boundary detection of the retinal layer is indicated by an alternate long and short dash line. In addition, dotted lines circled areas 620 and 630 which are an example of an index indicating different positions in the depth direction of the subject eye in the depolarized area are characteristic areas existing above and below the reference line 640. It shows. At this time, it is preferable to make the areas 620 and 630 have different display forms, for example, different colors, so that different positions in the depolarized area can be distinguished.

  Here, as a specific method of estimating the reference line 640, the input three-dimensional tomographic image is considered as a set of two-dimensional tomographic images (B-scan images), and the reference line is estimated for each two-dimensional tomographic image Will be described. The method used here is to estimate a reference line by applying an N-order curve to a coordinate point group representing a layer boundary detected in a two-dimensional tomographic image of interest. In this embodiment, a quadratic curve is applied to the RPE layer detected by the image analysis unit to form a reference line 640. For estimation of the quadratic curve, robust estimation such as M estimation or LMedS is used.

  However, when an abnormal range (lesion site) is included in the place where the polarization state is eliminated, it is desirable to select the coordinate point group from the place excluding the abnormal range and estimate the reference line. Here, the lesion site is identified, for example, by using the curvature value at each point of the depolarization region. Specifically, when the curvature value is out of a predetermined range, it is regarded as a predetermined shape. The curvature value is a value defined by the reciprocal of the radius of the circle when the inside of a predetermined range from each point in the region for eliminating the polarization state is approximated by a circle. If the radius of the circle is relatively large, the curvature value will be close to zero. The lesion area is an area where the change in shape in the area for eliminating the polarization state is large, and thus corresponds to the case where the radius of the circle is relatively small, and the absolute value of the curvature value is a relatively large value.

  At this time, when the curvature value at each point of the layer boundary changes smoothly, it is defined that the retinal layer is normal. In this case, in the detection of the abnormal range, the local curvature value of the detected layer boundary is calculated, and the boundary shape of the layer is evaluated, and the portion where the curvature value does not change smoothly is regarded as the abnormal range. . For example, 630 in FIG. 6C is a range in which the curvature value does not change smoothly. Alternatively, in detection of the abnormal range, vitiligo, hemorrhage or drusen are detected from the fundus image, and the retinal layer in the z direction of the tomographic image corresponding to the (x, y) region of the wide area image in which the lesion exists is abnormal. . Or you may judge using the magnitude | size which the continuous area | region of the location from which the polarization | polarized-light calculated | required by DOPU calculation cancelled | released occupies in a three-dimensional tomographic image. For example, 620 in FIG. 6C is an isolated area when viewed in the entire three-dimensional tomographic image. Alternatively, a region where the thickness of the depolarization region deviates from the normal range can be determined as an abnormal range. Here, the determination of the normal range can be obtained by comparison with statistical data collected from a plurality of normal eye data.

  By estimating the reference line 640 excluding the lesion as described above, it is possible to set the reference line to the position that is supposed to be the original RPE.

  Here, FIG. 8 is a display example on the display unit 192 in the present embodiment. In FIG. 8, reference numeral 700 denotes a window displayed on the display unit 192, which includes display areas 710, 720, 730, and 740.

  A fundus oculi image 711 is displayed in a display area 710 which is a first display area, and a rectangular frame 712 indicating the imaging position of the tomographic image and a line 713 indicating the position of the tomographic image 721 are superimposed. Although a fundus oculi luminance image is displayed as the fundus oculi image 711, it may be a fundus oculi image based on a polarization signal. On the fundus image, an indicator 714 and an indicator 715 are displayed so that the difference between the types of lesions can be recognized. In the present embodiment, the circular index 714 indicates the range in which the abnormal range 620 exists. Also, a square shape 715 indicates a range in which the abnormal range 630 exists. As described above, in accordance with the difference in shape feature of the retinal layer caused by the difference in the type of lesion, etc., the index is displayed so that the difference can be judged on the fundus image. As a difference in shape feature, for example, a lesion depending on whether the point where the polarization state has been eliminated exists above the reference line 640 (shallow position in the depth direction of the retina) or below the reference line 640. Can distinguish the type of At this time, for example, the area existing below the reference line 640 (the deep position in the depth direction of the retina) at the depolarized area is the color of another area such as the area above the reference line 640 It is preferable to display in a color different from. This allows the user to easily identify the type of lesion.

  Moreover, it is divided also by the part with continuity as a layered structure of RPE, and a missing part. As a method of displaying the indicator 714 and the indicator 715, for example, the color is changed and displayed depending on the type of the lesion. Alternatively, the shape of the indicator such as a circle, square or triangle is changed and displayed. Or do both. In addition, it is assumed that the operator can switch between the display and non-display of the superimposed display by an indication device (not shown) such as a mouse according to the type of the lesion.

  In the vicinity of the fundus image, lesion type information 716 for indicating what the index (714, 715) different according to the type of the lesion represents is displayed. In the present embodiment, assuming that the type of lesion is represented by the difference in color of the index, the color and the type of lesion corresponding to it are displayed. For example, it is desirable to display so as to indicate that red is the atrophic form of macular degeneration and purple is an exudative form of macular degeneration. Also, the degree of the lesion may be expressed by the color density. For example, when the color is light, the degree of lesion is light, and when the color is dark, the degree of lesion is strong. The lesion type information 716 does not necessarily have to be described above, and may be displayed so that the shape of the index and the type of the lesion can be known.

  A tomographic image 721 is displayed in a display area 720 which is a second display area. Furthermore, in the display area 720, buttons 722 to 725, which are an example of a selection unit for selecting the type of tomographic image to be displayed, are displayed. The type of tomographic image may be selected from the menu instead of the buttons 722 to 725. FIG. 7 shows a state in which the button 725 is selected, and shows an example in which the segmentation result is superimposed and displayed on the tomographic luminance image and the RPE is highlighted. The other buttons 722 to 724 and their displays will be described. When the operator selects the button 722, a tomographic luminance image is displayed on the display area 720. When the button 723 is selected, a retardation image is displayed in the display area 720. When the button 724 is selected, the DOPU image is displayed in the display area 720.

  In the segmentation image 721, tomographic luminance image, retardation image to be described later, DOPU image, etc., a display form indicating the type of each image, for example, a character of "Segmentation", a character of "Intensity", "Retardation" It is preferable to superimpose the character of "DOPU" on the image. This can prevent the user from mistakenly recognizing the image. Of course, the image may be displayed on the upper side or the side of the image without overlapping the image, or may be displayed in correspondence with the image.

  Thickness information 731 of the selected layer may be displayed in the display area 730 which is an example of the third display area. At 731 the thickness of the selected layer is represented by the difference in color. The integrated image may be displayed by changing the thickness of the selected layer indicated by 731. The integrated image may be an integrated image based on a specific layer or the entire PS-OCT. Also, although the case of changing the displayed image according to the instruction of the operator has been described, information on the disease to be diagnosed, for example, an image prioritized with respect to the disease by selecting the disease name from the menu It may be displayed in each area. Further, in the display area 740 which is an example of the fourth display area, a graph 741 indicating the layer thickness may be displayed.

  The display control unit 191 may display a retardation map or a birefringence map in any of the display regions of the display unit 192 instead of the various images described above. In addition, the display control unit 191 may superimpose a retardation map or a birefringence map on the fundus luminance image 711 and display it. At this time, it is preferable to display a retardation map or a birefringence map so as to overlap the area indicated by the frame 712.

(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU or the like) of the system or apparatus reads the program. It is a process to execute.

Claims (27)

A planar image obtaining means for obtaining a planar image of the test eye,
And the tomographic image obtaining means for obtaining a plurality of polarization tomographic image indicating the different polarization properties of the test eye,
A display means for displaying at least one of the plurality of polarization tomographic images is displayed on a display means, and the planar image and the selected at least one polarization tomographic image are displayed side by side on the display means, the display Display control means for causing the display means to display a display mode indicating the type of at least one polarization tomographic image corresponding to the displayed at least one polarization tomographic image;
The plurality of polarization tomographic images include a retardation image and a DOPU image, and the display mode for the selection is a display mode for selecting at least one of the retardation image and the DOPU image. An image processing apparatus characterized by   The image processing apparatus according to claim 1, wherein the display mode for the selection is a display mode for selecting any one tomographic image of the retardation image and the DOPU image.   The display control means causes the display means to display at least one polarization tomographic image selected in the priority order corresponding to the information on the disease based on the information on the disease selected according to the operation of the operator. The image processing apparatus according to claim 1 or 2, characterized in that   4. The display control means according to any one of claims 1 to 3, wherein the display control means causes the display means to display the display mode indicating the type in a state of being superimposed on the at least one polarization tomographic image selected. Image processing apparatus as described. It further comprises analysis means for analyzing at least one of the plurality of polarization tomographic images,
5. The display means according to claim 1, wherein the display control means causes the display means to display a display form indicating an analysis result by the analysis means together with the planar image and the selected at least one polarization tomographic image. An image processing apparatus according to any one of the preceding claims. Before SL analyzing means performs segmentation of the plurality of in at least one said subject's eye retinal layer of the polarization tomographic image,
6. The image processing apparatus according to claim 5, wherein the display control means causes the display means to display thickness information of the retinal layer. The tomographic image obtaining means obtains a tomographic luminance image and the plurality of polarization tomographic image of the subject eye based on the different polarization of the light from each other,
The apparatus further comprises analysis means for extracting a layer using the tomographic luminance image,
The display control means changes the display of the selected at least one polarization tomographic image to display of the tomographic luminance image in which a layer selected from the extracted layers is emphasized according to an operation of the operator; The image processing apparatus according to any one of claims 1 to 4, wherein the tomographic luminance image and thickness information of the selected layer are displayed side by side on the display unit. On the basis of the representative value of the polarization characteristics of a portion of the range of at least one polarization tomographic image is the selected in the depth direction of the subject eye, further comprising a generating means for generating a polarization plane image of the subject eye ,
The tomographic image obtaining means obtains a tomographic luminance image and the plurality of polarization tomographic image of the subject eye based on the different polarization of the light from each other,
The apparatus further comprises analysis means for extracting a layer using the tomographic luminance image,
The image processing apparatus according to claim 7, wherein the generation unit generates the polarization plane image based on the representative value of polarization characteristics in the range determined using the extracted layer.   The image processing apparatus according to claim 8, wherein the polarization plane image is at least one of a retardation map and a birefringence map.   The display control means causes the planar image and the at least one polarization tomographic image selected to be displayed side by side on the same screen of the display means, and an index indicating the position of the at least one polarization tomographic image selected is the index The image processing apparatus according to any one of claims 1 to 9, wherein the image processing apparatus displays the superimposed image on a planar image on the display unit. A planar image obtaining means for obtaining a planar image of the test eye,
The tomographic image acquisition unit configured to acquire a tomographic luminance image of the subject eye and the plurality of polarization tomographic image indicating the different polarization properties of the test eye,
Displaying a display form for selecting at least one of a plurality of tomographic images including the plurality of polarization tomographic images and the tomographic luminance image on a display unit; and displaying the planar image and the selected at least one tomographic image Display control means for arranging and displaying the display means on the display means, and displaying the display form indicating the type of the displayed at least one tomographic image on the display means in association with the displayed at least one tomographic image;
An image processing apparatus comprising:   The plurality of polarization tomographic images include a retardation image and a DOPU image, and the display mode for the selection includes at least the plurality of tomographic images including the retardation image, the DOPU image, and the tomographic luminance image. The image processing apparatus according to claim 11, wherein the image processing apparatus is a display form for selecting one tomographic image.   The display mode for the selection is a display mode for selecting any one tomographic image of the plurality of tomographic images including the retardation image, the DOPU image, and the tomographic luminance image. The image processing apparatus according to claim 12. The communicatively coupled to the imaging device for photographing a subject eye,
The tomographic image obtaining means, image processing according to any one of claims 1 to 13, characterized in that to obtain a plurality of polarization tomographic image obtained by photographing the subject eye by the imaging device apparatus. The tomographic image obtaining means on the basis of the irradiated above the return light and the reference light and different from each other obtained by dividing the coupled optical polarization corresponding to the measurement light from a subject eye optical measurement light, the image processing apparatus according to any one of claims 1 to 1 4, characterized in that to obtain a plurality of polarization tomographic image. Said planar image acquisition means, the irradiated light based on the light of each other in different polarization return light obtained by dividing from the subject eye to obtain a polarization plane image of the test eye as the planar image The image processing apparatus according to any one of claims 1 to 15 , wherein A planar image obtaining means for obtaining a planar image of the test eye,
Based on the light of the return light and the measurement reference light corresponding to the light and the multiplexed each other on different polarized light obtained and the combined light obtained by dividing from the subject eye is irradiated with measuring light via scanning means Te, the tomographic image acquisition unit configured to acquire a plurality of polarization tomographic image indicating the different polarization properties of the test eye,
Display control means for causing display means to display an index indicating acquisition positions of the plurality of polarization tomographic images superimposed on the planar image;
An instruction unit that instructs to change the position of the index on the planar image;
Wherein as the measurement light at the position of the subject eye corresponding to the indicated position on the planar image is scanned, and a control means for controlling said scanning means,
The display control means causes the display means to display a display mode for selecting at least one of the plurality of polarization tomographic images obtained by controlling the scanning means, and the planar image and the selected at least one are selected. Two polarization tomographic images are arranged and displayed on the display means, and a display form indicating the type of the displayed at least one polarization tomographic image is displayed on the display means in association with the displayed at least one polarization tomographic image An imaging device characterized in that A planar image obtaining means for obtaining a planar image of the test eye,
Based on the light of the return light and the measurement reference light corresponding to the light and the multiplexed each other on different polarized light obtained and the combined light obtained by dividing from the subject eye is irradiated with measuring light via scanning means Te, the tomographic image acquisition unit configured to acquire a tomographic luminance image of the subject eye and the plurality of polarization tomographic image indicating the different polarization properties of the test eye,
Display control means for causing display means to superimpose the plurality of polarization tomographic images and an index indicating acquisition positions of the tomographic luminance images on the planar image;
An instruction unit that instructs to change the position of the index on the planar image;
Wherein as the measurement light at the position of the subject eye corresponding to the indicated position on the planar image is scanned, and a control means for controlling said scanning means,
The display control means displays on the display means a display form for selecting at least one of a plurality of tomographic images including the plurality of polarization tomographic images obtained by controlling the scanning means and the tomographic luminance image. , The at least one tomographic image displayed side by side with the planar image and the at least one tomographic image selected, and displaying the display form indicating the type of the at least one tomographic image displayed is the at least one tomographic image displayed An imaging apparatus characterized by displaying on the display means in association with. The planar image acquisition means, the irradiated light based on the light of each other in different polarization return light obtained by dividing from the subject eye, at least one of the polarization plane image and the planar luminance image of the subject eye The imaging device according to claim 17 or 18 , wherein the image is acquired as the planar image. The tomographic image obtaining means obtains the polarization tomographic image of the subject eye 3D,
The planar image obtaining means, imaging apparatus according to the polarization plane image of the subject eye based on the three-dimensional polarization tomographic image to claim 1 7 or 1 8, characterized in that to obtain as the planar image. The tomographic image obtaining means obtains the 3-dimensional tomographic intensity image of the subject eye based on the different polarization of the light from each other,
The planar image obtaining means, imaging apparatus according to the planar luminance image of the subject eye based on the 3-dimensional tomographic luminance image to claim 1 7 or 1 8, characterized in that to obtain as the planar image. A planar image of the subject eye, a step of acquiring the planar image acquisition unit,
A plurality of polarization tomographic image indicating the different polarization properties of the subject eye, the steps of the tomographic image acquisition unit acquires,
A display means for displaying at least one of the plurality of polarization tomographic images is displayed on a display means, and the planar image and the selected at least one polarization tomographic image are displayed side by side on the display means, the display Displaying a display form indicating the type of at least one polarization tomographic image to be displayed on the display means in association with the at least one polarization tomographic image to be displayed;
The plurality of polarization tomographic images include a retardation image and a DOPU image, and the display mode for the selection is a display mode for selecting at least one of the retardation image and the DOPU image. An image processing method characterized by A planar image of the subject eye, a step of acquiring the planar image acquisition unit,
Wherein the tomographic intensity image of the subject eye and the plurality of polarization tomographic image indicating the different polarization properties of the test eye, the steps of the tomographic image acquisition unit acquires,
Displaying a display form for selecting at least one of a plurality of tomographic images including the plurality of polarization tomographic images and the tomographic luminance image on a display unit; and displaying the planar image and the selected at least one tomographic image Are displayed side by side on the display means, and a display form indicating the type of the displayed at least one tomographic image is displayed on the display means in association with the at least one tomographic image to be displayed;
An image processing method comprising: A program characterized by executing the steps of the image processing method according to claim 2 2 or 2 3 to the computer. A planar image of the subject eye, a step of acquiring the planar image acquisition unit,
Based on the light of the return light and the measurement reference light corresponding to the light and the multiplexed each other on different polarized light obtained and the combined light obtained by dividing from the subject eye is irradiated with measuring light via scanning means Te, a plurality of polarization tomographic image indicating the different polarization properties of the subject eye, the steps of the tomographic image acquisition unit acquires,
Displaying an indicator indicating acquisition positions of the plurality of polarization tomographic images on the planar image so as to be displayed on a display unit;
Receiving an instruction to change the position of the indicator on the planar image;
Wherein as the measurement light is scanned in a position of a subject eye corresponding to the designated position on said plane image, and controlling said scanning means,
A display form for selecting at least one of the plurality of polarization tomographic images obtained by controlling the scanning unit is displayed on the display unit, and the planar image and the selected at least one polarization tomographic image are displayed. Displaying them side by side on the display means and displaying the display form indicating the type of the displayed at least one polarization tomographic image on the display means in association with the displayed at least one polarization tomographic image;
A photographing method characterized by having: A planar image of the subject eye, a step of acquiring the planar image acquisition unit,
Based on the light of the return light and the measurement reference light corresponding to the light and the multiplexed each other on different polarized light obtained and the combined light obtained by dividing from the subject eye is irradiated with measuring light via scanning means Te, wherein the tomographic intensity image of the subject eye and the plurality of polarization tomographic image indicating the different polarization properties of the test eye, the steps of the tomographic image acquisition unit acquires,
Displaying the plurality of polarization tomographic images and indices indicating acquisition positions of the tomographic luminance images on the planar image so as to be displayed on display means;
Receiving an instruction to change the position of the indicator on the planar image;
Wherein as the measurement light is scanned in a position of a subject eye corresponding to the designated position on said plane image, and controlling said scanning means,
Displaying the display form for selecting at least one of a plurality of tomographic images including the plurality of polarization tomographic images obtained by controlling the scanning unit and the tomographic luminance image on the display unit; The selected at least one tomographic image is arranged and displayed on the display unit, and a display form indicating the type of the displayed at least one tomographic image is associated with the displayed at least one tomographic image, and the display is performed. A step of displaying on the means;
A photographing method characterized by having: A program which causes a computer to execute each step of the photographing method according to claim 25 or 26 .

Images