JP6922350B2 - Imaging device and imaging control program - Google Patents

Description

The present disclosure relates to an image capturing device that captures an image of a subject by processing an OCT signal, and an image capturing control program executed in the image capturing device.

Conventionally, there is known an imaging device that scans a subject with measurement light and captures an image of the subject (for example, a tomographic image) with the reflected light of the measurement light and the reference light. For example, the optical coherence stromography apparatus disclosed in Patent Document 1 obtains a tomographic image of the fundus in various modes such as macular line imaging, macular map imaging, and papillary map imaging by changing the scanning position of the measurement light. get.

Japanese Unexamined Patent Publication No. 2016-13210

The imaging device determines the imaging operation based on various parameters and input signals. For example, when the user operates the operation unit to set the scanning position of the measurement light, the image capturing apparatus sets parameters for controlling the driving of the scanning means, and controls the scanning means based on the parameters. As a result, the measurement light is scanned at a position desired by the user. Further, when the user operates the operation unit to input the shooting start instruction, the trigger signal for starting the shooting is input. The image capturing device starts the photographing operation when the trigger signal is input.

In the conventional image capturing apparatus, the user needs to frequently operate the operation unit in order to input various parameters and signals. Therefore, it has been difficult to reduce the work load on the user when taking an image.

A typical object of the present disclosure is to provide an image capturing device and an image capturing control program for easily reducing a user's workload when performing image capturing.

The imaging apparatus provided by the typical embodiment in the present disclosure captures an image of the tissue of the patient's eye by processing an OCT signal by the reference light and the reflected light of the measurement light applied to the patient's eye. An imaging device for acquiring a front image of a tissue of the patient's eye, a scanning means for scanning the measurement light in a two-dimensional direction on the tissue of the patient's eye, a sound input means for inputting a sound, and a front surface for acquiring the front image of the tissue of the patient's eye. A plurality of imaging patterns are predetermined, which include an image acquisition means and a control unit that controls the operation of the image capturing apparatus, and the method of capturing a tomographic image is different from each other . Sound recognition processing is performed on the input sound, and when the recognition result by the sound recognition processing is the result of designating the scanning position and the shooting pattern of the measurement light, the front image acquisition means acquires the sound. By performing image processing on the front image, the arrangement of the tissue of the patient's eye reflected in the front image is acquired, and based on the acquired arrangement of the tissue, the designated imaging is performed at the designated scanning position. A parameter for scanning the measurement light with a pattern is generated.

The imaging control program provided by the typical embodiment in the present disclosure processes an OCT signal by the reference light and the reflected light of the measurement light applied to the patient's eye to obtain an image of the tissue of the patient's eye. An image capturing control program executed in an image capturing device for imaging, wherein the imaging device includes scanning means for scanning the measurement light in a two-dimensional direction on the tissue of the patient's eye, and sound input for inputting sound. A plurality of imaging patterns that include means, a frontal image acquiring means for acquiring a frontal image of the tissue of the patient's eye, and a control unit that controls the operation of the imaging apparatus, and different imaging methods for tomographic images are prepared in advance. By executing the image capturing control program by the control unit, sound recognition processing is performed on the sound input by the sound input means, and the recognition result by the sound recognition processing is the measurement. When the result is to specify the scanning position of the light and the photographing pattern, by performing image processing on the front image acquired by the front image acquisition means, the tissue of the patient's eye reflected in the front image is arranged. Is acquired, and based on the arrangement of the acquired tissue, the image capturing apparatus is made to perform a step of generating a parameter for scanning the measurement light with the designated imaging pattern at the designated scanning position.

According to the image capturing apparatus and the image capturing control program according to the present disclosure, the workload of the user when performing image capturing is easily reduced.

It is a figure which shows the schematic structure of the image capturing apparatus 1 and PC40. It is a flowchart of the advance data generation process. It is a figure which shows an example of the state which the scanning position is defined on the preliminary front image 50. It is a flowchart of a custom pattern generation process. It is a figure which shows an example of the custom pattern defined on the fundus model 60. It is a flowchart of a shooting process. It is a flowchart of the pre-plan shooting preparation process executed during the shooting process. It is a flowchart of the follow-up shooting preparation process executed during the shooting process.

<Overview>
The imaging apparatus exemplified in the present disclosure captures an image of the tissue of the patient's eye (for example, a tomographic image) by processing an OCT signal by the reference light and the reflected light of the measurement light applied to the patient's eye. .. The imaging device includes scanning means, sound input means, and a control unit. The scanning means scans the measurement light in two dimensions on the tissue of the patient's eye. The sound input means inputs sound. The control unit performs recognition processing on the sound input by the sound input means, and based on the recognition result by the sound recognition processing, controls the driving of the scanning means to determine the shooting operation of the parameters and signals. Generate at least one. Therefore, the work of the user operating the operation unit for inputting various parameters and the like is reduced. Therefore, the work load of the user when executing the image shooting is reduced.

The control unit may generate parameters that define at least one of the scanning position and the scanning order of the measurement light scanned by the scanning means on the tissue of the patient's eye based on the recognition result by the sound recognition process. In this case, the work of the user operating the operation unit to specify the scanning position and the scanning order is reduced. Therefore, appropriate shooting can be performed more easily.

The control unit is a parameter that defines at least one of the position, shape, and length of the scanning line in which the measurement light is scanned, and the position, shape, and size of the scanning range in which a plurality of scanning lines are set. May be generated based on the recognition result by the sound recognition process. In this case, the user can set the scanning position more accurately by sound.

The specific method for letting the user specify the parameters by sound can be set as appropriate. For example, a plurality of imaging patterns in which the imaging methods of tomographic images are different from each other may be predetermined. Multiple imaging patterns include, for example, an imaging pattern in which a raster scan is performed near the macula (so-called “macular map”), an imaging pattern in which a raster scan is performed near the optic nerve papilla (so-called “papillary map”), and linear measurement in the macula. An imaging pattern that scans the light (so-called "macula line"), an imaging pattern that scans the measurement light linearly in the macula (so-called "macular line"), and an imaging pattern in which the measurement light is scanned so as to intersect in a cross shape in the macula. At least one of a pattern (so-called "macular cross"), an imaging pattern in which the measurement light is scanned so as to intersect in a cross shape at the optic nerve head (so-called "macular cross") and the like may be predetermined. When the recognition result by the sound recognition process is the result of designating the shooting pattern, the control unit may generate a parameter for executing shooting with the designated shooting pattern.

Further, even if the control unit generates a parameter for executing shooting by moving the position of the scanning line or the scanning range in the specified direction when the recognition result by the sound recognition process is the result of specifying the direction. good. Similarly, when the recognition result by the sound recognition process is the result of specifying the shape, length, or size of the scanning line or scanning range, the control unit controls the specified shape, length, or size. You may generate a parameter to execute shooting according to.

The imaging device may include a frontal image acquisition means for acquiring a frontal image of the tissue of the patient's eye. When the recognition result by the sound recognition processing is the result of specifying the scanning position of the measurement light, the control unit acquires and acquires the arrangement of the tissue reflected in the front image by performing image processing on the front image. Based on the arrangement of the tissue, parameters may be generated to scan the measurement light at a specified scanning position. In this case, the user can have the image capturing device capture the image at the desired position by saying the position at which the image is to be captured.

A plurality of shooting patterns for combination shooting may be predetermined. The combination shooting is a shooting in which a plurality of shooting operations in which the positions of the scanning lines or the positions of the scanning ranges are different from each other are continuously executed in order. The control unit may generate a parameter for executing the shooting operation in the shooting pattern corresponding to the recognition result by the sound recognition processing among the plurality of shooting patterns. In this case, the work of the user operating the operation unit to specify the shooting pattern of the combination shooting is reduced. Therefore, appropriate shooting can be performed more easily.

In addition, various patterns can be defined as the shooting pattern of the combination shooting. For example, at least one of a pattern in which macular map photography and macular line photography are continuously performed (so-called "macular combo"), a pattern in which nipple map photography and nipple line photography are continuously performed (so-called "nipple combo"), and the like. May be defined. Further, a pattern for scanning the measurement light in order for a plurality of scanning ranges may be defined.

The control unit generates a shooting pattern (custom pattern) for combination shooting that executes a plurality of shooting operations instructed by the user according to the instruction input by the user, and stores the generated custom pattern together with a specific keyword for specifying the generated custom pattern. It may be stored in the means. When the recognition result by the sound recognition process is a specific keyword, the control unit may generate a parameter for executing the shooting operation with the custom pattern specified by the specific keyword. In this case, the user can freely set a custom pattern for continuously executing a plurality of desired shooting operations. Further, the user can easily cause the image capturing device to perform shooting according to a desired custom pattern by saying a specific keyword.

A specific method for generating a custom pattern and storing it in the storage means can be appropriately set. For example, the control unit may generate a custom pattern in response to an operation instruction input by operating the operation unit. Further, the control unit may generate a custom pattern according to the recognition result when the recognition result by the sound recognition process is a result of instructing a plurality of shooting operations in the custom pattern.

When the control unit executes the imaging operation of the tissue of the patient's eye, the control unit may store the imaging conditions of the executed imaging operation in the storage means for each patient. When the result of the sound recognition process is the result of specifying that the shooting operation is to be executed under the same shooting conditions as the shooting conditions in the shooting operation executed in the past, the control unit stores the shooting conditions stored in the storage means. Of these, parameters for executing the imaging operation under the imaging conditions in the past imaging operation for the same patient may be generated. In this case, the user can easily cause the image capturing device to perform shooting performed under the same conditions as the past shooting conditions (so-called follow-up shooting).

The control unit may generate a start signal for starting the shooting operation when the recognition result of the sound recognition process is the result of instructing the start of the shooting operation. In this case, the user can start the shooting operation at an appropriate timing without operating the operation unit. Therefore, the work load of the user is reduced. In addition, it is easy for the patient to input the start instruction of the imaging operation into the imaging apparatus by himself / herself.

The control unit may display the image captured by the photographing operation on the display means. When the recognition result by the sound recognition process is a result that does not allow the displayed image, the control unit may generate a re-shooting signal for executing the shooting operation again. In this case, the user can see the image displayed on the display means and input the re-shooting execution instruction to the image-shooting device without operating the operation unit.

The control unit may generate a parameter for adjusting at least one of the optical path length difference between the measurement light and the reference light and the focus of the measurement light based on the recognition result by the sound recognition process. In this case, the operation of the operation unit performed by the user for adjusting the optical path length difference and the focus is reduced, so that the work efficiency of the user is improved.

The control unit may generate a signal based on the recognition result by the sound recognition process, which determines whether or not to perform tracking for tracking the scanning position of the measurement light according to the movement of the tissue of the patient's eye. In this case, the user can easily input an instruction as to whether or not to execute tracking to the image capturing device.

When the control unit scans the measurement light a plurality of times at the same scanning position and performs the averaging process of the images captured a plurality of times, the number of operations of the measurement light for the same scanning position (that is, the addition is performed). A parameter for determining (the number of images) may be generated based on the recognition result by the sound recognition process. In this case, the user can easily input the number of images to be added to the image capturing device.

The control unit includes imaging (for example, angiography imaging) in which multiple OCT signals are acquired from the same position in the tissue of the patient's eye at different times to acquire motion contrast data, and tomographic imaging of the tissue of the patient's eye. A signal for determining which of the plurality of shots to be performed may be generated based on the recognition result by the sound recognition process. In this case, the user can easily cause the image capturing device to perform the desired shooting among the plurality of shooting methods.

<Embodiment>
Hereinafter, one of the typical embodiments according to the present disclosure will be described. As an example, the image capturing device (optical coherence stromography device) 1 of the present embodiment can capture a tomographic image and a motion contrast image of the fundus tissue using the fundus of the patient's eye E as a subject. However, at least a part of the technique exemplified in the present disclosure is also applied to an imaging device that captures an image of a subject other than the fundus (for example, the anterior segment of the patient's eye E or a biological tissue other than the patient's eye E). can.

<Outline configuration>
The schematic configuration of the image capturing apparatus 1 of the present embodiment will be described with reference to FIG. The image capturing device 1 includes an OCT unit 10 and a control unit 30.

The OCT unit 10 will be described. The OCT unit 10 acquires an OCT signal using the principle of optical coherence tomography (OCT). The OCT unit 10 includes an OCT light source 11, a coupler (optical divider) 12, a measurement optical system 13, a reference optical system 20, a detector 22, and a front observation optical system 23.

The OCT light source 11 emits light (OCT light) for acquiring an OCT signal. The coupler 12 divides the light emitted from the OCT light source 11 into measurement light and reference light. Further, the coupler 12 of the present embodiment synthesizes the measurement light reflected by the subject (the fundus of the patient's eye E in the present embodiment) and the reference light generated by the reference optical system 20, and synthesizes interference. The light is received by the detector 22.

The measurement optical system 13 guides the measurement light divided by the coupler 12 to the subject, and returns the measurement light reflected by the subject to the coupler 12. The measurement optical system 13 includes an optical scanner 14, a projection optical system 16, and a focus adjusting unit 17. The optical scanner 14 can scan (deflect) the measurement light in the two-dimensional direction by being driven by the drive unit 15. In the present embodiment, two galvanometer mirrors capable of deflecting the measurement light in different directions are used as the optical scanner 14. However, another device that deflects light (eg, at least one of a polygon mirror, a resonant scanner, an acoustic optical element, etc.) may be used as the optical scanner 14. The projection optical system 16 is provided on the downstream side (that is, the subject side) of the optical path from the optical scanner 14, and projects the measurement light toward the subject. The focus adjusting unit 17 adjusts the focus of the measurement light by moving an optical member (for example, a lens) included in the projection optical system 16 in a direction along the optical axis of the measurement light.

The reference optical system 20 generates reference light and returns it to the coupler 12. The reference optical system 20 of the present embodiment generates reference light by reflecting the reference light divided by the coupler 12 by a reflective optical system (for example, a reference mirror). However, the configuration of the reference optical system 20 can also be changed. For example, the reference optical system 20 may transmit the light incident from the coupler 12 without reflecting it and return it to the coupler 12. The reference optical system 20 includes an optical path length difference adjusting unit 21 that changes the optical path length difference between the measurement light and the reference light. In the present embodiment, the optical path length difference is changed by moving the reference mirror in the optical axis direction. The configuration for changing the optical path length difference may be provided in the optical path of the measurement optical system 13.

The detector 22 detects an interference signal between the measurement light and the reference light. In this embodiment, the principle of Fourier domain OCT is adopted. In the Fourier domain OCT, the spectral intensity (spectral interference signal) of the interference light is detected by the detector 22, and the complex OCT signal is acquired by the Fourier transform on the spectral intensity data. As an example of the Fourier domain OCT, Spectral-domine-OCT (SD-OCT), Swept-source-OCT (SS-OCT) and the like can be adopted. Further, for example, Time-domine-OCT (TD-OCT) or the like can be adopted. In this embodiment, SD-OCT is adopted. In the case of SD-OCT, for example, a low coherent light source (broadband light source) is used as the OCT light source 11, and interference light is dispersed into each frequency component (each wavelength component) in the vicinity of the detector 22 in the optical path of the interference light. A spectroscopic optical system (spectrometer) is provided. In the case of SS-OCT, for example, as the OCT light source 11, a wavelength scanning type light source (wavelength variable light source) that changes the emission wavelength at high speed in time is used. In this case, the OCT light source 11 may include a light source, a fiber ring resonator, and a wavelength selection filter. Wavelength selection filters include, for example, a filter that combines a diffraction grating and a polygon mirror, a filter that uses a Fabry-Perot Etalon, and the like.

The frontal observation optical system 23 is provided to acquire a frontal image of a subject (in the present embodiment, the fundus of the patient's eye E). The front observation optical system 23 includes at least one of, for example, a scanning laser ophthalmoscope (SLO) and an infrared camera that collectively irradiates a two-dimensional imaging range with infrared light to capture a front image. The configuration of can be adopted. Further, the image capturing apparatus 1 acquires the three-dimensional tomographic image data by scanning the measurement light on the subject in the two-dimensional direction, and from the three-dimensional tomographic image data, the direction along the optical axis of the measurement light (front direction). An OCT front image (Enface) image may be acquired when the subject is desired to be viewed from. The OCT front image data includes, for example, integrated image data in which brightness values are integrated in the depth direction (Z direction) at each position in the XY direction, integrated values of spectral data at each position in the XY direction, and a certain depth. It may be brightness data at each position in the XY direction in the longitudinal direction, brightness data at each position in the XY direction in any layer of the retina (for example, the surface layer of the retinal), and the like. When the OCT front image is acquired, the front observation optical system 23 may be omitted. That is, the OCT unit 10 and the control unit 30 that acquire the OCT front image can also function as the front image acquisition means.

The control unit 30 will be described. The control unit 30 controls various controls of the image capturing device 1. The control unit 30 includes a CPU 31, a RAM 32, a ROM 33, and a non-volatile memory (NVM) 34. The CPU 31 is a controller that performs various controls. The RAM 32 temporarily stores various types of information. The ROM 33 stores a program executed by the CPU 31 and various initial values. The NVM 34 is a non-transient storage medium capable of retaining the stored contents even when the power supply is cut off. The image capturing control program for executing the custom pattern generation process (see FIG. 4) and the photographing process (see FIG. 6), which will be described later, may be stored in the NVM 34.

A microphone 36, a monitor 37, and an operation unit 38 are connected to the control unit 30. The microphone 36 inputs sound. The microphone 36 may be attached to the head of the user who operates the image capturing device 1. In this case, among the various sounds, only the remarks of the user who operates the image capturing device 1 are likely to be input to the control unit 30. Therefore, the occurrence of malfunction is suppressed. The monitor 37 displays various images. The operation unit 38 is operated by the user in order for the user to input various operation instructions to the image capturing device 1. For the operation unit 38, for example, various devices such as a mouse, a keyboard, a touch panel, and a foot switch can be used.

In the present embodiment, an integrated image capturing device 1 in which the OCT unit 10 and the control unit 30 are built in one housing is illustrated. However, it goes without saying that the image capturing device 1 may include a plurality of devices having different housings. For example, the image capturing device 1 may include an optical device having an OCT unit 10 built-in and a personal computer (hereinafter, referred to as “PC”) connected to the optical device by wire or wirelessly. In this case, the control unit included in the optical device and the control unit of the PC may both function as the control unit 30 of the image capturing device 1.

The schematic configuration of the advance data generation device 40 will be described with reference to FIG. The image capturing apparatus 1 of the present embodiment can scan the measurement light at a scanning position defined in advance by the prior data. The prior data is data generated in advance before the imaging operation (observation of the subject, alignment, and imaging of a tomographic image, etc.) is started. The prior data defines the relationship between the arrangement of the tissue of the subject and the scanning position of the measurement light. The pre-data generation device 40 can pre-generate the pre-data 40 before the photographing operation is performed.

As an example, in the present embodiment, an electronic medical record PC on which an electronic medical record is installed is used as the advance data generation device 40. Therefore, the doctor can generate the preliminary data while electronically creating the medical record using the electronic medical record. However, a device other than the electronic medical record PC may be used as the advance data generation device 40. For example, the image capturing device 1 may function as a pre-data generation device. Further, a medical device for observing or photographing a subject (for example, a fundus camera, an SLO, an infrared camera, etc.) may function as a pre-data generation device. In this case, the control unit of the medical device automatically generates advance data based on the analysis result of the subject (for example, the analysis result of the photographed image of the subject or the analysis result of the blood flow map or the like). May be good.

The control unit of the pre-data generation device 40 includes a CPU 41, a RAM 42, a ROM 43, and an NVM 44, similarly to the image capturing device 1. The NVM 44 stores a pre-data generation processing program and the like for executing the pre-data generation processing (see FIG. 2) described later. Further, a microphone 46, a monitor 47, and an operation unit 48 are connected to the advance data generation device 40.

<Preliminary data generation process>
The pre-data generation process will be described with reference to FIGS. 2 and 3. As described above, in the present embodiment, the user creates shooting data in advance before executing the shooting operation, so that the measurement light is scanned at a predetermined scanning position (hereinafter, """Pre-planshooting") can be executed by the image shooting device 1. The CPU 41 of the pre-data generation device 40 executes the pre-data generation processing shown in FIG. 2 according to the pre-data generation processing program stored in the NVM 44.

First, the CPU 41 displays the electronic medical record screen on the monitor 47 (S1). A user (for example, a doctor) can electronically create a medical record by inputting various instructions to the advance data generation device 40 while the electronic medical record screen is displayed on the monitor 47.

Next, the CPU 41 acquires a frontal image of the patient's tissue and displays it on the monitor 47 (S2). As an example, in this embodiment, a frontal image of the fundus of the patient eye E is used. The frontal image of the fundus may be taken by a photographing device such as a fundus camera, an SLO, or an infrared camera. The CPU 41 acquires front image data from the photographing device via wired communication, wireless communication, a detachable memory, or the like, and displays it on the monitor 47. In the following, the front image acquired in S2 may be referred to as a pre-front image.

The CPU 41 generates advance data by defining a scanning position on the advance front image in response to an instruction input by the user (S3). The CPU 41 associates the generated prior data with the patient ID and the electronic medical record information, and stores the generated prior data in the NVM 44 (S4).

An example of the process (S3) for generating the advance data will be described with reference to FIG. FIG. 3 is a diagram showing an example of a state in which the scanning position is defined on the preliminary front image 50. The pre-frontal image 50 shown in FIG. 3 shows the tissues of the fundus (for example, the optic disc 51, the macula 52, and the fundus blood vessel 53). When an instruction defining the position of the scanning line is input, the CPU 41 causes the scanning line 55 to be displayed on the monitor 47. When the movement instruction of the scanning line 55 is input, the CPU 41 moves the scanning line 55 on the preliminary front image 50 according to the instruction. The position of the moved scanning line 55 is defined as the scanning position of the measurement light with respect to the tissue. Further, when an instruction for defining the position of the scanning range is input, the CPU 41 displays the scanning range 56 on the monitor 47. When the movement instruction of the scanning range 56 is input, the CPU 41 moves the scanning range 56 on the pre-front image 50 according to the instruction. At the time of photographing by the image capturing apparatus 1, the measurement light is scanned a plurality of times within the scanning range 56.

The user gives an instruction to change the shape of the scanning line 55 to a shape other than a linear shape (for example, a circular shape), an instruction to change the length of the scanning line 55, an instruction to change the shape of the scanning range 56, and scanning. It is also possible to input an instruction or the like for changing the size of the range 56. In this case, the CPU 41 changes the scanning line 55 or the scanning range 56 according to the input instruction. Further, the CPU 41 may input an instruction from the user by an operation signal input from the operation unit 48. The CPU 41 may input an instruction from the user by performing a sound recognition process on the sound input to the microphone 46.

Needless to say, the specific method for allowing the user to specify the scanning position can be changed. For example, the user may be able to specify the position of a pattern scan (for example, cross scan, radial scan, etc.) in which a plurality of scan lines are combined. Further, the CPU 41 may define the scanning position of the combination shooting (hereinafter, also referred to as “combo shooting”) in which a plurality of shooting operations are continuously executed, according to an instruction to the user.

Further, in the examples shown in FIGS. 2 and 3, the scanning position is defined on the preliminary front image 50. However, the prior data does not have to be the data in which the scanning position is defined on the preliminary front image 50. For example, instead of the preliminary front image 50, the scanning position may be defined on a model in which the arrangement of the tissue of the subject is schematically represented (for example, the fundus model 60 (see FIG. 5) described later). In addition, a specific site on the subject (for example, at least one of the optic nerve head 51, the macula 52, and the fundus blood vessel 53) is set as a reference position, and data in which the relationship between the reference position and the scanning position is defined is generated as prior data. May be done.

<Custom pattern generation process>
The custom pattern generation process will be described with reference to FIGS. 4 and 5. In the image capturing device 1 of the present embodiment, the user can freely create a shooting pattern for combo shooting. The shooting pattern of combo shooting created by the user is called a custom pattern. In the custom pattern generation process, a custom pattern is generated according to the user's instruction. In the present embodiment, the image capturing device 1 executes the custom pattern generation process, but another device (for example, a PC or the like) may execute the custom pattern generation process.

First, the CPU 31 displays a model of the tissue of the subject (fundus model 60 in this embodiment) on the monitor 37 (S11). As an example, in the fundus model 60 shown in FIG. 5, the optic nerve head 61, the macula 62, and the fundus blood vessel 63, which are fundus tissues, are schematically represented. Instead of the fundus model 60, a general frontal image of the subject may be used.

Next, the CPU 31 generates a custom pattern by defining a plurality of shooting patterns on the fundus model 60 in response to an instruction input by the user (S12). For example, when an instruction to select a type of shooting pattern is input, the CPU 31 displays the selected shooting pattern on the fundus model 60. The shooting pattern may include, for example, a line shooting pattern that scans the measurement light linearly, a cross shooting pattern that scans a plurality of measurement lights so as to intersect each other, a map shooting pattern that performs raster scanning, and the like. .. In the example shown in FIG. 5, the map shooting pattern 65 and the line shooting pattern 66 are displayed. The CPU 31 moves the photographing pattern on the fundus model 60 in response to an instruction from the user. Further, the CPU 31 defines the shooting order of a plurality of shooting patterns in response to an instruction from the user. In the example shown in FIG. 5, it is specified that the map shooting pattern 65 is executed for the first time and the line shooting pattern is executed for the second time. When the combo imaging is executed with the custom pattern shown in FIG. 5, the map imaging is performed in the vicinity of the macula, and then the line imaging is continuously performed in the vicinity of the intermediate position between the macula and the optic nerve head. As with the pre-data creation process described above, the instruction from the user may be input via the operation unit 37 or may be input via the microphone 46.

Next, the CPU 31 associates the custom pattern generated in S12 with a specific keyword for specifying the custom pattern and stores it in the NVM 34 (S13). The specific keyword may be set according to the instruction by the user.

<Shooting process>
The photographing process executed by the image capturing apparatus 1 will be described with reference to FIGS. 6 to 8. The image capturing apparatus 1 of the present embodiment can scan the measurement light at a predetermined position based on the collation result of the prior data and the observation front image. Further, the image capturing device 1 of the present embodiment can generate parameters and signals for determining the photographing operation based on the recognition result by the sound recognition process. The CPU 31 of the image capturing device 1 executes the photographing process shown in FIG. 6 according to the image capturing control program stored in the NVM 34.

First, the CPU 31 starts the sound recognition process (S21). In the sound recognition process executed in the present embodiment, the sound input to the microphone 36 is processed as information that can be processed by a computer.

Next, the CPU 31 starts acquiring the observation front image by the front observation optical system 23 (see FIG. 1) (S22). Specifically, the user instructs the patient to gaze at the fixation target, and then the device is aligned with the patient's eye to start acquiring an observation front image of the fundus.

The CPU 31 determines whether or not at least one of the optical path length difference and the focus adjustment instruction is input by sound (S24). The optical path length difference is the difference between the optical path lengths of the measurement light and the reference light in the OCT unit 10. The focus is the focus of the optical system in the OCT unit 10. When the adjustment instruction is input (S24: YES), the CPU 31 adjusts at least one of the optical path length difference and the focus according to the instruction from the user (S25). The process shifts to S42.

For example, "Optimize" or the like can be adopted as a keyword for the user to instruct the adjustment of the optical path length difference and the focus. When the recognition result by the sound recognition process is "Optimize", the CPU 31 automatically adjusts the optical path length difference by driving the optical path length difference adjusting unit 21 based on the position where the tissue is captured in the captured tomographic image. Further, when the recognition result by the sound recognition process is "Optimize", the CPU 31 automatically adjusts the focus by driving the focus adjusting unit 17 based on the contrast of the captured tomographic image. The CPU 31 may adjust only one of the optical path length difference and the focus based on the result of sound recognition. Further, instead of automatically adjusting the optical path length difference and the focus, the CPU 31 may adjust at least one of the optical path length difference and the focus by the amount indicated by the sound.

The CPU 31 determines whether or not the execution instruction for the pre-plan shooting is input by sound (S27). As described above, the pre-plan shooting is a shooting in which the measurement light is scanned at a scanning position predetermined by the user. Various keywords such as "planning shooting" can be adopted as the keyword indicating the execution instruction of the pre-plan shooting. When the execution instruction for the pre-plan shooting is input (S27: YES), the CPU 31 executes the pre-plan shooting preparation process (S28). After that, the process shifts to S42.

The pre-plan shooting preparation process will be described with reference to FIG. 7. First, the CPU 31 identifies a patient to be imaged by the image capturing device 1 (S51). The patient may be identified, for example, by inputting a patient ID or the like. The CPU 31 acquires prior data of the patient to be imaged (that is, the patient identified in S51) (S52). As described above, in the present embodiment, the advance data is generated by the advance data generation device 40, which is a device different from the image capturing apparatus 1. In S52, pre-data is acquired from the pre-data generation device 40 via at least one of wired communication, wireless communication, detachable memory, and the like.

Next, the CPU 31 collates the currently captured observation front image with the prior data acquired in S52 (S53). As an example, the CPU 31 of the present embodiment positions two images so that the correlation value between the pre-front image 50 (see FIG. 3) used in the pre-data and the currently captured observation front image is the highest. By matching, the observation front image and the prior data are collated.

The CPU 31 sets the scanning position of the measurement light based on the result of the collation performed in S53 (S54). As an example, in the present embodiment, the scanning position defined on the pre-front image 50 is set as the scanning position for actually scanning the measurement light in the state where the pre-front image 50 and the observation front image are aligned. Will be done. The CPU 31 generates and stores a parameter for scanning the measurement light at the scanning position set in S54 (that is, a parameter for controlling the drive of the optical scanner 14 in the photographing operation) (S55). As a result, in S44 described later, the measurement light is scanned at the scanning position specified in the prior data.

Returning to the description of FIG. The CPU 31 determines whether or not the execution instruction for follow-up shooting is input by sound (S30). The follow-up imaging is an imaging performed on the same patient's eye under the same imaging conditions as the imaging operation performed in the past. Therefore, follow-up imaging is useful when a doctor performs follow-up on the same patient. The “photographing condition” in the present embodiment indicates the scanning position of the measurement light with respect to the tissue. However, in the follow-up shooting, the shooting conditions other than the scanning position (for example, the optical path length difference) may be the same as the past conditions. Various keywords such as "follow-up" can be adopted as the keyword indicating the execution instruction of the follow-up shooting. When the execution instruction for follow-up shooting is input (S30: YES), the CPU 31 executes the follow-up shooting preparation process (S31). After that, the process shifts to S42.

The follow-up shooting preparation process will be described with reference to FIG. For the processing of S51, S53 to S55 in the follow-up shooting preparation process, the same processing as in the above-mentioned advance plan shooting preparation processing S51, S53 to S55 can be adopted. Therefore, the description of the processes of S51 and S53 to S55 will be simplified. First, the CPU 31 identifies a patient to be imaged by the image capturing device 1 (S51). Next, the CPU 31 acquires the past imaging condition data of the patient (identified patient) to be imaged as prior data (S152). The past imaging condition data is data on the imaging status in the past imaging operation for the same patient. Details will be described later with reference to S48 (see FIG. 6), but in the present embodiment, when the imaging operation is performed, the imaging conditions are stored in the NVM 34 in association with the patient. In S152, the past shooting conditions stored in the NVM 34 are acquired as prior data.

The CPU 31 collates the currently captured observation front image with the prior data acquired in S152 (S54). The CPU 54 sets the scanning position of the measurement light based on the collation result (S54). As a result, the same position as the position where the measurement light was scanned in the past shooting operation is set as the scanning position of the measurement light in the current shooting operation (S44 described later). The CPU 31 generates a parameter for scanning the measurement light at the scanning position set in S54 and stores it in the NVM 34 (S55).

Returning to the description of FIG. The CPU 31 determines whether or not the instruction for designating the combo shooting pattern is input by sound (S33). In the present embodiment, a plurality of shooting patterns for combo shooting are predetermined. As an example, in the present embodiment, a pattern in which macular map photography and macular line photography are continuously performed (so-called “macular combo”) and a pattern in which papillary map photography and papillary line photography are continuously performed (so-called “nipple”). A plurality of combo shooting patterns including "combo") are defined. Further, in the present embodiment, in the custom pattern generation process (see FIG. 4) described above, the user can freely create a shooting pattern for combo shooting. When an instruction to specify a shooting pattern for combo shooting is input (S33: YES), the CPU 31 shoots with a shooting pattern corresponding to the recognition result by sound recognition processing among a plurality of shooting patterns for combo shooting including a custom pattern. Generate a parameter for executing the operation (S37). After that, the process shifts to S42. As the keyword indicating the instruction for designating the photographing pattern, for example, various keywords such as "macula combo", "nipple combo", and "custom A" can be adopted.

The CPU 31 determines whether or not an instruction for designating a shooting position is input by sound (S36). In the present embodiment, when the user specifies a shooting position (that is, a scanning position of the measurement light) by sound, the measurement light is automatically scanned at the designated position. As an example, in the present embodiment, "nipple" and "macula" are provided as keywords for designating the imaging position. When the instruction to specify the shooting position is input (S36: YES), the designated position shooting preparation process is executed (S37), and the process shifts to S42. In the designated position imaging preparation process, the CPU 31 performs image processing on the observation front image to acquire the arrangement of the tissue of the patient's eye reflected in the observation front image. Then, the CPU 31 generates a parameter for scanning the measurement light at a designated position based on the acquired tissue arrangement. For example, when "papillary" is specified, the CPU 31 identifies the position of the optic nerve papilla in the observation front image and generates a parameter for scanning the measurement light at the specified position. The user can also instruct the scanning pattern of the measurement light set in S37 (for example, line scan, cross scan, raster scan, etc.) by sound.

The CPU 31 determines whether or not an instruction to change at least one of the position, shape, and length of the scanning line and the position, shape, and size of the scanning range is input by sound (S39). When a change instruction is input (S39: YES), the CPU 31 changes the currently set scanning line or scanning range according to the input instruction, and newly generates a parameter for scanning the measurement light. (S40). For example, when a sound indicating a direction is input, the CPU 31 moves the position of the currently set scanning line or scanning range in the instructed direction. Similarly, when a sound indicating the shape, length, and size is input, the CPU 31 changes the shape, length, and size of the currently set scanning line or scanning range according to the instruction. do.

The CPU 31 determines whether or not a sound instructing the start of the shooting operation (for example, "shooting start") has been input (S42). If it is not input, the process returns to S24, and the processes of S24 to S42 are repeated. When a sound instructing the start of the shooting operation is input (S42: YES), the CPU 31 controls the drive of the optical scanner 14 and the like according to the parameters generated by the processes of S28, S31, S34, S37, S40 and the like. Then, the tomographic image is taken (S44).

The CPU 31 displays the tomographic image taken by S44 on the monitor 37 (S45), and determines whether or not the re-shooting execution instruction is input by sound (S46). The user can input to the image capturing apparatus 1 by sound an instruction as to whether or not to allow the image displayed on the monitor 37. For example, "OK" or the like can be adopted as a keyword indicating an instruction for allowing an image. For example, "NG" and "re-shooting" can be adopted as keywords for instructing the execution of re-shooting without allowing the image. When the re-shooting execution instruction is input (S46: YES), the process returns to S44, and the re-shooting is performed again according to the same parameters as the previous time. When the instruction to allow the image is input (S46: NO), the captured image and the imaging condition when the imaging operation in S44 is performed are stored in the NVM 34 in association with the patient.

The techniques disclosed in the above embodiments are merely examples. Therefore, it is possible to modify the techniques exemplified in the above embodiments. For example, the image capturing apparatus 1 does not need to execute all of the plurality of processes exemplified in the above embodiment, and may execute only a part of the plurality of processes. A part of the instruction input by sound in the above embodiment may be input via the operation unit 38.

The CPU 31 may generate a signal for determining whether or not to execute tracking based on the recognition result by the sound recognition process. The tracking is a process of tracking the scanning position of the measurement light according to the movement of the tissue of the subject. Further, the CPU 31 may generate a parameter for determining the number of tomographic images used in the addition averaging process based on the recognition result by the sound recognition process. The additive averaging process is a process of reducing noise by taking the average value of the pixel values of a plurality of images taken at the same position. Further, the CPU 31 may generate a signal for switching between the acquisition of the motion contrast image and the acquisition of the tomographic image based on the recognition result by the sound recognition process. The motion contrast image is an image showing movement in a tissue (for example, blood flow flowing through a blood vessel of the tissue, flow of lymph fluid in the tissue, etc.). The image capturing apparatus 1 can also acquire a motion contrast image by acquiring a plurality of OCT signals from the same position in the tissue at different timings and processing the acquired plurality of OCT signals. By switching between shooting a motion contrast image and shooting a tomographic image by sound, the work efficiency of the user is further improved.

In the above embodiment, the user's speech is extracted by the voice recognition process from the sounds input to the microphone 37, and various parameters and signals are generated according to the extracted speech. However, the CPU 31 may set various parameters or the like when it recognizes a specific sound other than the speech (for example, the sound of clapping a hand).

Further, the CPU 31 detects at least one of the direction of the sound source with respect to the sound input means (microphone 36 in the present embodiment) and the distance between the sound input means and the sound source, and is based on the detection result. May generate at least one of the parameters and signals. As an example, the CPU 31 may move the housing of the device in the direction of the sound source. Further, the CPU 31 may control the stop of the device, the volume adjustment of the sound generated from the speaker, or the like according to the distance from the sound generation source. Various methods can be adopted as a method for detecting the direction and distance of the sound source. For example, there is a method of using a plurality of sound input means and detecting the direction of the source based on the difference in the arrival time of the sound to each sound input means and the distance between the plurality of sound input means. There is also a method of detecting the distance to the source based on the phase interference of sound.

The CPU 31 may identify the person who made the statement by sound recognition processing (for example, voiceprint authentication processing or the like), and generate at least one of a parameter and a signal according to the identified result. For example, when the CPU 31 operates an apparatus to identify an inspector (for example, a doctor or an assistant) who inspects a patient by sound recognition processing, the CPU 31 sets at least one of various imaging conditions of the imaging apparatus 1. , The imaging conditions predetermined by the specified inspector, or the imaging conditions selected in the past by the identified inspector may be set. Further, when the patient is specified by the sound recognition process, the CPU 31 may acquire the past imaging condition data of the identified patient as prior data and perform follow-up imaging.

The CPU 31 is at least one of a plurality of continuously captured images when the recognition result by the sound recognition process is the result of instructing the saving of the captured image in the state where the images are continuously captured. May be captured and saved as a captured image. In this case, the user can easily store the images taken at a desired timing among the images taken continuously in the image taking device 1.

When the shooting operation is determined based on the recognition result by the sound recognition process, the CPU 31 may display the recognition result of the sound recognition process that triggered the determination of the shooting operation on the display means. Further, when the shooting operation is determined a plurality of times based on the recognition result by the sound recognition processing, the CPU 31 may display the recognition result of the sound recognition processing that triggered the determination of each of the plurality of shooting operations. In this case, the user can easily confirm whether or not the shooting operation instructed by the sound is properly executed by the display content of the display means.

1 Imaging device 10 OCT unit 11 OCT light source 12 Coupler 13 Measurement optical system 14 Optical scanner 20 Reference optical system 23 Front observation optical system 30 Control unit 31 CPU
34 NVM
36 Microphone 37 Monitor 40 Pre-data generator 41 CPU

Claims (4)

An imaging device that captures an image of the tissue of the patient's eye by processing an OCT signal from the reference light and the reflected light of the measurement light applied to the patient's eye.
A scanning means for scanning the measurement light in a two-dimensional direction on the tissue of the patient's eye.
Sound input means for inputting sound and
A frontal image acquisition means for acquiring a frontal image of the tissue of the patient's eye,
A control unit that controls the operation of the image capturing device, and
With
Multiple imaging patterns with different imaging methods for tomographic images are predetermined.
The control unit
Sound recognition processing is performed on the sound input by the sound input means, and the sound is recognized.
When the recognition result by the sound recognition process is the result of designating the scanning position and the shooting pattern of the measurement light,
By performing image processing on the front image acquired by the front image acquisition means, the arrangement of the tissue of the patient's eye reflected in the front image is acquired.
An image capturing apparatus comprising generating a parameter for scanning the measurement light at a designated scanning position with a designated imaging pattern based on the acquired tissue arrangement. The image capturing apparatus according to claim 1.
The control unit
An image capturing apparatus characterized in that a person who has made a statement is identified by the sound recognition process, and a parameter for scanning the measurement light is generated according to the identified result. The image capturing apparatus according to claim 1 or 2.
The control unit
An image capturing apparatus characterized in that when a shooting operation is determined based on a recognition result by the sound recognition process, the recognition result of the sound recognition process that triggered the determination of the shooting operation is displayed on a display means. An image capturing control program executed in an imaging apparatus that captures an image of the tissue of the patient's eye by processing an OCT signal by the reference light and the reflected light of the measurement light applied to the patient's eye.
The image capturing device is
A scanning means for scanning the measurement light in a two-dimensional direction on the tissue of the patient's eye.
Sound input means for inputting sound and
A frontal image acquisition means for acquiring a frontal image of the tissue of the patient's eye,
A control unit that controls the operation of the image capturing device, and
With
Multiple imaging patterns with different imaging methods for tomographic images are predetermined.
When the image capture control program is executed by the control unit,
Sound recognition processing is performed on the sound input by the sound input means, and the sound is recognized.
When the recognition result by the sound recognition process is the result of designating the scanning position and the shooting pattern of the measurement light,
By performing image processing on the front image acquired by the front image acquisition means, the arrangement of the tissue of the patient's eye reflected in the front image is acquired.
An image capture feature is characterized in that the imaging apparatus is made to perform a step of generating a parameter for scanning the measurement light with the designated imaging pattern at the designated scanning position based on the acquired tissue arrangement. Control program.

Images