JP6373322B2 - Endoscope apparatus and program - Google Patents

Description

  The present invention relates to an endoscope apparatus having a measurement function. The present invention also relates to a program for realizing a measurement function in an endoscope apparatus on a computer.

  In the inspection of boilers, turbines, engines, chemical plants, etc., industrial endoscopes are widely used to observe internal scratches and corrosion. In an industrial endoscope, a plurality of types of optical adapters are prepared so that various observation objects can be observed and inspected, and the distal end portion of the endoscope is replaceable.

  As one of the above optical adapters, there is a stereo measurement optical adapter having two optical systems for forming left and right subject images corresponding to different viewpoints. Patent Document 1 describes an endoscope apparatus that uses an optical adapter for stereo measurement and realizes three-dimensional measurement by stereo measurement using the principle of triangulation.

  In the endoscope apparatus of Patent Document 1, an image including left and right subject images having parallax formed by two optical systems is displayed. For this reason, when the user frequently moves his / her line of sight between the left and right subject images, the visibility is lowered and the user feels bothered.

  Patent Documents 2 and 3 describe an endoscope that displays an image including only a part of a plurality of subject images in order to prevent a reduction in visibility due to displaying an image including a plurality of subject images used in measurement. An apparatus is described. More specifically, in Patent Document 2, an image including only one subject image is extracted from an image obtained by simultaneously capturing two subject images formed by two optical systems, and the image is enlarged and displayed. In this state, measurement is performed. In Patent Document 3, two subject images formed by two optical systems are picked up in time series, an image including only one subject image is displayed, and measurement is performed in that state.

  When an image including only a part of the plurality of subject images is displayed as described above, the visibility is not deteriorated. However, since only a part of the image used in the measurement is displayed, the measurement is performed without confirming the remaining image used in the measurement by the user. In measurement, for example, if an image in which the part to be measured is not captured or an image with an inappropriate brightness is used, the measurement accuracy decreases, so the user must check the image including each subject image used in the measurement before measurement. is important. However, in Patent Documents 2 and 3, since the measurement is performed without confirming a part of the image used in the measurement by the user, the validity (reliability) of the measurement result is lowered.

  Patent Document 4 describes an endoscope apparatus that enables a user to confirm the validity of a measurement result. In Patent Document 4, when the measurement function is activated, an image including only one of the two subject images formed by the two optical systems is displayed (FIG. 7 of Patent Document 4). When the measurement point indicating the measurement position on the image is input by the user while the image is displayed, measurement (calculation of the matching degree of the image in ST115 of FIG. 10 of Patent Document 4) is performed. When the validity of the measurement result is low, the displayed image is switched, and an image including two subject images is displayed (FIG. 12 of Patent Document 4). As described above, when the validity of the measurement result is low, an image including two subject images is automatically displayed. Therefore, the user can check the validity of the measurement result while comparing the two subject images. it can.

  Moreover, in patent document 4, after a measurement is performed as described above and the measurement result (image matching degree in patent document 4) is displayed, the user inputs an instruction to switch the displayed image. It is also possible to switch between an image including only one of two subject images formed by two optical systems and an image including both (paragraphs 0081 and 0082 of Patent Document 4). In this way, since the user can switch the displayed image at his / her own will, when the user has anxiety about the measurement result, the user can switch the displayed image and confirm the image while checking the validity of the measurement result. Sex can be confirmed.

JP 2005-348870 A JP 2009-198787 A JP 2010-128354 A Japanese Patent No. 4409625

  As described above, in Patent Document 4, when the validity of the measurement result is low, the displayed image is automatically switched, and an image including two subject images is displayed. For this reason, the user can confirm the validity of the measurement result while comparing the two subject images. However, since the image is not always switched at the timing when the user wants to confirm the image, the user may feel anxious about the validity of the measurement result.

  On the other hand, as described above, in Patent Document 4, since the user can switch the image on his / her own intention, the user switches the displayed image when he / she is anxious about the measurement result. It is also possible to check the validity of the measurement result while checking the image. However, it is conceivable that the image is confirmed or not depending on the skill of the user. In addition, the timing when the image is confirmed is after the measurement point is once designated and the measurement is performed. As a result, the user may not confirm whether all the images used for measurement are suitable for measurement, or the timing at which the user determines that the image is not suitable for measurement may be delayed. Therefore, the validity of the measurement results and the inspection efficiency have been reduced.

The present invention has been made in view of the above-described problems, and an object thereof is to provide an endoscope apparatus and program capable of improving inspection efficiency.

In order to solve the above-described problem, an endoscope apparatus according to the present invention includes an image generation unit that generates an image including one or more subject images, a display unit that displays the images, and a subject that is based on the images. A control unit that controls the measurement of the size, and the control unit is configured to perform a measurement after a first process for displaying a moving image including one subject image on the display unit, and after the first process. A second process for sequentially displaying a plurality of subject images used or a plurality of images based on one subject image used for measurement on the display unit as still images, and the second process for measurement. After a portion of a plurality of subject images used or a portion of a plurality of images based on one subject image used in measurement is displayed and before all of the images are displayed, the user's first A third process for returning to the first process when instructed; In the second process, after all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement are displayed, the user has given a second instruction. In this case, the measurement point is designated based on the user's instruction, and the subject at the designated measurement point is based on the image based on all of the plurality of subject images or the plurality of images based on the one subject image And a measurement process for measuring the size of.

In order to solve the above problems, an endoscope apparatus according to the present invention is based on an image generation unit that generates an image including one or more subject images, a display unit that displays the image, and the image. A control unit that controls measurement of the size of the subject, and the control unit displays a moving image including one subject image on the display unit, and after the first processing, Measurement is performed by a second process in which a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement are displayed on the display unit as still images, and in the second process. When all of the plurality of subject images used in the above or a plurality of images based on one subject image used in measurement are displayed, the first instruction is given when the user gives a first instruction . a third process of returning to the processing, in the second processing, used in the measurement After all of the plurality of all of the subject image or the plurality based on one of the object image to be used in the measurement image, it is displayed, which is, when there is a second user instruction, based on a user's instruction Measurement processing for designating a measurement point and measuring the size of the subject at the designated measurement point based on an image based on all of the plurality of subject images or on all of the plurality of images based on the one subject image; , Is executed.

In order to solve the above problems, an endoscope apparatus according to the present invention is based on an image generation unit that generates an image including one or more subject images, a display unit that displays the image, and the image. A control unit that controls measurement of the size of the subject, and the control unit displays a moving image including one subject image on the display unit, and after the first processing, A second process of sequentially displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images; and the second process, After a part of a plurality of subject images used in measurement or a part of a plurality of images based on one subject image used in measurement and before all of them are displayed, Third process to return to the first process when there is an instruction of 1 In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is issued. And an image recording process for recording all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement. .

In order to solve the above problems, an endoscope apparatus according to the present invention is based on an image generation unit that generates an image including one or more subject images, a display unit that displays the image, and the image. A control unit that controls measurement of the size of the subject, and the control unit displays a moving image including one subject image on the display unit, and after the first processing, Measurement is performed by a second process in which a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement are displayed on the display unit as still images, and in the second process. When all of the plurality of subject images used in the above or a plurality of images based on one subject image used in measurement are displayed, the first instruction is given when the user gives a first instruction. The third process to return to the process and the second process are used for measurement. The plurality of object images used in the measurement when the second instruction of the user is given after all of the plurality of object images to be processed or all of the plurality of images based on one object image used in the measurement are displayed. Image recording processing for recording all of the subject images or all of a plurality of images based on one subject image used in measurement.

In addition, the present invention is used in measurement after a first step of causing a computer to display a moving image including one subject image captured by an endoscope apparatus on a display unit, and after the first step. A second step of sequentially displaying a plurality of subject images or a plurality of images based on one subject image used in measurement on the display unit as still images and used in the measurement in the second step. The first instruction of the user is input after a part of a plurality of subject images or a part of a plurality of images based on one subject image used in measurement and before all of them are displayed. In this case, in the third step to return to the first step and the second step, all of a plurality of subject images used in measurement or a plurality of subject images used in the measurement are used. All images of were displayed In addition, when the user's second instruction is input, a measurement point is designated based on the user's measurement point instruction, and an image based on all of the plurality of subject images or a plurality of subjects based on the one subject image And a measurement step for measuring the size of the subject at a specified measurement point based on all of the images.

In addition, the present invention is used in measurement after a first step of causing a computer to display a moving image including one subject image captured by an endoscope apparatus on a display unit, and after the first step. A second step of displaying a plurality of subject images or a plurality of images based on one subject image used in measurement on the display unit as a still image, and a plurality of subjects used in the measurement in the second step. When the user's first instruction is input after all of the subject images or all of the plurality of images based on one subject image used in measurement are displayed, the process returns to the first step. And the second step, after all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement are displayed. There was an instruction In other words, the measurement point is designated based on the measurement point instruction of the user, and the designated measurement point is based on the image based on all of the plurality of subject images or the plurality of images based on the one subject image. A measurement step for measuring the size of the subject in the program.

In addition, the present invention is used in measurement after a first step of causing a computer to display a moving image including one subject image captured by an endoscope apparatus on a display unit, and after the first step. A second step of sequentially displaying a plurality of subject images or a plurality of images based on one subject image used in measurement on the display unit as still images and used in the measurement in the second step. The first instruction of the user is input after a part of a plurality of subject images or a part of a plurality of images based on one subject image used in measurement and before all of them are displayed. In the third step, the plurality of subject images used in the measurement, or a plurality of subject images used in the measurement in the third step and the second step returned to the first step. After all of the image is displayed An image recording step of recording all of a plurality of subject images used in measurement or all of a plurality of images based on one subject image used in measurement when the user's second instruction is input; Is a program for executing
In addition, the present invention is used in measurement after a first step of causing a computer to display a moving image including one subject image captured by an endoscope apparatus on a display unit, and after the first step. A second step of displaying a plurality of subject images or a plurality of images based on one subject image used in measurement on the display unit as a still image, and a plurality of subjects used in the measurement in the second step. When the user's first instruction is input after all of the subject images or all of the plurality of images based on one subject image used in measurement are displayed, the process returns to the first step. And the second step, after all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement are displayed. Instructions are entered When a program for executing and an image recording step of recording all of one of the plurality of images based on a subject image to be used by all, or measurement of a plurality of object images to be used in the measurement.

  According to the present invention, inspection efficiency can be improved.

1 is a perspective view of an endoscope apparatus according to a first embodiment of the present invention. 1 is a block diagram showing a configuration of an endoscope apparatus according to a first embodiment of the present invention. It is a block diagram which shows the function structure of the endoscope apparatus by the 1st Embodiment of this invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 1st Embodiment of this invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 1st Embodiment of this invention. It is a reference diagram showing an image in the first embodiment of the present invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 1st Embodiment of this invention. It is a reference diagram showing an image in the first embodiment of the present invention. It is a block diagram which shows the structure of the optical adapter with which the front-end | tip of the endoscope insertion part of the endoscope apparatus by the 2nd Embodiment of this invention is mounted | worn. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 2nd Embodiment of this invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 2nd Embodiment of this invention. It is a reference diagram showing an image in the second embodiment of the present invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 2nd Embodiment of this invention. It is a reference diagram showing an image in the second embodiment of the present invention. It is a flowchart which shows the procedure of operation | movement of the endoscope apparatus by the 3rd Embodiment of this invention. It is a reference figure which shows the screen at the time of the image confirmation in the 3rd Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
First, a first embodiment of the present invention will be described. FIG. 1 shows the appearance of the endoscope apparatus according to the present embodiment. FIG. 2 shows a functional configuration of the endoscope apparatus according to the present embodiment. FIG. 3 shows a functional configuration of a control unit provided in the endoscope apparatus according to the present embodiment.

  The endoscope apparatus 1 according to the present embodiment takes an image of a subject that is a subject to be examined and performs measurement using the image, so that the optical adapter at the distal end of the endoscope insertion portion is replaced or built-in. Various observations and measurements can be performed by appropriately selecting the measured measurement program or adding the measurement program as appropriate. Hereinafter, a case where stereo measurement is performed as an example of measurement will be described.

  As shown in FIGS. 1 and 2, an endoscope apparatus 1 includes a stereo measurement optical adapter 2, an endoscope insertion unit 3, an endoscope unit 7, a CCU 9 (camera control unit), a liquid crystal monitor 6 (display unit). ), The remote controller 5 and the control unit 4. The stereo measurement optical adapter 2 has a structure in which objective lenses 2A and 2B arranged at a predetermined distance to obtain an image having parallax are arranged in a substantially cylindrical adapter body 2a. The endoscope 2 is detachably attached to the distal end of the endoscope insertion portion 3 by a mount portion 2b formed with a female screw or the like.

  The positions of the objective lenses 2A and 2B are different between the direct-viewing type having a visual field in the axial direction of the stereo measurement optical adapter 2 and the side-viewing type having a visual field in the side surface direction of the stereo measurement optical adapter 2. In FIG. 1, it is illustrated as a direct view type. For this reason, the objective lenses 2A and 2B are disposed in the vicinity of the opening provided on the distal end surface with the optical axis directed in the axial direction of the stereo measurement optical adapter 2. In addition, an illumination window 2c that emits the illumination light guided into the adapter main body 2a toward the subject is provided on the distal end surface of the stereo measurement optical adapter 2.

  The endoscope insertion unit 3 images the region to be measured while being inserted into the subject, and outputs an imaging signal to the control unit 4. The distal end portion of the bendable endoscope insertion portion 3 is provided with a mount portion common to a plurality of optical adapters such as the stereo measurement optical adapter 2 so that each optical adapter is replaceably mounted. Yes. Although not particularly illustrated, an imaging element such as a CCD that images an image formed by a plurality of objective lenses of the optical adapter is disposed inside the distal end portion, and a light that irradiates the subject with illumination light. A guide is provided.

  The endoscope insertion portion 3 is formed in an elongated tubular shape that can be bent from the distal end portion to the proximal end portion. Inside the endoscope insertion portion 3, a signal line of the image sensor, a light guide body, a wire mechanism for operating the bending of the distal end portion, and the like (all not shown) are arranged. When the stereo measurement optical adapter 2 is attached to the endoscope insertion unit 3, a pair of images having parallax (hereinafter referred to as parallax images) are simultaneously acquired by the imaging device, and the endoscope insertion unit 3. An imaging signal is transmitted to the CCU 9 through an internal signal line.

  The endoscope unit 7 stores an illumination light source that generates illumination light guided to the light guide of the endoscope insertion portion 3, an electric bending drive unit of a wire mechanism, and a control parameter for driving the electric bending drive unit. The device includes an EEPROM 8 and the like, and is built in the control unit 4 while being connected to the proximal end portion of the endoscope insertion portion 3.

  The CCU 9 controls the imaging operation of the imaging device provided in the endoscope insertion unit 3 and converts the imaging signal acquired by the imaging device into an image signal such as an NTSC signal, for example, to obtain an input image signal 100 (FIG. 3) and output to the control unit 4.

  The liquid crystal monitor 6 displays an image of the subject and other information based on the display image signal 101a (see FIG. 3) output from the control unit 4. These images and information are displayed individually or in combination as required. When performing stereo measurement as in the present embodiment, the display image signal 101a corresponds to an image including one or both of parallax images.

  Examples of other information displayed on the liquid crystal monitor 6 include information input from an operation unit such as a remote controller 5 described later, an operation menu, and an operation graphical user interface (GUI). Further, measurement information 102 (see FIG. 3) including an image of a cursor used at the time of measurement, a measurement result, and the like can be given. Hereinafter, an image including information related to an operation is referred to as an operation image.

  The remote controller 5 is an operation unit for a user to input various operations to the endoscope apparatus 1, and is connected to the control unit 4. The operation input performed by the user via the remote controller 5 includes, for example, an operation relating to power on / off, an operation relating to an imaging operation, an operation relating to illumination, an operation for driving the bending of the endoscope insertion portion 3, an operation relating to measurement, a liquid crystal There are an image processing selection operation for an image displayed on the monitor 6, an image recording operation to an external storage medium, an operation for reading an image recorded on the external storage medium, and the like. These operations can be appropriately performed via a user interface.

  For example, although not particularly illustrated, the remote controller 5 includes a joystick, a lever switch, a freeze switch, a store switch, a measurement execution switch, and the like. Through these, the user can select and input an operation menu, directly input an instruction, or operate a GUI displayed on the liquid crystal monitor 6 so that various operation inputs can be performed. It has become.

  The control unit 4 performs overall control of the endoscope apparatus 1 including image processing and measurement processing of the captured image. In the present embodiment, the control unit 4 includes a CPU 10, a ROM 11, a RAM 12, various input / output interfaces, and an image processing circuit 16, as shown in FIG.

  The CPU 10 loads a control program stored in the ROM 11 or the external storage medium 44 (see FIG. 3) into the RAM 12 and executes it, and performs operations of functions described later. Examples of the input / output interface include an RS-232C interface 15, a PC card interface 13, and a USB interface 14.

  The RS-232C interface 15 performs communication for operation control among the remote controller 5, the endoscope unit 7, and the CCU 9. The PC card interface 13 is used to connect a PC card compliant with PCMCIA. In the present embodiment, a removable external storage medium is mainly connected to the PC card interface 13, and information regarding measurement results and image information and the like are stored via the PC card interface 13. Therefore, various memory cards using a flash memory as an external storage medium, for example, a PCMCIA memory card 18 and a flash memory card 19 are mounted on the PC card interface 13.

  The USB interface 14 is used for connecting a USB device. In the present embodiment, a USB interface 14 is provided for detachably connecting the personal computer 17. When the personal computer 17 is connected to the USB interface 14, various information is transmitted and received between the control unit 4 and the storage device in the personal computer 17 via the PC card interface 13.

  When connecting the personal computer 17, the personal computer 17 can also share the functions of the liquid crystal monitor 6, the remote controller 5, and the external storage medium connected to the control unit 4. Therefore, for example, control related to measurement, image processing, image display, and the like can be performed using resources of the personal computer 17 as necessary.

  The image processing circuit 16 performs image processing designated via the remote controller 5 on the input image signal 100 (see FIG. 3) supplied from the CCU 9 and outputs output image signals 101A and 101B (see FIG. 3). Generate. Further, the image processing circuit 16 synthesizes the output image signals 101A and 101B with the operation image generated by the CPU 10 and the measurement information 102 (see FIG. 3) as necessary, and further displays the image on the liquid crystal monitor 6. Is displayed, for example, is converted into an NTSC signal or the like and output to the liquid crystal monitor 6 as a display image signal 101a.

  Next, a main functional configuration of the endoscope apparatus 1 will be described with reference to FIG. The endoscope apparatus 1 includes an image generation unit 30, an operation unit 31, and a display unit 33, and further includes an image processing unit 34, a signal conversion unit 38, an image storage unit 42, and a control unit 43 in the control unit 4. Have.

  The image generation unit 30 corresponds to the imaging device in the endoscope insertion unit 3, the endoscope unit 7, and the CCU 9, and is configured by two optical systems (objective lenses 2A and 2B) of the stereo measurement optical adapter 2. An image including two subject images formed simultaneously as a parallax image is generated. The operation unit 31 is provided for the user to perform an operation input such as measurement, and corresponds to the remote controller 5. The display unit 33 corresponds to the liquid crystal monitor 6 and displays an image based on the display image signal 101a. The personal computer 17 may have the functions of the operation unit 31 and the display unit 33.

  From the image generation unit 30, image information for one frame including a pair of parallax images that has been subjected to preprocessing such as luminance level adjustment and noise removal processing by the CCU 9 is input to the image processing unit 34 as an input image signal 100. Is done. The preprocessing may be performed by the image processing unit 34 as image processing.

  The image processing unit 34 and the signal conversion unit 38 correspond to the image signal processing circuit 16. The image processing unit 34 performs image processing on the input image signal 100 that has been input, generates an output image signal 101A and outputs it to the signal conversion unit 38, and generates an output image signal 101B and outputs it to the image storage unit 42. It can be done. In addition, the image processing unit 34 appropriately inputs so as to extract a parallax image including one subject image from an image including two subject images simultaneously formed by the two optical systems of the stereo measurement optical adapter 2. The image signal 100 is processed and output to the signal converter 38 as an output image signal 101A. Note that the output image signals 101A and 101B are not necessarily different signals, and may be the same signal subjected to the same image processing.

  The signal conversion unit 38 outputs the output image signal 101A output from the image processing unit 34 to the display unit 33 as the display image signal 101a. At this time, other image data such as an operation image can be combined with the display image signal 101a as necessary. When the measurement information 102 is output from the control unit 43, the display image signal 101a can be generated in a state where the measurement information 102 is also synthesized.

  The image storage unit 42 corresponds to the RAM 12 and stores the output image signal 101A output from the image processing unit 34 as still image data. When an operation input for recording processing is performed via the operation unit 31, still image data is read from the image storage unit 42 and output to the external storage medium 44 according to control by the control unit 43. It is stored in the storage medium 44. The external storage medium 44 corresponds to the personal computer 17, the PCMCIA memory card 18, and the flash memory card 19.

  The control unit 43 corresponds to the CPU 10, reads a control program stored in the ROM 11 or the external storage medium 44, loads it into the RAM 12, and executes an instruction described in the control program. Each part in the endoscope apparatus 1 is controlled. When an operation input for measurement processing is performed via the operation unit 31, the control unit 43 performs measurement processing by stereo measurement using still image data stored in the image storage unit 42, and performs measurement processing. A measurement GUI image necessary for operation input is generated. For example, when a measurement point is input on the display image of the liquid crystal monitor 6 via the operation unit 31, the control unit 43 uses the position information of the corresponding point of each parallax image corresponding to the measurement point as the luminance information. Is obtained by matching processing based on the above and converted into three-dimensional position coordinates by the principle of triangulation.

  The cursor, measurement point information, measurement results, and the like displayed on the display unit 33 are output from the control unit 43 to the signal conversion unit 38 as measurement information 102 together with the measurement GUI image. The signal conversion unit 38 outputs an output image. It is synthesized with the signal 101A.

  The control program for the endoscope apparatus 1 may be recorded on a computer-readable recording medium, and the control program recorded on the recording medium may be read by a computer other than the endoscope apparatus 1 and executed. For example, the personal computer 17 reads and executes a control program, transmits control information for controlling the endoscope apparatus 1 to the endoscope apparatus 1 according to the control program, and displays the endoscope apparatus 1 as an image. It may be operated in a mode or an image confirmation mode.

  Here, the “computer” includes a homepage providing environment (or display environment) if the WWW system is used. The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, a DVD-ROM, and a flash memory, and a storage device such as a hard disk built in the computer. Say. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included.

  The program described above may be transmitted from a computer storing the program in a storage device or the like to another computer via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting a program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. Further, the above-described program may be for realizing a part of the above-described function. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer, what is called a difference file (difference program) may be sufficient.

  Next, the operation of the endoscope apparatus 1 will be described. 4 and 5 show the operation procedure of the endoscope apparatus 1. When the power is turned on, the endoscope apparatus 1 operates in an image display mode in which an image acquired through the stereo measurement optical adapter 2 is displayed on the liquid crystal monitor 6. In addition, when an operation input is performed via the operation unit 31, the endoscope apparatus 1 operates in an image confirmation mode in which the user confirms all images used for measurement. When the confirmation of all the images used for measurement is completed during operation in the image confirmation mode and an operation input is performed via the operation unit 31, the endoscope apparatus 1 performs various processing modes according to the operation input. Works with. In the following description, various processing modes will be described using an example of a mode in which measurement processing and image information recording processing are performed.

  In the image display mode, the user inserts the endoscope insertion unit 3 equipped with the stereo measurement optical adapter 2 into the subject. Image information including two subject images formed on the image sensor through the stereo measurement optical adapter 2 is output to the control unit 4 as an input image signal 100 through the CCU 9.

  As shown in FIG. 4, in ST 101, the control unit 4 acquires image information for one frame from the image generation unit 30. That is, according to control by the control unit 43, the input image signal 100 is output from the image generation unit 30 to the image processing unit 34 of the control unit 4, and the input image signal 100 for one frame is acquired as image information by the image processing unit 34. The

  Subsequently, in ST102, the image processing unit 34 divides the input image signal 100 for one frame in accordance with control by the control unit 43. That is, the image processing unit 34 performs processing for dividing the image information acquired from the image generation unit 30 for each visual field region including each of the left and right two subject images. At this time, the image may be divided into two at the center of the image, or an image of only the visual field region may be extracted using information on the positions of the two visual field regions obtained by measurement in advance. The divided two pieces of image information are output as an output image signal 101B to the image storage unit 42 and stored in the image storage unit 42.

  Subsequently, in ST103, in accordance with control by the control unit 43, the image processing unit 34 selects one of the two pieces of divided image information (as an example, a parallax image corresponding to the left visual field in this embodiment) Image signal corresponding to 1 frame) is output to the signal converter 38 as an output image signal 101A.

  Subsequently, in ST104, in accordance with the control by the control unit 43, the signal conversion unit 38 performs processing such as changing the image size to a size that can be displayed by the display unit 33 on the input output image signal 101A. The subsequent output image signal 101A is output to the display unit 33 as a display image signal 101a. The display unit 33 displays an image based on the display image signal 101a. Thereby, an image including a parallax image corresponding to the left visual field is displayed on the display unit 33.

  FIG. 6 shows an image generated and displayed by the endoscope apparatus 1 of the present embodiment. FIG. 6A shows an image generated by the image generation unit 30 and before being divided for each visual field region by the image processing unit 34. The image 60 includes an image area provided in an I shape at the top and bottom and the center of the image, and two substantially rectangular image areas other than the area. The left image area includes a parallax image 61L corresponding to the left subject image of the two subject images formed simultaneously by the two optical systems of the stereo measurement optical adapter 2. The right image area includes a parallax image 61R corresponding to the right subject image of the two subject images formed simultaneously by the two optical systems of the stereo measurement optical adapter 2.

  FIG. 6B shows an image displayed on the display unit 33 in ST104. The image 50a includes a parallax image 51L corresponding to the left subject image of the two subject images simultaneously formed by the two optical systems of the stereo measurement optical adapter 2. The parallax image 51L may be enlarged and displayed. In this case, the image processing unit 34 performs an enlargement process on the image signal for one frame corresponding to one of the divided two pieces of image information. The processed image signal is output to the signal converter 38 as an output image signal 101A.

  When the process of ST104 ends, the process of ST105 is performed. In ST105, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. When an operation input is performed, the process of ST106 is performed. If no operation input is performed, the process of ST101 is performed, and the above-described process is performed again for the next one frame of image information. In other words, when no operation input occurs, an image display mode is realized in which one frame of image processed image is displayed on the display unit 33 in real time as a moving image. While viewing the displayed image, the user adjusts the curvature of the distal end portion of the endoscope insertion portion 3 with the remote controller 5 so that the desired measurement site of the subject fits in the image.

  Next, details of the process (image confirmation process) performed in ST106 will be described. FIG. 5 shows a procedure of processing performed in ST106. As shown in FIG. 5, in ST201, the image processing unit 34 controls one of the two pieces of image information stored in the image storage unit 42 according to control by the control unit 43 (for example, the present embodiment). In this case, an image signal for one frame corresponding to the left visual field is output to the signal conversion unit 38 as an output image signal 101A. In accordance with control by the control unit 43, the signal conversion unit 38 performs processing such as changing the image size to a size that can be displayed by the display unit 33 on the input output image signal 101A, and outputs the processed output image signal 101A. Is output to the display unit 33 as the display image signal 101a. The display unit 33 displays an image based on the display image signal 101a. Thereby, an image including a parallax image corresponding to the left visual field is displayed on the display unit 33. The parallax image corresponding to the left visual field displayed in ST201 is the same as the parallax image corresponding to the left visual field displayed in ST104 immediately before.

  FIG. 6C shows an image displayed on the display unit 33 in ST201. The image 50b includes a parallax image 51L corresponding to the left subject image of two subject images simultaneously formed by the two optical systems of the stereo measurement optical adapter 2, an operation input button 70, and a user. Includes a cursor 71 for operating the button 70. As described above, the parallax image 51L in the image 50b is the same as the parallax image 51L in the image 50a displayed in ST104 immediately before. Information such as characters indicating which parallax image corresponding to the left or right visual field is displayed may be displayed together with the parallax image.

  Subsequently, in ST202, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. Until the operation input is performed, the image (still image) displayed in ST201 does not change. In ST202, when the button 70 meaning to proceed to the next is operated, the process of ST203 is performed.

  In ST203, in accordance with control by the control unit 43, the image processing unit 34 selects the other image information of the two pieces of image information stored in the image storage unit 42 (for example, in the right visual field region in the present embodiment). An image signal for one frame corresponding to a corresponding parallax image is output to the signal conversion unit 38 as an output image signal 101A. Thereafter, an image is displayed on the display unit 33 by the processing described above. Thereby, an image including a parallax image corresponding to the right visual field region is displayed on the display unit 33. Information such as characters indicating which parallax image corresponding to the left or right visual field is displayed may be displayed together with the parallax image.

  FIG. 6D shows an image displayed on the display unit 33 in ST203. The image 50c includes a parallax image 51R corresponding to the right subject image of two subject images simultaneously formed by the two optical systems of the stereo measurement optical adapter 2, a button 70 for operation input, and a user. Includes a cursor 71 for operating the button 70.

  Subsequently, in ST204, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. Until an operation input is performed, the image (still image) displayed in ST203 does not change. In ST204, when the button 70 meaning to proceed to the next is operated, the process of ST205 is performed.

  In ST205, as in ST201, an image including a parallax image corresponding to the left visual field is displayed on the display unit 33. In ST205, an image including a parallax image corresponding to the right visual field may be displayed. When the processing of ST205 is finished, the processing of ST106 (image confirmation processing) is finished, and the processing of ST107 is performed. Also, in ST204, when an operation input meaning returning to the previous position is performed, the process of ST201 is performed, and an image including a parallax image corresponding to the left visual field region is displayed on the display unit 33 again. Further, in ST202 and ST204, when an operation input meaning that the confirmation of the image is stopped is performed, the process of ST101 is performed, and the endoscope apparatus 1 operates in the image display mode.

  In ST107, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31, and when the operation input has been performed, performs each process according to the operation input. When an operation input meaning a measurement instruction is performed, the process of ST108 (measurement process) is performed. In ST108, in accordance with control by the control unit 43, the image processing unit 34 corresponds to one of the two pieces of image information stored in the image storage unit 42 (for example, the left visual field in the present embodiment). Image signal corresponding to one frame) is output to the signal conversion unit 38 as an output image signal 101A. Thereafter, an image is displayed on the display unit 33 by the processing described above. Thereby, an image including a parallax image corresponding to the left visual field is displayed on the display unit 33.

  FIG. 6E shows an image displayed on the display unit 33 in ST108. The image 50d includes a parallax image 51L corresponding to the left subject image of the two subject images simultaneously formed by the two optical systems of the stereo measurement optical adapter 2, and a measurement after the user inputs a measurement point. An operation input button 72 for instructing the execution of the arithmetic processing, an operation input button 73 for the user to instruct the end of the measurement processing, and a user specifying a measurement point or operating the buttons 72 and 73 And a cursor 71 for performing. In FIG. 6E, a parallax image corresponding to the left visual field is displayed, but a parallax image corresponding to the right visual field may be displayed. Further, the operation input button in FIG. 6E is an example, and there may be a button for designating the type of calculation processing (distance between two points, depth, area, etc.).

  In ST108, the control unit 43 reads the image signal for one frame corresponding to the two pieces of image information from the image storage unit 42, and based on the measurement point instruction input via the operation unit 31, 2 A measurement point in one of the pieces of image information is designated. Further, the control unit 43 obtains the position of the point (corresponding point) corresponding to the measurement point in the other image information, calculates the three-dimensional coordinates on the subject from the position of the measurement point and the corresponding point, and Measure the size of the subject (distance between two points, depth, area, etc.).

  In ST107, when an operation input for instructing recording of image information is performed, the process of ST109 (recording process of image information) is performed. In ST109, in accordance with control by the control unit 43, an image signal for one frame corresponding to two pieces of image information is read from the image storage unit 42, output to the external storage medium 44, and stored in the external storage medium 44. . In recording the image information, an image including two parallax images corresponding to the left and right visual field regions may be recorded as shown in FIG. 6A, or the parallax images corresponding to the left and right visual field regions may be recorded as separate images. These images may be recorded in an associated state.

  In ST107, when an operation input meaning that neither measurement nor image information is recorded is performed, the process of ST101 is performed, and the endoscope apparatus 1 operates in the image display mode.

  As described above, a parallax image corresponding to only one of the left and right visual field regions is displayed except when confirming the image (ST106). For this reason, when two parallax images corresponding to the left and right visual field regions are displayed at the same time, there is no degradation in visibility due to frequent movement of the line of sight between the two parallax images.

  Further, before the user inputs the measurement point, the operation mode of the endoscope apparatus can be shifted to the image confirmation mode by a simple operation input. In the image confirmation mode, all the parallax images used in the measurement are confirmed by the processes of ST201 and ST203, and when both the processes of ST201 and ST203 are completed, it is possible to shift to the measurement process. When checking the image, the user can check all the parallax images at his / her own pace while the image is stationary. Therefore, the measurement is performed with an image including only one of the two parallax images displayed at the time of measurement. Even when performing the measurement, the validity of the measurement result can be easily confirmed before the measurement is performed. In addition, when the user determines that the displayed image is not suitable for measurement during image confirmation, the operation mode of the endoscope apparatus is shifted to the image display mode by a simple operation input, and the image is displayed. Since the image can be retaken, the inspection efficiency is improved.

  When examining a subject with an endoscope apparatus, the distal end of an endoscope insertion portion is often brought close to the subject to observe the subject, resulting in an increase in left and right parallax. An endoscope in which an image including two parallax images is automatically displayed when the validity of the measurement result is low, as in Patent Document 4, since the validity of the measurement result tends to be low when the left and right parallax increases. In the apparatus, an image including two parallax images is often displayed, and visibility during measurement is reduced. On the other hand, in the endoscope apparatus of the present embodiment, it is not necessary to display an image including two parallax images during measurement, and thus visibility during measurement does not decrease.

  After observing a subject with an endoscopic device, the measurement is not always performed on-site, but only an image is taken on-site, and later, the measurement can be performed while reproducing the image. is there. When an inspection is performed by this method using a conventional endoscope apparatus, if the photographed image is not suitable for measurement, it takes time and effort to return to the site and recapture the image. In contrast, when an inspection is performed using the endoscope apparatus of the present embodiment, all parallax images used in measurement are confirmed by the processing in ST201 and ST203, and then image information is received in ST109. To be recorded. For this reason, it is possible to reduce mistakes in recording an image that is not suitable for measurement, and it is possible to prevent the trouble of returning to the site again and re-taking the image.

  Next, a modification of this embodiment will be described. FIG. 7 shows another example of the processing procedure performed in ST106. In ST210, in accordance with control by the control unit 43, the image processing unit 34 outputs to the signal conversion unit 38 an image signal for one frame corresponding to two pieces of image information stored in the image storage unit 42 as an output image signal 101A. Output. Thereafter, an image is displayed on the display unit 33 by the processing described above. Thereby, an image including two parallax images corresponding to the left and right visual field regions is displayed on the display unit 33.

  FIG. 8 shows an image displayed on the display unit 33 in ST210, which is the same as the image shown in FIG. In ST210, as shown in FIG. 8, an image including two parallax images corresponding to the left and right visual field regions is displayed. In ST210, the two parallax images may be displayed side by side after being enlarged to such an extent that the respective parallax images are not hidden on the liquid crystal monitor 6.

  Subsequently, in ST202, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. Until an operation input is performed, the image (still image) displayed in ST210 does not change. In ST202, when the button 70 meaning to proceed to the next is operated, the process of ST205 is performed.

  In ST205, as described above, an image including a parallax image corresponding to the left visual field is displayed on the display unit 33. When the processing of ST205 is finished, the processing of ST106 (image confirmation processing) is finished, and the processing of ST107 is performed. Further, in ST202, when an operation input meaning that the confirmation of the image is stopped is performed, the process of ST101 is performed, and the endoscope apparatus 1 operates in the image display mode.

  By simultaneously displaying the two parallax images when confirming the image as described above, the user can easily compare them, and the validity of the measurement result can be easily confirmed.

  When confirming an image, not only two parallax images are displayed in order (FIG. 6), but two parallax images are simultaneously displayed (FIG. 8), and two parallax images are displayed in order. Both parallax images may be displayed simultaneously. For example, when the image is confirmed, the image 50b in FIG. 6C, the image 50c in FIG. 6D, and the image 60 in FIG.

  When two parallax images are displayed at the same time, the displayed parallax image may be small and it may be difficult to confirm the parallax image. However, when only one of the two parallax images is displayed by the above method, The parallax image can be confirmed in detail, and when both parallax images are displayed, both can be compared. Regardless of whether two parallax images are displayed simultaneously or separately, at least a part of each parallax image may be enlarged.

  When the image is confirmed, the image may be displayed after image processing for assisting the confirmation is performed on the displayed image. For example, according to control by the control unit 43, the image processing unit 34 performs an image signal for one frame corresponding to one or both of the two pieces of image information stored in the image storage unit 42. Edge enhancement is performed, or a process for making the area conspicuous in a predetermined color (red, etc.) by discriminating a halation part in the image is performed, and the signal conversion unit 38 uses the processed image signal as the output image signal 101A. Output to. Thereafter, an image is displayed on the display unit 33 by the processing described above. Whether or not to perform image processing for assisting confirmation may be switched by a simple operation by the user. By performing such image processing, the user can more easily confirm the validity of the measurement result.

  Two parallax images may be automatically displayed in order at the time of image confirmation, regardless of the user's operation input. For example, the displayed parallax images may be switched at regular time intervals as in a slide show. The time interval for switching the parallax images may be arbitrarily set within a time range in which the user can check the images.

  In the present embodiment, an example of capturing an image including two subject images simultaneously formed by two optical systems has been described. However, when capturing an image including three or more subject images corresponding to different viewpoints. In addition, it is possible to make the user confirm the image in the same procedure as in the present embodiment.

  As described above, according to the present embodiment, in the image display mode, a moving image including only one of the left and right parallax images is displayed, so visibility during observation of the subject can be maintained. Further, in the image confirmation mode, all the left and right parallax images used in the measurement are displayed as still images, so that the user can easily confirm the validity of the measurement result before the measurement is performed.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. The endoscope apparatus according to the first embodiment captures an image including two subject images simultaneously formed by two optical systems, but the endoscope apparatus according to the second embodiment sometimes uses two optical systems. An image containing two subject images separately formed is photographed.

  In this embodiment, instead of the stereo measurement optical adapter 2 in the first embodiment, an optical adapter capable of switching the optical path of light incident on the image sensor is attached to the distal end of the endoscope insertion portion 3. . FIG. 9 shows the configuration of the optical adapter in this embodiment. An optical adapter 21 is attached to the distal end of the endoscope insertion portion 3. The optical adapter 21 includes concave lenses 23a and 23b, convex lenses 24a and 24b, a switching unit 25, and an imaging optical system 26. An imaging element 3 a is disposed in the distal end of the endoscope insertion portion 3.

  The concave lens 23a, the convex lens 24a, and the imaging optical system 26 constitute a first optical system that forms a first subject image formed by light from the subject in the region S1 of the image sensor 3a. The concave lens 23b, the convex lens 24b, and the imaging optical system 26 constitute a second optical system that forms a second subject image formed by light from the subject in the region S1 of the image sensor 3a. The light from the subject incident on the first optical system passes through the optical path L1 and is formed as a first subject image on the region S1 of the image sensor 3a. The light from the subject incident on the second optical system passes through the optical path L2, and is formed as a second subject image in the region S1 of the image sensor 3a. The first subject image and the second subject image are formed in a common area S1 of the image sensor 3a.

  The switching unit 25 switches the optical path between the optical path L1 and the optical path L2 so that only one of the first subject image and the second subject image is formed in the region S1. The optical path switching operation by the switching unit 25 is controlled by the CPU 10 in the control unit 4. When the optical path L1 is set by the switching unit 25, the imaging device 3a generates a first image including the first subject image formed in the region S1, and the optical path L2 is set by the switching unit 25. The second image including the second subject image formed in the region S1 is generated.

  The first image has parallax with respect to the second image, or the second image has parallax with respect to the first image. The first image corresponds to the parallax image of the left visual field area in the first embodiment, and the second image corresponds to the parallax image of the right visual field area in the second embodiment. The first image and the second image generated by the image sensor 3 a are output to the control unit 4.

  Two subject images formed by light passing through the two optical paths are formed in a common area S1 of the image sensor 3a. For this reason, an imaging area can be enlarged and imaging image quality and measurement accuracy can be improved.

  Next, the operation of the endoscope apparatus 1 will be described. 10 and 11 show an operation procedure of the endoscope apparatus 1. As shown in FIG. 10, in ST110, the switching unit 25 sets the optical path to the optical path L1 in accordance with control by the control unit 43. Subsequently, in ST111, the control unit 4 acquires image information for one frame from the image generation unit 30. That is, according to control by the control unit 43, the input image signal 100 is output from the image generation unit 30 to the image processing unit 34 of the control unit 4, and the input image signal 100 for one frame is acquired as image information by the image processing unit 34. The The image processing unit 34 performs predetermined image processing on the acquired input image signal 100, outputs the processed input image signal 100 to the signal conversion unit 38 as an output image signal 101A, and outputs an image as an output image signal 101B. The data is output to the storage unit 42. The output image signal 101B output to the image storage unit 42 is stored in the image storage unit 42 as first image information.

  Subsequently, in ST112, in accordance with control by the control unit 43, the signal conversion unit 38 performs a process such as changing the image size to a size that can be displayed by the display unit 33 on the input output image signal 101A. The subsequent output image signal 101A is output to the display unit 33 as a display image signal 101a. The display unit 33 displays an image based on the display image signal 101a. As a result, the first image is displayed on the display unit 33.

  FIG. 12 shows an image displayed by the endoscope apparatus 1 of the present embodiment. FIG. 12A shows an image displayed on the display unit 33 in ST112, and a first image 52L based on the light passing through the optical path L1 is displayed.

  When the process of ST112 is completed, the process of ST105 is performed. Since the processes of ST105 to ST109 are the same as the processes described in the first embodiment except for the process of ST106, description of these processes is omitted.

  Next, details of the process (image confirmation process) performed in ST106 will be described. FIG. 11 shows the procedure of processing performed in ST106. As shown in FIG. 11, in ST220, in accordance with control by the control unit 43, the image processing unit 34 outputs an image signal for one frame corresponding to the first image information stored in the image storage unit 42 as an output image. The signal 101A is output to the signal converter 38. In accordance with control by the control unit 43, the signal conversion unit 38 performs processing such as changing the image size to a size that can be displayed by the display unit 33 on the input output image signal 101A, and outputs the processed output image signal 101A. Is output to the display unit 33 as the display image signal 101a. The display unit 33 displays an image based on the display image signal 101a. As a result, the first image is displayed on the display unit 33. The first image displayed in ST220 is the same as the first image displayed in ST112 immediately before.

  FIG. 12B shows an image displayed on the display unit 33 in ST220. The first image 52L based on the light passing through the optical path L1, the operation input button 70, and the user presses the button 70. A cursor 71 for operation is displayed. Information such as characters indicating which of the first image and the second image is displayed may be displayed together with the image.

  In parallel with the process of ST220, the processes of ST221 and ST222 are performed. In ST2221, the switching unit 25 sets the optical path to the optical path L2 in accordance with control by the control unit 43. Subsequently, in ST222, the control unit 4 acquires image information for one frame from the image generation unit 30. That is, according to control by the control unit 43, the input image signal 100 is output from the image generation unit 30 to the image processing unit 34 of the control unit 4, and the input image signal 100 for one frame is acquired as image information by the image processing unit 34. The The image processing unit 34 performs predetermined image processing on the acquired input image signal 100 and outputs the processed input image signal 100 to the image storage unit 42 as an output image signal 101B. The output image signal 101B output to the image storage unit 42 is stored in the image storage unit 42 as second image information.

  Subsequently, in ST223, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. Until the operation input is performed, the image (still image) displayed in ST220 does not change. In ST223, when an operation input meaning to proceed to the next is performed, the process of ST224 is performed.

  In ST224, in accordance with control by the control unit 43, the image processing unit 34 outputs an image signal for one frame corresponding to the second image information stored in the image storage unit 42 to the signal conversion unit 38 as an output image signal 101A. Output. Thereafter, an image is displayed on the display unit 33 by the processing described above. As a result, the second image is displayed on the display unit 33. Information such as characters indicating which of the first image and the second image is displayed may be displayed together with the image.

  FIG. 12C shows an image displayed on the display unit 33 in ST224. The second image 52R based on the light passing through the optical path L2, the operation input button 70, and the user presses the button 70. A cursor 71 for operation is displayed. Information such as characters indicating which of the first image and the second image is displayed may be displayed together with the image.

  Subsequently, in ST225, the control unit 43 determines whether or not an operation input has been performed via the operation unit 31. Until an operation input is made, the image (still image) displayed in ST224 does not change. In ST225, when an operation input meaning to proceed to the next is performed, the process of ST226 is performed.

  In ST226, as in ST220, the first image is displayed on display unit 33. In ST226, a second image may be displayed. When the process of ST226 ends, the process of ST106 (image confirmation process) ends, and the process of ST107 is performed. Also, in ST225, when an operation input that means returning is performed, the process of ST220 is performed, and an image including a parallax image corresponding to the left visual field is displayed on the display unit 33 again. At this time, the processes of ST221 and ST222 are not performed. Also, in ST223 and ST225, when an operation input meaning that the confirmation of the image is stopped is performed, the process of ST110 is performed, and the endoscope apparatus 1 operates in the image display mode.

  In ST108 (measurement processing), measurement is performed using the first image and the second image. FIG. 12D shows an image displayed on the display unit 33 in ST108. The first image 52L based on the light passing through the optical path L1 and the execution of measurement calculation processing after the user inputs measurement points. An operation input button 72 for instructing the user, an operation input button 73 for the user to instruct the end of the measurement process, and a user specifying a measurement point or operating the buttons 72 and 73. The cursor 71 is included. Although the first image is displayed in FIG. 12D, the second image may be displayed.

  As described above, an image based on light passing through only one of the two optical paths is displayed except when confirming the image (ST106). For this reason, when two images based on light passing through each of the two optical paths are displayed at the same time, there is no deterioration in visibility due to the user frequently moving his / her line of sight between the two parallax images. In the image confirmation mode, all the images used in the measurement are confirmed by the processes of ST220 and ST224, so that the user can easily confirm the validity of the measurement result before the measurement is performed.

  Next, a modification of this embodiment will be described. FIG. 13 shows another example of the processing procedure performed in ST106. In FIG. 13, the process performed in ST224 shown in FIG. 11 is changed to the process performed in ST227 described below.

  In ST227, in accordance with control by the control unit 43, the image processing unit 34 corresponds to the image signal for one frame corresponding to the first image information and the second image information stored in the image storage unit 42. The image signal for one frame is combined so that two images are displayed side by side, and the combined image signal is output to the signal conversion unit 38 as an output image signal 101A. Thereafter, an image is displayed on the display unit 33 by the processing described above. As a result, the first image and the second image are displayed on the display unit 33.

  FIG. 14 shows an image displayed on the display unit 33 in ST227. The image 53 includes a first image 54L obtained by reducing the first image based on the light passing through the optical path L1, and a second image 54R obtained by reducing the second image based on the light passing through the optical path L2. It is.

  In FIG. 13, since the processes other than the process of ST227 have already been described, the description thereof will be omitted.

  When confirming the image, not only the two images are displayed in order (FIG. 12), the two images are displayed simultaneously (FIG. 14), but the two images are displayed in sequence and the two images are displayed. You may perform both displaying simultaneously. For example, when the image is confirmed, the image 52L in FIG. 12B, the image 52R in FIG. 12C, and the image 53 in FIG.

  Further, as described in the first embodiment, when confirming an image, the displayed image may be displayed after image processing for assisting confirmation is performed on the displayed image. Sometimes, two images may be automatically displayed in order regardless of user operation input.

  In the present embodiment, an example has been described in which images including two subject images separately formed in time series by two optical systems are captured, but three or more subject images corresponding to different viewpoints are included. Even when an image is taken, the user can check the image in the same procedure as in the present embodiment.

  In addition, the present embodiment can be applied to an apparatus that sequentially projects a plurality of patterns on a subject and performs measurement using a plurality of images obtained by capturing each pattern. For example, before the measurement function is activated, a moving image obtained by photographing the subject for observation (moving image based on one subject image) is displayed. When imaging for measurement is instructed, a plurality of patterns are sequentially projected onto the subject to perform imaging, and a plurality of images (still images based on one subject image) used for measurement are generated. Thereafter, all of the plurality of images used for measurement are displayed sequentially or simultaneously as still images, and confirmation by the user is performed. After confirmation for all images is completed, measurement points are input and measurement is performed.

  As described above, according to the present embodiment, even in an endoscope apparatus that captures images including two subject images separately formed in time series by two optical systems, in the image display mode, the subject In the image confirmation mode, the user can easily confirm the validity of the measurement result before performing the measurement.

(Third embodiment)
Next, a third embodiment of the present invention will be described. In the present embodiment, a case where measurement is performed by reproducing a recorded image will be described. In the following, a method for allowing a user to check an image used for measurement will be described, taking as an example the case where measurement is performed on the personal computer 17.

  For example, a file including all image information used for measurement is recorded in the personal computer 17 by the process of ST109 (image information recording process). At this time, information indicating image information that is representative of all the recorded image information (hereinafter referred to as representative image information) is also recorded in the file. In the process of ST109, the file may be recorded on an external storage medium such as a card medium connected to the endoscope apparatus 1, the external storage medium may be connected to the personal computer 17, and the file may be read by the personal computer 17. .

  After the file is recorded on the personal computer 17, when the user opens the file on the personal computer 17, the image is confirmed and measured according to the procedure shown in FIG. FIG. 15 shows an operation procedure of the control unit of the personal computer 17.

  As shown in FIG. 15, in ST301, the control unit displays an image based on the representative image information (hereinafter referred to as a representative image) on the display unit of the personal computer 17, and all the image information recorded in the file. Display thumbnails. FIG. 16 shows a screen of the display unit of the personal computer 17 when the user confirms the image. On the screen 80 of the display unit, a still image 81 for confirmation and thumbnails 82, 83, and 84 that are reduced images of image information recorded in the file are displayed. FIG. 16 shows an example in which images including three subject images corresponding to different viewpoints are taken simultaneously or in time series, and three images corresponding to the respective subject images are generated. Two or more images may be generated.

  In ST301, a representative image is displayed as the still image 81. A thumbnail 82 corresponding to the still image 81 is conspicuously displayed. In FIG. 16, the thumbnail 82 is a thumbnail of the representative image. In the example shown in FIG. 16, the thumbnails 82, 83, and 84 are displayed. However, the thumbnails 82, 83, and 84 may not be displayed when the image is confirmed.

  Subsequently, in ST302, the control unit determines whether or not an operation input has been performed on the personal computer 17. Until an operation input is performed, the image (still image) displayed in ST301 does not change. In ST302, when an operation input meaning to proceed to the next is performed, the process of ST303 is performed.

  In ST303, the control unit displays another still image different from the displayed still image on the display unit. For example, if an image corresponding to the thumbnail 82 in FIG. 16 is displayed as a still image 81 in ST301, an image corresponding to the thumbnail 83 is displayed as a still image 81 in ST303, and an image corresponding to the thumbnail 83 is displayed in ST301. When displayed as the still image 81, an image corresponding to the thumbnail 84 is displayed as the still image 81 in ST303. The image (still image) displayed in ST303 does not change until the next operation input is performed.

  Subsequently, in ST304, the control unit determines whether all images in the same file are displayed as still images. If there is an image that is not displayed, the process of ST302 is performed again. If all the images are displayed as still images, the process of ST305 is performed.

  In ST305, the control unit determines whether or not an operation input has been performed on the personal computer 17. In ST305, when an operation input meaning to proceed to the next is performed, the process of ST306 is performed. In ST306, the control unit performs measurement processing. In the measurement process, a measurement image including a representative image and a measurement menu is displayed on the display unit, and a measurement point is input. In the measurement process, the representative image information and all image information corresponding to the still image displayed in ST303 are used to measure the size of the subject (distance between two points, depth, Area etc.) is measured. When the measurement process ends, the image confirmation and measurement process ends.

  Also, in ST305, when an operation input meaning returning to the previous position is performed, the process of ST307 is performed. In ST307, the control unit returns the still image displayed on the display unit to the representative image, and performs the process of ST302 again. Also, in ST302 and ST305, when an operation input meaning that the image confirmation is stopped is performed, the image confirmation and measurement processing ends.

  In the present embodiment, the method of reproducing and recording the recorded image using a device other than the endoscope device 1 has been described. However, the image is reproduced on the endoscope device 1 by the same method as described above. You may measure by reproducing.

  As described above, according to the present embodiment, even when a recorded image is reproduced and measurement is performed, all images used in the measurement are displayed as still images. The validity of the measurement result can be easily confirmed.

  As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments, and includes design changes and the like without departing from the gist of the present invention. .

  DESCRIPTION OF SYMBOLS 1 ... Endoscope apparatus, 2 ... Optical adapter for stereo measurement, 3 ... Endoscope insertion part, 3a ... Imaging element, 4 ... Control unit, 5 ... Remote controller, 6 ... Liquid crystal monitor, 9 ... CCU, 21 ... Optical adapter, 23a, 23b ... Concave lens, 24a, 24b ... Convex lens, 25 ... Switching unit, 26 ... Imaging optics System 30... Image generation unit 31. Operation unit 33. Display unit 34. Image processing unit 38. Signal conversion unit 42. ..Control unit 44 ... External storage medium

Claims (13)

An image generator that generates an image including one or more subject images;
A display unit for displaying the image;
A control unit that controls measurement of the size of the subject based on the image;
The control unit includes:
A first process for displaying a moving image including one subject image on the display unit;
A second process of sequentially displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first process; ,
In the second processing, a part of a plurality of subject images used for measurement or a part of a plurality of images based on one subject image used for measurement are displayed and all are displayed. A third process for returning to the first process when there is a user's first instruction ,
In the second process , after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is issued. A measurement point is designated based on a user instruction, and an image based on all of the plurality of subject images or a plurality of images based on the one subject image is designated at the designated measurement point. A measurement process for measuring the size of the subject;
The endoscope apparatus characterized by performing. An image generator that generates an image including one or more subject images;
A display unit for displaying the image;
A control unit that controls measurement of the size of the subject based on the image;
The control unit includes:
A first process for displaying a moving image including one subject image on the display unit;
A second process for displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first process;
In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's first instruction is given. A third process for returning to the first process when
In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is issued. A measurement point is designated based on a user instruction, and an image based on all of the plurality of subject images or a plurality of images based on the one subject image is designated at the designated measurement point. A measurement process for measuring the size of the subject;
The endoscope apparatus characterized by performing. An image generator that generates an image including one or more subject images;
A display unit for displaying the image;
A control unit that controls measurement of the size of the subject based on the image;
The control unit includes:
A first process for displaying a moving image including one subject image on the display unit;
A second process for sequentially displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first process; ,
In the second processing, a part of a plurality of subject images used for measurement or a part of a plurality of images based on one subject image used for measurement are displayed and all are displayed. A third process for returning to the first process when there is a user's first instruction ,
In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is issued. If the, the image recording process for recording all of the plurality of images based on one of the object image to be used by all, or measurement of a plurality of object images to be used in the measurement,
The endoscope apparatus characterized by performing. An image generator that generates an image including one or more subject images;
A display unit for displaying the image;
A control unit that controls measurement of the size of the subject based on the image;
The control unit includes:
A first process for displaying a moving image including one subject image on the display unit;
A second process for displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first process;
In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's first instruction is given. A third process for returning to the first process when
In the second process, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is issued. If the, the image recording process for recording all of the plurality of images based on one of the object image to be used by all, or measurement of a plurality of object images to be used in the measurement,
The endoscope apparatus characterized by performing.   In the second process, the control unit converts all of a plurality of subject images used in measurement or all of a plurality of images based on one subject image used in measurement as still images in time series. The endoscope apparatus according to any one of claims 1 to 4, wherein the endoscope is displayed on the display unit.   In the second process, the control unit simultaneously displays all of a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement as still images on the display unit. The endoscope apparatus according to claim 2, wherein the endoscope apparatus is displayed. In the second process, the control unit converts a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement into the display unit as still images in time series. A plurality of subject images used in measurement , or a plurality of images based on one subject image used in measurement are simultaneously displayed as still images on the display unit. The endoscope apparatus according to claim 2 or 4 .   In the second process, the control unit performs image processing on all of a plurality of subject images used for measurement or all of a plurality of images based on one subject image used for measurement. The endoscope apparatus according to claim 1, wherein the image is displayed on the display unit as a still image.   The endoscope apparatus according to claim 8, wherein switching whether or not to perform the image processing is possible. On the computer,
A first step of causing the display unit to display a moving image including one subject image photographed by the endoscope device;
A second step of sequentially displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first step; ,
In the second step, a part of a plurality of subject images used for measurement or a part of a plurality of images based on one subject image used for measurement are displayed and all are displayed. A third step of returning to the first step when a first instruction of the user is input before
In the second step , after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is input When the measurement point is specified, the measurement point is designated based on the measurement point instruction of the user, and is designated based on the image based on all of the plurality of subject images or all of the plurality of images based on the one subject image. A measurement step for measuring the size of the subject at the measurement point;
A program for running On the computer,
A first step of causing the display unit to display a moving image including one subject image photographed by the endoscope device;
After the first step, a second step of displaying a plurality of subject images to be used in the measurement, or a plurality of images based on one of the object image to be used in the measurement, on the display unit as a static image,
In the second step, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed , the first instruction of the user is input If so, a third step returning to the first step;
In the second step , after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is given. The measurement point is designated based on the measurement point instruction of the user, and the designated measurement is performed based on the image based on all of the plurality of subject images or the plurality of images based on the one subject image. A measurement step for measuring the size of the subject at the point;
A program for running On the computer,
A first step of causing the display unit to display a moving image including one subject image photographed by the endoscope device;
A second step of sequentially displaying a plurality of subject images used in measurement or a plurality of images based on one subject image used in measurement on the display unit as still images after the first step; ,
In the second step, a part of a plurality of subject images used for measurement or a part of a plurality of images based on one subject image used for measurement are displayed and all are displayed. A third step of returning to the first step when a first instruction of the user is input before
In the second step , after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is input If so, an image recording step of recording all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement;
A program for running On the computer,
A first step of causing the display unit to display a moving image including one subject image photographed by the endoscope device;
After the first step, a second step of displaying a plurality of subject images to be used in the measurement, or a plurality of images based on one of the object image to be used in the measurement, on the display unit as a static image,
In the second step, after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed , the first instruction of the user is input If so, a third step returning to the first step;
In the second step , after all of the plurality of subject images used for measurement or all of the plurality of images based on one subject image used for measurement are displayed, the user's second instruction is input If so, an image recording step of recording all of the plurality of subject images used in the measurement or all of the plurality of images based on one subject image used in the measurement;
A program for running