JP7486338B2 - Medical image display device, medical image output device, medical image medium, and medical image display program - Google Patents

Description

The embodiments disclosed in this specification relate to a medical image display device, a medical image output device, a medical image medium, and a medical image display program.

For example, in X-ray diagnostic equipment, when printing (transferring: also called filming) onto film, there is a technology that simultaneously prints supplementary information such as comments, annotations, and shooting conditions along with the image. This type of supplementary information is generally placed in the corner of the image on the printed film so that it does not overlap with the diagnostic area, etc.

However, when multiple images or additional information are arranged on a single piece of film, it may not be possible to secure a sufficient printing area for the additional information. In such cases, reducing the size of the text too much makes it difficult to read, while reducing the image size reduces the visibility of the image. In X-ray image inspection, for example, there are cases where a total of 25 images, 5 vertically and 5 horizontally, are filmed simultaneously. In cases like this where multiple images are filmed simultaneously, it is particularly difficult to balance the visibility of the images and the additional information.

JP 2016-526204 A

One of the problems that the embodiments disclosed herein aim to solve is to improve the visibility of images and associated information in image diagnosis using filmed medical images.

The medical image display device according to this embodiment includes an optical imaging unit and a display control unit. The optical imaging unit captures a medical image captured by a medical image diagnostic device and coded coded information including layout information related to the display layout of the supplementary information of the medical image. The display control unit displays the image captured by the optical imaging unit and the supplementary information based on the layout information included in the captured coded information.

FIG. 1 is a diagram showing a medical image display system S having a medical image output device and a medical image display device according to an embodiment. FIG. 2 is a block diagram showing the configuration of the medical image display device according to the embodiment. FIG. 3 is a diagram showing an example of a medical image medium on which an image with coded information is printed. FIG. 4 shows an example of a medical imaging medium on which a plurality of images with coded information are printed. FIG. 5 is a block diagram showing the configuration of the medical image display device according to the embodiment. FIG. 6 is a diagram showing a medical image medium placed on a light box and supplementary information superimposed on a medical image captured by a medical image display device in the medical image medium. FIG. 7 is a diagram for explaining a display example of supplementary information as character information when a part of an image displayed on a medical image display device is rotated. FIG. 8 is a diagram for explaining a display example of supplementary information as character information when a part of an image displayed on a medical image display device is enlarged. FIG. 9 is a diagram for explaining a display example of the supplementary information as the ROI when a part of the image displayed on the medical image display device is rotated. FIG. 10 is a diagram for explaining a display example of supplementary information as an ROI when a part of an image displayed on a medical image display device is enlarged. FIG. 11A is a flowchart showing the flow of the coded information-added image output process in this embodiment. FIG. 11B is a flowchart showing the flow of the supplementary information superimposed display process in this embodiment. FIG. 12A is a diagram for explaining the medical image display device as glasses. FIG. 12B is a diagram for explaining the medical image display device as glasses.

Below, we will explain the medical image display device, medical image output device, and medical image medium according to the embodiment, with reference to the attached drawings.

First, the environment in which the medical image display device and medical image output device according to the embodiment are used will be described. FIG. 1 is a diagram showing a medical image display system S having a medical image output device 1 and a medical image display device 5 according to the embodiment. As shown in FIG. 1, the medical image display system S has a medical image diagnostic device 2 incorporating the medical image output device 1, and a medical image display device 5 such as a smartphone or tablet computer. The medical image diagnostic device 2 can communicate with a radiology department server device 3 and a medical image management server device 4 via a network.

The medical image output device 1 is a device that prints medical images captured by the medical image diagnostic device 2 and medical images acquired from the medical image management server device 4 on medical image media such as film or paper. The medical image output device 1 may be built into the medical image diagnostic device 2 as shown in FIG. 1, or the medical image output device 1 as a standalone device may be connected to the medical image diagnostic device 2 so as to be able to communicate with it via wired or wireless communication. In this embodiment, for the sake of concrete explanation, the medical image diagnostic device 2 is an X-ray diagnostic device (hereinafter referred to as the "X-ray diagnostic device 2"), and the medical image output device 1 is built into the X-ray diagnostic device 2. The specific configuration and functions of the medical image output device 1 will be described in detail later.

The medical image display device 5 is a display device that displays supplementary information superimposed on the medical image output from the medical image output device 1. The medical image display device 5 is typically a smartphone, a tablet computer, or the like. In this embodiment, for the sake of concrete explanation, the medical image display device 5 is assumed to be a smartphone. The specific configuration and functions of the medical image display device 5 will be described in detail later.

The radiology department server device 3 is a computer device that executes processes related to information management in the radiology information systems (RIS) that manage information in the radiology department in the hospital. As an example of the operation of the radiology department server device 3, it receives an examination order and obtains information about the X-ray diagnostic device 2 (e.g., examination type) from the examination order. The radiology department server device 3 transmits the examination order to the X-ray diagnostic device 2 specified by the examination order. When the examination order is transmitted to the X-ray diagnostic device 2, the radiology department server device 3 may add information such as the patient ID and examination date to the meta information as a DICOM (Digital Imaging and Communications in Medicine) tag.

The medical image management server device 4 is a computer device that executes processes related to the management of information in a medical image management system (Picture Archiving and Communication Systems: PACS). PACS is an information system that manages medical images such as X-ray images, X-ray CT images, and MR images, as well as interpretation reports, also known as image diagnostic reports. When the medical image management server device 4 receives medical images and examination orders from the X-ray diagnostic device 2, it associates the medical images with the examination orders and stores them. Meta information is attached to the medical images as DICOM tags.

Figure 2 is a block diagram showing the configuration of the medical image output device 1 according to the embodiment. As shown in Figure 2, the medical image output device 1 includes a first memory circuit 10, a first processing circuit 11, a first input circuit 12, a communication I/F circuit 13, a first display circuit 14, and a printing circuit 15.

The first memory circuit 10 is composed of a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, an optical disk, etc. The first memory circuit 10 may be composed of a portable medium such as a USB (Universal Serial Bus) memory and a DVD (Digital Video Disk).

The first memory circuit 10 stores the OS (Operating System) programs used in the first processing circuit 11, various processing programs (including application programs, etc.), data required for program execution, volume data, and medical images.

The first processing circuit 11 is a processor that reads out the programs from the first storage circuit 10 and executes them to realize the functions corresponding to each program. The first processing circuit 11, for example, reads out various control programs stored in the first storage circuit 10 to realize an image data acquisition function 110, a coded information generation function 111, and an image generation function with coded information 112, and also comprehensively controls the processing operations in the first storage circuit 10, the first input circuit 12, the communication I/F circuit 13, and the first display circuit 14. In other words, the first processing circuit 11 in a state in which each program has been read out has each function shown in the first processing circuit 11 in FIG. 2.

The image data acquisition function 110 acquires image data of medical images captured by the X-ray diagnostic device 2. The image data acquisition function 110 also acquires image data of medical images from the medical image management server device 4 via the network.

The coded information generation function 111 generates layout information based on the additional information attached to the image data acquired by the image data acquisition function 110. The coded information generation function 111 also generates coded information corresponding to the image data using the additional information attached to the image data and the layout information generated based on the additional information.

Here, the accompanying information refers to patient information (patient name, patient ID, sex, etc.), imaging conditions (tube current value, tube voltage value, presence or absence of contrast agent, etc.), examination information, the region of interest (ROI) or marker set in the corresponding image, comments (or annotations) added to the image, measurement values measured using the image, findings added to the image, etc. Typically, the accompanying information is attached to the corresponding image as DICOM tag information. However, the accompanying information is not limited to DICOM tag information, and any form of attachment may be used as long as it is information that is managed in association with the image.

Layout information is information about the display layout of the incidental information based on the corresponding medical image. More specifically, layout information is information about the layout for specifying, when displaying a medical image, the position and size at which the associated incidental information is to be placed and displayed in terms of the positional relationship and size relationship based on the medical image.

Coded information is information in which the additional information and layout information are coded (encoded) using a one-dimensional barcode, a two-dimensional barcode (e.g., QR Code (registered trademark), Data Matrix (registered trademark)), or the like. In this embodiment, for the sake of concrete explanation, the coded information is generated using a two-dimensional barcode. However, without being limited to this example, the additional information and layout information may be coded using other coding methods to generate coded information.

The coded information-added image generating function 112 generates an image with coded information. Here, the coded information-added image is an image in which the coded information generated by the coded information generating function 111 is added to the corresponding medical image. The coded information-added image generating function 112 causes the printing circuit 15 to print the coded information-added image.

2, the image data acquisition function 110, the coded information generation function 111, and the coded information-added image generation function 112 are realized by the first processing circuit 11, which is a single processor. However, a processing circuit may be configured by combining multiple independent processors, and each processor may execute a program to realize the functions. Also, in FIG. 2, a single first storage circuit 10 is described as storing a program corresponding to each processing function, but multiple first storage circuits 10 may be distributed and the first processing circuit 11 may read out the corresponding program from each first storage circuit 10.

Figure 3 shows an example of a medical imaging medium 6 on which an image 60 with coded information is printed. If the medical imaging medium 6 is a film, it is placed on a light box and used for image diagnosis.

As shown in FIG. 3, the image with coded information 60 includes a medical image 60a and coded information 60b in which the additional information and layout information related to the medical image 60a are coded. By using this medical image medium 6 and the additional information superimposition display function (described later) of the medical image display device 5, the additional information can be superimposed on the medical image 60a via the monitor of the medical image display device 5.

In addition, FIG. 3 shows an example of an image with coded information 60 in which coded information 60b is placed at the bottom left of medical image 60a. However, this is not limited to this example, and coded information 60b may be placed anywhere on medical image medium 6 as long as the relative positional relationship with medical image 60a is specified.

Figure 4 shows an example of a medical imaging medium 6 on which multiple images with coded information 60-63 are printed. In image diagnosis, as shown in Figure 4, multiple medical images 60a-63a (four are shown in Figure 4) may be printed simultaneously on a single medical imaging medium 6. In such cases, coded information 60b-63b corresponding to the medical images 60a-63a are printed in a fixed positional relationship.

Returning to FIG. 2, the first input circuit 12 is a circuit that inputs signals from input devices such as a pointing device (such as a mouse) or a keyboard that can be operated by an operator, and here, the input devices themselves are also included in the first input circuit 12. When the input device is operated by the operator, the first input circuit 12 generates an input signal corresponding to the operation and outputs it to the first processing circuit 11. The first input circuit 12 may also include a touch panel in which the input device is integrated with the first display circuit 14.

The first input circuit 12 is not limited to being equipped with physical operating parts such as a mouse and a keyboard. For example, an example of the first input circuit 12 also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to a control circuit.

The communication I/F (interface) circuit 13 communicates with an external device according to a specific communication standard. When the medical image output device 1 is installed on a network, the communication I/F circuit 13 transmits and receives information to and from external devices on the network. For example, the communication I/F circuit 13 receives data obtained by imaging from the X-ray diagnostic device 2 or the medical image management server device 4.

The first display circuit 14 is a display that displays images, and is configured with an LCD (Liquid Crystal Display) or the like. The first display circuit 14 displays various display information such as various operation screens and image data on the LCD in response to instructions from the first processing circuit 11.

The printing circuit 15 prints (transfers) the image with coded information onto a medical imaging medium such as film or paper based on the control signal and image data from the coded information image generation function 112.

(Medical image display device)
Fig. 5 is a block diagram showing the configuration of a medical image display device 5 according to an embodiment. As shown in Fig. 5, the medical image display device 5 includes a second processing circuit 50 which is a processor for integrally controlling the medical image display device 5, a second display circuit 51, a second storage circuit 52, a communication circuit 53, a second input circuit 54, a camera 55, a microphone 56, and a speaker 57.

The second display circuit 51 performs display based on the signal received from the second processing circuit 50. The second display circuit 51 is, for example, a liquid crystal display, a plasma display, or an organic EL display.

The second memory circuit 52 is composed of semiconductor memory elements such as RAM and flash memory, a hard disk, a USB memory, etc. The second memory circuit 52 stores various processing programs (including OS programs, application programs, etc.) used in the second processing circuit 50 and data required for executing the programs.

The communication circuit 53 can communicate in a communication network of a communication carrier according to a predetermined method. The communication circuit 53 can also perform short-range wireless communication, for example, by Wi-Fi (registered trademark) or Bluetooth (registered trademark).

The second input circuit 54 can receive input from a user and transmit a signal based on the input to the second processing circuit 50. The second input circuit 54 includes a touch panel 540 and a power button 541 as an operation unit. The user can perform input required for operating the medical image display device 5 from the second input circuit 54.

Camera 55 is a reading device for capturing medical images captured by a medical image diagnostic device and reading coded information such as one-dimensional barcodes and two-dimensional barcodes, and is an optical imaging device such as a digital camera. Camera 55 is an example of an optical imaging unit.

The second processing circuit 50 is a processor that performs integrated control of the medical image display device 5. The second processing circuit 50 has a CPU and a memory circuit (memory element) such as an SRAM or a DRAM. The second processing circuit 50 also realizes functions corresponding to each program by reading and executing programs from the second memory circuit 52.

For example, the second processing circuit 50 reads out various control programs stored in the second memory circuit 52 to realize the decoding function 500 and the display control function 502, and also comprehensively controls the processing operations in the second display circuit 51, the second memory circuit 52, the communication circuit 53, the second input circuit 54, the camera 55, the microphone 56, and the speaker 57. In other words, the second processing circuit 50 in a state in which each program has been read out has each function shown in the second processing circuit 50 in FIG. 5.

The decoding function 500 decodes the coded information 60b captured (read) by the camera 55, and acquires the auxiliary information and layout information. The decoding function 500 is an example of an information acquisition unit.

The display control function 502 displays the additional information on the medical image captured by the camera 55 based on the layout information included in the coded information captured by the camera 55. That is, the display control function 502 superimposes (compositely displays) the additional information on the image captured by the camera 55 at a position specified by the layout information, for example, by using AR (Augmented Reality) technology. The display control function 502 also displays the image captured by the camera 55 and the additional information in parallel at a position specified by the layout information, for example, by using AR technology. When medical images are captured sequentially by the camera 55, the display control function 502 displays each medical image captured sequentially and the additional information at a position specified by the layout information.

Furthermore, the display control function 502 controls at least one of the position and size of the supplementary information superimposed on the image captured by the camera 55 in response to the zoom-in operation, zoom-out operation, and rotation operation input from the touch panel 540. The display control function 502 is an example of a display control unit.

In FIG. 5, the decoding function 500 and the display control function 502 are implemented by the second processing circuit 50, which is a single processor. However, a processing circuit may be configured by combining multiple independent processors, and each processor may execute a program to implement the function. In FIG. 5, a single second storage circuit 52 is described as storing a program corresponding to each processing function. However, a configuration may be adopted in which multiple second storage circuits 52 are distributed and the second processing circuit 50 reads out the corresponding program from each second storage circuit 52.

Figure 6 shows a medical image medium 6 placed on a viewing stand and coded information 61b superimposed on a medical image 61a in the medical image medium 6 captured by a medical image display device 5. As shown in Figure 6, it is assumed that coded information 61b is captured by a camera 55 of the medical image display device 5, and then the medical image 61a contained in the medical image medium 6 placed on the viewing stand is captured by the camera 55 of the medical image display device 5.

In this case, the decoding function 500 acquires the auxiliary information of the medical image 61a based on the coded information 61b, and the layout information of the auxiliary information for the medical image 61a. As shown in FIG. 6, the display control function 502 displays the acquired auxiliary information 5a, 5b in a superimposed or parallel manner at a predetermined size at a corresponding position on the medical image 61a captured by the camera 55 based on the layout information.

This superimposed display is achieved, for example, by AR technology, so that the incidental information 5a, 5b maintains a fixed positional relationship with the corresponding medical image 61a based on the layout information. Therefore, for example, when the camera 55 of the medical image display device 5 is panned (PANned) so that the medical image 61a is framed out, the incidental information superimposed on the medical image 61a is also framed out. On the other hand, when the camera 55 of the medical image display device 5 is panned from a state in which the medical image 61a is framed out to frame in the medical image 61a, the incidental information superimposed on the medical image 61a is also framed in.

Also, for example, a case is considered in which, while a medical image 61a with auxiliary information 5a, 5b superimposed at a fixed position is displayed, the camera 55 of the medical image display device 5 is panned to capture, for example, adjacent coded information 60b, and then the medical image 60a placed on the light box is captured by the camera 55 of the medical image display device 5.

In such a case, the decoding function 500 newly acquires the supplementary information of the medical image 60a based on the coded information 60b, and the layout information of the supplementary information for the medical image 60a. The display control function 502 superimposes the acquired supplementary information at a predetermined size at a corresponding position on the medical image 60a captured by the camera 55 based on the layout information.

The additional information obtained from the coded information is superimposed on the corresponding medical image while maintaining a fixed positional relationship with the corresponding medical image according to the layout information obtained from the same coded information. Therefore, the additional information is not superimposed on a non-corresponding medical image.

Figure 7 is a diagram for explaining a display example of the additional information as character information when a part of the image displayed on the medical image display device 5 is rotated. Figure 8 is a diagram for explaining a display example of the additional information as character information when a part of the image displayed on the medical image display device 5 is enlarged. First, the coded information of the medical image medium placed on the light box is read by the camera 55, and then the corresponding medical image 61a is captured by the camera 55. As a result, the medical image 61a with the additional information 5b as character information superimposed at a fixed position is displayed on the second display circuit 51 of the medical image display device 5. Assume that a rotation operation is input to this medical image 61a by the user operating the touch panel 540. At this time, in the second display circuit 51, as shown in Figure 7, the medical image 61a is rotated and the additional information 5b as character information is displayed while maintaining a fixed positional relationship with the medical image 61a.

In addition, for example, in the state shown in FIG. 7, suppose that the user operates the touch panel 540 to input an operation to enlarge the medical image 61a. At this time, in the second display circuit 51, as shown in FIG. 8, the medical image 61a is enlarged and displayed, and the additional information 5b is displayed as text information while maintaining a fixed positional relationship with the medical image 61a. Note that at this time, the additional information 5b may be enlarged in response to the enlargement operation. Also, the size of the additional information 5b may be controlled while maintaining the positional relationship with the medical image 61a so that the additional information 5b fits within the screen even when the medical image 61a is enlarged.

Figure 9 is a diagram for explaining an example of the display of the additional information as the ROI when a part of the image displayed on the medical image display device is rotated. Figure 10 is a diagram for explaining an example of the display of the additional information as the ROI when a part of the image displayed on the medical image display device is enlarged. First, the coded information of the medical image medium placed on the light box is read by the camera 55, and then the corresponding medical image 61a is captured by the camera 55. As a result, the medical image 61a on which the additional information 5c as the ROI is superimposed is displayed on the second display circuit 51 of the medical image display device 5. Assume that a rotation operation is input to this medical image 61a by the user operating the touch panel 540. At this time, in the second display circuit 51, as shown in Figure 9, the medical image 61a is rotated and the additional information 5b as the ROI is displayed while maintaining a fixed positional relationship with the medical image 61a.

For example, in the state shown in FIG. 9, suppose that the user operates the touch panel 540 to input an enlargement operation of the medical image 61a. At this time, in the second display circuit 51, as shown in FIG. 10, the medical image 61a is enlarged and displayed, and the additional information 5c is displayed as the ROI while maintaining a fixed positional relationship with the medical image 61a. Note that at this time, the additional information 5c as the ROI is also enlarged and displayed following the enlargement operation. Also, the size of the additional information 5c may be controlled while maintaining the positional relationship with the medical image 61a so that the additional information 5c fits within the screen even when the medical image 61a is enlarged.

(Image output processing with coded information)
Next, the coded information-added image output process executed by the medical image output device 1 and the supplementary information superimposed display process executed by the medical image display device 5 will be described.

Figure 11A is a flowchart showing the flow of the process for outputting an image with coded information in this embodiment.

First, the medical image output device 1 receives a filming instruction for a specific medical image via the first input circuit 12 (step S1). The image data acquisition function 110 of the medical image output device 1 acquires the image data that is the subject of the filming instruction and the associated information attached to the image data (step S2).

The coded information generating function 111 of the medical image output device 1 generates layout information based on the image data and the additional information acquired by the image data acquisition function 110. The coded information generating function 111 of the medical image output device 1 also codes the additional information and the layout information generated based on the additional information, and generates coded information corresponding to the image data (step S3).

The coded information-added image generating function 112 of the medical image output device 1 generates an image with coded information by adding the coded information generated by the coded information generating function 111 to the medical image to be printed (step S4). The coded information-added image generating function 112 also causes the printing circuit 15 to print the image with coded information. The printing circuit 15 outputs a medical image medium on which the image with coded information is printed (step S5).

(Additional information superimposed display processing)
11B is a flowchart showing the flow of the supplementary information superimposed display process in this embodiment. Hereinafter, it is assumed that the medical image medium output in step S5 is placed on a light box and observed by a user such as a doctor.

The camera 55 of the medical image display device 5 captures (reads) the coded information in the image with coded information placed on the light box (step S11), and the decoding function 500 of the medical image display device 5 decodes the coded information captured by the camera 55 and obtains the supplementary information and layout information (step S12).

The display control function 502 of the medical image display device 5 uses AR technology to superimpose the supplementary information at a position specified by the layout information on the image captured by the camera 55 and displayed on the second display circuit 51 (step S13).

The medical image display device 5 according to the embodiment described above includes a camera 55 as an optical imaging unit, and a display control function 502 as a display control unit. The camera 55 captures a medical image captured by the X-ray diagnostic device 2, and coded information including layout information regarding the display layout of the supplementary information of the medical image. The display control function 502 displays the medical image captured by the camera 55 and the supplementary information based on the layout information included in the coded information captured by the camera 55.

In other words, a user can read the coded information printed together with a medical image with a device such as a smartphone or tablet computer, and simply capture the medical image to display the additional information of the medical image only on the screen of the smartphone, for example. The user can observe the medical image without additional information on a light box, and can check the additional information on the screen of the smartphone, etc. Medical images printed on film do not have additional information superimposed on them, so they do not interfere with observation. Furthermore, the additional information displayed together with the medical image on a smartphone, etc., is displayed in a specific position without reducing the text, etc.

Therefore, the user can observe the medical image and understand the incidental information without the incidental information making it difficult to observe the medical image or reducing the size of the text, making the incidental information difficult to read. In particular, the user can observe the medical image on a printed film or the like, and view the incidental information on a smartphone or the like. Therefore, even when observing a film or the like on which multiple images are printed, or when the amount of incidental information increases, it is possible to achieve both good visibility of the medical image and easy readability and a sufficient amount of information for the incidental information. As a result, in image diagnosis using filmed medical images, the visibility of the image and incidental information can be improved compared to the conventional method.

In addition, the supplementary information is displayed at a specific position based on the corresponding medical image according to the layout information. This makes it easy to associate a medical image with the supplementary information, and there is no risk of confusion between other medical images and other supplementary information.

In addition, even if the medical image on the smartphone or the like is enlarged, reduced, or rotated, or the camera 55 of the medical image display device 5 is panned, the position and size of the supplementary information including markers, comments, etc. can be tracked and displayed. In addition, if an ROI or the like is set, the position and size of the ROI can be tracked and displayed.

(Variation 1)
In the above embodiment, the medical image diagnostic apparatus is an X-ray diagnostic apparatus. However, even if the medical image diagnostic apparatus is an X-ray computed tomography apparatus, a magnetic resonance imaging apparatus, a PET (Positron Emission Tomography), or a SPECT (Single Photon Emission Computed Tomography), the above-described coded information-attached image generation/output process and the auxiliary information superimposition display process can be applied.

(Variation 2)
In the above embodiment, the medical image output device 1 built in the X-ray diagnostic device 2 executes the above-mentioned coded information-added image generation and output process. In contrast, the medical image output device 1 executing the coded information-added image generation and output process may be installed as a separate device on a network or on the cloud. In such a configuration, the medical image output device 1 executes the coded information-added image generation and output process using medical images acquired via a network from the X-ray diagnostic device 2, the medical image management server device 4, or a medical image observation device (viewer) not shown.

(Variation 3)
In the above embodiment, the coded information-added image generating/outputting process is exemplified as a case where a coded information-added image including a medical image and coded information is generated as one image data, and the image is printed or transferred onto a sheet of medical image medium. In contrast, when a medical image captured by the X-ray diagnostic device 2 is developed onto a film, for example, it is also possible to generate a coded information-added image including a medical image and coded information by developing the corresponding coded information onto the same film.

This makes it possible to obtain a film on which a coded information-added image containing an X-ray image and corresponding coded information has been developed. Using the film obtained in this way, the user can realize the above-mentioned supplementary information display process. Note that this is not limited to film, and is also applicable when a medical image captured by the X-ray diagnostic device 2 is printed, for example, on paper.

(Variation 4)
In the above embodiment, a smartphone or a tablet PC is used as a medical image display device when observing an image with coded information. Alternatively, a dedicated eyeglass-type medical image display device having a function of displaying additional information may be used.

Figures 12A and 12B are diagrams for explaining a glasses-type medical image display device 8 according to variant example 4. When a user wears the glasses-type medical image display device 8 and turns on the supplementary information display function to observe a medical image 61a placed on a light box, the user can see supplementary information 5e, 5f superimposed on the medical image 61a according to the supplementary information display function, as shown in Figure 12A. On the other hand, when a user turns off the supplementary information display function of the glasses-type medical image display device 8 and observes a medical image 61a placed on a light box, the user can observe a medical image 61a without the supplementary information superimposed, as shown in Figure 12B.

The eyeglass-type medical image display device 8 allows the user to observe medical images with or without superimposed additional information in a hands-free state. As a result, the user can observe medical images and their additional information with less strain, and a medical image display device with even greater convenience can be realized in image diagnosis using filmed medical images.

(Variation 5)
In the above embodiment, an example has been described in which the supplementary information is superimposed on the medical image by using AR technology in the medical image display device 5. In contrast to this, the supplementary information may be superimposed on the medical image by using MR (Mixed Reality) technology in the medical image display device 5.

(Variation 6)
In the above embodiment, the coded information includes the additional information. Alternatively, the coded information may include layout information, link information to a location where the additional information of the medical image to be observed is stored (e.g., a server that manages the additional information of the medical image to be observed), and link information to the additional information of the medical image to be observed according to the DICOM standard, without including the additional information.

In addition, the term "processor" used in the above embodiment refers to circuits such as a CPU (Central Processing Unit), a GPU (Graphical processing unit), or an application specific integrated circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD), a Complex Programmable Logic Device (CPLD), and a Field Programmable Gate Array (FPGA)). The processor realizes its functions by reading and executing the programs stored in the first storage circuit 10 and the second storage circuit 52. Note that instead of storing the programs in the first storage circuit 10 and the second storage circuit 52, the programs may be directly embedded in the processor's circuit. In this case, the processor realizes its functions by reading and executing the programs embedded in the circuit.

According to at least one of the embodiments described above, in image diagnosis using filmed medical images, it is possible to improve the visibility of images and associated information compared to conventional methods.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are within the scope and gist of the invention, and are included in the scope of the invention and its equivalents as set forth in the claims.

1 Medical image output device 2 X-ray diagnostic device (medical image diagnostic device)
3 Radiology department server device 4 Medical image management server device 5 Medical image display device 5a, 5b, 5c Supplementary information 10 First memory circuit 11 First processing circuit 12 First input circuit 13 Communication I/F circuit 14 First display circuit 15 Printing circuit 50 Second processing circuit 51 Second display circuit 52 Second memory circuit 53 Communication circuit 54 Second input circuit 55 Camera 56 Microphone 57 Speaker 60, 61, 62, 63 Images with coded information 60a, 61a, 62a, 63a Medical images 60b, 61b, 62b, 63b Coded information 110 Image data acquisition function 111 Coded information generation function 112 Image with coded information generation function 500 Decoding function 502 Display control function

Claims (10)

an optical imaging unit that captures a medical image captured by a medical image diagnostic device and coded information obtained by coding auxiliary information of the medical image and layout information related to a display layout of the auxiliary information ;
a combination unit that combines the captured coded information to obtain the additional information and the layout information;
a display control unit that displays the medical image captured by the optical imaging unit and the supplementary information based on the layout information;
A medical image display device comprising: When the optical imaging unit sequentially captures the medical images, the display control unit displays the sequentially captured medical images and the auxiliary information based on the acquired layout information.
The medical image display device according to claim 1 . an operation unit that receives at least one of an enlargement operation, a reduction operation, and a rotation operation on the medical image displayed with the supplementary information;
the display control unit controls at least one of a position and a size of the medical image and the auxiliary information to be displayed in accordance with at least one of an enlargement operation, a reduction operation, and a rotation operation received by the operation unit.
The medical image display device according to claim 1 . The medical image display device according to claim 1 , wherein the display control unit uses an AR technique to display the medical image captured by the optical imaging unit and the supplementary information . The medical image display device according to any one of claims 1 to 4, wherein the medical image display device is a glasses type. The medical image display device according to any one of claims 1 to 5, wherein the layout information includes information regarding the display layout of the supplementary information based on the medical image. The medical image display device according to any one of claims 1 to 6, wherein the coded information includes the additional information of the medical image. The medical image display device according to claim 1 , wherein the display control unit superimposes the supplementary information on the medical image captured by the optical imaging unit based on the acquired layout information. an acquisition unit that acquires a medical image captured by a medical image diagnostic device;
a coded information generating unit that generates coded information by coding the supplementary information related to the medical image and layout information related to a display layout of the supplementary information that is generated based on the supplementary information ;
an output unit that prints or transfers the medical image and the coded information onto a medium and outputs the medical image and the coded information;
Equipped with
The layout information is information on a layout for specifying, when displaying the medical image, at what position and in what size the auxiliary information associated with the medical image is to be arranged and displayed in terms of a positional relationship and a size relationship based on the medical image.
Medical image output device. On the computer,
an image acquisition function for acquiring an image with coded information captured by an optical imaging unit that captures an image with coded information, the image including a medical image captured by a medical image diagnostic device, and coded information obtained by coding auxiliary information of the medical image and layout information related to a display layout of the auxiliary information;
a combination function of combining the coded information included in the acquired coded information-added image to acquire the additional information and the layout information;
a display control function for displaying the medical image and the auxiliary information included in the coded information-added image based on the layout information;
A medical image display program to achieve this.

Images