JP7612371B2 - Medical image diagnostic device, medical image processing device, and program - Google Patents

Description

The embodiments disclosed in this specification and the drawings relate to a medical image diagnostic device, a medical image processing device, and a program.

For example, a three-dimensional image (hereinafter referred to as a "3D image") of a fetus may be acquired by an ultrasound imaging diagnostic device, and this 3D image may be rendered and provided to a patient such as a pregnant woman. In this case, since there is a limit to the range in which the probe can be applied and the range in which the ultrasound beam can be applied by manipulating the probe when acquiring an image of the fetus, it may be difficult to include, for example, the entire face of the fetus in one frame of data. When showing an image acquired in this way to a patient, for example, if images of key parts such as the eyes, nose, and mouth are missing, this may evoke negative feelings at first glance.

Some rendering systems have the ability to cut out parts of an image in 3D, so that the parts you do not want to show are not included in the rendered image. However, when cutting in 3D, the task of surrounding the parts to be cut becomes cumbersome. Furthermore, because the parts to be cut extend into the depth direction, there is a possibility that the parts you want to see will also be cut out when you rotate the image after cutting it.

On the other hand, when using a rendering mode that performs light calculations, it is possible to make unwanted parts less noticeable by shining light on them so that they are in shadow. However, in this case, it may not be possible to both darken the parts you don't want to see and brighten the parts you want to see. By adding more light sources, it is possible to both darken the parts you don't want to see and brighten the parts you want to see, but this can make position adjustments more complicated.

JP 2020-062215 A Patent No. 5882217 Patent No. 6060173

The problem that the embodiments disclosed in this specification and the drawings aim to solve is to make it possible to hide parts of a rendering image that one does not want to show by simple processing. However, the problem that the embodiments disclosed in this specification and the drawings aim to solve is not limited to the problem described above. Problems corresponding to the effects of each configuration shown in the embodiments described below can also be positioned as other problems.

The medical image diagnostic device of the embodiment has an acquisition unit, a first generation unit, a second generation unit, a concealment unit, and a provision unit. The acquisition unit acquires image generation elements generated by a medical device. The first generation unit generates a three-dimensional image based on the acquired image generation elements. The second generation unit performs a rendering process on the generated three-dimensional image to generate a rendering image. The concealment unit sets a concealment area in the rendering image. The provision unit provides the rendering image in which the concealment area is set.

1 is a diagram showing an example of the configuration of an ultrasound imaging diagnostic system 1 according to an embodiment. 4 is a flowchart showing an example of processing of the ultrasound imaging diagnostic system 100. FIG. 4 is a diagram showing an example of a rendering image displayed on a display device 200. FIG. 4 is a diagram showing an example of a composite image displayed on a display device 200. FIG. 4 is a diagram showing an example of a rendering image displayed on a display device 200. FIG. 4 is a diagram showing an example of a composite image displayed on a display device 200.

The following describes the medical image diagnostic device, medical image processing device, and program of the embodiment with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of an ultrasound diagnostic imaging system 1 according to an embodiment. The ultrasound diagnostic imaging system 1 receives, for example, ultrasound waves transmitted by an ultrasound probe 10 that are reflected by a subject, detects the waveform of the reflected waves, and displays an image for diagnosing the subject based on the detected waveform. The ultrasound diagnostic imaging system 1 includes, for example, an ultrasound probe 10, an input interface 20, an ultrasound diagnostic imaging device 100, and a display device 200.

The ultrasound probe 10 is used, for example, when performing ultrasound diagnosis on a subject. The ultrasound probe 10 transmits ultrasound to the subject, for example, based on a drive signal output by the ultrasound imaging diagnostic device 100. The ultrasound probe 10 receives the reflected waves of the transmitted ultrasound at the acoustic emission surface. The ultrasound probe 10 generates reflected wave information (reflection intensity data) based on the reflected waves of the received ultrasound, and transmits it to the ultrasound imaging diagnostic device 100.

The input interface 20 accepts various input operations by an operator (hereinafter referred to as "user") and outputs an electrical signal indicating the content of the accepted input operation to the ultrasound imaging diagnostic device 100. For example, the input interface 20 accepts switching information for switching the rendering image displayed on the display device 200 between a first rendering image and a second rendering image.

The input interface 20 is realized, for example, by a mouse, a keyboard, a touch panel combined with a display device, a trackball (drag ball), a switch, a button, a joystick, a camera, an infrared sensor, a microphone, etc. The input interface 20 may also be realized by a display device (e.g., a tablet terminal) capable of wireless communication with the ultrasound diagnostic imaging device 100.

In this specification, the input interface 20 is not limited to an interface equipped with physical operating parts such as a mouse and a keyboard. For example, an example of an input interface also includes an electrical signal processing circuit that receives an electrical signal corresponding to an input operation from an external input device provided separately from the device and outputs this electrical signal to a control circuit.

The ultrasound diagnostic imaging device 100 includes, for example, a transmission/reception circuit 110, a processing circuit 120, and a memory 150. The transmission/reception circuit 110 includes, for example, a drive circuit that vibrates the transducer of the ultrasound probe 10. The transmission/reception circuit 110 outputs a drive signal according to the transmission/reception conditions transmitted by the processing circuit 120 to the ultrasound probe 10. The transmission/reception circuit 110 acquires reflected wave information output by the ultrasound probe 10. The transmission/reception circuit 110 converts the acquired reflected wave information into a digital signal.

The processing circuit 120 includes, for example, an acquisition function 122, a first generation function 124, a setting function 126, a second generation function 128, a designation function 130, a concealment function 132, a third generation function 134, a composition function 136, and a provision function 138. Of these, the concealment function 132 includes the third generation function 134 and the composition function 136. The processing circuit 120 realizes these functions, for example, by a hardware processor executing a program stored in a memory (storage circuit) 150. The hardware processor refers to a circuit such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a programmable logic device (e.g., a Simple Programmable Logic Device (SPLD) or a Complex Programmable Logic Device (CPLD), or a Field Programmable Gate Array (FPGA) (hereinafter the same). Instead of storing a program in the memory 150, the program may be directly embedded in the circuit of the hardware processor. In this case, the hardware processor realizes a function by reading and executing the program embedded in the circuit. The hardware processor is not limited to being configured as a single circuit, but may be configured as a single hardware processor by combining multiple independent circuits to realize each function. Also, multiple components may be integrated into a single hardware processor to realize each function.

The memory 150 is realized, for example, by a semiconductor memory element such as a RAM (Random Access Memory), a flash memory, a hard disk, an optical disk, etc. The memory 150 stores a color map 152 and a light characteristic setting map 154 used when generating a rendering image that is a two-dimensional representation of a 3D image (model image).

The color map 152 stored in the memory 150 is a color map determined by the user from among multiple color maps. The color map 152 includes multiple colors for determining colors when generating a rendering image from a 3D image. The light characteristic setting map 154 includes multiple colors (darkening) for determining the color (darkening) of shadows when generating a rendering image from a 3D image.

The color map 152 and the light characteristic setting map 154 stored in the memory 150 may be stored in an external memory with which the ultrasound diagnostic imaging device 100 can communicate, rather than in the memory 150 (or in addition to the memory 150). The external memory is controlled by a cloud server that manages the external memory, for example, by the cloud server accepting a read/write request. The memory 150 is an example of a storage unit. The color map 152 and the light characteristic setting map 154 are examples of generation conditions.

The acquisition function 122 acquires reflected wave information transmitted by the ultrasound probe 10. The acquisition function 122 acquires various information according to the user's input operation on the input interface 20. The acquisition function 122 outputs the acquired various information to an appropriate output destination. For example, the acquisition function 122 outputs the acquired reflected wave information to the first generation function 124. For example, the acquisition function 122 outputs the specified data output by the input interface 20 to the setting function 126. The acquisition function 122 is an example of an acquisition unit.

The first generating function 124 generates 3D digital data of the subject based on the reflected waves of ultrasound received by the ultrasound probe 10. The first generating function 124 outputs the generated 3D digital data to the second generating function 128. The reflected waves of ultrasound transmitted by the ultrasound probe 10 are an example of an image generating element. The first generating function 124 is an example of a first generating unit.

The setting function 126 switches and sets the rendering mode of the ultrasound diagnostic imaging device 100. The ultrasound diagnostic imaging device 100 has a first rendering mode and a second rendering mode. The first rendering mode is a mode in which a rendering image is generated using surface rendering. The second rendering mode is a mode in which a light source is positioned like global illumination and a rendering image is generated using characteristics such as light attenuation.

The setting function 126 sets a color map to be used when generating a 3D image (3D digital data) for the first rendering mode. The setting function 126 determines a color map 152 from among a plurality of color maps in response to, for example, a user's operation of the input interface 20, and stores the color map in the memory 150. The setting function 126 sets a color map for the second rendering mode similar to that for the first rendering mode.

The second generation function 128 two-dimensionalizes the 3D digital data generated by the first generation function 124 through a rendering process according to the rendering mode, and generates a rendering image. The second generation function 128 renders the 3D digital data in the first rendering mode to generate a first rendering image. The second generation function 128 renders the 3D digital data in the second rendering mode to generate a second rendering image.

When the rendering mode is the first rendering mode, the second generation function 128 generates a first rendering image by surface rendering using the color map 152 stored in the memory 150. The color used in the surface rendering is, for example, specified in advance by the user.

When the rendering mode is the second rendering mode, the second generation function 128 uses the light characteristic setting map 154 stored in the memory 150 to arrange light sources like global illumination and generate a second rendering image by utilizing characteristics such as light attenuation. The second generation function 128 outputs the generated rendering image to the synthesis function 136 and the provision function 138. The second generation function 128 is an example of a second generation unit.

The designation function 130 designates a concealment area to be concealed in the rendering image based on an instruction input from outside the processing circuit 120, for example, from the input interface 20. When the designation function 130 designates a concealment area, the provision function 138 causes the display device 200 to display the rendering image generated by the second generation function 128. The provision function 138 causes the display device 200 to display, for example, a preset image for designating the concealment area together with the rendering image.

The preset images are simple shapes, such as circles, triangles, quadrilaterals (squares, rectangles), and ovals. The provision function 138 displays, for example, a rectangular image as a preset image. The provision function 138 may display sample images of multiple preset images, such as circles, triangles, and quadrilaterals, on the display device 200 and allow the user to select one. The preset images may be displayed, for example, at the edge of the display area on the display device 200, or may be specified or changed by the user using presets, etc.

The user operates the input interface 20, for example a trackball, to enlarge or reduce or change the position of the preset image displayed on the display device 200, to specify a concealment area that conceals a part of the rendering image. The input interface 20 transmits specification information regarding the identified concealment area to the specification function 130. The specification function 130 specifies the concealment area based on the specification information transmitted by the input interface 20. The specification function 130 outputs the specified concealment area to the third generation function 134. The specification function 130 is an example of a specification unit.

The concealment function 132 uses the third generation function 134 and the composition function 136 to set a concealment area in the rendering image and generate a concealment image to be placed in the concealment area. For example, the concealment function 132 adjusts the color and darkness of the concealment area specified by the designation function 130 according to the rendering mode set by the setting function 126, and generates a concealment image (2D object) to be placed in the concealment area. The concealment function 132 conceals the concealment area by combining the generated concealment image with the rendering image. The concealment function 132 is an example of a concealment section.

When generating a concealment image, the third generation function 134 specifies a color for dark areas contained in the color map 152 stored in the memory 150 for the first rendering image. The third generation function 134 specifies, for example, a color determined by the second generation function 128 as the color for dark areas. The third generation function 134 specifies a darkness contained in the light characteristic setting map 154 stored in the memory 150 for the second rendering image. The color map 152 and the light characteristic setting map 154 are conditions for generating a concealment image.

The third generation function 134 generates a concealed image in a set generation mode. The third generation function 134 works in conjunction with the second generation function to specify the color and darkness, and specifies the color and darkness for generating a concealed image according to the settings of the second generation function 128. For example, the third generation function 134 generates a first concealed image in a mode (hereinafter referred to as the "first generation mode") in which the concealed area is colored using a specified color for dark areas for the first rendering mode. The third generation function 134 generates a second concealed image in a mode (hereinafter referred to as the "second generation mode") in which the concealed area is brightened or darkened with a specified darkness for the second rendering mode.

The first generation mode and the second generation mode correspond to the first rendering mode and the second rendering mode, and when the rendering mode is switched, the generation mode is also switched at the same time. The third generation function 134 outputs the generated concealed image to the synthesis function 136. The third generation function 134 may be able to enlarge, reduce, move, etc. the concealed image when generating the concealed image. The third generation function 134 is an example of a third generation unit.

The compositing function 136 moves the concealed image by, for example, a user operating a trackball, and places the concealed image generated by the third generation function 134 in the concealed area in the rendering image output by the second generation function 128. The rendering image and the concealed image are composited to generate a composite image. The compositing function 136 composites the first rendering image and the first concealed image to generate a first composite image. The compositing function 136 composites the second rendering image and the second concealed image to generate a second composite image. The compositing function 136 is an example of a composite unit.

The compositing function 136 overlays all overlays such as text on the rendering image and the concealment image, and adds them to the composite image. The rendering image and the concealment image are combined to generate a composite image in which the concealment area in the rendering image is concealed by the concealment image. The compositing function 136 outputs the generated composite image to the providing function 138. The third generating function 134 and the compositing function 136 are examples of a concealment section.

The providing function 138 controls the display of an image to be displayed on the display device 200. The providing function 138 causes the display device 200 to display a rendering image corresponding to the rendering mode. When the first rendering mode is set, the providing function 138 causes the display device 200 to display a first rendering image. When the second rendering mode is set, the providing function 138 causes the display device 200 to display a second rendering image.

When a switching signal is output by the input interface 20 while a rendering image or a composite image is being displayed on the display device 200, and the rendering mode is switched, the providing function 138 switches between the rendering image or the composite image to be displayed on the display device 200. The providing function 138 provides the composite image to the user, for example, by displaying the composite image output by the compositing function 136 on the display device 200. The providing function 138 is an example of a providing unit. The providing function 138 may provide the composite image by a function other than display on the display device 200.

The display device 200 displays an image according to the control of the provision function 138. The ultrasound diagnostic imaging device 100 is used for diagnosis by a doctor or the like, for example, by displaying an ultrasound image on the display device 200. The display device 200 is, for example, a liquid crystal display. The display device 200 may be anything that displays an image, and may be, for example, a projector or a touch panel integrated with the input interface 20.

Next, the processing of the ultrasound diagnostic imaging device 100 will be described. In the ultrasound diagnostic imaging device 100, as processing prior to performing ultrasound diagnosis, the setting function 126 sets a first rendering mode in which a first rendering image is displayed on the display device 200, and a second rendering mode in which a second rendering image is displayed on the display device 200. Furthermore, the setting function 126 sets the color map 152 to be used in the first rendering mode and the second rendering mode, respectively. These settings by the setting function 126 are performed, for example, when the ultrasound diagnostic imaging device 100 is started up, or when a rendering image is displayed on the display device 200 for the first time.

The ultrasound diagnostic imaging device 100 switches the rendering mode when the user operates the input interface 20 and switching information is output by the input interface 20. The ultrasound diagnostic imaging device 100 switches the rendering mode by executing interrupt processing each time switching information is output during startup. Therefore, the ultrasound diagnostic imaging device 100 is capable of switching the rendering mode at any time while it is running.

Next, an example of the processing of the ultrasound diagnostic imaging device 100 during diagnosis will be described. Here, the processing from when a user such as a doctor places the ultrasound probe 10 on a pregnant woman who is a patient, to when an image of the fetus inside the patient is acquired by the ultrasound diagnostic imaging device 100, to when a rendering image is generated and shown to the patient will be described. FIG. 2 is a flowchart showing an example of the processing of the ultrasound diagnostic imaging device 100.

For example, when a user holds the ultrasound probe 10 against a patient and initiates transmission from the input interface 20 to the ultrasound diagnostic imaging device 100, ultrasound is transmitted from the ultrasound probe 10. When this reflected wave is input to the ultrasound diagnostic imaging device 100 through the ultrasound probe 10, it is stored in data storage by the acquisition function 122 of the processing circuit 120 (step S101). Next, the first generation function 124 compiles the stored reflected wave information for each volume to generate 3D digital data (step S103).

Next, the second generation function 128 performs a rendering process on the 3D digital data generated by the first generation function 124 to generate a rendering image (step S105). The second generation function 128 generates both a first rendering image in the first rendering mode and a second rendering image in the second rendering mode.

The second generation function 128 may generate only a rendering image that corresponds to the current rendering mode. In this case, the second generation function 128 may store the generated rendering image in the memory 150 so that it can be used even after the rendering mode is switched.

The first rendering image is generated, for example, using the reflection intensity indicated by the reflected wave information and the color in the color map 152 stored in the memory 150. The second rendering image is generated, for example, using the reflection intensity indicated by the reflected wave information and the light characteristic setting map 154 stored in the memory 150, taking into account the light source position and light attenuation. The providing function 138 causes the display device 200 to display a rendering image corresponding to the set rendering mode, for example, the first rendering image when the first rendering mode is set (step S107).

Next, the providing function 138 causes the display device 200 to display an image prompting the user to select whether or not to specify a hidden area. The user can select whether or not to specify a hidden area by operating the input interface 20. The input interface 20 transmits result information of the user's selection to the ultrasound imaging diagnostic device 100.

The designation function 130 in the ultrasound diagnostic imaging device 100 determines whether or not the user has decided to designate a hidden region based on the result information transmitted by the input interface 20 (step S109). If it is determined that the user has not decided to designate a hidden region, the designation function 130 advances the process to step S117.

When the designation function 130 determines that the user has decided to designate a hidden area, the designation function 130 designates a hidden area according to the user's input operation (step S111). When the designation function 130 designates a hidden area, the provision function 138 causes the display device 200 to display an image that prompts the user to designate a hidden area.

The user operates the input interface 20 according to the procedure shown in the image displayed on the display device 200 to specify the hidden area. When specifying the hidden area, the provision function 138 causes the display device 200 to display, for example, a simple rectangular dividing line. After the default display, the size of the dividing line and the area enclosed by the dividing line can be adjusted, for example, by moving, enlarging, or reducing the area by operating the trackball as the input interface 20.

In the rendered image, for example, due to the movable range of the ultrasound probe 10, part of the image of the fetus may be missing. The missing location may give a negative impression to the patient and may be a part that the user does not want to show to the patient, so the user, for example, designates this part as a hidden area. The hidden area is moved by the user, for example, by operating a trackball. For this reason, the user can adjust the size of the dividing line or the area enclosed by the dividing line by, for example, operating the trackball as the input interface 20, and designate, for example, an area that the user does not want the patient to see as a hidden area.

Then, the third generation function 134 generates a concealment image (step S113). If the current rendering mode is the first rendering mode, the third generation function 134 generates the concealment image in the first generation mode. Therefore, the third generation function 134 automatically specifies a color for dark areas included in the color map 152 stored in the memory 150 to generate the concealment image.

The third generation function 134, for example, reads the color map 152 stored in the memory 150, automatically specifies the color of the dark areas of the color map 152, colors the hidden area, and draws it in a buffer to generate a hidden image. The hidden image may be a single color using a color specified for the edge of the hidden area, or may be generated by executing a process that creates a gradation from the set color toward the center of the hidden area.

When the current rendering mode is the second rendering mode, the third generation function 134 generates a concealed image in the second generation mode. To this end, the light characteristic setting map 154 stored in the memory 150 is read, and the concealed area is colored with a color that corresponds to the color when the light is sufficiently attenuated, and a concealed image is generated with a darkness equivalent to that of a shadow area, for example. The edges of the shadow may be blurred. The color of the concealed area may be any color different from the color specified using the color map. The color of the shadow may also be any color different from the color specified using the color map.

Then, the composition function 136 generates a composite image by, for example, arranging the concealed image generated by the third generation function 134 in the concealed area in the rendering image generated by the second generation function 128 in accordance with the user's operation of the trackball and combining the rendering image and the concealed image (step S115). The composition function 136 generates a first composite image by, for example, combining the first rendering image and the first concealed image. The composition function 136 generates a second composite image by, for example, combining the second rendering image and the second concealed image.

Next, the providing function 138 causes the display device 200 to display the composite image generated by the composition function 136 (step S117). If the designation function 130 determines in step S109 that the user has decided not to designate a hidden area, the providing function 138 causes the display device 200 to display the rendering image generated in step S107 as a composite image.

When the rendering mode is switched, the providing function 138 switches the display of the image to be displayed on the display device 200. For example, in the first rendering mode, the providing function 138 causes the display device 200 to display a first composite image, a first rendering image, a first concealed image, etc. When the rendering mode is switched from the first rendering mode to the second rendering mode, the providing function 138 switches the image to be displayed on the display device 200 to a second composite image, a second rendering image, a second concealed image, etc. In this way, the ultrasound imaging diagnostic device 100 ends the processing shown in FIG. 2.

Next, the rendering image and composite image that the provision function 138 displays on the display device 200 will be described. FIG. 3 is a diagram showing an example of a rendering image displayed on the display device 200. FIG. 4 is a diagram showing an example of a rendering image displayed on the display device 200. FIG. 5 is a diagram showing an example of a rendering image displayed on the display device 200. FIG. 6 is a diagram showing an example of a rendering image displayed on the display device 200. Below, the first composite image will be described using FIG. 3 and FIG. 4, and the second composite image will be described using FIG. 5 and FIG. 6.

First, the first composite image will be described. In the first rendering image R1 shown in FIG. 3, the fetal face is shown. In the first rendering image R1, the shape that forms the fetal face is roughly shown. However, the image in the area that becomes the first concealed area X1 at the lower left corner of the first rendering image R1 is partially missing due to reasons such as the ultrasonic waves output by the ultrasound probe 10 not reaching there. The first concealed area X1 is, for example, a vertically elongated ellipse.

When the user operates the input interface 20 to specify the first hidden area X1, the specification function 130 specifies the first hidden area X1. Next, the third generation function 134 generates a first hidden image H1 that conceals the first hidden area X1, as shown in FIG. 4. When generating the first hidden image H1, the third generation function 134 uses, for example, a color map that is stored in the memory 150 and includes the colors used when generating the first rendering image R1. The first hidden image H1 is an image generated to place simple shapes such as circles and squares only in the first hidden area X1, which is the part to be hidden.

For example, when pink is used as the first rendering image R1, the third generation function 134 generates the first concealed image H1 using pink. The third generation function 134 automatically specifies the color of the dark part of the color map 152 and colors the concealed area. Therefore, the first concealed image H1 blends naturally with the first rendering image and does not interfere with the recognition of the image of the subject in the first rendering image R1. The color used by the third generation function 134 is linked to the color used by the second generation function 128, for example. Therefore, the user does not need to specify the color when generating the concealed image. The third generation function 134 may generate the first concealed image H1 by, for example, applying a gradation process that makes the vicinity of the outer periphery dark and gradually lightens toward the inside. The composition function 136 composes the first rendering image R1 and the first concealed image H1 to generate the first composite image S1 shown in FIG. 4.

The first concealed region X1 of the first composite image S1 displays an image that was missing in the first rendering image R1, but in the first composite image S1, a first concealed image H1 with a color close to the surrounding color is displayed. As a result, the missing portion that is not desired to be shown is concealed, and the first concealed image H1 blends naturally with the surrounding image of the first concealed region X1, making it less likely to interfere with the patient's perception when viewing the first composite image S1.

Next, the second composite image will be described. In the second rendering image R2 shown in FIG. 5, the fetal face is shown, similar to the first rendering image R1. In the second rendering image R2, the shape that forms the fetal face is roughly shown, but a portion of the image in the area that becomes the second concealed area X2 at the upper left corner is missing. The second concealed area X2 is, for example, a vertically long rectangle with the edges chamfered.

As shown in the first rendering image R1 and the second rendering image R2, missing portions often occur at the edges of the rendering image. For this reason, the hidden area is often specified as the edge of the rendering image, and, for example, if a template is prepared in advance for the shape of the hidden area, it is preferable to use a shape that is easy to place at the edge, such as a rectangle (including a shape with chamfered corners) or an ellipse.

When the user operates the input interface 20 to specify the second hidden area X2, the specification function 130 specifies the second hidden area X2. Next, the third generation function 134 generates a second hidden image H2 that conceals the second hidden area X2, as shown in FIG. 6. When generating the second hidden image H2, the third generation function 134 uses, for example, the light characteristic setting map 154 stored in the memory 150 and used when generating the second rendering image R2. The second hidden image H2 is an image generated to conceal the second hidden area X2, for example, by darkening the specified range with a simple shape to create a shadow.

The third generation function 134 generates the second concealed image H2 according to, for example, the light characteristic setting map 154 stored in the memory 150. The third generation function 134 generates the second concealed image H2 so that, for example, while darkening the interior of the second composite image S2, the color of the shadowed portion is automatically specified by coloring the vicinity of the portion in which the subject is projected, resulting in an image that naturally blends into the image as a shadow. The composition function 136 composes the second rendering image R2 and the second concealed image H2 to generate the second composite image S2 shown in FIG. 6.

The second concealed region X2 of the second composite image S2 displays an image that was missing in the first rendering image R1, but in the second composite image S2, the second concealed image H2 is displayed in a form that is less likely to cause discomfort in relation to the surroundings. As a result, the missing parts that are not desired to be shown are concealed, and the second concealed image H2 appears to blend naturally with the surrounding images of the second concealed region X2, making it less likely to interfere with the patient's perception when viewing the second composite image S2.

In the ultrasound diagnostic imaging device 100 of the embodiment, for example, a composite image in which an image of a part that the examinee does not want to see is concealed with a concealment image is shown to the examinee for diagnosis, so that the discomfort felt by the examinee can be reduced. In addition, the concealment image is generated with a color and darkness that matches the composite image, so that the unnatural feeling caused by using the concealment image can be reduced. In the ultrasound diagnostic imaging device 100 of the embodiment, the concealment image is generated not for a 3D image, but for a rendering image that has been two-dimensionalized from the 3D image, and the rendering image and the concealment image are composited. Therefore, the concealment image can be generated with simple processing compared to processing for a 3D image, so that the parts of the rendering image that the examinee does not want to see can be concealed with simple processing.

In the above embodiment, the rendering image and the composite image are generated in the ultrasound diagnostic imaging device 100, but the rendering image and the composite image may be generated by a medical imaging diagnostic device other than the ultrasound diagnostic imaging device 100. The medical imaging diagnostic device that generates the rendering image and the composite image may be, for example, a modality such as a radiation diagnostic imaging device, an MRI diagnostic imaging device, or an X-ray CT diagnostic imaging device. Furthermore, instead of a medical imaging diagnostic device, a medical image processing device may be used. The medical image processing device may be, for example, an in-hospital console, a cloud console, a workstation, or various modalities (medical equipment).

In the above embodiment, the 3D image is generated based on reflected wave information corresponding to the reflected waves of the ultrasound, but in a medical image diagnostic device or a medical image processing device, the 3D image may be an image generated based on information corresponding to the characteristics of the various devices. For example, in a radiation image diagnostic device, the 3D image may be a 3D image obtained by converting a radiation image into 3D. The 3D image includes a 4D image in which 3D images are successively displayed on the time axis.

In the ultrasound imaging diagnostic device 100 of the above embodiment, for example, when the rendering image is rotated or the light source position of the rendering image is changed after the composite image is generated, the concealed image may be erased (reset) and the composite image may be regenerated (regenerated) each time, or the color specified in the first rendering mode may be preset. When the rendering image is rotated or the light source position of the rendering image is changed, the concealed area often moves, and it is often necessary to regenerate the concealed image (composite image). For this reason, when the rendering image is rotated or the light source position of the rendering image is changed, the concealed image area and even the area before the composite image are generated can be reduced by erasing the concealed image each time.

When erasing the concealed image, if the above erasure conditions are met, an image that allows the user to select whether or not to erase the concealed image may be displayed on the display device 200, and the user may instruct the display device 200 to erase the concealed image. If the rotation of the rendering image or the movement of the light source position is slight, the concealed area may barely move. In this case, regenerating the concealed image may be a waste, so in order to suppress regeneration of the concealed image when it is not necessary, the user may be allowed to select whether or not to regenerate the concealed image. Alternatively, threshold values may be set for the amount of rotation of the rendering or the amount of movement of the light source position, and the concealed image may be erased when these threshold values are exceeded.

In the above embodiment, one concealment image is generated for one rendering image and then composited, but two or more concealment images may be generated for one rendering image and then composited. Also, previously generated concealment images may be stored and used as preset images when generating concealment images for other rendering images.

In the above embodiment, when the rendering mode is switched, the generation mode in the third generation function 134 and the image displayed by the provision function 138 are switched accordingly, but it is also possible to configure the generation mode and some or all of the image to be displayed not to be switched even when the rendering mode is switched.

According to at least one of the embodiments described above, by having an acquisition unit that acquires image generation elements generated by a medical device, a first generation unit that generates a 3D image based on the image generation elements, a second generation unit that performs a rendering process on the 3D image to generate a rendering image, a concealment unit that conceals a concealed area in the rendering image, and a provision unit that provides the rendering image in which the concealed area is concealed, it is possible to conceal parts of the rendering image that are not to be shown with simple processing.

Although several embodiments have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are within the scope of the invention and its equivalents as set forth in the claims, as well as the scope and spirit of the invention.

1...Ultrasound image diagnostic system 10...Ultrasound probe 20...Input interface 100...Ultrasound image diagnostic device 110...Transmitter/receiver circuit 120...Processing circuit 122...Acquisition function 124...First generation function 126...Setting function 128...Second generation function 130...Designation function 132...Concealment function 134...Third generation function 136...Synthesis function 138...Providing function 150...Memory 152...Color map 154...Light characteristic setting map 200...Display device H1...First concealed image H2...Second concealed image R1...First rendering image R2...Second rendering image S1...First composite image S2...Second composite image X1...First concealed area X2...Second concealed area

Claims (7)

An acquisition unit that acquires image generation elements generated by a medical device;
A first generation unit that generates a three-dimensional image based on the acquired image generation elements;
a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image;
a concealment unit that sets a concealment area in the rendering image;
a providing unit that provides the rendering image in which the hidden area is set;
and a designation unit that designates the hidden area based on an instruction input from outside .
Medical imaging diagnostic equipment. An acquisition unit that acquires image generation elements generated by a medical device;
A first generation unit that generates a three-dimensional image based on the acquired image generation elements;
a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image;
a concealment unit that sets a concealment area in the rendering image;
a providing unit that provides the rendering image in which the hidden area is set,
the concealment unit uses a color map used in generating the rendering image to specify a color of the concealment area and generates a concealment image to be displayed in the concealment area.
Medical imaging diagnostic equipment. An acquisition unit that acquires image generation elements generated by a medical device;
A first generation unit that generates a three-dimensional image based on the acquired image generation elements;
a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image;
a concealment unit that sets a concealment area in the rendering image;
a providing unit that provides the rendering image in which the hidden area is set,
The concealment unit adjusts the darkness of the concealment area by using a light characteristic setting map used when generating the rendering image, and generates a concealment image to be displayed in the concealment area.
Medical imaging diagnostic equipment. An acquisition unit that acquires image generation elements generated by a medical device;
A first generation unit that generates a three-dimensional image based on the acquired image generation elements;
a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image;
a concealment unit that sets a concealment area in the rendering image;
a providing unit that provides the rendering image in which the hidden area is set;
A storage unit that stores a generation condition for the concealment unit to generate a concealment image that conceals the concealment area.
Medical imaging diagnostic equipment. The concealment unit includes a third generation unit that generates a concealment image to be placed in the concealment unit;
a synthesis unit that arranges the third generation unit in the concealment unit and synthesizes the rendering image and the concealment image,
The medical image diagnostic apparatus according to claim 1 . An acquisition unit that acquires image generation elements generated by a medical device;
A first generation unit that generates a three-dimensional image based on the acquired image generation elements;
a second generation unit that generates a rendering image by performing a rendering process on the generated three-dimensional image;
a concealment unit that sets a concealment area in the rendering image;
and a designation unit that designates the hidden area based on an instruction input from outside .
Medical imaging equipment. On the computer,
acquiring an imaging element generated by a medical device;
generating a three-dimensional image based on the acquired image generating elements;
A rendering process is performed on the generated three-dimensional image to generate a rendered image; and a hidden area is set in the rendered image.
providing the rendering image in which the occlusion region is set ;
The concealment area is designated based on an externally input instruction.
program.

Images