JP6750988B2 - Interpretation report creation device - Google Patents

Description

Embodiments of the present invention relates to a diagnostic report generation equipment.

The image interpretation report is created by an image interpretation doctor. Explaining the process of creating an interpretation report by the radiologist, first, the radiologist interprets the medical image (inspection image) taken by the technician based on the examination content requested by the clinician. For example, the image interpretation doctor displays the medical image of the image interpretation target on the screen based on the requested image interpretation content. The image interpretation doctor observes the medical image while changing the display mode of the medical image as the image interpretation target displayed on the screen. Thereby, the image interpretation doctor finds a lesion or the like included in the medical image as the image interpretation target. Then, the image interpretation doctor inputs the findings (text data) based on the lesion found from the medical image to be interpreted. Further, the image interpretation doctor specifies a medical image (key image) that is the basis of the finding, and inputs information for identifying the specified medical image. The information for identifying the medical image corresponds to, for example, a path indicating a storage location where the identified medical image exists, a URL (Uniform Resource Locator), an image ID for identifying the medical image, or the identified medical image. It is a thumbnail to do.

The image interpretation report created by the image interpretation doctor through the above process is attached with a medical image on which the image interpretation doctor bases his findings, or contains information for identifying the specified medical image. Some of the image interpretation reports include link information that causes the image interpreting doctor to call a medical image based on the finding from the storage location based on the path or the URL and display the called medical image on the screen.

By the way, a reader of an interpretation report such as a clinician confirms, for each lesion, the findings regarding the lesion described in the interpretation report and the medical image that is the basis of the findings. Some readers of the interpretation report have a desire to confirm (reproduce) the transition of the display mode of the medical image displayed on the screen by the interpreting doctor in order to judge the validity of the findings. There is.

Therefore, the image processing parameters applied to each medical image at the time of image interpretation by the image interpreting doctor are stored as history information, and the transition of the display mode of the medical image displayed on the screen by the image interpreting doctor based on the stored history information. The realization of a medical image display device capable of reproducing the above is envisioned.

From the history information, each image processing applied to each medical image can be reproduced. However, even if each image processing applied to the medical image at the time of image interpretation is reproduced, each display mode of each medical image observed by the image interpretation doctor at the time of image interpretation is only vaguely understood. That is, the intention of the image interpreting doctor for each image processing, the relationship between each display mode and the content of the finding (for example, the relationship between the individual sentences and phrases forming the finding) and the like are not yet examined.

For this reason, the reader of the image interpretation report cannot know in detail the image interpretation process by the image interpretation doctor and the review process at the time of creating the finding. Therefore, it is still difficult for the reader of the interpretation report to judge the appropriateness of the findings in the interpretation report.

JP, 2004-334789, A JP, 2007-088785, A

The purpose of this embodiment is able to know the interpretation process from finding of the interpretation report is to provide a diagnostic report generation equipment which can contribute to the determination of the validity of the findings.

According to the embodiment, the image interpretation report creating apparatus includes a finding input operation for inputting a finding using a finding input screen, a screen operation for a medical image to be read using an image display screen, the screen operation, and the finding input operation. An input unit that accepts a switching operation of, a detection unit that detects the switching operation via the input unit, and a series of screen operations performed via the input unit based on the detected switching operation. Into a series of screen operation groups, and a grouping section for classifying a series of finding input operations performed via the input section into a series of finding input operation groups, the series of screen operating groups, and the series of findings. Reproduction information for associating an input operation group with a time context, and reproducing the screen operation included in each of the series of screen operation groups, and the series of findings associated with the series of screen operation groups. A storage unit that stores the sentence unit of the finding input by the finding input operation included in each input operation group.

FIG. 1 is a block diagram showing an image interpretation report management system according to the first embodiment. FIG. 2 is a block diagram showing the image interpretation report creating apparatus shown in FIG. FIG. 3 is a diagram showing an example of a display screen displayed on the display circuit in the process of creating an image interpretation report in the image interpretation report creating apparatus according to the first embodiment. FIG. 4 is a screen operation performed on the image display screen displayed on the display circuit 23, a finding input operation performed on the finding input screen, a screen operation and a finding input operation in the process of creating the interpretation report in the first embodiment. It is a figure which shows an example of the switching operation which switches and. FIG. 5 is a diagram showing the operation history information stored in the storage circuit in the process of creating the image interpretation report shown in FIG. FIG. 6 is a diagram showing screen operation groups divided by processing circuits in the operation examples shown in FIGS. 4 and 5. FIG. 7 is a diagram showing finding input operation groups divided by processing circuits in the operation examples shown in FIGS. 4 and 5. FIG. 8 shows the reproduction information included in each of the series of screen operation groups stored in the storage circuit in the first embodiment and the findings included in each of the series of finding input operation groups associated with each of the series of screen operation groups. It is a figure which shows a sentence unit. FIG. 9 shows a screen operation performed on the image display screen displayed on the display circuit, a finding input operation performed on the finding input screen, a screen operation and a finding input operation in the process of creating the interpretation report in the second embodiment. FIG. 7 is a diagram showing an example of a switching operation for switching the. FIG. 10 is a diagram showing the operation history information stored in the storage circuit in the process of creating the image interpretation report shown in FIG. FIG. 11 is a diagram showing screen operation groups divided by processing circuits in the operation examples shown in FIGS. 9 and 10. FIG. 12 is a diagram showing finding input operation groups divided by processing circuits in the operation examples shown in FIGS. 9 and 10. FIG. 13 shows the reproduction information included in each of the series of screen operation groups stored in the storage circuit according to the second embodiment and the findings included in each of the series of finding input operation groups associated with each of the series of screen operation groups. It is a figure which shows a sentence unit. FIG. 14 is a block diagram showing the image interpretation report display device shown in FIG. FIG. 15 is a diagram showing an example of a report display screen in the image interpretation report display device according to the third embodiment. FIG. 16 is a diagram showing a display example 1 of the report display screen when the icon displayed on the finding display screen is designated. FIG. 17 is a diagram showing a second display example of the report display screen when the icon displayed on the finding display screen is designated. FIG. 18 is a diagram showing a display example 1 of the report display screen when the reproduction information associated with the designated sentence unit includes a plurality of screen operations. FIG. 19 is a diagram showing a second display example of the report display screen when the reproduction information associated with the designated sentence unit includes a plurality of screen operations.

Hereinafter, an image interpretation report creating apparatus and an image interpretation report display apparatus according to the present embodiment will be described with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing an image interpretation report management system according to the first embodiment. As shown in FIG. 1, the image interpretation report management system includes a medical image display device 1, an image interpretation report creation device 2, and an image interpretation report display device 3. The medical image display apparatus 1 is a computer (image viewer) for browsing the medical image captured by the medical image capturing apparatus. The image interpretation report creating apparatus 2 is a computer or a workstation for creating an image interpretation report regarding the medical image. The image interpretation report display device 3 is a computer (report viewer) for browsing the image interpretation report created by the image interpretation report creation device 2. The medical image display apparatus 1, the image interpretation report creating apparatus 2, and the image interpretation report display apparatus 3 are connected to each other via a network NW. The medical image display apparatus 1, the image interpretation report creating apparatus 2, and the image interpretation report display apparatus 3 may all be installed in one examination room, or may be installed in different examination rooms. In the first embodiment, the medical image display apparatus 1 and the image interpretation report creating apparatus 2 are installed in one examination room, and the image interpretation report display apparatus 3 is different from the medical image display apparatus 1 and the image interpretation report creating apparatus 2. Install in the room.

Here, the configuration of the image interpretation report creating apparatus 2 will be described in detail. FIG. 2 is a block diagram showing the image interpretation report creating apparatus 2 shown in FIG. The image interpretation report creating apparatus 2 shown in FIG. 2 includes an input interface (IF) circuit 21, a communication interface (IF) circuit 22, a display circuit 23, a storage circuit 24, a creating apparatus control circuit 25, and a processing circuit 26. Have. The input IF circuit 21, the communication IF circuit 22, the display circuit 23, the storage circuit 24, the creation device control circuit 25, and the processing circuit 26 are connected via a bus BUS.

The input IF circuit 21 is realized by a trackball, a scroll wheel, a switch button, a mouse, a keyboard, a touch pad that performs an input operation by touching an operation surface, a touch panel display in which a display screen and a touch pad are integrated, and the like. It The input IF circuit 21 converts an input operation received from an operator (user) into an electric signal and outputs the electric signal to the creation device control circuit 25. In the first embodiment, the input IF circuit 21 is not limited to the one including physical operation parts such as a trackball, a scroll wheel, a switch button, a mouse, and a keyboard. For example, an example of the input IF circuit 21 is a processing circuit of an electric signal that receives an electric signal corresponding to an input operation from an external input device provided separately from the device and outputs the electric signal to the creation device control circuit 25. include.

The communication IF circuit 22 is a communication device for communicating with an external device by wire or wirelessly. The external device is, for example, a server included in a system such as a hospital information system (HIS: Hospital Information System) and a PACS (Picture Archiving and Communication System), or another workstation. In the first embodiment, the communication IF circuit 22 communicates with the medical image display device 1 and the image interpretation report display device 3 shown in FIG.

The display circuit 23 displays various data, the medical image, and the like under the control of the creation device control circuit 25. The display circuit 23 has a display interface circuit and a display device. The display interface circuit converts data representing a display target into a video signal. The display signal is supplied to the display device. The display device displays a video signal representing a display target. Examples of the display device include a CRT display (Cathode Ray Tube Display), a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro Luminescence Display), a plasma display, and others known in the art. Any display of can be used as appropriate.

The storage circuit 24 is an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like that can store data. For example, the storage circuit 24 associates a series of screen operation groups with a series of finding input operation groups on the basis of time context, and reproduction information for reproducing the screen operations included in each of the series of screen operation groups. , The sentence unit of the finding input by the finding input operation included in each of the series of finding input operation groups associated with the series of screen operation groups is stored. The storage circuit 24 may use an optical disc such as a magneto-optical disc, a CD (Compact Disc), a DVD (Digital Versatile Disc), etc., in addition to a magnetic disc such as an HDD. The storage area of the storage circuit 24 may be in the image interpretation report creating apparatus 2 or in an external storage device connected by the network NW.

The creation device control circuit 25 has, as hardware resources, a predetermined processor such as a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and a predetermined memory such as a ROM (Read Only Memory) and a RAM (Random Access Memory). It is realized by. The memory of the creation device control circuit 25 stores a control program. The processor of the creation device control circuit 25 reads the control program stored in the memory. By executing the read control program, the processor of the creation device control circuit 25 centrally controls the operation and processing of each component in the image interpretation report creation device 2.

The processing circuit 26 is realized as a hardware resource by a predetermined processor such as a CPU and an MPU and a predetermined memory such as a ROM and a RAM. The memory of the processing circuit 26 stores the viewer screen display program. The processor of the processing circuit 26 reads the viewer screen display program stored in the memory. The processor of the processing circuit 26 realizes the viewer screen display function 261 by executing the read viewer screen display program. By realizing the viewer screen display function 261, the processing circuit 26 requests the medical image display apparatus 1 to transfer the image display screen for browsing the medical image on the display circuit 23.

Here, the medical image display apparatus 1 transfers the image display screen to the image interpretation report creating apparatus 2 in response to a request from the image interpretation report creating apparatus 2. The display circuit 23 displays the transferred image display screen. The image display screen may be displayed on the medical image display device 1.

The memory of the processing circuit 26 stores the report creation screen display program. The processor of the processing circuit 26 reads the report creation screen display program stored in the memory. The processor of the processing circuit 26 realizes the report creation screen display function 262 by executing the read report creation screen display program. By implementing the report creation screen display function 262, the processing circuit 16 displays on the display circuit 23 a finding input screen for inputting a finding for the medical image to be interpreted, which is displayed on the image display screen of the display circuit 23.

The memory of the processing circuit 26 stores the operation detection program. The processor of the processing circuit 26 reads out the operation detection program stored in the memory. The processor of the processing circuit 26 realizes the operation detection function 263 by executing the read operation detection program. By implementing the operation detection function 263, the processing circuit 26 detects an input operation input by the operator via the input IF circuit 21. For example, the processing circuit 26 detects a screen operation, a finding input operation, and a switching operation as input operations. The processing circuit 26 stores, in the storage circuit 24, codes indicating the detected screen operation, finding input operation, and switching operation, as operation history information performed in the process of creating the image interpretation report, together with time information when the corresponding input operation is performed. Remember.

Here, the screen operation is an operation using the image display screen displayed on the display circuit 23 to change the display mode of the medical image to be interpreted. Specifically, the screen operations include slice position change, window division change, layout change, position adjustment, gradation change (change of window level (WL: Window Level) and change of window width (WW: Window Width)). This is an operation for changing the display mode generally performed on the medical image displayed on the image display screen, such as including at least one of these), scaling, moving (for example, pan), rotating, and the like. The finding input operation is an operation of using the finding input screen displayed on the display circuit 23 to input a finding for the medical image to be interpreted. The switching operation is an operation for switching between the screen operation and the finding input operation.

The memory of the processing circuit 26 stores the sentence unit determination program. The processor of the processing circuit 26 reads the sentence unit determination program stored in the memory. The processor of the processing circuit 26 realizes the sentence unit confirmation function 264 by executing the read sentence unit confirmation program. By implementing the sentence unit determination function 264, the processing circuit 26 determines the sentence unit of the finding input on the finding input screen based on a predetermined trigger.

The memory of the processing circuit 26 stores the grouping program. The processor of the processing circuit 26 reads the grouping program stored in the memory. The processor of the processing circuit 26 realizes the grouping function 265 by executing the read grouping program. By implementing the grouping function 265, the processing circuit 26 divides a series of screen operations performed via the input IF circuit 21 into a series of screen operation groups. Further, the processing circuit 26 divides a series of finding input operations performed via the input IF circuit 21 into a series of finding input operation groups.

Here, the operation of the image interpretation report creating process in the image interpretation report creating apparatus 2 according to the first embodiment will be described with a specific example. In the first embodiment, both the image display screen and the finding input screen are displayed on the display circuit 23 of the image interpretation report creating apparatus 2.

FIG. 3 is a diagram showing an example of a display screen displayed on the display circuit 23 in the process of creating an image interpretation report in the image interpretation report creating apparatus 2 according to the first embodiment. First, a display screen displayed on the display circuit 23 in the process of creating an interpretation report will be described. As shown in FIG. 3, an image display screen D1 and a finding input screen D2 are displayed on the display screen DP of the display circuit 23. On the image display screen D1, a medical image (Img) to be interpreted corresponding to the examination requested to be interpreted is displayed. Further, on the display screen DP, a pointer operated by an operator's operation via the input IF circuit 21. P is displayed by the operator to change the display mode of the medical image Img to be read on the image display screen D1 by performing the screen operation via the input IF circuit 21. By performing the finding input operation via the input IF circuit 21, the finding for the medical image Img to be interpreted, which is displayed on the image display screen D1, is input.

Next, a process of creating an image interpretation report will be described along with an input operation performed on the display screen DP. FIG. 4 shows screen operations performed on the image display screen D1 displayed on the display circuit 23, observation input operations performed on the observation input screen D2, screen operations and observations in the process of creating an image interpretation report in the first embodiment. It is a figure which shows an example of the switching operation which switches between input operation.

First, in step Sa1, the screen operation 1 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 1, a pan operation for changing the display position of the medical image to be interpreted is input. When the screen operation 1 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 1. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 1 in the storage circuit 24 together with the time information (time t ₁ ) when the screen operation 1 was performed. The medical image display apparatus 1 acquires the reproduction information corresponding to the screen operation 1 by using the detection of the screen operation 1 by the processing circuit 26 as a trigger. In the first embodiment, the medical image display apparatus 1 transfers the acquired reproduction information corresponding to the screen operation 1 to the image interpretation report creating apparatus 2. The reproduction information corresponding to the transferred screen operation 1 is stored in the storage circuit 24 of the image interpretation report creating apparatus 2. The reproduction information is information for reproducing a series of screen operations performed via the input IF circuit 21 in the process of inputting a sentence unit of a finding in the image interpretation report creating apparatus 2. For example, the reproduction information is one of a screen-operated image interpretation target image, a captured image of an image display screen including the screen-operated image interpretation target medical image, and a log indicating the content of the screen operation for the image interpretation target medical image. At least one.

In step Sa2, the screen operation 2 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 2, the operation of enlarging the region of interest in the medical image to be interpreted, which has been panned in step Sa1, is input. When the screen operation 2 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 2. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 2 in the storage circuit 24 together with the time information (time t ₂ ) when the screen operation 2 was performed. The medical image display apparatus 1 uses the detection of the screen operation 2 by the processing circuit 26 as a trigger to acquire the reproduction information corresponding to the screen operation 2. In the first embodiment, the medical image display apparatus 1 transfers the acquired reproduction information corresponding to the screen operation 2 to the image interpretation report creating apparatus 2. The reproduced information corresponding to the transferred screen operation 2 is stored in the storage circuit 24 of the image interpretation report creating apparatus 2.

In step Sa3, a switching operation for switching between the screen operation and the finding input operation is input via the input IF circuit 21. Specifically, the switching operation SW1 for switching the active window from the image display screen D1 to the finding input screen D2 is input. The switching of the active window from the image display screen D1 to the finding input screen D2 can be performed, for example, by operating the pointer P via the input IF circuit 21 and clicking the finding input screen D2 with the pointer P. When the switching operation SW1 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW1. Processing circuit 26 stores the operation history information corresponding to the switching operation SW1 detected, the memory circuit 24 together with the time information was switching operation SW1 (time t _3).

In step Sa4, the finding input operation A-1 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-1, the finding for the medical image to be interpreted which has been subjected to the screen operation 1 and the screen operation 2 displayed on the image display screen D1 is input. When the finding input operation A-1 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-1. The processing circuit 26 also stores the operation history information corresponding to the detected finding input operation A-1 in the storage circuit 24 together with the time information (time t ₄ ) when the finding input operation A-1 was performed.

In step Sa5, the confirmation operation SE1 in sentence units of the finding input by the finding input operation A-1 is input to the finding input screen D2 via the input IF circuit 21. Specifically, the confirming operation SE1 is performed by pressing the enter key installed on the keyboard, that the finding input operation on the finding input screen D2 has not been performed for a predetermined time, and that between the image display screen D1 and the finding input screen D2 Including switching of the active window. When the confirming operation SE1 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE1. The processing circuit 26 stores the operation history information corresponding to the detected finalizing operation SE1 in the storage circuit 24 together with the time information (time t ₅ ) when the finalizing operation SE1 was performed. The processing circuit 26 sets the sentence unit of the finding input by the finding input operation A-1 by using the input of the setting operation SE1 on the finding input screen D2 as a trigger. After the confirmation operation, the processing circuit 26 stores the character string of the finding input by the finding input operation A-1 in the storage circuit 24.

In step Sa6, the finding input operation A-2 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-2, the finding on the medical image to be interpreted which has been subjected to the screen operation 1 and the screen operation 2 displayed on the image display screen D1 is input. When the finding input operation A-2 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-2. Further, the processing circuit 26 stores the operation history information corresponding to the detected finding input operation A-2 in the storage circuit 24 together with the time information (time t ₆ ) when the finding input operation A-2 is performed.

In step Sa7, the confirmation operation SE2 in sentence units of the finding input by the finding input operation A-2 is input to the finding input screen D2 via the input IF circuit 21. When the confirming operation SE2 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE2. Processing circuit 26, the operation history information corresponding to the determined operation SE2 detected and stored in the storage circuit 24 together with the time information was confirmation operation SE2 (time t _7). The processing circuit 26 sets the sentence unit of the finding input by the finding input operation A-2, triggered by the input of the setting operation SE2 on the finding input screen D2. After the confirmation operation, the processing circuit 26 stores the sentence unit of the finding input by the finding input operation A-2 in the storage circuit 24.

In step Sa8, the switching operation SW2 for switching the active window from the finding input screen D2 to the image display screen D1 is input via the input IF circuit 21. The switching of the active window from the finding input screen D2 to the image display screen D1 can be performed by operating the pointer P via the input IF circuit 21 and clicking the image display screen D1 with the pointer P, for example. When the switching operation SW2 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW2. Processing circuit 26 stores the operation history information corresponding to the switching operation SW2 detected, the memory circuit 24 together with the time information was switching operation SW2 (time t _8).

In step Sa9, the screen operation 3 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 3, a pan operation for changing the display position of the medical image to be interpreted that has been magnified in Sa2 is input. When the screen operation 3 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 3. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 3 in the storage circuit 24 together with the time information (time t ₉ ) when the screen operation 3 was performed. The medical image display apparatus 1 uses the detection of the screen operation 3 by the processing circuit 26 as a trigger to acquire the reproduction information corresponding to the screen operation 3. In the first embodiment, the medical image display apparatus 1 transfers the acquired reproduction information corresponding to the screen operation 3 to the image interpretation report creating apparatus 2. The reproduced information corresponding to the transferred screen operation 3 is stored in the storage circuit 24 of the image interpretation report creating apparatus 2.

In step Sa10, the screen operation 4 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 4, the operation of enlarging the region of interest in the medical image to be interpreted, which has been panned in step Sa9, is input. When the screen operation 4 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 4. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 4 in the storage circuit 24 together with the time information (time t ₁₀ ) when the screen operation 4 was performed. The medical image display apparatus 1 acquires the reproduction information corresponding to the screen operation 4 by using the detection of the screen operation 4 by the processing circuit 26 as a trigger. In the first embodiment, the medical image display apparatus 1 transfers the obtained reproduction information corresponding to the screen operation 4 to the image interpretation report creating apparatus 2. The reproduction information corresponding to the transferred screen operation 4 is stored in the storage circuit 24 of the image interpretation report creating apparatus 2.

In step Sa11, the switching operation SW3 for switching the active window from the image display screen D1 to the finding input screen D2 is input via the input IF circuit 21. When the switching operation SW3 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW3. The processing circuit 26 stores the operation history information corresponding to the detected switching operation SW3 in the storage circuit 24 together with the time information (time t ₁₁ ) when the switching operation SW1 was performed.

In step Sa12, the finding input operation A-3 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-3, the finding for the medical image to be interpreted which has been subjected to the screen operation 1, the screen operation 2, the image operation 3, and the image operation 4 displayed on the image display screen D1 is input. To be done. When the finding input operation A-3 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-3. The processing circuit 26 also stores the operation history information corresponding to the detected finding input operation A-3 in the storage circuit 24 together with the time information (time t ₁₂ ) when the finding input operation A-3 was performed.

In step Sa13, the sentence-based finalizing operation SE3 of the finding input by the finding input operation A-3 is input to the finding input screen D2 via the input IF circuit 21. When the confirming operation SE3 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE3. The processing circuit 26 stores the operation history information corresponding to the detected finalizing operation SE3 in the storage circuit 24 together with the time information (time t ₁₃ ) when the finalizing operation SE3 was performed. The processing circuit 26 sets the sentence unit of the finding input by the finding input operation A-3, triggered by the input of the setting operation SE3 on the finding input screen D2. After the confirmation operation, the processing circuit 26 stores in the storage circuit 24 the sentence unit of the finding input by the finding input operation A-3.

In step Sa14, the finding input operation A-4 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-4, the finding for the medical image to be interpreted which has been subjected to the screen operation 1, the screen operation 2, the image operation 3, and the image operation 4 displayed on the image display screen D1 is input. To be done. When the finding input operation A-4 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-4. Further, the processing circuit 26 stores the operation history information corresponding to the detected finding input operation A-4 in the storage circuit 24 together with the time information (time t ₁₄ ) when the finding input operation A-4 was performed.

In step Sa15, the sentence-based finalizing operation SE4 of the finding input by the finding input operation A-4 is input to the finding input screen D2 via the input IF circuit 21. When the confirming operation SE4 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE4. The processing circuit 26 stores the operation history information corresponding to the detected finalizing operation SE4 in the storage circuit 24 together with the time information (time t ₁₅ ) when the finalizing operation SE4 was performed. The processing circuit 26 sets the sentence unit of the finding input by the finding input operation A-4, triggered by the input of the setting operation SE4 on the finding input screen D2. After the confirmation operation, the processing circuit 26 stores the sentence unit of the finding input by the finding input operation A-4 in the storage circuit 24.

Here, based on the operation history information stored in the storage circuit 24, the processing circuit 26 divides the series of screen operations performed via the input IF circuit 21 into a series of screen operation groups. In the first embodiment, a series of screen operations is divided into a series of screen operation groups based on a switching operation in the process of creating an image interpretation report. Specifically, the processing circuit 26 classifies one or a plurality of screen operations performed via the input IF circuit 21 into a single screen operation group 1. In addition, based on the operation history information stored in the storage circuit 24, the processing circuit 26 divides the series of finding input operations performed via the input IF circuit 21 into a series of finding input operation groups. In the first embodiment, similar to the method of classifying into a series of screen operation groups, a series of finding input operations is classified into a series of finding input operation groups based on a switching operation in the process of creating an interpretation report. Specifically, the processing circuit 26 divides one or a plurality of finding input operations performed via the input IF circuit 21 into a single finding input operation group.

Here, the classification of a series of screen operations and the classification of a series of finding input operations by the processing circuit 26 will be specifically described with reference to FIG.

FIG. 5 is a diagram showing the operation history information stored in the storage circuit 24 in the process of creating the image interpretation report shown in FIG. For example, the storage circuit 24 stores the operation history information arranged in time series, as shown in FIG. The operation history information illustrated in FIG. 5 is associated with a code (operation history) indicating an input operation, screen information that is a target of the input operation, and time information when the input operation is performed.

Based on the operation history information shown in FIG. 5, the processing circuit 26 determines the screen operation 1 and the screen operation 2 performed via the input IF circuit 21 from the start of the interpretation report generation to the detection of the switching operation SW1. It is divided into one screen operation group 1. Further, the processing circuit 26 assigns the screen operation 3 and the screen operation 4 performed via the input IF circuit 21 from the detection of the switching operation SW2 to the detection of the switching operation SW3 to the single screen operation group 2. Divide.

Based on the operation history information shown in FIG. 5, the processing circuit 26 detects the finding input operation A-1 and the finding input operation A-1 performed via the input IF circuit 21 from the detection of the switching operation SW1 to the detection of the switching operation SW2. The finding input operation A-2 is divided into a single finding input operation group 1. Further, the processing circuit 26 performs a single finding on the finding input operation A-3 and the finding input operation A-4 performed via the input IF circuit 21 from the detection of the switching operation SW3 to the completion of the interpretation report creation. It is divided into the input operation group 2.

FIG. 6 is a diagram showing screen operation groups divided by the processing circuit 26 in the operation examples shown in FIGS. 4 and 5. As shown in FIG. 6, the screen operation group 1 includes a screen operation 1 and a screen operation 2. The screen operation group 2 includes screen operations 3 and 4. FIG. 7 is a diagram showing finding input operation groups divided by the processing circuit 26 in the operation examples shown in FIGS. 4 and 5. As shown in FIG. 7, the finding input operation group 1 includes a finding input operation A-1 and a finding input operation A-2. Further, the finding input operation group 2 includes a finding input operation A-3 and a finding input operation A-4.

After dividing the series of screen operation groups and the series of finding input operation groups, the memory circuit 24 associates the series of screen operating groups with the series of finding input operation groups based on the time context. In the first embodiment, the storage circuit 24 associates the screen operation group with the finding input operation group temporally immediately after the screen operation group.

Specifically, the storage circuit 24 associates the screen operation group 1 with the finding input operation group 1 performed immediately after the screen operation group 1 in terms of time. Further, the storage circuit 24 associates the screen operation group 2 with the finding input operation group 2 performed immediately after the screen operation group 2 in time.

FIG. 8 shows reproduction information included in each of the series of screen operation groups stored in the storage circuit 24 in the first embodiment and findings included in each of the series of finding input operation groups associated with each of the series of screen operation groups. It is a figure which shows the sentence unit of. As shown in FIG. 8, reproduction information corresponding to each of the screen operation 1 and the screen operation 2 included in the screen operation group 1, and the finding input operation A-1 and the finding input operation A-2 included in the finding input operation group 1. A sentence unit corresponding to each is associated. Further, reproduction information corresponding to each of the screen operation 3 and the screen operation 4 included in the screen operation group 2, and a sentence corresponding to each of the finding input operation A-3 and the finding input operation A-4 included in the finding input operation group 2. Units are associated with.

Here, the reproduction information corresponding to the screen operation 1 is, for example, a medical image to be interpreted for which the screen operation 1 has been performed, a capture image of the image display screen D1 including the medical image for which the screen operation 1 has been performed, It is at least one of a log indicating the contents of the screen operation 1 for the medical image to be interpreted. The reproduction information corresponding to the screen operation 2 is for the medical image to be interpreted which has undergone the screen operation 2, the capture image of the image display screen D1 including the medical image to be interpreted which has undergone the screen operation 2, and the medical image to be interpreted. It is at least one of the log indicating the contents of the screen operation 2. The reproduction information corresponding to the screen operation 3 is for the medical image to be interpreted which has undergone the screen operation 3, the capture image of the image display screen D1 including the medical image to be interpreted which has undergone the screen operation 3, and the medical image to be interpreted. It is at least one of the log indicating the contents of the screen operation 3. The reproduction information corresponding to the screen operation 4 is for the interpretation target medical image subjected to the screen operation 4, the capture image of the image display screen D1 including the interpretation target medical image subjected to the screen operation 4, and the interpretation target medical image. It is at least one of a log indicating the contents of the screen operation 4.

The sentence units corresponding to the finding input operations A-1 and A-2 are, for example, findings on the medical image to be interpreted that has undergone screen operation 1 and screen operation 2. The sentence units corresponding to the finding input operations A-3 and A-4 are findings for the medical image to be interpreted, which has been subjected to the screen operation 3 and the screen operation 4.

The image interpretation report display device 3 is based on the association between the reproduction information shown in FIG. 8 and the sentence unit of the finding, and the sentence unit of the finding for each sentence unit of the finding included in the image interpretation report created by the image interpretation report creating device 2. It is possible to display the medical image to be interpreted, which has the display form when "."

The storage circuit 24 in the first embodiment may store the information shown in FIGS. 5 to 8 in a file format (for example, XML format) and a relational database format.

According to the above configuration, the image interpretation report creating apparatus 2 according to the first embodiment divides a series of screen operations performed via the input IF circuit 21 into a series of screen operation groups based on the detected switching operation. To do. Further, the image interpretation report creating apparatus 2 divides a series of finding input operations performed via the input IF circuit 21 into a series of finding input operation groups based on the detected switching operation. Further, the image interpretation report creating apparatus 2 associates a series of screen operation groups and a series of finding input operation groups with each other based on the time context. The image interpretation report creating apparatus 2 reproduces, for each sentence unit of the finding input by the finding input operation, a sentence unit and a series of screen operations performed via the input IF circuit 21 in the process of inputting the sentence unit. The information is stored in association with it. Accordingly, the image interpretation report creating apparatus 2 according to the first embodiment can easily display the image of the medical image to be interpreted, which was displayed on the image display screen D1 when the text unit was input, and thus the image is described in the image interpretation report. It is easy to judge the appropriateness of the findings.

Here, every time the image interpretation report creating apparatus 2 according to the first embodiment detects a screen operation by the processing circuit 26, it reproduces the reproduction information corresponding to the screen operation from the medical image display apparatus 1. However, the image interpretation report creating apparatus 2 according to the first embodiment is not limited to this. For example, the image interpretation report creating apparatus 2 may acquire the reproduction information corresponding to the screen operation from the medical image display apparatus 1 by using the detection of the confirming operation by the processing circuit 26 as a trigger.

(Second embodiment)
In the image interpretation report creating apparatus according to the second embodiment, a series of screen operations is divided into a series of screen operation groups and a series of finding input operations is made into a series of finding input operation groups using a method different from that of the first embodiment. The method of classification will be described. Since the configuration of the image interpretation report display apparatus according to the second embodiment is substantially the same as the configuration of the image interpretation report creation apparatus 2 according to the first embodiment, the same reference numerals are given to each configuration and detailed description thereof will be omitted. .. Further, in the process of creating the interpretation report, the display screen displayed on the display circuit of the interpretation report creating apparatus according to the second embodiment is the same as the display screen displayed on the display circuit of the interpretation report creating apparatus according to the first embodiment. Since they are substantially the same, the same reference numerals are given to the respective components, and detailed description thereof will be omitted. In the following description, constituent elements having substantially the same functions and configurations are designated by the same reference numerals, and repeated description will be given only when necessary.

First, a process of creating an image interpretation report in the second embodiment will be described along with an input operation performed on the display screen. FIG. 9 is a screen operation performed on the image display screen D1 displayed on the display circuit 23, a finding input operation performed on the finding input screen D2, a screen operation and a finding in the process of creating an image interpretation report in the second embodiment. It is a figure which shows an example of the switching operation which switches between input operation.

In step Sb1, the screen operation 1 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 1, a pan operation for changing the display position of the medical image to be interpreted is input. When the screen operation 1 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 1. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 1 in the storage circuit 24 together with the time information (time t ₁ ) when the screen operation 1 was performed. The medical image display apparatus 1 acquires the reproduction information corresponding to the screen operation 1 by using the detection of the screen operation 1 by the processing circuit 26 as a trigger. In the second embodiment, the medical image display apparatus 1 stores the reproduction information corresponding to the acquired screen operation 1.

In step Sb2, the screen operation 2 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 2, the operation of enlarging the region of interest in the medical image to be interpreted, which has been panned in step Sa1, is input. When the screen operation 2 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 2. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 2 in the storage circuit 24 together with the time information (time t ₂ ) when the screen operation 2 was performed. The medical image display apparatus 1 uses the detection of the screen operation 2 by the processing circuit 26 as a trigger to acquire the reproduction information corresponding to the screen operation 2. In the second embodiment, the medical image display apparatus 1 stores the reproduction information corresponding to the acquired screen operation 2.

In step Sb3, the switching operation SW1 for switching the active window from the image display screen D1 to the finding input screen D2 is input via the input IF circuit 21. When the switching operation SW1 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW1. Processing circuit 26 stores the operation history information corresponding to the switching operation SW1 detected, the memory circuit 24 together with the time information was switching operation SW1 (time t _3).

In step Sb4, the finding input operation A-1 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-1, the finding for the medical image to be interpreted which has been subjected to the screen operation 1 and the screen operation 2 displayed on the image display screen D1 is input. When the finding input operation A-1 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-1. The processing circuit 26 also stores the operation history information corresponding to the detected finding input operation A-1 in the storage circuit 24 together with the time information (time t ₄ ) when the finding input operation A-1 was performed.

In step Sb5, the switching operation SW2 for switching the active window from the finding input screen D2 to the image display screen D1 is input via the input IF circuit 21. When the switching operation SW2 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW2. Processing circuit 26 stores the operation history information corresponding to the switching operation SW2 detected, the memory circuit 24 together with the time information was switching operation SW2 (time t _5).

Here, in step Sb5, after switching the active window from the finding input screen D2 to the image display screen D1, no screen operation is performed on the image display screen D1. As an example in which the screen operation is not performed on the image display screen D1, for example, the finding input in step Sb4 is in the process of being created, and the active window may be switched from the image display screen D1 to the finding input screen D2 again.

In step Sb6, the switching operation SW3 for switching the active window from the image display screen D1 to the finding input screen D2 is input via the input IF circuit 21. When the switching operation SW3 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW3. Processing circuit 26 stores the operation history information corresponding to the switching operation SW3 detected, the memory circuit 24 together with the time information was switching operation SW3 (time t _6).

In step Sb7, the finding input operation A-2 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-2, the finding on the medical image to be interpreted which has been subjected to the screen operation 1 and the screen operation 2 displayed on the image display screen D1 is input. When the finding input operation A-2 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-2. Further, the processing circuit 26 stores the operation history information corresponding to the detected finding input operation A-2 in the storage circuit 24 together with the time information (time t ₇ ) when the finding input operation A-2 is performed.

In step Sb8, the sentence unit of the finding input by the finding input operation A-1 and the sentence unit of the finding input by the finding input operation A-2 are input to the finding input screen D2 via the input IF circuit 21. The confirmation operation SE1 is input. When the confirming operation SE1 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE1. Processing circuit 26, the operation history information corresponding to confirmation operations SE1 detected and stored in the storage circuit 24 together with the time information was confirmation operation SE1 (time t _8). The processing circuit 26 is triggered by the input of the confirming operation SE1 on the finding input screen D2, and the sentence unit of the finding input by the finding input operation A-1 and the sentence of the finding input by the finding input operation A-2. Confirm the unit and. After the confirmation operation, the processing circuit 26 stores in the storage circuit 24 the sentence unit of the finding input by the finding input operation A-1 and the sentence unit of the finding input by the finding input operation A-2.

Here, the processing circuit 26 uses the input of the confirmation operation SE1 on the finding input screen D2 as a trigger to transfer the stored reproduction information corresponding to the screen operation 1 and the stored reproduction information corresponding to the screen operation 2 to the medical use. Request to the image display device 1. The medical image display apparatus 1 transfers the stored reproduction information corresponding to the screen operation 1 and the stored reproduction information corresponding to the screen operation 2 to the image interpretation report creating apparatus 2 in response to a request from the image interpretation report creating apparatus 2. The transferred reproduction information corresponding to the screen operation 1 and the transferred reproduction information corresponding to the screen operation 2 are stored in the storage circuit 24 of the image interpretation report creating apparatus 2.

In step Sb9, the switching operation SW4 for switching the active window from the finding input screen D2 to the image display screen D1 is input via the input IF circuit 21. When the switching operation SW4 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW4. Processing circuit 26 stores the operation history information corresponding to the switching operation SW4 detected, the memory circuit 24 together with the time information was switching operation SW4 (time t _4).

In step Sb10, the screen operation 3 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 3, a pan operation for changing the display position of the medical image to be interpreted that has been enlarged in step Sb2 is input. When the screen operation 3 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 3. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 3 in the storage circuit 24 together with the time information (time t ₁₀ ) when the screen operation 3 was performed. The medical image display apparatus 1 uses the detection of the screen operation 3 by the processing circuit 26 as a trigger to acquire the reproduction information corresponding to the screen operation 3. In the second embodiment, the medical image display apparatus 1 stores the reproduction information corresponding to the acquired screen operation 3.

In step Sb11, the screen operation 4 is input to the image display screen D1 via the input IF circuit 21. For example, as the screen operation 4, the operation of enlarging the region of interest in the medical image to be interpreted, which has been panned in step Sb10, is input. When the screen operation 4 is input via the input IF circuit 21, the processing circuit 26 detects the screen operation 4. The processing circuit 26 stores the operation history information corresponding to the detected screen operation 4 in the storage circuit 24 together with the time information (time t ₁₁ ) when the screen operation 4 was performed. The medical image display apparatus 1 acquires the reproduction information corresponding to the screen operation 4 by using the detection of the screen operation 4 by the processing circuit 26 as a trigger. In the second embodiment, the medical image display apparatus 1 stores the reproduction information corresponding to the acquired screen operation 4.

In step Sb12, the switching operation SW5 for switching the active window from the image display screen D1 to the finding input screen D2 is input via the input IF circuit 21. When the switching operation SW5 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW5. Processing circuit 26 stores the operation history information corresponding to the switching operation SW5 detected, the memory circuit 24 together with the time information was switching operation SW5 (time t _12).

In step Sb13, the finding input operation A-3 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-3, the finding on the medical image to be interpreted which has been subjected to the screen operation 3 and the screen operation 4 displayed on the image display screen D1 is input. When the finding input operation A-3 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-3. Further, the processing circuit 26 stores the operation history information corresponding to the detected finding input operation A-3 in the storage circuit 24 together with the time information (time t ₁₃ ) when the finding input operation A-3 was performed.

In step Sb14, the switching operation SW6 for switching the active window from the finding input screen D2 to the image display screen D1 is input via the input IF circuit 21. When the switching operation SW6 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW6. The processing circuit 26 stores the operation history information corresponding to the detected switching operation SW6 in the storage circuit 24 together with the time information (time t ₁₄ ) when the switching operation SW6 was performed.

Here, after switching the active window from the finding input screen D2 to the image display screen D1 in step Sb14, no screen operation is performed on the image display screen D1.

In step Sb15, the switching operation SW7 for switching the active window from the image display screen D1 to the finding input screen D2 is input via the input IF circuit 21. When the switching operation SW7 is input via the input IF circuit 21, the processing circuit 26 detects the switching operation SW7. Processing circuit 26 stores the operation history information corresponding to the switching operation SW7 detected, the memory circuit 24 together with the time information was switching operation SW7 (time t _15).

In step Sb16, the finding input operation A-4 is input to the finding input screen D2 via the input IF circuit 21. For example, as the finding input operation A-4, the finding for the medical image to be interpreted which has been subjected to the screen operation 3 and the screen operation 4 displayed on the image display screen D1 is input. When the finding input operation A-4 is input via the input IF circuit 21, the processing circuit 26 detects the finding input operation A-4. Further, the processing circuit 26 stores the operation history information corresponding to the detected finding input operation A-4 in the storage circuit 24 together with the time information (time t ₁₆ ) when the finding input operation A-4 is performed.

In step Sb17, the sentence unit of the finding input by the finding input operation A-3 and the sentence unit of the finding input by the finding input operation A-4 are input to the finding input screen D2 via the input IF circuit 21. The confirmation operation SE2 is input. When the confirming operation SE2 is input via the input IF circuit 21, the processing circuit 26 detects the confirming operation SE2. Processing circuit 26, the operation history information corresponding to the determined operation SE2 detected and stored in the storage circuit 24 together with the time information was confirmation operation SE2 (time t _17). The processing circuit 26 is triggered by the input of the confirming operation SE2 on the finding input screen D2, and the sentence unit of the finding input by the finding input operation A-3 and the sentence of the finding input by the finding input operation A-3. Confirm the unit and. After the confirmation operation, the processing circuit 26 stores in the storage circuit 24 the sentence unit of the finding input by the finding input operation A-3 and the sentence unit of the finding input by the finding input operation A-4.

Here, the processing circuit 26 uses the input of the confirmation operation SE2 on the finding input screen D2 as a trigger to transfer the stored reproduction information corresponding to the screen operation 3 and the stored reproduction information corresponding to the screen operation 4 to the medical use. Request to the image display device 1. The medical image display apparatus 1 transfers the stored reproduction information corresponding to the screen operation 3 and the stored reproduction information corresponding to the screen operation 4 to the image interpretation report creating apparatus 2 in response to a request from the image interpretation report creating apparatus 2. The transferred reproduction information corresponding to the screen operation 3 and the transferred reproduction information corresponding to the screen operation 4 are stored in the storage circuit 24 of the image interpretation report creating apparatus 2.

Here, based on the operation history information stored in the storage circuit 24, the processing circuit 26 divides the series of screen operations performed via the input IF circuit 21 into a series of screen operation groups. In the second embodiment, a series of screen operations is divided into a series of screen operation groups based on a confirmation operation in the process of creating an image interpretation report. Specifically, the processing circuit 26 classifies one or a plurality of screen operations performed via the input IF circuit 21 into a single screen operation group 1. In addition, based on the operation history information stored in the storage circuit 24, the processing circuit 26 divides the series of finding input operations performed via the input IF circuit 21 into a series of finding input operation groups. In the second embodiment, similar to the method of classifying into a series of screen operation groups, a series of finding input operations is classified into a series of finding input operation groups based on a finalizing operation in the process of creating an image interpretation report. Specifically, the processing circuit 26 divides one or a plurality of finding input operations performed via the input IF circuit 21 into a single finding input operation group.

Here, the classification of a series of screen operations and the classification of a series of finding input operations by the processing circuit 26 will be specifically described with reference to FIG.

FIG. 10 is a diagram showing the operation history information stored in the storage circuit 24 in the process of creating the image interpretation report shown in FIG. For example, the storage circuit 24 stores the operation history information arranged in time series as shown in FIG. In the operation history information illustrated in FIG. 6, a code (operation history) indicating an input operation, screen information that is a target of the input operation, and time information when the input operation is performed are associated with each other.

Based on the operation history information shown in FIG. 10, the processing circuit 26 determines the screen operation 1 and the screen operation 2 performed via the input IF circuit 21 from the start of the interpretation report generation to the detection of the confirmation operation SE1. It is divided into one screen operation group 1. Further, the processing circuit 26 assigns the screen operation 3 and the screen operation 4 performed via the input IF circuit 21 from the detection of the confirming operation SE1 to the detection of the confirming operation SE2 into a single screen operation group 2. Divide.

The processing circuit 26, based on the operation history information shown in FIG. 10, inputs the finding input operation A-1 and the finding input operation performed via the input IF circuit 21 from the start of the interpretation report creation to the detection of the confirmation operation SE1. Operation A-2 is divided into a single finding input operation group 1. Further, the processing circuit 26 unifies the finding input operation A-3 and the finding input operation A-4 performed via the input IF circuit 21 from the detection of the confirming operation SE1 to the detection of the confirming operation SE2. The observation input operation group 2 is classified.

FIG. 11 is a diagram showing screen operation groups divided by the processing circuit 26 in the operation examples shown in FIGS. 9 and 10. As shown in FIG. 11, the screen operation group 1 includes a screen operation 1 and a screen operation 2. The screen operation group 2 includes screen operations 3 and 4. FIG. 12 is a diagram showing finding input operation groups divided by the processing circuit 26 in the operation examples shown in FIGS. 9 and 10. As shown in FIG. 12, the finding input operation group 1 includes a finding input operation A-1 and a finding input operation A-2. Further, the finding input operation group 2 includes a finding input operation A-3 and a finding input operation A-4.

After dividing the series of screen operation groups and the series of finding input operation groups, the memory circuit 24 associates the series of screen operating groups with the series of finding input operation groups based on the time context. In the second embodiment, the storage circuit 24 associates the screen operation group with the finding input operation group temporally immediately after the screen operation group.

Specifically, the storage circuit 24 stores the screen operation group 1 and the finding input operation group 1 performed immediately after the screen operation group 1 in association with each other. The storage circuit 24 also stores the screen operation group 2 and the finding input operation group 2 performed immediately after the screen operation group 2 in association with each other.

FIG. 13 shows reproduction information included in each of the series of screen operation groups stored in the storage circuit 24 in the second embodiment and findings included in each of the series of finding input operation groups associated with each of the series of screen operation groups. It is a figure which shows the sentence unit of. As shown in FIG. 13, reproduction information corresponding to each of the screen operation 1 and the screen operation 2 included in the screen operation group 1, and the finding input operation A-1 and the finding input operation A-2 included in the finding input operation group 1. A sentence unit corresponding to each is associated. Further, reproduction information corresponding to each of the screen operation 3 and the screen operation 4 included in the screen operation group 2, and a sentence corresponding to each of the finding input operation A-3 and the finding input operation A-4 included in the finding input operation group 2. Units are associated with.

The image interpretation report display device 3, based on the association between the reproduction information and the sentence unit of the finding shown in FIG. 13, for each sentence unit of the finding included in the image interpretation report created by the image interpretation report creating device 2, the sentence unit of the finding. It is possible to display the medical image to be interpreted, which has the display form when "."

The storage circuit 24 in the second embodiment may store the information shown in FIGS. 10 to 13 in a file format (for example, XML format) and a relational database.

According to the above configuration, the image interpretation report creating apparatus 2 according to the second embodiment divides a series of screen operations performed via the input IF circuit 21 into a series of screen operation groups based on the detected switching operation. To do. Further, the image interpretation report creating apparatus 2 divides a series of finding input operations performed via the input IF circuit 21 into a series of finding input operation groups based on the detected switching operation. Further, the image interpretation report creating apparatus 2 associates a series of screen operation groups and a series of finding input operation groups with each other based on the time context. The image interpretation report creating apparatus 2 reproduces, for each sentence unit of the finding input by the finding input operation, a sentence unit and a series of screen operations performed via the input IF circuit 21 in the process of inputting the sentence unit. The information is stored in association with it. As a result, the image interpretation report creating apparatus 2 according to the second embodiment can easily display the medical image to be interpreted, which is displayed on the image display screen D1 when the text unit is input, and thus is described in the image interpretation report. It is possible to easily judge the validity of the finding.

Here, in the image interpretation report creating apparatus 2 according to the second embodiment, the reproduction information corresponding to the screen operation is transmitted from the medical image display apparatus 1 by using the detection of the confirmation operation by the processing circuit 26 as a trigger in the process of creating the image interpretation report. Have acquired. However, the image interpretation report creating apparatus 2 according to the second embodiment is not limited to this. For example, the image interpretation report creating apparatus 2 according to the second embodiment, similar to the image interpretation report creating apparatus 2 according to the first embodiment, performs screen operation from the medical image display apparatus 1 every time a screen operation by the processing circuit 26 is detected. You may acquire the reproduction information corresponding to.

(Third Embodiment)
In the image interpretation report creating apparatus 2 according to the first and second embodiments, the reproduction information is associated with the sentence unit of the finding. The image interpretation report creating apparatus 2 according to the third embodiment displays the image interpretation report and reproduces information associated with the sentence units of findings included in the image interpretation report on the basis of the association between the above-mentioned reproduction information and sentence units of findings. Based on the display.

First, the configuration of the image interpretation report display device 3 will be described. FIG. 14 is a block diagram showing the image interpretation report display device 3 shown in FIG. The image interpretation report display device 3 shown in FIG. 14 includes an input IF circuit 31, a communication IF circuit 32, a display circuit 33, a storage circuit 34, a display device control circuit 35, and a processing circuit 36. Here, the input IF circuit 31, the display circuit 33, the storage circuit 34, and the display device control circuit 35 are the input IF circuit 11, the display circuit 13, the storage circuit 14, and the display in the medical image display device 1. Since it is substantially the same as the device control circuit 15, detailed description thereof will be omitted.

The communication IF circuit 32 is a communication device for communicating with an external device by wire or wirelessly. The external device is, for example, a server included in a system such as HIS and PACS, or another workstation. In the third embodiment, the communication IF circuit 32 communicates with the image interpretation report creating apparatus 2 and the image interpretation report display apparatus 3 shown in FIG.

The processing circuit 36 is realized as a hardware resource by a predetermined processor such as a CPU and an MPU and a predetermined memory such as a ROM and a RAM. The memory of the processing circuit 36 stores the report display program. The processor of the processing circuit 36 reads the report display program stored in the memory. The processor of the processing circuit 36 realizes the report display function 361 by executing the read report display program. By implementing the report display function 361, the processing circuit 36 displays on the display circuit 33 a report display screen for viewing the image interpretation report created by the image interpretation report creating apparatus 2 on the display circuit 33. The report display screen includes an image display screen for displaying a medical image and a finding display screen for displaying a finding of an image interpretation report.

The memory of the processing circuit 36 stores the reproduction information specifying program. The processor of the processing circuit 36 reads the reproduction information specifying program stored in the memory. The processor of the processing circuit 36 realizes the reproduction information specifying function 362 by executing the read reproduction information specifying program. By implementing the reproduction information specifying function 362, the processing circuit 36 designates by the input from the operator via the input IF circuit 31 among a plurality of sentence units forming the finding sentence of the image interpretation report displayed on the display circuit 33. The reproduction information associated with the created sentence unit is identified.

The memory of the processing circuit 36 stores the reproduction program. The processor of the processing circuit 36 reads the reproduction program stored in the memory. The processor of the processing circuit 36 realizes the reproduction function 363 by executing the read reproduction program. By implementing the reproduction function 363, the processing circuit 36 reproduces a series of screen operations performed on the medical image to be interpreted, which is performed when the sentence unit associated with the specified reproduction information is created.

Here, the display operation of the image interpretation report in the image interpretation report display device 3 according to the third embodiment will be described with a specific example. First, the report display screen displayed on the display circuit 33 will be described.

FIG. 15 is a diagram showing an example of a report display screen in the image interpretation report display apparatus 3 according to the third embodiment. As shown in FIG. 15, on the report display screen DO, a pointer P operated by an operation of the operator via the input IF circuit 21 is displayed. Further, on the report display screen DO of the display circuit 33, an image display screen D3 and a finding display screen D4 are displayed. The image display screen D3 in the third embodiment is divided into a plurality of regions R1 to R4, and an image designated by the operator is displayed in each of the plurality of regions R1 to R4. Further, the finding display screen D4 displays the finding text of the image interpretation report created in the past. In the finding sentence, a boundary between two sentence units that are temporally before and after among a plurality of sentence units is clearly indicated. The boundary is, for example, the timing when the operation screen is switched between the finding input screen for inputting the finding text and the image display screen on which the medical image to be interpreted is displayed, or the finding input operation is interrupted. This corresponds to the timing when the screen operation is performed on the medical image to be interpreted. The interruption of the finding input operation means that the finding input operation on the finding input screen D2 has not been performed for a predetermined time. At the boundary of the finding sentence, icons M1, M2, and M3 for displaying a predetermined screen are displayed by designating with the pointer P via the input IF circuit 31. In addition, a plurality of sentence units forming the finding sentence are displayed using underlines (for example, a solid line, a broken line, and an alternate long and short dash line). Note that a plurality of sentence units forming the finding sentence may be displayed by changing the format of the character string.

The operator operates the pointer P via the input IF circuit 21 and designates one sentence unit from a plurality of sentence units forming the finding sentence of the image interpretation report displayed on the finding display screen D4. The processing circuit 36 specifies the reproduction information associated with the sentence unit designated by the input from the operator via the input IF circuit 31. Here, the reproduction information is a medical image to be interpreted which is screen-operated at the time of inputting sentence units of findings, and a capture image of the image display screen D3 including the medical image to be interpreted which is screen-operated at the time of inputting sentence units of the findings, It is at least one of a log indicating the contents of screen operations for the medical image to be interpreted. The processing circuit 36 reproduces a series of screen operations performed on the medical image to be interpreted, which is performed when the text unit associated with the specified reproduction information is created. When the reproduction information associated with the sentence unit designated by the operator via the input IF circuit 31 includes a plurality of screen operations, the processing circuit 36 reproduces the plurality of screen operations in order.

Here, when the specified reproduction information is the screen-operated image interpretation target medical image or the captured image, the processing circuit 36 displays the screen-operated image interpretation target medical image or the captured image on the image display screen D3. Further, when the identified reproduction information is a plurality of image interpretation target medical images or a plurality of captured images corresponding to each of the plurality of screen operations, the processing circuit 36 sequentially images the image interpretation target medical images or the plurality of captured images. It is displayed on the display screen D3.

When the identified reproduction information is a log indicating the content of the screen operation on the medical image to be interpreted, the processing circuit 36 performs a screen operation on the medical image to be interpreted based on the log, and the image interpretation target on which the screen operation is performed. The medical image is displayed on the image display screen D3. Further, when the identified reproduction information is a plurality of logs indicating the contents of a plurality of screen operations on the medical image to be interpreted, the processing circuit 36 sequentially performs screen operations based on the logs on the medical image to be interpreted, and The image interpretation target medical images that have been operated are sequentially displayed on the image display screen D3.

Here, reproduction of a series of screen operations for the medical image to be interpreted will be specifically described with reference to the drawings. Hereinafter, the reproduction information in the third embodiment will be referred to as an image interpretation target medical image that has been operated on the screen.

First, reproduction of a series of screen operations for a medical image to be interpreted will be described with reference to FIG. As shown in FIG. 15, the operator operates the pointer P via the input IF circuit 31 to specify a sentence unit “WW is VV” from a plurality of sentence units forming the finding sentence. The processing circuit 36 specifies the reproduction information associated with the sentence unit “WW is VV” designated by the input from the operator via the input IF circuit 31. Based on the specified reproduction information, the processing circuit 36 reproduces a series of screen operations performed on the medical image to be interpreted, which is performed when the designated text unit is created. For example, when the reproduction information associated with the sentence unit “WW is VV.” includes the screen operation 1 and the screen operation 2 illustrated in FIG. 8, the processing circuit 36 uses the image interpretation target medical doctor who performed the image operation 1. The image ImgP and the medical image ImgP for which the image operation 2 was performed are sequentially displayed in the region R2 of the image display screen D3.

Next, with reference to FIG. 16, reproduction of a series of screen operations for the medical image to be interpreted will be described. FIG. 16 is a diagram showing a display example 1 of the report display screen DO when the icon displayed on the finding display screen D4 is designated. The finding display screen D4 of the report display screen DO shown in FIG. 16 is used for instructing reproduction of a series of screen operations for the medical image to be interpreted, which is performed when one of the two sentence units is created. Icons M1, M2, M3 are displayed. The icon M1 corresponds to the sentence unit “it is considered to be YY as a result of comparing XX”. The icon M2 corresponds to the sentence unit "There is no significant change in ZZ." The icon M3 corresponds to the sentence unit "WW is VV."

As shown in FIG. 16, the operator specifies the icon M3 via the input IF circuit 31 by the operator. The processing circuit 36 specifies the reproduction information associated with the sentence unit “WW is VV.” corresponding to the icon M3 designated by the input from the operator via the input IF circuit 31. Based on the specified reproduction information, the processing circuit 36 reproduces a series of screen operations performed on the medical image to be interpreted, which is performed when the designated text unit "WW is VV." For example, when the reproduction information associated with the sentence unit “WW is VV.” includes the screen operation 1 and the screen operation 2 illustrated in FIG. 8, the processing circuit 36 uses the image interpretation target medical doctor who performed the image operation 1. The image ImgP and the medical image ImgP for which the image operation 2 was performed are sequentially displayed in the region R2 of the image display screen D3.

Next, with reference to FIG. 17, reproduction of a series of screen operations for a medical image to be interpreted will be described. FIG. 17 is a diagram showing a display example 2 of the report display screen DO when the icon displayed on the finding display screen D4 is designated. On the report display screen DO shown in FIG. 17, icons M1 and M2 for displaying the contents of a series of screen operations for the medical image to be interpreted, which are performed when one of the two sentence units is created. M3 is displayed. The correspondence relationship between the icons M1, M2, M3 and the text unit is the same as in FIG. The operator specifies the icon M3 by the operator via the input IF circuit 31. The processing circuit 36 identifies the reproduction information associated with the sentence unit “WW is VV.” corresponding to the designated icon M3. The processing circuit 36 displays the content of a series of screen operations on the medical image to be interpreted on the display screen D5 based on the specified reproduction information. For example, when the reproduction information associated with the sentence unit “WW is VV.” includes the screen operation 1 and the screen operation 2 illustrated in FIG. The contents and are displayed on the display screen D5.

Next, with reference to FIG. 18, reproduction of a series of screen operations for a medical image to be interpreted will be described. FIG. 18 is a diagram showing a display example 1 of the report display screen DO when the reproduction information associated with the designated sentence unit includes a plurality of screen operations. For example, the image interpretation report display device 3 displays a forward button B1 and a backward button B2 on the image display screen D3, as shown in FIG. The operator operates the pointer P via the input IF circuit 31 to designate either one of the forward feed button B1 and the backward feed button B2. When the forward button B1 is designated by the operator via the input IF circuit 31, the processing circuit 26 reproduces the screen operation immediately after the screen operation being reproduced among the plurality of screen operations. When the reverse button B2 is designated by the operator via the input IF circuit 31, the processing circuit 26 reproduces the screen operation immediately preceding the screen operation being reproduced among the plurality of screen operations. For example, when the reproduction information includes the screen operation 1 and the screen operation 2 illustrated in FIG. 8, the processing circuit 36 causes the interpretation target medical image ImgP on which the image operation 1 is performed and the interpretation target on which the image operation 2 is performed. The medical image ImgP and the medical image ImgP are sequentially displayed in the region R2 of the image display screen D3. Specifically, the processing circuit 36 displays the medical image ImgP for the image interpretation subject to the image operation 1 when the forward button B1 is specified. The processing circuit 36 displays the medical image ImgP for which the image operation 2 is performed when the reverse feed button B2 is specified.

Note that, in FIG. 18, the forward feed button B1 and the backward feed button B2 are displayed on the image display screen D3, and one of the forward feed button B1 and the backward feed button B2 is designated to display the medical image to be interpreted. However, forward feed and reverse feed may be designated by a mouse gesture or the like.

Next, reproduction of a series of screen operations for the medical image to be interpreted will be described with reference to FIG. FIG. 19 is a diagram showing a display example 2 of the report display screen DO when the reproduction information associated with the designated sentence unit includes a plurality of screen operations. For example, the image interpretation report display device 3 displays the image flip button SW in the area R4 of the image display screen D3 as shown in FIG. The operator operates the pointer P via the input IF circuit 31 to specify the image flip button SW. When the operator designates the image flip button SW via the input IF circuit 31, the processing circuit 26 sequentially reproduces a series of screen operations associated with the finding text displayed on the finding display screen D4. For example, when the reproduction information includes the screen operation 1 and the screen operation 2 illustrated in FIG. 8, the processing circuit 36 causes the image interpretation target medical image ImgP in which the image operation 1 is performed in the order of the time when the operation is performed in time series. And the medical image ImgP for which the image operation 2 has been performed are sequentially displayed in the region R2 of the image display screen D3.

According to the above configuration, in the image interpretation report display device 3 according to the third embodiment, the processing circuit 36 specifies the reproduction information associated with the sentence unit designated by the input from the operator via the input IF circuit 31. To do. The processing circuit 36 reproduces a series of screen operations performed on the medical image to be interpreted, which is performed when the text unit associated with the specified reproduction information is created. When the reproduction information associated with the sentence unit designated by the operator via the input IF circuit 31 includes a plurality of screen operations, the processing circuit 36 reproduces the plurality of screen operations in order. As a result, the image interpretation report creating apparatus 2 according to the second embodiment can reproduce a series of screen operations for the image interpretation target medical image displayed on the image display screen D1 when the text unit is input, and thus the image interpretation report The validity of the findings described in can be easily determined.

The image interpretation report display device 3 according to the third embodiment operates the pointer P via the input IF circuit 31 to specify a sentence unit. However, the image interpretation report display device 3 according to the third embodiment is not limited to this. For example, the image interpretation report display apparatus 3 according to the third embodiment may select a sentence unit from the context menu, or may drag and drop a sentence unit onto the image display screen D3.

(Summary)
As described above, the image interpretation report creating apparatus according to the embodiment includes the input IF circuit, the processing circuit, and the storage circuit. The input IF circuit receives a finding input operation for inputting a finding using the finding input screen, a screen operation for a medical image to be interpreted using the image display screen, and a switching operation between the screen operation and the finding input operation. The processing circuit detects the switching operation via the input IF circuit. The processing circuit divides a series of screen operations performed through the input IF circuit into a series of screen operation groups based on the detected switching operation, and performs a series of finding input operations performed through the input IF circuit. Are divided into a series of finding input operation groups. The storage circuit associates a series of screen operation groups with a series of finding input operation groups based on the time context, and reproduction information for reproducing the screen operations included in each of the series of screen operation groups, and a series of The sentence unit of the finding input by the finding input operation included in each of the series of finding input operation groups associated with the screen operation group is stored.

With the above configuration, the image interpretation report creating apparatus according to the embodiment can easily display the medical image of the image interpretation target displayed on the image display screen when the text unit is input.

Thus, the image interpretation report creating apparatus according to the embodiment can provide the image interpretation report creating apparatus and the image interpretation report display apparatus that can know the image reading process from the findings of the image reading report and can contribute to the determination of the appropriateness of the findings. You can

The wording "predetermined processor" used in the above description is, for example, a dedicated or general-purpose processor, circuit(circuitry), processing circuit(circuitry), operation circuit(circuitry), arithmetic circuit(circuitry), or specific Application Specific Integrated Circuit (ASIC), programmable logic device (eg, Simple Programmable Logic Device (SPLD), complex programmable logic device (CPLD), and field programmable gate array (FPGA: Field Programmable Gate Array), etc. Further, each constituent element (each processing unit) of this embodiment is not limited to a single processor, and may be realized by a plurality of processors. A plurality of constituent elements (a plurality of processing units) may be realized by a single processor.

Although some embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the scope equivalent thereto.

DESCRIPTION OF SYMBOLS 1... Medical image display device, 2... Interpretation report preparation device, 3... Interpretation report display device, 21... Input interface (IF) circuit, 22... Communication interface (IF) circuit, 23... Display circuit, 24... Storage circuit, 25 ... Creation device control circuit, 26... Processing circuit, 31... Input interface (IF) circuit, 32... Communication interface (IF) circuit, 33... Display circuit, 34... Storage circuit, 35... Display device control circuit, 36... Processing circuit , 261... Viewer screen display function, 262... Report creation screen display function, 263... Operation detection function, 264... Text unit confirmation function, 265... Grouping function, 361... Report display function, 362... Reproduction information specifying function, 363... Reproduction function.

Claims (14)

A finding input operation for inputting a finding using the finding input screen, a screen operation for the medical image to be interpreted using the image display screen, and an input unit for accepting a switching operation between the screen operation and the finding input operation,
A detection unit that detects the switching operation via the input unit,
Based on the detected switching operation, a series of screen operations performed via the input unit is divided into a series of screen operation groups, and a series of finding input operations performed via the input unit A grouping section that divides into finding input operation groups,
Reproduction information for reproducing the screen operation included in each of the series of screen operation groups by associating the series of screen operation groups with the series of finding input operation groups based on a temporal context. A storage unit that stores the sentence unit of the finding input by the finding input operation included in each of the series of finding input operation groups associated with the screen operation group of
Equipped with,
The detection unit represents, as the switching operation, a first switching operation that represents switching of an active window from the image display screen to the finding input screen, and a switching of active window from the finding input screen to the image display screen. Detect the second switching operation,
Interpretation report creation device. The grouping unit is
Dividing one or a plurality of screen operations performed via the input unit into a single screen operation group until the first switching operation is detected,
Dividing one or more finding input operations performed via the input unit until the second switching operation is detected into a single finding input operation group;
The image interpretation report creating apparatus according to claim 1 . The storage unit, the screen and the operating group, the image interpretation report creating apparatus according to claim 1 or 2, wherein done the associate and the findings input operation group immediately temporally the screen operation group. The input unit receives a confirmation operation for each sentence unit,
The storage unit stores reproduction information for reproducing a series of screen operations performed via the input unit until the confirmation operation is input, in association with the confirmed sentence unit .
The image interpretation report creating apparatus according to claim 1 . The storage unit, as the reproduction information, a screen-operated image interpretation target medical image, a captured image of the image display screen including the screen-operated image interpretation target medical image, of the screen operation for the image interpretation target medical image content of at least one stores the claims 1 to 4 interpretation report creating apparatus according to any one claim of one of the log of the. A display unit that displays the finding input by the finding input operation ;
Creation of a sentence unit associated with the specified reproduction information of the plurality of sentence units based on user-specified reproduction information of the plurality of sentence units of reproduction information stored in the storage unit Further comprising a reproducing unit that reproduces a series of screen operations performed on the medical image to be interpreted, which is sometimes performed ,
The image interpretation report creating apparatus according to claim 1 . 7. The image interpretation report creating apparatus according to claim 6 , wherein the display unit clearly indicates a boundary between two sentence units that are temporally before and after the plurality of sentence units. At the boundary, the switching operation is performed on the operation screen between the finding input screen for inputting the finding text and the image display screen on which the medical image to be interpreted is displayed, which is detected by the detection unit . The image interpretation report creating apparatus according to claim 7, which corresponds to timing. 9. The image interpretation report creating apparatus according to claim 8 , wherein the boundary corresponds to a timing when the operation of creating the finding sentence is interrupted and a screen operation is performed on the medical image to be interpreted. The display unit displays an icon for instructing reproduction of a series of screen operations on the medical image to be interpreted, which is performed when one of the two sentence units is created, at the boundary. Item 7. The image interpretation report creating apparatus according to Item 7 . The display unit displays an icon for displaying the content of a series of screen operations on the medical image to be interpreted, which is performed when one of the two sentence units is created, at the boundary. Item 7. The image interpretation report creating apparatus according to Item 7 . The input unit accepts designation of any one of the plurality of sentence units ,
The reproduction unit sets reproduction information associated with the specified sentence unit to the reproduction information specified by the user,
The image interpretation report creating apparatus according to claim 6 . The radiology report creating apparatus according to claim 12 , wherein the reproduction unit reproduces the plurality of screen operations in order when the reproduction information associated with the designated sentence unit includes a plurality of screen operations. The display unit displays a forward feed button and a reverse feed button,
The reproduction section is
When the forward button is specified by the user via the input unit, of the plurality of screen operations, the screen operation immediately after the screen operation being reproduced is reproduced,
When the reverse button is specified by the user via the input unit, the screen operation immediately preceding the screen operation being reproduced among the plurality of screen operations is reproduced.
The image interpretation report creating apparatus according to claim 13 .