JP7570876B2 - Processor device and method of operation thereof - Google Patents

Description

The present invention relates to a processor device that displays a screen according to the output performance of an output device, and a method of operating the same.

In recent years, technological innovations in monitors and displays have led to the development of higher resolution output devices. Furthermore, in the medical field, where images input from medical equipment such as endoscopes are becoming increasingly higher resolution due to technological advances in such output devices, technology is being developed that allows the output device to select a display method to match the high resolution image being input.

Patent document 1 describes a technology that selects a display method template according to the resolution of a medical image input to a processor device from multiple display method templates according to the resolution and aspect ratio of an output device, and displays the medical image.

JP 2009-112507 A

In recent years, output devices have become increasingly high-definition and have larger screens. This has resulted in an increasing number of cases where more information is displayed on the output device. However, in the medical field, the appropriate inch size of the output device and the information displayed vary depending on the environment in which it is used.

For example, displays used in large endoscopy rooms or displays used outside operating rooms for multiple doctors to observe surgery tend to be relatively large in size and wall-mountable, and a lot of information is displayed. In this case, in addition to the medical images acquired by the endoscope, information other than medical images, such as location information of any lesions found during the examination and location information of the endoscope within the body, is also displayed.

On the other hand, for displays installed on carts used to transport medical equipment and for displays used in small hospitals, relatively small inch sizes are selected due to the cart's load capacity and the narrowness of the endoscopy room. On a small display, if a lot of other information is displayed in addition to high-definition medical images such as 4K, the screen displaying each piece of information becomes too small, making it difficult to see. Furthermore, even on a large display, displaying too much information can make the screen cluttered and difficult to see.

The present invention aims to provide a processor device and an operating method thereof that can make the screen easy to view regardless of the size of the display when displaying information other than medical images, such as location information of lesions discovered during an examination and location information of an endoscope within the body, in addition to medical images.

The processor device of the present invention is a processor device connected to a display and includes a processor, the processor acquires an inspection image, generates an inspection image display screen having a main screen that displays the inspection image, and a sub-screen that displays a screen different from the main screen and is displayed at a position different from the main screen, acquires output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen, and determines the number and type of sub-screens based on the output performance information.

The types of sub-screens preferably include at least one of the following: a still image related to the examination image, position information of the region of interest, an insertion shape image, treatment tool appearance position information, and additional text information. The additional text information preferably includes at least one of the following: patient information, operator information, and switch assignment information.

When the processor acquires only the inch size as the output performance information, and the first inch size is larger than the second inch size and the display is the second inch size, it is preferable to reduce the number of sub-screens compared to when the display is the first inch size. When the processor acquires only the resolution as the output performance information, and the first resolution is higher than the second resolution and the display is the second resolution, it is preferable to reduce the number of sub-screens compared to when the display is the first resolution. When the processor acquires the inch size and resolution as the output performance information, and the first inch size is larger than the second inch size and the first resolution is higher than the second resolution, it is preferable to reduce the number of sub-screens compared to when the output performance information includes the first resolution and the first inch size in any of the cases where the output performance information includes the first inch size and the second resolution, the second inch size and the first resolution, or the second inch size and the second resolution.

When displaying still images related to the inspection image on the sub-screen, if the first inch size is larger than the second inch size and the first resolution is higher than the second resolution, and the output performance information includes the first inch size and the second resolution, the second inch size and the first resolution, or the second inch size and the second resolution, it is preferable for the processor to reduce the number of still images displayed on the sub-screen compared to when the output performance information includes the first resolution and the first inch size.

It is preferable that the processor calculates standard output conditions based on the inspection image, and reduces the number of sub-screens if the inch size of the display is smaller than the standard output conditions. It is preferable that the processor sets an upper limit on the number of sub-screens. It is preferable that the processor determines the type of sub-screen according to the sub-screen display priority. It is preferable that the sub-screen display priority is configurable. It is preferable that the arrangement of the sub-screens is changeable on the inspection image display screen. It is preferable that the processor determines the font size on the inspection image display screen based on the output performance information. It is preferable that the processor is able to select whether the auxiliary text information is displayed on the main screen in a portion other than the inspection image, or on the sub-screen.

The method of operating a processor device of the present invention is a method of operating a processor device connected to a display and including a processor, in which the processor acquires an inspection image, generates an inspection image display screen having a main screen for displaying the inspection image, and a sub-screen for displaying a screen different from the main screen and displayed at a position different from the main screen, acquires output performance information including at least one of the inch size, resolution, and aspect ratio of the display for displaying the inspection image display screen, and determines the number and type of sub-screens based on the output performance information.

The present invention provides a processor device and an operating method thereof that can make the screen easy to view regardless of the size of the display when displaying information other than medical images, such as location information of a lesion discovered during an examination or location information of an endoscope within the body, in addition to medical images.

FIG. 1 is a block diagram showing an endoscope system including an endoscope, a light source device, a processor device, a first display, and a UI. 4 is a block diagram showing a detailed functional relationship between a processor and a first display. FIG. FIG. 1 is a block diagram showing an endoscope system including an endoscope, a light source device, a processor device, a second display, and a UI. 4 is a block diagram showing functions of a sub-screen number setting section, a sub-screen type setting section, and a layout setting section in the display setting section. FIG. 13 is a table showing a setting table for the number of sub-screens when the output performance information is only the inch size. 13 is a table showing a setting table for the number of sub-screens when the output performance information is only resolution. 13 is a table showing a setting table for the number of sub-screens when the output performance information is an inch size and a resolution. 11 is a block diagram showing an output performance information acquisition unit in the case where a standard output condition calculation unit is provided. FIG. 13 is a table showing a specific example of determining the number of sub-screens when calculating standard output conditions. 13 is a table showing a still image display number setting table. 13 is an image diagram showing a sub-screen display priority setting table displayed on a sub-screen display priority setting screen. FIG. FIG. 13 is an image diagram showing a first layout setting screen. FIG. 13 is an image diagram showing a layout template in which the screen is divided into two parts, left and right. FIG. 13 is an image diagram showing a layout template in which the screen is divided into two parts, top and bottom. FIG. 13 is an image diagram showing a layout template in which the screen is divided into two parts, left and right, and the right-hand screen is further divided into two parts, top and bottom. FIG. 13 is an image diagram showing a layout template in which the screen is divided vertically into three. FIG. 13 is an image diagram showing a layout template in which the number of sub-screens determined by the sub-screen number setting unit is three, and the right side of the screen is further divided horizontally into two, with the lower screen being divided vertically into two. FIG. 13 is an image diagram showing a layout template in which the number of sub-screens determined by the sub-screen number setting unit is three, and the right side of the screen is further divided horizontally into two, with the upper screen being divided vertically into two. FIG. 13 is an image diagram showing a layout template in which the number of sub-screens determined by the sub-screen number setting unit is four, the right side of the screen is divided into two halves horizontally, and the central screen is further divided into three horizontally, with the central screen being divided into two vertically. FIG. 13 is an image diagram showing a layout template in which the number of sub-screens determined by the sub-screen number setting unit is four, and the right side of the screen is further divided horizontally into two, with the lower screen being divided vertically into three. FIG. 13 is an image diagram showing a layout creation screen when creating one new layout section. FIG. 13 is an image diagram showing a layout creation screen when four layout sections are newly created. FIG. 13 is an image diagram showing a second layout setting screen. FIG. 13 is an image diagram showing an examination image display screen when the number of sub-screens is four. FIG. 13 is an image diagram showing an examination image display screen when the number of sub-screens is two. 4 is a flowchart illustrating functions of a processor device in the first embodiment. 1 is a block diagram showing an ultrasound imaging system including an ultrasound probe, a processor device, a first display, and a UI. FIG. 1 is a block diagram showing an ultrasound imaging system including an ultrasound probe, a processor device, a second display, and a UI. 10 is a flowchart illustrating a function of a processor device in a second embodiment. 1 is a block diagram showing a radiation image capturing system including a radiation image capturing device, a radiation irradiation device, a processor device, a first display, and a UI. 1 is a block diagram showing a radiation image capturing system including a radiation image capturing device, a radiation irradiation device, a processor device, a second display, and a UI. 1 is a block diagram showing a radiation image capturing system including an electronic cassette, a radiation irradiation device, a processor device, a first display, and a UI. 13 is a flowchart illustrating the function of a processor device according to a third embodiment.

[First embodiment]
In the first embodiment, a case in which the processor device 20 is provided in an endoscope system 10 will be described.

As shown in FIG. 1, the endoscope system 10 includes an endoscope 12, a light source device 13, a processor device 20, a first display 21, and a UI (User Interface) 23. The endoscope 12 is connected to the light source device 13 and also to the processor device 20. The processor device 20 is connected to the first display 21 and the UI 23.

The first display 21 outputs and displays an examination image display screen, which will be described later. The UI 23 has a keyboard, mouse, touchpad, microphone, etc., and has a function of accepting input operations such as function settings.

The endoscope 12 obtains a normal light image with natural coloring by illuminating the object of observation with normal light such as white light and capturing an image. Furthermore, the endoscope 12 obtains a special light image that emphasizes a specific structure by illuminating the object of observation with special light having a different wavelength band from the normal light and capturing an image. In the first embodiment, the term "inspection image" simply refers to a normal light image and/or a special light image that is an endoscopic image.

The light source device 13 includes a light source section. The light source section has multiple semiconductor light sources, which are turned on or off, and when turned on, the amount of light emitted by each semiconductor light source is controlled to emit illumination light that illuminates the object of observation.

The processor device 20 receives information from an output device such as the first display 21, generates an examination image display screen having a main screen that mainly displays the examination image and a sub-screen that mainly displays information other than the examination image, and displays the examination image display screen on the output device.

As shown in FIG. 2, the processor device 20 has an examination image acquisition unit 14, a position information acquisition unit 15, a still image acquisition unit 16, an insertion state acquisition unit 17, a treatment tool appearance position information acquisition unit 18, a central control unit 30, an output performance information acquisition unit 40, a display setting unit 50, and a display screen generation unit 60.

In the processor device 20, the central control unit 30, which is composed of an image control processor, operates the programs in the program memory to realize the functions of the examination image acquisition unit 14, position information acquisition unit 15, still image acquisition unit 16, insertion state acquisition unit 17, treatment tool appearance position information acquisition unit 18, output performance information acquisition unit 40, display setting unit 50, and display screen generation unit 60.

The inspection image acquisition unit 14 performs image processing on the inspection image, which is an image signal acquired by the endoscope 12. The inspection image is displayed on the main screen of the inspection image display screen. Note that the inspection image may be displayed on the main screen and the sub-screen in the display setting unit 50, which will be described later. In this case, for example, the normal light image is displayed on the main screen and the special light image is displayed on the sub-screen. The inspection image acquisition unit 14 transmits the inspection image to the display setting unit 50.

The position information acquisition unit 15 acquires position information of the region of interest. A region of interest is an area that is found in an examination image and has features within a specific range, such as a lesion. Specifically, the detected position of the endoscope tip at the time the examination image in which the region of interest is detected is obtained is acquired as the position information of the region of interest. The position information acquisition unit 15 transmits the position information of the region of interest to the display setting unit 50.

When a signal related to a still image acquisition instruction is transmitted, the still image acquisition unit 16 acquires a still image of the observation target. The still image acquisition unit 16 transmits the still image to the display setting unit 50.

The insertion state acquisition unit 17 acquires insertion state information of the endoscope 12 being inserted into the lumen. Specifically, the insertion state information is acquired based on the insertion length of the endoscope insertion part into the lumen. The insertion shape information is converted into an insertion shape image and displayed in the display screen generation unit 60, which will be described later. The insertion state acquisition unit 17 transmits the insertion state information to the display setting unit 50.

The treatment tool appearance position information acquisition unit 18 acquires treatment tool appearance position information, which is information that predicts where a treatment tool used during endoscopic surgery will appear in the examination image. The treatment tool appearance position information acquisition unit 18 transmits the treatment tool appearance position information to the display setting unit 50.

The display setting unit 50 acquires at least one of the examination image acquired by the examination image acquisition unit 14, the position information of the region of interest acquired by the position information acquisition unit 15, the still image acquired by the still image acquisition unit 16, the insertion state information acquired by the insertion state acquisition unit 17, the treatment tool appearance position information acquired by the treatment tool appearance position information acquisition unit 18, and the associated character information. Note that the information acquired by the display setting unit 50 is not limited to this.

As the additional text information, the display setting unit 50 acquires at least one of the following: patient information, surgeon information, and switch assignment information.

Patient information includes, but is not limited to, the patient number, name, age, date of birth, and gender of the patient undergoing the examination or surgery. Surgeon information includes the doctor number, name, and other information of the doctor performing the examination or surgery. Switch assignment information is information that assigns the operation of medical devices such as the endoscope 12 to the UI 23. For example, it is information related to the functions of the switches attached to the endoscope 12, such as assigning a still image acquisition command to switch 1, switching between normal light and special light to switch 2, and the screen zoom function to switch 3. Note that the accompanying text information is not limited to the above. Additionally, the accompanying text information may be acquired from an external device, such as a system that manages patient information and surgeons.

The display setting unit 50 performs settings for generating an examination image display screen from the information to be displayed on the examination image display screen having a main screen and a sub-screen received from the examination image acquisition unit 14, the position information acquisition unit 15, the still image acquisition unit 16, the insertion state acquisition unit 17, and the treatment tool appearance position information acquisition unit 18, and the output performance information received from the output performance information acquisition unit 40.

The output performance information acquisition unit 40 acquires output performance information of the output device. In the example of FIG. 1, the output device is the first display 21, but as shown in FIG. 3, it may be the second display 22 that has a different inch size and/or resolution (unit: pixels) from the first display 21.

The differences between the first display 21 and the second display 22 are, for example, as follows: The first display 21 is a large inch size and is used in situations where multiple doctors and others observe surgery outside a large endoscopy room or operating room. On the other hand, the second display 22 is a small inch size and is used by mounting it on a cart that transports medical equipment.

The output performance information is the inch size, resolution, aspect ratio, etc. of the display connected to the processor device 20 as an output device. The output performance information acquisition unit 40 acquires at least one of the inch size, resolution, and aspect ratio of the display. The output performance information acquisition unit 40 transmits the output performance information to the display setting unit 50. In this embodiment, as a specific example, a case where the first display 21 (FIG. 1) or the second display 22 (FIG. 3) is connected to the processor device will be described.

As shown in FIG. 4, the display setting unit 50 includes a sub-screen number setting unit 51, a sub-screen type setting unit 52, and a layout setting unit 53.

The sub-screen number setting unit 51 determines the number and type of sub-screens based on the output performance information. The function of the sub-screen number setting unit 51 is explained below with a specific example.

When the output performance information acquired by the output performance information acquisition unit 40 is only the inch size, the number of sub-screens is determined based only on the inch size by referring to a sub-screen number setting table such as that shown in FIG. 5.

A specific example will be described. The inch size of the first display 21 is the first inch size, and the inch size of the second display 22 is the second inch size. The first inch size is larger than the second inch size, for example, the first inch size is 50 inches, and the second inch size is 24 inches. When the output performance information acquired by the output performance information acquisition unit 40 is the first inch size, the sub-screen number setting table shown in Figure 5 is referenced, the number of sub-screens is set to 4, and this information is sent to the display screen generation unit 60.

On the other hand, if the output performance information acquired by the output performance information acquisition unit 40 is the second inch size, the number of sub-screens is set to 2 by referring to the sub-screen number setting table shown in FIG. 5, and this information is sent to the display screen generation unit 60.

The above configuration allows the number of sub-screens to be determined according to the inch size of the display. As in the above specific example, if the display connected to the processor device 20 is small, the number of sub-screens that display information other than the test image can be reduced, making it possible to present a screen with higher visibility to the user.

When reducing the number of sub-screens, the types of sub-screens are also reduced. When reducing the number of sub-screens, it is preferable to reduce the types of sub-screens in accordance with the sub-screen display priority, which will be described later.

Another example will be described. When the output performance information acquired by the output performance information acquisition unit 40 is only the resolution, the number of sub-screens is determined based only on the resolution by referring to a sub-screen number setting table such as that shown in FIG. 6.

A specific example will be described. The resolution of the first display 21 is the first resolution, and the resolution of the second display 22 is the second resolution. The first resolution is higher than the second resolution, for example, the first resolution is 3840 x 2160, and the second resolution is 720 x 480. When the output performance information acquired by the output performance information acquisition unit 40 is the first resolution, the number of sub-screens setting table shown in Figure 6 is referenced, the number of sub-screens is set to 4, and this information is sent to the display screen generation unit 60.

On the other hand, if the output performance information acquired by the output performance information acquisition unit 40 is the second resolution, the number of sub-screens is set to 2 by referring to the sub-screen number setting table shown in FIG. 6, and this information is sent to the display screen generation unit 60.

The above configuration allows the number of sub-screens to be determined according to the resolution of the display. As in the above specific example, if the resolution of the display connected to the processor device 20 is low, the number of sub-screens that display information other than the test image can be reduced, making it possible to present a screen with higher visibility to the user.

Another example will be described. When the output performance information acquired by the output performance information acquisition unit 40 is inch size and resolution, the number of sub-screens is determined based on the inch size and resolution by referring to a sub-screen number setting table such as that shown in FIG. 7.

A specific example will be described. For example, the first inch size is 50 inches, the second inch size is 24 inches, the first resolution is 3840 x 2160, and the second resolution is 720 x 480. When the output performance information of the first display 21 or the second display 22 is the first inch size and the first resolution, the number of sub-screens setting table shown in FIG. 7 is referenced, the number of sub-screens is set to 4, and this information is sent to the display screen generation unit 60.

On the other hand, if the output performance information of the first display 21 or the second display 22 is either the first inch size and the second resolution, the second inch size and the first resolution, or the second inch size and the second resolution, the number of sub-screens is set to 2 by referring to the sub-screen number setting table shown in FIG. 7, and this information is sent to the display screen generation unit 60.

With the above configuration, the number of sub-screens can be determined based on the combination of the inch size and resolution of the display. As in the above specific example, when the inch size or resolution of the display connected to the processor device 20 is small, the number of sub-screens that contain information other than the test image can be reduced, and a screen with higher visibility can be presented to the user. Furthermore, when the inch size of the display is large and the resolution is low, displaying many low-resolution sub-screens can actually hinder the user's visibility, so in this case it is preferable to reduce the number of sub-screens. Additionally, the aspect ratio of the output device may be obtained and the number of sub-screens may be changed.

Furthermore, the sub-screen number setting unit 51 may set an upper limit on the number of sub-screens. This upper limit may be set automatically or by the user. With the above configuration, when the inch size or resolution of the display connected to the processor device 20 is large, the number of sub-screens is prevented from becoming too large, thereby preventing the screen from becoming cluttered and making it possible to present a screen with higher visibility to the user.

As shown in FIG. 8, a standard output condition calculation unit 40a may be provided in the output performance information acquisition unit 40, the inspection image acquired by the inspection image acquisition unit 14 may be transmitted to the output performance information acquisition unit 40, the standard output conditions may be calculated based on the resolution of the inspection image, etc., and the number of sub-screens may be set in advance according to the standard output conditions. In this case, when the inch size of the display connected to the processor device 20 is smaller than the standard output conditions, it is preferable to reduce the number of sub-screens from the number of sub-screens determined based on the standard output conditions. When the inch size of the display is larger than the standard output conditions, the number of sub-screens may be increased from the number of sub-screens determined based on the standard output conditions.

A specific example of determining the number of sub-screens when calculating standard output conditions is shown below. For example, when the resolution of the inspection image is 1920 x 1080, the standard output condition calculation unit 40a calculates the standard output condition to be an inch size of 30 to 40 inches. At this time, the number of sub-screens when the display is within the range of the standard output conditions is set to 4. When the number of sub-screens is determined based on the standard output conditions in this way, when the output performance information acquisition unit 40 acquires the inch size of the display, it refers to a table such as that shown in FIG. 9.

For example, if the display size is 40 inches, the number of sub-screens is not changed and is set to 4. On the other hand, if the display size is 20 inches, the number of sub-screens is reduced to 2. Also, if the display size is 50 inches, the number of sub-screens is increased to 5. Once the number of sub-screens has been determined in this manner, information on the number of sub-screens is sent to the display screen generation unit 60. The standard output conditions may be set automatically or by the user. With the above configuration, the number of sub-screens can be determined according to specific standard output conditions and the inch size of the display.

When the display setting unit 50 acquires a still image, the still image is displayed on the sub-screen. In this case, the number of still images to be displayed on the sub-screen may be determined by the sub-screen number setting unit 51.

For example, if the output performance information acquired by the output performance information acquisition unit 40 is inch size and resolution, the number of still images to be displayed on the sub-screen is determined based on the inch size and resolution by referring to a still image display count setting table such as that shown in FIG. 10.

A specific example will be described. For example, the first inch size is 50 inches, the second inch size is 24 inches, the first resolution is 3840 x 2160, and the second resolution is 720 x 480. When the output performance information of the first display 21 or the second display 22 is the first inch size and the first resolution, the still image display count setting table shown in FIG. 10 is referenced, the number of still images to be displayed on the sub screen is set to 4, and this information is sent to the display screen generation unit 60.

On the other hand, if the output performance information of the first display 21 or the second display 22 is the first inch size and the second resolution, the second inch size and the first resolution, or the second inch size and the second resolution, the still image display number setting table shown in FIG. 10 is referenced, the number of still images to be displayed on the sub-screen is set to 2, and this information is sent to the display screen generation unit 60. With the above configuration, the number of still images to be displayed on the sub-screen can be determined according to the combination of the inch size and resolution of the display. As in the above specific example, if the inch size or resolution of the display connected to the processor device 20 is small, the number of still images to be displayed on the sub-screen can be reduced, and a screen with higher visibility can be presented to the user.

The type of sub-screen to be displayed on the examination image display screen is determined by the sub-screen type setting unit 52 of the display setting unit 50 according to the information acquired by the display setting unit 50 and the sub-screen display priority. Specifically, the information acquired by the display setting unit 50 is displayed as a sub-screen according to the sub-screen display priority setting table of the sub-screen display priority setting screen 52a as shown in FIG. 11.

The user can select the type of sub-screen to be displayed on the sub-screen in a sub-screen display priority setting table on the sub-screen display priority setting screen 52a as shown in FIG. 11 in advance. The information or image related to the type of sub-screen that can be selected (type of sub-screen) is at least one of, but is not limited to, a still image related to the examination image, position information of the region of interest, an insertion shape image, treatment tool appearance position information, and associated text information.

In the sub-screen display priority setting table, the type of sub-screen you want to prioritize can be changed, for example, by selecting and moving the hamburger icon (icon with three lines) 52b. The method for changing the sub-screen display priority is not limited to this. For example, a form for inputting the priority may be set next to the item. With the above configuration, the type of sub-screen can be determined. Being able to set the priority of the types of sub-screens to be displayed on the sub-screen allows the user to select the sub-screen items they want to prioritize.

The layout of the sub-screens displayed on the examination image display screen is determined by the layout set by the user in the layout setting section 53 of the display setting section 50.

Specifically, first, from the first layout setting screen 53a as shown in FIG. 12, the user selects the main/sub-screen layout allocation setting button 53b that matches the number of sub-screens, and then a main/sub-screen layout allocation screen is displayed that presents layout templates as shown in FIG. 13 to FIG. 20. The user can then set in which positions in each section the main screen and sub-screens will be displayed on the layout template. In addition, the user can set in which position the sub-screen with a high sub-screen display priority will be displayed.

The display setting unit 50 performs display settings for the examination image display screen in accordance with the number of sub-screens determined by the sub-screen number setting unit 51 and the main/sub-screen layout allocation settings preset by the user, and transmits information related to the display settings to the display screen generation unit 60.

Below, we explain a specific example of main/sub screen layout assignment settings using layout templates.

When the number of sub-screens determined by the sub-screen number setting unit is 1, the layout template shown in FIG. 13 or FIG. 14 is displayed on the main/sub-screen layout allocation screen.

Figure 13 shows a layout template in which the screen is divided into two, left and right. Here, the left section is layout first section 53e, and the right section is layout second section 53f. In this case, it is possible to select whether layout first section 53e or layout second section 53f will be the main screen or the sub-screen. In the specific example of Figure 13, layout first section 53e is the main screen, and layout second section 53f is the sub-screen.

In the specific example of FIG. 13, the screen is divided equally into left and right sections, but the sizes of the first layout section 53e and the second layout section 53f can be set arbitrarily, for example, by selecting and moving the line that divides the sections on the layout template on the screen. Changing the size of the sections on the layout template is also common to the following specific examples.

It is also preferable that the size of the sub-screens to be displayed can be set to be constant even if the sub-screens are changed. For example, when the same type of sub-screens are displayed on the first display 21 and the second display 22, which have different inch sizes, the sub-screens of the same type may be set to be the same size even if the number of sub-screens is changed.

Figure 14 shows a layout template in which the screen is divided into two, top and bottom. Here, the top section is layout first section 53e, and the bottom section is layout second section 53f. Even in this case, it is possible to select whether layout first section 53e or layout second section 53f will be the main screen or the sub-screen. In the specific example of Figure 14, layout first section 53e is the main screen, and layout second section 53f is the sub-screen.

When the number of sub-screens determined by the sub-screen number setting unit 51 is two, a layout template such as that shown in Figure 15 or Figure 16 is displayed on the main/sub-screen layout allocation screen.

Figure 15 shows a layout template in which the screen is divided into two parts, left and right, and the right screen is further divided into two parts, top and bottom. Here, the left section is layout first section 53e, the top right section is layout second section 53f, and the bottom right section is layout third section 53g. In this case, it is possible to select which of layout first section 53e, layout second section 53f, and layout third section 53g will be the main screen or the sub-screen. In the specific example of Figure 15, layout first section 53e is the main screen, layout second section 53f is the sub-screen (sub-screen 1) that displays the items of the sub-screen with the highest sub-screen display priority, and layout third section 53g is the sub-screen (sub-screen 2) that displays the items of the sub-screen with the second highest sub-screen display priority.

Figure 16 shows a layout template in which the screen is divided vertically into three. Here, from the left, there are layout first section 53e, layout second section 53f, and layout third section 53g. Layout first section 53e occupies twice the area of layout second section 53f and layout third section 53g. Even in this case, it is possible to select which of layout first section 53e, layout second section 53f, and layout third section 53g will be the main screen or the sub-screen. In the specific example of Figure 16, layout first section 53e is the main screen, layout second section 53f is the sub-screen (sub-screen 1) that displays the items of the sub-screen with the highest sub-screen display priority, and layout third section 53g is the sub-screen (sub-screen 2) that displays the items of the sub-screen with the second highest sub-screen display priority.

Note that the method of dividing the layout first section 53e, the layout second section 53f, and the layout third section 53g is not limited to this. For example, the layout template of FIG. 15 or FIG. 16 may be divided by flipping it left to right. Also, in cases where the output performance information includes an aspect ratio, a recommended template may be presented to the user.

In addition, if the number of layout sections increases, the layout setting unit 53 may automatically create a layout template and display it on the main/sub screen layout assignment screen.

For example, if the number of sub-screens determined by the sub-screen number setting unit is 3, a layout template including layout first section 53e, layout second section 53f, layout third section 53g, and layout fourth section 53h as shown in Figures 17 and 18 is displayed.

When the number of sub-screens determined by the sub-screen number setting unit 51 is 4, a layout template such as that shown in FIG. 19 and FIG. 20 is displayed, including a first layout section 53e, a second layout section 53f, a third layout section 53g, a fourth layout section 53h, and a fifth layout section 53i. In the specific examples shown in FIG. 17 to FIG. 20, the user can also arbitrarily set the allocation of the main screen and the sub-screens, and the size of the sub-screens. When the main/sub-screen layout allocation setting is completed, it is preferable to save the settings by selecting an end setting button (not shown). With the above configuration, the main screen and the sub-screens can be arranged in any arrangement desired by the user.

The main/sub-screen layout allocation setting screen may display a layout template created by the user. In the first layout setting screen 53a, selecting the layout creation button 53c displays the layout creation screen 53j shown in Figs. 21 and 22. In the layout creation screen 53j, the user can create any layout template. In the specific example of creating a new layout section shown in Fig. 21, the second layout creation section 53m can be created by dragging the first layout creation section 53k in the direction of the arrow 53l via the UI 23.

In the specific example of creating four new layout sections in FIG. 22, a second layout creation section 53m, a third layout creation section 53n, a fourth layout creation section 53o, and a fifth layout creation section 53p can be created by dragging the first layout creation section 53k in the direction of the arrow 53l via the UI 23. The method of creating the layout is not limited to this. When the layout creation is finished, the settings can be saved by selecting the save button 53q and the user can return to the first layout setting screen 53a. With the above configuration, a template of any format the user desires can be created.

In the first layout setting screen 53a, by selecting the additional character information setting button 53d, a second layout setting screen 53s as shown in FIG. 23 can be displayed. In the second layout setting screen 53s, it is possible to select whether the additional character information is displayed in a portion of the main screen other than the examination image, or on the sub-screen. In the second layout setting screen 53s, a display example 53t of the additional character information is shown, and by selecting a radio button 53u, it is possible to select whether the additional character information is displayed on the main screen or the sub-screen. Note that the method of setting whether the additional character information is displayed on the main screen or the sub-screen is not limited to this. In addition, when the inch size becomes equal to or smaller than a certain value, the display of the additional character information may be changed from the sub-screen to the main screen.

The second layout setting screen 53s also allows the user to set the font size of the additional text information to be displayed on the examination image display screen. The font size can be set by entering a number into the font size input form 53v. Note that the method for setting the font size is not limited to this. For example, the font size may be set using a pull-down menu. With the above configuration, the font size can be kept constant even if the inch size of the display changes, improving the visibility of the text information.

The font size may be determined based on output performance information such as the inch size of the display. In the specific example of FIG. 23, the font size for each display, such as the first display 21 and the second display 22, can be set by entering numbers into the font size input form 53v.

The display screen generation unit 60 generates an examination image display screen according to the settings of the display setting unit 50, and displays it on an output device (e.g., the first display 21 or the second display 22).

Specific examples of the examination image display screen 70 will be described with reference to Figures 24 and 25. Figure 24 shows a specific example in the case of a first display 21 with an inch size of 50 inches and a case where the number of sub-screens is four. Figure 25 shows a specific example in the case of a second display 22 with an inch size of 24 inches and a case where the number of sub-screens is two. In the specific examples shown in Figures 24 and 25, the order of sub-screen display priority is as follows: insertion shape image, still image, special light image, and incidental character information. Furthermore, it is set so that when the inch size becomes 25 inches or less, the display of incidental character information is changed from the sub-screen to the main screen.

In the examination image display screen 70 of the first display 21 shown in FIG. 24, the examination image is displayed on the main screen 71, the insertion shape image is displayed on the first sub-screen section 72, the still image is displayed on the second sub-screen section 73, the special light image is displayed on the third sub-screen section 74, and the associated text information is displayed on the fourth sub-screen section 75. On the other hand, in the examination image display screen 70 of the second display 22 shown in FIG. 25, the examination image is displayed on the main screen 71, the insertion shape image is displayed on the first sub-screen section 72, and the still image is displayed on the second sub-screen section 73. As described above, the processor device 20 determines the number and type of sub-screens in the examination image display screen 70.

It is preferable that the user can change the layout of the sub-screens while the examination image display screen 70 is displayed. Specifically, for example, the layout of the sub-screens can be changed by dragging and dropping from one sub-screen section to another sub-screen section via the UI 23. It is noted that the method of changing the layout of the sub-screens is not limited to this. With the above configuration, it is possible to customize the layout of the sub-screens even during an examination or surgery.

It is also preferable that the user can change the number and/or type of sub-screens while the examination image display screen 70 is displayed. Specifically, for example, the number and/or type of sub-screens can be changed by voice input via the UI 23. Also, the first display 21 and the second display 22 may be provided with a switch (not shown) that can change the number and/or type of sub-screens. With the above configuration, the number and/or type of sub-screens can be customized even during an examination or surgery.

A series of steps in the first embodiment in which the processor device 20 receives an examination image and sub-screen display information other than the examination image, and displays the examination image display screen 70 on the output device, will be described with reference to FIG. 26. First, the processor device 20 acquires an endoscopic image, which is an examination image, and sub-screen display information, which is information other than the examination image (step S101). Next, the processor device 20 acquires output performance information from the output device (e.g., the first display 21 or the second display 22) (step S102). Note that steps S101 and S102 are in no particular order. Next, the number and type of sub-screens are determined according to the settings of the display setting unit 50 (step S103), and the display screen generation unit 60 generates an examination image display screen and displays it on the output device (step S104).

[Second embodiment]
In the second embodiment, a case in which the processor device 20 is provided in an ultrasonic imaging system 200 will be described.

As shown in FIG. 27 or FIG. 28, the processor device 20 of the second embodiment is connected to an ultrasound probe 201, a UI 23, and a first display 21 or a second display 22.

The ultrasound probe 201 transmits ultrasound to the subject and receives a reflected wave signal from the subject. An ultrasound image signal generated by the reflected wave signal is received by the examination image acquisition unit 14 of the processor device 20. The examination image acquisition unit 14 performs image processing on the ultrasound image signal to generate an examination image. The examination image is transmitted to the display setting unit 50.

A position sensor is attached to the ultrasound probe 201. In the second embodiment, the position information acquisition unit 15 acquires position information of the ultrasound probe 201. The position information is transmitted to the display setting unit 50.

In the second embodiment, when a still image acquisition signal is issued, the still image acquisition unit 16 acquires a still image of the ultrasound image. The still image is transmitted to the display setting unit 50.

In the second embodiment, the processor device 20 does not need to include the insertion state acquisition unit 17 and the treatment tool appearance position information acquisition unit 18. This is because these are configured to obtain information specific to the endoscope.

In the second embodiment, the information received by the display setting unit 50 includes an examination image, position information of the ultrasound probe 201, a still image, and additional text information. However, this is not limited to this. Specific examples of information included in the additional text information are the same as in the first embodiment.

The functions of the output performance information acquisition unit 40, display setting unit 50, and display screen generation unit 60 of the processor device 20 are the same as those of the first embodiment, except for the parts related to the insertion state information and the treatment tool appearance position information, and therefore will be omitted.

A series of steps in the second embodiment, in which the processor device 20 receives an examination image and information for displaying a sub-screen other than the examination image, and displays the examination image display screen 70 on the output device, will be described with reference to FIG. 29. First, the processor device 20 acquires an ultrasound image, which is an examination image, and information for displaying the sub-screen (step S201). Next, the processor device 20 acquires output performance information from the output device (e.g., the first display 21 or the second display 22) (step S202). Note that steps S201 and S202 are in no particular order. Next, the number and type of sub-screens are determined according to the settings of the display setting unit 50 (step S203), and the display screen generating unit 60 generates the examination image display screen 70 and displays it on the output device (step S204). In the second embodiment, only some of the information acquired by the processor device 20 as information for displaying the sub-screen is different, and the series of steps are the same as in the first embodiment.

[Third embodiment]
In the third embodiment, a case in which the processor device 20 is provided in a radiation image capturing system 300 will be described.

As shown in FIG. 30 or FIG. 31, the processor device 20 of the second embodiment is connected to a radiographic imaging device 301, a radiation ray irradiation device 302, a UI 23, and a first display 21 or a second display 22.

The radiographic imaging device 301 includes a radiation detector in a housing. The radiation irradiator 302 includes a radiation source and a radiation source control device that controls the radiation source. The radiation detector of the radiographic imaging device 301 generates electric charges according to the amount of radiation emitted from the radiation irradiator 302 and transmitted through the subject. Based on the amount of electric charge generated by the radiation detector, a radiographic image signal is transmitted to the examination image acquisition unit 14 of the processor device 20.

As shown in FIG. 32, the radiation image capturing system 300 may include an electronic cassette 303 equipped with a radiation detector instead of the radiation image capturing device 301. The electronic cassette 303 acquires a radiation image signal in the same manner as the radiation image capturing device 301, in synchronization with the irradiation of radiation from the radiation source. As a synchronization method, there is a method of performing communication between the electronic cassette and a radiation irradiation device wirelessly connected thereto to control the irradiation timing. In addition, if the electronic cassette 303 has an irradiation start detection function that automatically detects the start of radiation irradiation, the irradiation timing is controlled using the irradiation start detection function.

In the third embodiment, the test image acquisition unit 14 receives a radiographic image signal from the radiographic imaging device 301 or the electronic cassette 303, and generates a test image, which is a radiographic image. The test image is transmitted to the display setting unit 50.

In the third embodiment, when a still image acquisition signal is issued, the still image acquisition unit 16 acquires a still image of the radiation image. The still image is transmitted to the display setting unit 50.

In the third embodiment, the processor device 20 does not need to include the position information acquisition unit 15, the insertion state acquisition unit 17, and the treatment tool appearance position information acquisition unit 18.

In the third embodiment, the information received by the display setting unit 50 of the processor device 20 includes an inspection image, a still image, and additional text information. However, this is not limited to this. Specific examples of information included in the additional text information are the same as those in the first embodiment.

The functions of the output performance information acquisition unit 40, display setting unit 50, and display screen generation unit 60 of the processor device 20 are the same as those of the first and second embodiments, except for the parts related to position information, insertion state information, and treatment tool appearance position information, and therefore will be omitted.

A series of steps in which the processor device 20 receives an examination image and sub-screen display information other than the examination image and displays the examination image display screen 70 on the output device in the third embodiment will be described with reference to FIG. 33. First, the processor device 20 acquires a radiological image, which is an examination image, and sub-screen display information (step S301). Next, the processor device 20 acquires output performance information from the output device (e.g., the first display 21 or the second display 22) (step S302). Note that steps S301 and S302 are in no particular order. Next, the number and type of sub-screens are determined according to the settings of the display setting unit 50 (step S303), and the display screen generating unit 60 generates the examination image display screen 70 and displays it on the output device (step S304). In the third embodiment, the information acquired by the processor device 20 as sub-screen display information is only partially different from that of the first and second embodiments, and the series of steps are the same as those of the first and second embodiments.

In the above embodiment, the processor device of the present invention is applied to a medical device that acquires endoscopic images, ultrasound images, and radiological images as examination images. However, the processor device of the present invention can also be applied to various endoscopic systems such as capsule endoscopes, and various other medical devices that acquire CT (Computed Tomography) images, MRI (Magnetic Resonance Imaging) images, pathological images, PET (Positron Emission Tomography) images, etc.

In the above embodiment, the hardware structure of the processing units that execute various processes, such as the central control unit 30, the examination image acquisition unit 14, the position information acquisition unit 15, the still image acquisition unit 16, the insertion state acquisition unit 17, the treatment tool appearance position information acquisition unit 18, the output performance information acquisition unit 40, the display setting unit 50, and the display screen generation unit 60, is various processors as shown below. The various processors include a CPU (Central Processing Unit), which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit, which is a processor with a circuit configuration designed specifically to execute various processes.

A processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Multiple processing units may also be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or server, one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with a single IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

More specifically, the hardware structure of these various processors is an electric circuit (circuitry) that combines circuit elements such as semiconductor elements. The hardware structure of the memory unit is a storage device such as a hard disk drive (HDD) or a solid state drive (SSD).

10: Endoscope system 12: Endoscope 13: Light source device 14: Examination image acquisition unit 15: Position information acquisition unit 16: Still image acquisition unit 17: Insertion state acquisition unit 18: Treatment tool appearance position information acquisition unit 20: Processor device 21: First display 22: Second display 23: UI
30 Central control unit 40 Output performance information acquisition unit 40a Standard output condition calculation unit 50 Display setting unit 51 Number of sub-screens setting unit 52 Sub-screen type setting unit 52a Sub-screen display priority setting screen 52b Hamburger icon 53 Layout setting unit 53a First layout setting screen 53b Main/sub-screen layout allocation setting button 53c Layout creation button 53d Additional character information setting button 53e First layout section 53f Second layout section 53g Third layout section 53h Fourth layout section 53i Fifth layout section 53j Layout creation screen 53k First layout creation section 53l Arrow 53m Second layout creation section 53n Third layout creation section 53o Fourth layout creation section 53p Fifth layout section 53q Save button 53s Second layout setting screen 53t Example of additional character information display 53u Radio button 53v Font size input form 60 Display screen generating unit 70 Examination image display screen 71 Main screen 72 Sub-screen first section 73 Sub-screen second section 74 Sub-screen third section 75 Sub-screen fourth section 200 Ultrasonic image capturing system 201 Ultrasonic probe 300 Radiation image capturing system 301 Radiation image capturing device 302 Radiation ray irradiation device 303 Electronic cassette

Claims (12)

A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The types of the sub-screens include at least one of a still image related to the examination image, position information of a region of interest, an insertion shape image, treatment tool appearance position information, and incidental character information,
The processor device, wherein the additional character information includes at least one of patient information, surgeon information, and switch assignment information. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of an inch size, a resolution, and an aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
When the processor acquires only the inch size as the output performance information,
A processor device in which, when the first inch size is larger than the second inch size and the display is of the second inch size, the number of the sub-screens is reduced compared to when the display is of the first inch size. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of an inch size, a resolution, and an aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
When the processor acquires only the resolution as the output performance information,
A processor apparatus, the processor apparatus being configured such that when the display is at the second resolution, a first resolution is greater than a second resolution, and the number of sub-screens is reduced compared to when the display is at the first resolution. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of an inch size, a resolution, and an aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
When the processor acquires the inch size and the resolution as the output performance information,
When the first inch size is larger than the second inch size and the first resolution is higher than the second resolution,
A processor device that reduces the number of sub-screens when the output performance information includes the first inch size and the second resolution, when the output performance information includes the second inch size and the first resolution, or when the output performance information includes the second inch size and the second resolution, compared to when the output performance information includes the first resolution and the first inch size. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of an inch size, a resolution, and an aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
When displaying a still image related to the inspection image on the sub-screen, the processor:
A processor device that reduces the number of still images displayed on the sub-screen when the output performance information includes the first inch size and the second resolution, when the output performance information includes the first inch size and the second resolution, when the output performance information includes the second inch size and the first resolution, or when the output performance information includes the second inch size and the second resolution, compared to when the output performance information includes the first resolution and the first inch size. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of an inch size, a resolution, and an aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The processor calculates standard output conditions based on the inspection image;
A processor device that reduces the number of sub-screens when the inch size of the display is smaller than the standard output condition. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The processor is a processor device that sets an upper limit on the number of the sub-screens. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The processor determines the type of the sub-screen to be displayed on the display in accordance with a sub-screen display priority. The processor device according to claim 8, wherein the sub-screen display priority is configurable. A processor device including a processor, the processor device being connected to a display,
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The processor is a processor device that determines a font size on the inspection image display screen based on the output performance information. The processor device according to claim 1, wherein the processor can select whether to display the additional text information in a portion of the main screen other than the examination image or on the sub-screen. A method for operating a processor device including a processor and connected to a display, comprising:
The processor,
Obtaining an inspection image;
generating an examination image display screen including a main screen for displaying the examination image and a sub-screen for displaying a screen different from the main screen and displayed at a position different from that of the main screen;
Acquire output performance information including at least one of the inch size, resolution, and aspect ratio of the display that displays the inspection image display screen;
determining the number and type of the sub-screens based on the output performance information;
The types of the sub-screens include at least one of a still image related to the examination image, position information of a region of interest, an insertion shape image, treatment tool appearance position information, and incidental character information,
A method for operating a processor device, wherein the additional character information includes at least one of patient information, operator information, and switch assignment information.

Images