JP4780101B2 - Image display system, image display method, and program - Google Patents

Description

  The present invention relates to an image display device, a display control method, and a program for displaying a window on a display unit.

  Conventionally, for example, a system having a single drawing system on a single OS, a system having a single drawing system on a plurality of OSs such as an X window system, or an OSD function (On There is a system that allocates a plurality of VRAMs to an HW layer using a screen display).

  Window control apparatuses using these systems are known. This type of window control apparatus creates a window corresponding to each of different jobs that are simultaneously processed in parallel by a processor. The window control device simultaneously displays a plurality of windows corresponding to these individual jobs on the screen. Furthermore, the window control apparatus can simultaneously monitor the status of a plurality of job processes.

For example, Patent Document 1 discloses an output data control apparatus that displays a plurality of output images (image data), for example, image data output from a plurality of devices, on one screen using window display. The output data control apparatus according to Patent Document 1 inputs a plurality of image data from a plurality of information processing terminals (PCs) or video output devices. Then, the plurality of input image data are synthesized in one screen using the main screen and the window screen. Further, the synthesized screen is output to the monitor device. Then, the output data control device calculates the ratio of displaying the window screen so as to overlap the main screen as the transparency. Furthermore, the output data control device changes the screen by changing the ratio of displaying the window screen according to the calculated transparency, and outputs the changed screen to the monitor device.
Japanese Patent No. 2002-182890

  As described above, when a plurality of windows are displayed on a display such as an LCD shared by a plurality of OSs or a plurality of drawing systems, overlay control is performed by assigning an HW layer to each window using the OSD function which is a conventional technique. It was possible. However, there is a problem that the number of windows that can be handled simultaneously is limited by the number of HW layers.

  On the other hand, by adopting a window system capable of multi-window display as a drawing system, it has become possible to remove restrictions on the number of windows that can be handled simultaneously. However, since each drawing system draws in different VRAMs, there is a problem in that overlay control cannot be performed dynamically in units of windows between different drawing systems.

  In addition, the display order is determined between the HW layers, and in the method of simply superimposing them, there is a local priority used in each HW layer, and rendering is performed for each HW layer. Images drawn in each HW layer are superimposed according to the display order between the HW layers. That is, in HW layer 1 and HW layer 2 (priority is HW layer 1> HW layer 2), the window of HW layer 2 is not displayed in front of the window of HW layer 1.

  The present invention has been made to solve such a problem, and in a system having a display shared by a plurality of drawing systems, for example, an image display device that enables superimposition in units of windows, It is an object to provide a display control method and program.

The image display system according to the present invention acquires image information of an image drawn on each of a plurality of display layers to be combined, and when the first display layer has a lower display order than the second display layer, Based on the image information, an image drawn on the first display layer to be displayed when the first and second display layers are combined is detected as a specific image, and a transparent image for displaying the specific image is displayed. A management unit configured to generate the second display layer, and the management unit generates an image corresponding to each display layer with an arrangement position and display priority information of an image drawn on each of the plurality of combined display layers The information acquisition unit, the first display layer has a lower display order than the second display layer, and the shape of the specific image is a non-rectangular shape, the arrangement information and the table Based on the priority information, an image drawn on the first layer to be displayed when the first and second display layers are combined is detected as the specific image, and a transparent image for displaying the specific image is displayed. An instruction generation unit that causes the second display layer to generate, and when the shape of the specific image is a non-rectangular shape, the information acquisition unit includes rectangular information including the specific image, and the specific image background information for identifying the other areas, is shall be obtained as the image information.

A program according to the present invention is a program for causing a computer to execute a predetermined operation, acquires image information of an image drawn on each of a plurality of display layers to be combined, and the first display layer is a first program. When the display order is lower than that of the second display layer, based on the image information, an image drawn on the first display layer to be displayed when the first and second display layers are combined is detected as a specific image. And a management step for generating a transparent image for displaying the specific image in the second display layer, wherein the management step includes an arrangement position of an image drawn on each of the plurality of display layers to be synthesized. And an information acquisition step of acquiring display priority information from the image generation unit corresponding to each display layer, and the first display layer has a lower display order than the second display layer, and the specific image When the shape is a non-rectangular shape, the image drawn on the first layer to be displayed when the first and second display layers are combined is based on the arrangement information and the display priority information. A command generation step of generating a second transmission layer for detecting a specific image and displaying the specific image on the second display layer, wherein the shape of the specific image is a non-rectangular shape In this case, rectangular information including the specific image and background information for identifying the specific image and other regions are acquired as the image information .

The image display method according to the present invention acquires image information of an image drawn on each of a plurality of display layers to be combined, and when the first display layer has a lower display order than the second display layer, Based on the image information, an image drawn on the first display layer to be displayed when the first and second display layers are combined is detected as a specific image, and a transparent image for displaying the specific image is displayed. A management step of generating the second display layer, wherein the management step generates an image corresponding to each display layer with an arrangement position and display priority information of an image drawn on each of the plurality of combined display layers Information acquisition step acquired from the unit, and when the first display layer is lower in display order than the second display layer and the shape of the specific image is a non-rectangular shape, the arrangement information and the Based on the display priority information, a transparent image for detecting an image drawn on the first layer to be displayed at the time of combining the first and second display layers as the specific image and displaying the specific image A command generation step for generating the second display layer, and in the information acquisition step, when the shape of the specific image is a non-rectangular shape, the rectangular information including the specific image, and the specific image and others The background information for identifying the area is acquired as the image information .

  According to the present invention, it is possible to provide a window control device, a window control method, a program, and an information processing device that enable overlapping in units of windows even in a system having a display shared by a plurality of drawing systems. .

  Hereinafter, specific examples to which the present invention is applied will be described in detail with reference to the drawings. In this embodiment, the present invention is applied to an image display apparatus capable of combining and displaying a window on a display shared from a drawing system that is activated on each of a plurality of OSs. In particular, in this embodiment, an image display apparatus capable of displaying a non-rectangular window as a window will be described.

  Even when different drawing systems are operating on a plurality of OSs, there is a system that cooperatively draws windows on a single display shared by the plurality of OSs. FIG. 1 is a schematic view showing such an image display apparatus. The image display apparatus 1100 includes a plurality of processing units 1 and 2 including, for example, a CPU (Central Processing Unit), and different OSs are installed. On each OS, window generation units 1010 and 1020 as image generation units and application managers (APM) 1012 and 1022 as management units are activated. Here, in the present embodiment, for example, one OS is an OS for a control system such as engine control, speed control, or air bag control, and the other OS is for entertainment or multimedia. The information system OS.

  The window generation unit 1010 generates a window 1711 to be displayed on a hardware layer (HW layer) 1071 as a display layer. The window generation unit 1020 generates a window 1721 to be displayed on the HW layer 1072 displayed on the same display unit as the HW layer 1071.

  Specifically, the APMs 1012, 1022 acquire window arrangement information including frame information of each window and Z-axis information (display priority information, hereinafter referred to as priority) of each window as image information from the window generation units 1010, 1020. To do. In the case of a rectangular window, the window frame information may be the coordinates of the starting point and the vertical and horizontal sizes. The priority indicates the display order of windows used in common by all HW layers. In the present embodiment, it is possible to control the display order of windows across the HW layers by using priority information common to all the HW layers. The APM 1022 should be displayed when the first and second HW layers 1071 and 1072 are combined based on the window arrangement information when the display order of the first HW layer 1071 is lower than that of the second HW layer 1072 A window drawn on the first HW layer 1071 is detected as a specific window 1711. Then, the APM 1022 generates an arrangement command for causing the second HW layer 1072 to generate a transparent window 1725 for displaying the specific window 1711. The APM 1012 generates an arrangement command for generating a window 1711 to be displayed on the first HW layer 1072. The HW layers 1071 and 1072 are subjected to screen composition by an LCD controller (not shown) as a composition unit, and a display screen 1041 is generated. In the present embodiment, the description will be made assuming that the display order of the HW layers is determined in advance. APM forms a transparent window, which will be described later, according to the vertical relationship of the HW layer and the priority of the window. The LCD controller synthesizes the display screen according to the determined display order. However, the present invention is not limited to this, and the APM or the like may change the display order of the HW layers.

  Hereinafter, the APM 1022 will be described in detail. The APM 1022 includes an information acquisition unit 1221 and an instruction generation unit 1222. The information acquisition unit 1221 acquires the arrangement position and the display degree of the image drawn on each of the plurality of display layers to be combined from the window generation units 1020 and 1010 corresponding to the display layers. That is, the information acquisition unit 1221 acquires window arrangement information of the display layer 1072 from the window generation unit 1020. Further, window arrangement information of the display layer 1071 is acquired from the window generation unit 1010 via the APM 1012.

  The instruction generation unit 1222 is displayed when the first and second HW layers 1071 and 1072 are combined based on the window arrangement information when the display order of the first HW layer 1071 is lower than that of the second HW layer 1072. A window drawn on the first power layer 1071 to be detected is detected as the specific window 1711. Then, the command synthesis unit 1222 generates a placement command that causes the second HW layer 1072 to generate a transparent window 1725 for displaying the specific window 1711.

  When the priority of the first window 1711 of the second HW layer 1072 is higher than the priority of the second window 1721, the instruction generation unit 1222 selects the window drawn on the first HW layer 1071 as a specific window. 1711 is detected. Then, an arrangement command for generating a transparent window 1725 for displaying the specific window 1711 in the same shape and the same arrangement position as the first window 1711 in the second HW layer 1072 is generated. The window generation unit 1020 generates a transparent window 1725 in the second HW layer 1072 in accordance with the arrangement instruction from the instruction generation unit 1222 and combines it with the second window 1721.

  Here, the transparent window refers to a window that transmits the image that is transmitted through itself and displayed on the lower HW layer. As an example of the transmissive window, the region in the transmissive window is generated by performing mask processing for erasing the image signal in the HW layer. For example, in a system that expresses one dot by 32 bits (8 bits for each of ARGB) consisting of RGB information and transmittance information (A), the APM or the drawing system uses VRAM data (transmittance information) in bit units. By controlling, a transparent window can be generated.

  In the present embodiment, two processing units are described. However, two or more processing units may be used. Furthermore, each window generation unit controls the display of one window with one HW layer, but it may display two or more windows even with two or more HW layers. Of course.

  As described above, the command generation unit 1222 generates a placement command for the transparent window 1725 using the display priority and the window frame information as the information of the first window 1711. That is, the command generation unit 1222 generates an arrangement command for generating the transparent window 1725 without acquiring image information such as a pixel value of the first window 1711. By generating such a transparent window 1725, when the LCD controller synthesizes the HW layers 1071 and 1072, a screen in which the window 1711 and the window 1721 are superimposed according to the display priority is generated. As a result, in a system having a display shared by a plurality of OSs, window superposition control (Z-axis) between different HW layers can be achieved by only passing a small amount of data without transferring detailed information about images displayed on each other. Control). Accordingly, it is possible to speed up the process of combining image information drawn by a plurality of OSs. Hereinafter, embodiments of the present invention will be described in detail.

  By the way, in the embedded GUI system, it is necessary to display only a part of a non-rectangular window or application unlike a PC. However, when different drawing systems are operating on a plurality of OSs, The shape is unknown and it is difficult to perform cooperative operation between OSs using a transparent window. Examples of non-rectangular applications include LCD speedometers for in-vehicle systems and dialog displays for safety applications.

  If it is a rectangular window, only the information on the coordinates and width and height of the upper left corner is sufficient, but a non-rectangular window (hereinafter also referred to as bitmap data) is expressed in a gradation format composed of RGB. It is difficult to grasp the shape of the window with APM, and it is difficult to give an appropriate instruction to the other drawing system via APM.

  Therefore, the image display apparatus according to the present embodiment creates a transparent window corresponding to a shape other than a rectangle (non-rectangular shape) in a system in which different drawing systems are operated on a plurality of OSs, and the lower HW It has a mechanism for cooperating with layer applications. For this purpose, an APM (application manager) having means for selecting boundary information at the time of window generation and acquiring outline information (boundary data) of a non-rectangular window and means for sending only difference information in subsequent operations is provided.

  FIG. 2 is a schematic diagram showing an image display apparatus according to an embodiment of the present invention. The image display apparatus 100 includes a plurality of processing units 1 and 2, and different OSs are installed in each. On each OS. Window generation units 10 and 20 as image generation units and application managers (APM) 12 and 22 as management units are activated. Here, in this embodiment, for example, one OS is an OS for a control system such as engine control, speed control, or air bag control, and the other OS is for entertainment or multimedia. Let it be an information system OS.

  The window generation unit 10 generates a window 711 to be displayed on a hardware layer (HW layer) 71 as a display layer. The window generation unit 20 generates a window 721 to be displayed on the HW layer 72 displayed on the same display unit as the HW layer 71. The APMs 12 and 22 acquire window arrangement information including window frame information and Z-axis information (display priority information, hereinafter referred to as priority) of each window as image information from the window generation units 10 and 20. Further, when the window has a non-rectangular shape, rectangular information including the specific image and background information for identifying the specific image and other regions are acquired as the window arrangement information. Here, of the APM 12 and the AP 22, the APM 22 that generates a placement command for a window to be drawn on the upper HW layer 72 should be displayed when the first and second display layers 71 and 72 are combined based on the window information. An image drawn on the first display layer 71 is detected as the specific image 711. Then, the APM 22 causes the second display layer 72 to generate a transparent image 725 for displaying the specific image 711. In this case, when the shape of the specific image 711 is a non-rectangular shape, the APM 22 acquires the shape of the specific image 711 based on the window information, and causes the second display layer 72 to generate the transparent image 725. The APM 12 generates an arrangement command for generating a window to be displayed on the first HW layer 71.

  The HW layers 71 and 72 are screen-synthesized by an LCD controller (not shown) as a synthesis unit, and a display screen 41 is generated. In the present embodiment, the description will be made assuming that the display order of the HW layers is determined in advance. APM forms a transparent window according to the hierarchical relationship of the HW layer and the priority of the window. The LCD controller synthesizes the display screen according to the determined display order. However, the present invention is not limited to this, and the APM or the like may change the display order of the HW layers.

  Hereinafter, the APM 22 will be described in detail. The APM 22 includes an information acquisition unit 221 and an instruction generation unit 222. The information acquisition unit 221 acquires an arrangement position and display priority information of an image drawn on each of the plurality of display layers to be combined from the window generation unit corresponding to each display layer. That is, the information acquisition unit 221 acquires window arrangement information of the display layer 72 from the window generation unit 20. Further, the window arrangement information of the display layer 71 is acquired from the window generation unit 10 via the APM slave 12.

  A case where the display order of the first display layer 71 is lower than that of the second display layer 72 will be described. In this case, if the shape of the specific image 711 is a non-rectangular shape, the command generation unit 222 first and second display layers 71 based on window arrangement information including background information in addition to arrangement information and display priority information. , 72 is detected as a specific image 711 that is drawn on the first layer 71 to be displayed. Then, the command generation unit 222 generates a placement command that causes the second display layer 72 to generate a transparent image 725 for displaying the specific image 711.

  Here, when the priority of the first window 711 of the second HW layer 72 is higher than the priority of the second window 721, the instruction generation unit 222 identifies a window to be drawn on the first HW layer 71. An arrangement command for generating a transparent window 725 for displaying the specific window at the same shape and the same arrangement position as the first window 711 in the second HW layer 72 is generated. The window generation unit 20 generates a transparent window 725 in the second HW layer 72 in accordance with the arrangement instruction from the instruction generation unit 222 and synthesizes it with the second window 721.

  Furthermore, in this embodiment, when the shape of the specific image 711 is a non-rectangular shape, the information acquisition unit 221 includes rectangular information including the specific image 711 (hereinafter referred to as base window information) and the specific image. Background information for identifying other areas is acquired as window arrangement information. The command generation unit 222 detects the contour of the specific image 711 using the background information as a threshold. Specifically, the command generation unit 222 detects the contour of the specific image 711 by determining whether each pixel value is the background from the top, bottom, left, and right of the rectangular area including the specific image 711 using the background information as a threshold value. To do. Alternatively, the command generation unit 222 searches for a rectangular area including the specific image 711 using the background information as a threshold, detects an arbitrary point constituting the outline of the specific image 711, and sets a surrounding pixel value as a threshold from the point By determining, the contour of the specific image is detected.

  Thus, since the instruction generation unit 222 acquires the window shape of the non-rectangular window, for example, even if the first window 711 is a non-rectangular window, it can be combined with the second window 721 and displayed. In the present embodiment, the information acquisition unit 221 is described as acquiring the window shape of the non-rectangular window 711. However, the window generation unit 10 accesses the first storage unit VRAM 131 and determines the shape of the non-rectangular window or Information for obtaining the shape of the non-rectangular window may be acquired and notified to the APM 22 via the APM 12. Examples of the present invention will be described in detail below.

  FIG. 3 is a diagram showing details of the image display apparatus according to the embodiment of the present invention. As shown in FIG. 3, the image display device 100 includes an MPU (Micro Processor Unit) 6, an LCD (Liquid Crystal Display) 4, and an SDRAM (Synchronous Dynamic Random Access Memory) 5. The MPU 4 includes processing units 1 and 2 as control devices, and the OSs 11 and 12, APMs 12 and 22, drawing systems 101 and 201, GUI applications 102 and 103, 202 and 203 are installed in the processing units 1 and 2. Has been. The window generation unit described above is configured by the drawing system and the GUI application.

  As described above, the OS 1 is an OS of a control system such as μITRON, for example, and is equipped with a unique drawing system 101 and GUI applications 102 and 103 as vehicle cooperation applications such as an LCD speedometer. The OS 2 is an information system OS such as UNIX (registered trademark) in which Xwindowsystem or the like is installed as the drawing system 201, and multimedia applications (AVN, browser, etc.) are installed as GUI applications 202 and 203.

  Furthermore, the image display apparatus 100 has a plurality of HW layers such as an HW layer 71 to which the VRAM 51 is assigned and an HW layer 72 to which the VRAM 52 is assigned. The LCDC 20 combines these to generate the display screen 41 and displays it on the LCD 4. Here, in the present embodiment, at least one HW layer is exclusively assigned to the drawing systems 101 and 201 activated on each OS from other drawing systems. That is, the drawing systems 101 and 201 do not share the HW layer. In this example, the drawing system 101 accesses the VRAM 51 and uses the HW layer 71 assigned thereto. The drawing system 201 accesses the VRAM 52 and uses the HW layer 72 assigned thereto. The GUI applications 102 and 103 draw a desired window on the HW layer 71 using the drawing system 101. The GUI applications 202 and 203 draw a desired window on the HW layer 72 using the drawing system 201.

  This image display device 100 is a (built-in) system that accesses a display LCD 4 shared by a plurality of OSs 11 and 21. APMs 12 and 22 are arranged in the OSs 11 and 21, respectively. This APM can be a master-slave system having a master and a slave. In this case, the master APM collectively manages window arrangement information (base window information, priority, background information, etc.) arranged by the GUI application.

  Further, the APMs 12 and 22 on the OSs 11 and 21 are configured to be able to communicate with each other. Based on the window arrangement information, the master APM can issue a window arrangement command to the drawing systems 101 and 201 of all the OSs 11 and 21 as necessary. As will be described later, the window arrangement command is issued, for example, when the priority is changed or the focus moves when the touch panel is operated. It should be noted that each APM may issue a placement command individually without using the master-slave method. The drawing systems 101 and 201 superimpose the transparent windows managed by the APM based on the received arrangement command.

  When the APM is set to the master-slave system, it operates as follows. First, an APM master is arranged in one of the OSs, and an APM slave is arranged in the other OSs. The APM master controls and manages all windows. In this example, it is assumed that an APM master is arranged in the OS 21 and an APM slave is arranged in the OS 11. The APM slave 12 mainly performs communication between the APM master 22 and the drawing system 101. The APM master 22 has window layout information (window frame information, priority, and background information) for all windows. When a new window is generated or a window priority is changed, all window arrangement information managed by the APM master 22 is updated. At this time, the APM master 22 acquires the window arrangement information of the AP 102 and AP 103 from the APM slave 12. Further, the window arrangement information of the AP 202 and AP 203 is obtained directly from the AP 202 and AP 203. The APM master 22 generates a transparent window based on the updated all window arrangement information. Note that the APM master 22 may output a window arrangement command to the drawing systems 101 and 201 of all the OSs, for example, at a timing when the window arrangement information is updated, as necessary. The drawing system 201 can receive an arrangement command from the APM 12 via the APM 22.

  FIG. 4 is a sequence diagram illustrating the operation of the image display apparatus according to the present embodiment. FIG. 5 is a diagram for explaining the window control method. Hereinafter, a process of combining and displaying windows drawn on different HW layers using APM as a master-slave method will be described in detail. As described above, the APM is arranged in each OS, and the window arrangement information used by all GUI applications is collectively managed by the APM master 22 arranged in the OS 21. If the window is a rectangular window, the window arrangement information includes window frame information and priority. If the window is a non-rectangular shape, the base window information, background information, priority, and the like are included. It is also possible to control the window arrangement information such as rewriting the priority as necessary. The APM master 22 manages window arrangement information using storage means such as a hard disk.

  The APM master 22 acquires and holds window arrangement information such as window arrangement information and priority information of all GUI applications operating on each OS from the GUI application. The APM master 22 updates the window arrangement information at the timing when the window is generated by the AP or when the window is discarded.

  With regard to Z-axis control, priority (display priority) is set for the windows held by each drawing system 101, 201, and overlapping of windows is determined based on the priority level. In the example illustrated in FIG. 5, an OS on which an application 102 having a window other than a rectangle and a drawing system 101 that draws the application 102 is assumed to be an OS 11. An OS having GUI applications 202 and 203 that generate rectangular windows 721 and 722 and a drawing system 201 is referred to as OS 21. An arrangement command is generated by the APM 12 for the window 711 drawn on the HW layer 71. Arrangement instructions are generated by the APM 22 for the windows 721, 722, and 725 drawn on the HW layer 72. Here, the HW layer 72 is disposed on the upper surface of the HW layer 71, and the display priority of the window is rectangular window 721 (display priority 15)> non-rectangular window 711 (display priority 10)> rectangular window 722 (display priority) Degree 5). Hereinafter, an operation when the non-rectangular window 711 is arranged in the HW layer 71 will be described. The windows 721, 722, and 711 are windows for which display requests are issued by the APs 202, 203, and 102, respectively.

  First, the AP 102 is activated by the OS 1 (step S1). The AP 102 requests the APM slave 12 to display the window 711 with the priority 10 (step S2). Then, the APM slave 12 notifies the APM master 22 that the display request for the window 711 has been issued with the priority 10 (step S3). The APM master 22 detects from the window arrangement information of the window 711 that the window is non-rectangular information.

  In this embodiment, when generating a window for an application operating on the OS 11 side, the APM 22 on the OS 11 side can select an optimum boundary section depending on the type of window. The AP 102 notifies the APM 22 of the boundary division. The AP 102 selects a rectangle as a boundary section when it is a rectangular window, and selects a bitmap as a boundary section when it is a non-rectangular window. When the APM 22 receives a rectangle as the boundary section, the snapshot acquisition process described later is not performed. In this case, the AP 102 notifies the APM 22 of the coordinates of the upper left corner of the rectangle and the width / height information as boundary data. Thereby, APM22 can produce | generate the transparent window which permeate | transmits the display of the HW layer 71 in which the said rectangular area | region is lower.

  If the APM 22 that manages the HW layer 72, which is the upper layer, controls the transparent window as in this embodiment, it is not necessary to generate a placement command for the other HW layer, and the system It can be configured simply. In this case, the APM slave 12 may send the window arrangement information to the APM master 22 after performing simultaneous drawing processing. In this case, the APM master can generate or delete a transparent window according to the sent window arrangement information.

  When the APM 22 receives a bitmap as a boundary segment, the APM 22 acquires information for acquiring the shape of the non-rectangular window 711 from the AP 102. Specifically, the APM 22 receives rectangular information of a rectangle (base window) 715 including a non-rectangular window and auxiliary information for acquiring the shape of the non-rectangular window from the AP 102. Further, the APM 12 takes a snapshot (bitmap data) of the non-rectangular window 711 and stores it in the shared memory 133. The shared memory 133 is a memory accessible from the drawing systems 101 and 201. The base window is rectangular information that is an outer frame of the non-rectangular window. As the auxiliary information, for example, there is background color information indicating the color of the area other than the non-rectangular window in the base window. The window shape can be detected using the background color information as a threshold value. Furthermore, as the auxiliary information, in addition to the background color information, a transmittance (alpha blend value) can be selected. For the normal transmittance, a value of ± 1 of the non-transmissive value (infinitely non-transmissive) is selected.

  In this embodiment, as window layout information of the window 711, information of priority = 10, threshold = 125, layout position and size of the base window (distance from the left edge of the screen, left = 100, distance from the top edge of the screen) 200, window width = 150, window height = 150).

  Based on the above result, the bitmap data in the base window 715 is extracted as a snapshot. If there is another low priority window in the base window 715, based on the information of the APM 12, a snapshot is extracted in a form in which the area in which the window exists is rewritten with a threshold color or transmittance. It is also possible. The APM 22 on the OS 21 side converts the snapshot data into boundary data (contour information of a non-rectangular window) and saves it (step S4).

  Next, the APM master 22 updates the window arrangement information with the window arrangement information of the window 711 (step S5). The APM 22 can determine that the transparent window 725 of the window 711 is necessary because the HW layer 72 is positioned on the HW layer 71. In this embodiment, the window 711 is sandwiched between the window 721 and the window 722. Note that when the base window of the window 711 overlaps the windows 721 and 722 and the priority is smaller than these windows, the boundary data of the non-rectangular window need not be acquired at the above timing.

  The APM slave 12 instructs the drawing system 101 to generate the window 711 (step S6). On the other hand, the APM master 22 creates a transparent window 725 based on the boundary data described above (step S7).

  Next, the APM master 22 instructs the drawing system 201 to rearrange the windows based on the window arrangement information. If a new window is added or the window display order is changed, the window layout is updated. The APM master 22 also transmits a window rearrangement request to the APM slave 12 based on the arrangement information (step S9). Based on this, the APM slave 12 instructs the drawing system 101 to rearrange the windows (step S10). The drawing system 101 changes the window display order and the like as necessary. Finally, the drawing system 101 displays the window of the HW layer 71 including the window 711 according to the instruction of the APM slave 12 (step S11). Further, the drawing system 201 displays a window of the HW layer 72 including the transparent window 725 according to an instruction from the APM master 22 (step S12).

  Thus, the HW layers 71 and 72 generated in accordance with the placement instruction of the APM master 22 are combined by the LCDC 3. On the LCD display screen 41, a window 711, a window 712, and a window 722 are displayed in the window 722 via a transparent window (see FIG. 5).

  Here, when the window 711 on the OS 11 side is moved, communication between APMs is performed, and difference information is notified to the APM master 22. Based on the difference information and the boundary data, the APM master 22 corrects the transparent window and the boundary data value. For example, when the non-rectangular window 711 moves to the left by 2 dots, the APM master 22 may perform calculation based on the boundary data and the difference information, and correct the area and boundary data handled as the transparent window 725.

  In addition, when a window has a high priority in the same drawing system and a part of the window area is hidden when the window is generated, the window being generated is an area that is not temporarily assigned to the HW layer in the VRAM. The non-rectangular window is moved to the save area 70 (hereinafter referred to as the save area 70), and the snapshot is extracted. After the snapshot is extracted at the time of window generation, the above background color and transmittance can be freely changed. Even if a part of the window is hidden by another window, if it is non-rectangular, the shape of the non-rectangular window is extracted. Thus, even when the non-rectangular window is moved and exposed as a whole, the processing can be performed without acquiring shape information of the non-rectangular window again.

  Further, the APM master 22 performs boundary tracking from the snapshot information stored in the shared memory 133, extracts boundary data, and stores it in the memory VRAM 52 on the OS 21 side. The snapshot extraction and the boundary tracking process on the OS 21 side are basically required only when generating a window. Thereafter, only the difference information is handled, so that no burden is imposed on the system.

  FIG. 6 is a diagram illustrating a method for converting snapshot data into boundary data. The boundary data is expressed in relative coordinates starting from the upper left corner of the specified window. It is assumed that the value increases as the X axis moves to the right and the Y axis moves downward. In the above-described example, the APM master 22 calculates the area handled as the transparent window 725 based on the boundary data and displays it on the display. The boundary data can be expressed by X = (the leftmost end, the rightmost end) for Y = 0 to 6, for example.

  Here, since the extraction process of the transparent window 725 from the boundary data does not use a complicated algorithm, the high-speed transparent window 725 can be drawn. When the application on the OS 11 side moves, only the difference information is sent to the OS 21 side.

  Next, another method for extracting boundary data will be described. FIG. 7 is a diagram illustrating a method for extracting boundary data of a non-rectangular window. As illustrated in FIG. 7A, the instruction generation unit 222 determines whether each pixel value is a background value from the vertical and horizontal directions of the base window 801 including the specific image 802 with background information (background value) as a threshold value. Thus, the contour of the specific image 802 is detected. For example, the command generation unit 222 determines whether or not each pixel matches the background value for the leftmost column. In this example, when matching is determined from the upper end, it is detected that only the pixel 811 has the pixel value different from the background value, and the pixel 811 is detected to be a contour. Next, for each rightmost column on the opposite side, it is determined whether each pixel matches the background value. In this example, only the pixel 812 matches the background value, and it is detected that the pixel 812 is a contour. Furthermore, when it is determined whether each pixel matches the background value for the top row, the pixel 813 is detected. Finally, when it is determined whether or not each pixel matches the background value for the bottom row, two points of pixels 814 and 815 are detected. By repeating the above, the boundary data of the specific image 802 can be detected. Note that the matching may be determined from any column.

  Alternatively, as illustrated in FIG. 7B, the command generation unit 222 searches the base window 821 including the specific image 822 using the background information as a threshold, and detects an arbitrary point 831 constituting the contour of the specific image 821. To do. Then, the command generation unit 222 can detect the contour of the specific image 822 by determining the threshold value of surrounding pixel values starting from the point 831. For example, by examining each row in the horizontal direction and the vertical direction passing through the center of the base window, some contours in the base window are detected as starting points. In this example, the starting point 831 to 834 is detected by comparing the pixel value in the horizontal direction with the background value, and the pixel values around these starting points 831 to 834 (for example, near 8) are compared with the background value. When the contour is detected again, the pixel values in the vicinity of the eight may be compared with the background value.

  In this embodiment, windows drawn by the drawing systems of a plurality of OSs on the respective HW layers can be overlapped using transparent windows. In this case, since the transparent window is generated using the base window and the background information, the exchange of information may be small. Even when a non-rectangular window or a part of the window is transparent, the snapshot extraction method using the shared memory 133 and the drawing process using the boundary data make use of the features of each OS without imposing a burden on the system. Drawing is possible. This function is particularly effective in an embedded GUI system or the like.

  It should be noted that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  For example, in the above-described embodiments, the hardware configuration has been described. However, the present invention is not limited to this, and any processing can be realized by causing the CPU to execute a computer program. In this case, the computer program can be provided by being recorded on a recording medium, or can be provided by being transmitted via the Internet or another transmission medium.

It is the schematic which shows the image display apparatus concerning a reference example. It is the schematic which shows the image display apparatus concerning the Example of this invention. It is a figure which shows the detail of the image display apparatus concerning the Example of this invention. It is a sequence diagram which shows operation | movement of the image display apparatus concerning the Example of this invention. It is a figure for demonstrating the window control method in the Example of this invention. It is a figure explaining the method to convert from snapshot data to boundary data. It is a figure explaining the method of extracting the boundary data of a non-rectangular window.

Explanation of symbols

10 Window generator 11, 21 OS
12, 22 APM
101, 201 Drawing system 102, 202 Application 20 Window generation unit 41 Display screen 70 Save area 71, 72 HW layer 100 Image display device 121 Information acquisition unit 122 Arrangement command generation unit 133 Shared memory 711, 712, 715, 721, 722, 725 window

Claims (16)

When image information of an image drawn on each of the plurality of display layers to be combined is acquired and the display order of the first display layer is lower than that of the second display layer, the first and An image drawn on the first display layer to be displayed when the second display layer is synthesized is detected as a specific image, and a transparent image for displaying the specific image is generated on the second display layer. Have a management department,
The management unit
An information acquisition unit that acquires an arrangement position and display priority information of an image drawn on each of the plurality of display layers to be combined from an image generation unit corresponding to each display layer;
When the display order of the first display layer is lower than that of the second display layer and the shape of the specific image is a non-rectangular shape, the first and second displays are based on the arrangement information and the display priority information. An instruction generation unit that detects an image drawn on the first layer to be displayed at the time of layer synthesis as the specific image, and generates a transparent image for displaying the specific image on the second display layer; Have
When the shape of the specific image is a non-rectangular shape, the information acquisition unit acquires rectangular information including the specific image and background information for identifying the specific image and other regions as the image information. image display system that. The management unit is a non-rectangular first image drawn on the first display layer based on the arrangement information and the display priority information, and a second image drawn on the second display layer the image display system according to claim 1, wherein the positions overlap and the display priority information and detecting high image than display priority of the second image as the specific image and. The instruction generation unit, an image display system according to claim 1 or 2 wherein wherein detecting the contour of the specific image the background information as a threshold. The command generation unit detects an outline of the specific image by determining whether each pixel value is a background with the background information as a threshold value from the top, bottom, left, and right of a rectangular region including the specific image. The image display system according to any one of claims 1 to 3 . The command generation unit searches for a rectangular region including the specific image using the background information as a threshold, detects an arbitrary point constituting the outline of the specific image, and determines a surrounding pixel value as a threshold from the point the image display system of any one of claims 1 to 3, characterized in that for detecting the contour of the specific image by. Said plurality of display layers, was synthesized in accordance with a predetermined display order, any one of claims 1 to 5, characterized in further comprises a combining unit which generates a single screen information to be displayed on the display unit The image display system described. The transmitted image may be generated as information for erasing the image information of the corresponding section of the display layer, or any one of claims 1 to 6 transmission bits is characterized in that the image information set 1 The image display system according to item. It has 1st and 2nd management part which manages the image displayed on the said 1st and 2nd display layer, respectively, The said 1st and 2nd management part operate | moves on different OS, respectively The image display system according to any one of claims 1 to 7 . The first and second management units are provided corresponding to the first and second management units and draw images on the first and second display layers in accordance with instructions generated by the first and second management units. 9. The image display system according to claim 8 , further comprising an image generation unit, wherein the first and second image generation units operate on different OSs. The image display system of any one of claims 1 to 9, wherein the image drawn on the display layer is the window. A program for causing a computer to execute a predetermined operation,
When image information of an image drawn on each of the plurality of display layers to be combined is acquired and the display order of the first display layer is lower than that of the second display layer, the first and An image drawn on the first display layer to be displayed when the second display layer is synthesized is detected as a specific image, and a transparent image for displaying the specific image is generated on the second display layer. Has a management process,
The management process includes
An information acquisition step of acquiring an arrangement position and display priority information of an image drawn on each of the plurality of display layers to be combined from an image generation unit corresponding to each display layer;
When the display order of the first display layer is lower than that of the second display layer and the shape of the specific image is a non-rectangular shape, the first and second displays are based on the arrangement information and the display priority information. A command generation step of detecting an image drawn on the first layer to be displayed at the time of layer synthesis as the specific image, and generating a transparent image for displaying the specific image in the second display layer; Including
In the information acquisition step, when the shape of the specific image is a non-rectangular shape, rectangular information including the specific image and background information for identifying the specific image and other regions are acquired as the image information. program to be. In the management step, a non-rectangular first image drawn on the first display layer based on the arrangement information and the display priority information, and a second image drawn on the second display layer 12. The program according to claim 11 , wherein an image whose arrangement position overlaps and whose display priority information is higher than the display priority of the second image is detected as the specific image. The program according to claim 11 or 12, wherein, in the command generation step, an outline of the specific image is detected using the background information as a threshold value. When image information of an image drawn on each of the plurality of display layers to be combined is acquired and the display order of the first display layer is lower than that of the second display layer, the first and An image drawn on the first display layer to be displayed when the second display layer is synthesized is detected as a specific image, and a transparent image for displaying the specific image is generated on the second display layer. Has a management process,
The management process includes
An information acquisition step of acquiring an arrangement position and display priority information of an image drawn on each of the plurality of display layers to be combined from an image generation unit corresponding to each display layer;
When the display order of the first display layer is lower than that of the second display layer and the shape of the specific image is a non-rectangular shape, the first and second displays are based on the arrangement information and the display priority information. A command generation step of detecting an image drawn on the first layer to be displayed at the time of layer synthesis as the specific image, and generating a transparent image for displaying the specific image in the second display layer; Including
In the information acquisition step, when the shape of the specific image is a non-rectangular shape, rectangular information including the specific image and background information for identifying the specific image and other regions are acquired as the image information. image display method. In the management step, a non-rectangular first image drawn on the first display layer based on the arrangement information and the display priority information, and a second image drawn on the second display layer The image display method according to claim 14 , wherein an image whose arrangement position overlaps and whose display priority information is higher than the display priority of the second image is detected as the specific image. 16. The image display method according to claim 14, wherein in the command generation step, an outline of the specific image is detected using the background information as a threshold value.

Images