JP3801082B2 - Screen image transmission system and method, and screen image transmission program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a screen image transmission system and method for transmitting a screen image of an information processing apparatus to another information processing apparatus, and a screen image transmission program.
[0002]
[Prior art]
As a conventional system having a function of transmitting a screen image of an information processing apparatus to another information processing apparatus, “VNC” (manufactured by AT & T), “WinShare” (manufactured by NEC), “Desktop On-Call” (manufactured by IBM Japan) ), And “pcANYWHERE32” (manufactured by Symantec). In these remote operation systems, the information processing apparatus 1 to be remotely operated and the information processing apparatus 2 at the user's hand inputting the remote operation are both computers having a GUI (graphical user interface). The screen of the information processing apparatus 1 can be displayed on the information processing apparatus 2 by transmitting the screen image of the apparatus 1 to the information processing apparatus 2 at hand of the user who inputs the remote operation. The GUI is characterized by visually displaying objects (referred to as GUI parts) such as windows, menus, buttons, and icons on a screen, and selecting the GUI parts using a pointing device such as a mouse. User interface.
[0003]
[Problems to be solved by the invention]
When the screen image of the information processing device 1 is transmitted to another information processing device 2 and displayed on the screen of the information processing device 2, the display reproducibility of the screen image and the information processing device 1 and the information processing device 2 There is a trade-off relationship with the amount of communication data. That is, if the screen image of the information processing apparatus 1 is compressed using a lossless compression method and then transmitted, and the information processing apparatus 2 receives, restores, and displays the compressed screen image, the display reproducibility is Although it is high, the amount of communication data becomes larger than when using a compression method with loss (because the compression method with loss generally has a higher compression rate than the compression method without loss). This is because when the same data is compressed, the amount of data after compression becomes smaller). On the other hand, when compression is performed using a compression method with loss, the amount of communication data can be kept small, but display reproducibility is inferior to that when a compression method without loss is used.
[0004]
Therefore, it can be said that a device for appropriately balancing the display reproducibility and the amount of communication data is necessary. For example, in the screen image of the information processing apparatus 1, the area where the display reproducibility on the screen of the information processing apparatus 2 should be high is not the entire screen but only a part of the area, and the display reproducibility for other areas. If it is acceptable, the display reproducibility and the amount of communication data can be appropriately balanced by processing the partial area and the remaining area separately. However, in order to perform such processing, a means for extracting information (screen information) indicating what information is displayed on the screen of the information processing apparatus 1 must be provided. For example, when the screen of the information processing apparatus 1 is a GUI screen, it is necessary to extract information about what GUI component is displayed.
[0005]
However, the conventional screen image transmission / reception and display in the above-described remote operation system does not include such screen information extraction means, and only handles the screen image as a simple image. There is a problem that it cannot be said that the balance of communication data amount is properly adjusted.
[0006]
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a screen image transmission system and method capable of appropriately balancing display reproducibility and communication data amount. It is to provide a screen image transmission program.
[0007]
[Means for Solving the Problems]
A screen image transmission system according to the present invention includes a screen information acquisition unit that acquires screen information of an information processing device, and a screen image acquired by the screen image acquisition unit, among the screen information acquired by the screen information acquisition unit. Different image compression in certain screen element areas and other areas Compress by method A screen image processing unit that processes the screen image processed by the screen image processing unit; and a screen image transmission unit that transmits the screen image processed by the screen image processing unit to another information processing apparatus.
A screen image transmission system according to the present invention includes a screen information acquisition unit that acquires screen information of an information processing device, and a screen information monitor that monitors a specific screen element in the screen information acquired by the screen information acquisition unit. And when the specific screen element is found by the screen information monitoring means, the screen image acquired by the screen image acquisition means is the region of the specific screen element found by the screen information monitoring means. Different image compression for other areas Compress by method A screen image processing unit that processes the screen image processed by the screen image processing unit; and a screen image transmission unit that transmits the screen image processed by the screen image processing unit to another information processing apparatus.
[0008]
In the screen image transmission system of the present invention, the screen information acquisition unit acquires the screen information of the information processing apparatus, and the screen image acquired by the screen image acquisition unit is included in the screen information acquired by the screen information acquisition unit. Different image compression for specific screen element areas and other areas Compress by method The screen image processing means processes the processed screen image, and the screen image transmission means transmits the screen image processed by the screen image processing means to another information processing apparatus, so that all the screen images are processed uniformly. Compared to the case where processing is performed, the balance between display reproducibility and communication data amount is optimized.
In the screen image transmission system of the present invention, the screen information acquisition unit acquires the screen information of the information processing apparatus, and the screen information monitoring unit monitors a specific screen element in the screen information acquired by the screen information acquisition unit. When the specific screen element is found by the screen information monitoring unit, the screen image acquired by the screen image acquiring unit is changed to the region of the specific screen element detected by the screen information monitoring unit. Different image compression for areas other than Compress by method The screen image processing means processes the processed screen image, and the screen image transmission means transmits the screen image processed by the screen image processing means to another information processing apparatus, so that the entire screen image is uniformly processed. Compared to the case where processing is performed, the balance between display reproducibility and communication data amount is optimized.
[0009]
The screen image transmission method according to the present invention includes a screen information acquisition step for acquiring screen information of an information processing device, and a screen image acquired by the screen image acquisition step, among the screen information acquired by the screen information acquisition step. Different image compression in certain screen element areas and other areas Compress by method A screen image processing step for processing the screen image, and a screen image transmission step for transmitting the screen image processed by the screen image processing step to another information processing apparatus.
A screen image transmission method according to the present invention includes a screen information acquisition step for acquiring screen information of an information processing device, and a screen information monitor for monitoring a specific screen element in the screen information acquired by the screen information acquisition step. And when the specific screen element is found by the screen information monitoring step, the screen image acquired by the screen image acquisition step is the region of the specific screen element found by the screen information monitoring step. Different image compression for other areas Compress by method A screen image processing step for processing the screen image, and a screen image transmission step for transmitting the screen image processed by the screen image processing step to another information processing apparatus.
[0010]
In the screen image transmission method of the present invention, the screen information of the information processing apparatus is acquired in the screen information acquisition step, and the screen image acquired in the screen image acquisition step is included in the screen information acquired in the screen information acquisition step. Different image compression for specific screen element areas and other areas Compress by method The screen image is processed in the screen image processing step, and the screen image processed in the screen image processing step is transmitted to another information processing apparatus in the screen image transmission step, so that all the screen images are processed uniformly. Compared to the case where processing is performed, the balance between display reproducibility and communication data amount is optimized.
The screen image transmission method of the present invention acquires screen information of an information processing device in a screen information acquisition step, and monitors a specific screen element in the screen information acquired in the screen information acquisition step in a screen information monitoring step. When the specific screen element is found by the screen information monitoring step, the screen image acquired by the screen image acquisition step is changed to the region of the specific screen element found by the screen information monitoring step. Different image compression for areas other than Compress by method The screen image is processed in the screen image processing step, and the screen image processed in the screen image processing step is transmitted to another information processing apparatus in the screen image transmission step, so that all the screen images are processed uniformly. Compared to the case where processing is performed, the balance between display reproducibility and communication data amount is optimized.
[0011]
A screen image transmission program according to the present invention includes: Computer Screen image acquisition that acquires the screen image displayed on the information processing device means Screen information acquisition for acquiring screen information of the information processing apparatus means , The screen image acquired by the screen information acquisition unit is converted into a screen image compressed by a different screen compression method in the area of the specific screen element in the screen information acquired by the screen information acquisition unit and the other area. Screen image compression means for processing, processed by the screen image processing means Screen image transmission that transmits a screen image to another information processing device Function as a means It is characterized by that.
A screen image transmission program according to the present invention includes: Computer Screen image acquisition that acquires the screen image displayed on the information processing device means Screen information acquisition for acquiring screen information of the information processing apparatus means , Get screen information means Screen information monitoring for monitoring a specific screen element in the screen information acquired by means , Screen information monitoring means When the specific screen element is found by the acquisition of the screen image means The screen image acquired by the screen information monitoring means Different image compression in the area of the specific screen element and other areas found by Compress by method Screen image processing to process the selected screen image means , The screen image processing means Screen image transmission for transmitting the screen image of the information processing device processed by the above to another information processing device Function as a means It is characterized by that.
[0012]
The screen image transmission program of the present invention includes: Computer Acquire screen image displayed on information processing device means To obtain the screen information of the information processing device. means To obtain the screen information. means Acquired by The screen image is processed by the screen image processing means for processing the screen image into a screen image compressed by a different image compression method in the area of the specific screen element in the screen information acquired by the screen information acquisition means and the other area. And processed by the screen image processing means Send screen image to screen image means Send to another information processing device with To function like In this way, the balance between display reproducibility and communication data volume is optimized.
The screen image transmission program of the present invention includes: Computer Acquire screen image displayed on information processing device means To obtain the screen information of the information processing device. means To obtain the screen information. means Screen information monitoring for specific screen elements in the screen information acquired by means And monitor the screen information means When the specific screen element is discovered by the acquisition of the screen image means The screen image acquired by the above screen information monitoring means Different image compression in the area of the specific screen element found by and other areas Compress by method Screen image processing means And processing the screen image means The screen image of the information processing device processed by means Send to another information processing device with To function like Thus, the balance between display reproducibility and communication data amount is optimized as compared with the case where uniform processing is performed on all the screen images.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a screen image transmission system according to the first embodiment of this invention.
The screen information acquisition unit 101 acquires screen information of the information processing apparatus 1. In this embodiment, the information processing apparatus 1 is an apparatus provided with a GUI (graphical user interface). For example, assume that the screen of the information processing apparatus 1 is as shown in FIG. In the example of FIG. 2, three windows 201, 202, and 203 are displayed in the screen 200, and the titles of the windows are “AAA”, “BBB”, and “CCC”, respectively. Among these windows, an active window (a window in a state of receiving input) is the window 202. At this time, the screen information acquisition unit 101 acquires information regarding these windows.
[0014]
Although the method of acquiring the GUI screen information itself is not within the scope of claims of the present application, for example, the document: Human Interface Symposium '98 Lecture Collection, pages 61-66 (1998) has acquired GUI screen information (and The method of recording) is described.
[0015]
The screen image acquisition unit 103 acquires a screen image (screen image data) of the information processing apparatus 1. The screen image processing unit 102 processes the screen image acquired by the screen image acquisition unit 103 based on the screen information acquired by the screen information acquisition unit 101.
As an example, the screen image processing means 102 divides the screen image into an active window area and other areas, and uses the compression method 1 for the active window area and the compression method 2 for the other areas. The image shall be compressed. However, the compression method 1 is lossless and can be restored without loss, and the compression method 2 is irreversible compression and has a loss at the time of restoration. However, the compression rate is superior to the compression method 1 (that is, the data size is larger). Can be reduced). Further, the screen of the information processing apparatus 1 is the screen 200 of FIG. In this case, since the window 202 is an active window, the screen image processing unit 102 applies the compression method 1 to the area of the window 202 and the compression method 2 to the other areas of the screen image of the screen 200. Use to compress. This example is referred to as Example 1-1.
[0016]
The screen image data processed by the screen image processing means 102 is transmitted by the screen image transmitting means 104, and this screen image is received by the screen image receiving means 105 of the information processing apparatus 2 and displayed by the screen image display means 106. Is done.
In the case of Example 1-1, a screen image compressed by using the compression method 1 is transmitted / received in the area of the window 202 in FIG. Is displayed.
[0017]
The effects obtained in the case of Example 1-1 are as follows.
First, as compared with the case where the entire screen image is compressed by the compression method 1, the amount of data transmitted and received can be further reduced. Further, since the screen image of the active window area can be restored without loss compared to the case where the entire screen image is compressed by the compression method 2, the active window area has high display reproducibility.
[0018]
As another example (referred to as Example 1-2), the screen image processing unit 102 cuts out only the active window area from the screen image, deletes the other areas, and compresses the remaining screen image using the compression method 1. It shall be compressed by. However, the compression method 1 is the same as Example 1-1. Further, it is assumed that the screen of the information processing apparatus 1 is as the screen 200 of FIG. In this case, since the window 202 is an active window, the screen image processing means 102 cuts out only the area of the window 202 from the screen image of the screen 200 in FIG. The screen image is compressed by the compression method 1. Accordingly, the screen image data transmitted from the screen image transmission means 104 is only the screen image of the area of the window 202, and the amount of communication data can be further reduced as compared with the case of Example 1-1.
[0019]
In a general window system, there is only one active window at the same time. However, if there are two or more active windows, the areas of all the windows may be cut out.
[0020]
As yet another example (referred to as Example 1-3), the “active window” in Example 1-1 can be replaced with “the window in the foreground in the depth direction”. However, the window in the foreground in the depth direction is a window that is displayed in front of the window even if it overlaps with any other window, and as a result, is not hidden by the other window. When the active window is always displayed in the foreground, the processing results of Example 1-1 and Example 1-3 are the same.
[0021]
As yet another example (referred to as Example 1-4), the “active window” in Example 1-2 can be replaced with a “window in the foreground in the depth direction”. When the active window is always displayed in the foreground, the processing results of Example 1-2 and Example 1-4 are the same.
[0022]
As yet another example (referred to as Example 1-5), the “active window” in Example 1-1 can be replaced with “all windows whose specific keyword is included in the window title”. For the purpose of explaining Example 1-5, it is assumed that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. In the example of FIG. 3, three windows 301 to 303 are displayed in the screen 200, and the titles of the windows are “mail”, “send mail”, and “memo pad”, respectively. Of these windows, the active window is the window 302. Further, it is assumed that the specific keyword is “mail”. In this case, the screen image processing means 102 uses the compression method 1 for the area of the window 301 and the area of the window 302 and the compression method 2 for the other areas of the screen image of the screen 200 of FIG. Compress.
[0023]
As yet another example (referred to as Example 1-6), the “active window” in Example 1-2 can be replaced with “all windows whose specific keyword is included in the window title”. Similarly to Example 1-5, it is assumed that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. 3 and that the specific keyword is “mail”. In this case, the screen image processing unit 102 cuts out the area of the window 301 and the area of the window 302 from the screen image of the screen 200, and compresses the cut out two screen images using the compression method 1.
[0024]
As yet another example (referred to as Example 1-7), the “active window” in Example 1-2 can be replaced with “a specific type of GUI component”. For the purpose of explaining Example 1-7, it is assumed that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. In the example of FIG. 4, two windows 401 and 402 are displayed in the screen 200, and a GUI component 403 displayed in the window 402 is a GUI component that displays and edits text data. This GUI part for displaying and editing text data is assumed to be a GUI part of the type “TEXTEDIT”. Further, it is assumed that the specific type of GUI component for which the screen image processing unit 102 specifies the area is a TEXTEDIT GUI component. In this case, the screen image processing unit 102 compresses the screen image of the screen 200 using the compression method 1 for the area of the GUI component 403 and the compression method 2 for the other areas.
[0025]
The effects obtained in the case of Example 1-7 are as follows. When the compression rate of the compression method 2 is very high and the loss is large, the data size is reduced and the amount of communication data can be reduced. On the other hand, when the restored screen image is displayed, the compression method 2 is applied. There is a possibility that characters included in the area may be crushed and become unreadable (especially when the font size of the characters is small). However, in this example, the area of the GUI component for displaying / editing text data is compressed not by the compression method 2 but by the compression method 1 without loss. Therefore, when the restored screen image is displayed, the GUI for displaying / editing the text data is displayed. The part area has high display reproducibility, and the text displayed in the GUI part can be read clearly.
[0026]
As a further variation of Example 1-7, when there are two or more specific types of GUI parts, for example, a menu part (MENU), a button part (BUTTON), a text data display editing part (TEXTEDIT) The same applies to all cases.
[0027]
Further, a combination of Example 1-1 or Example 1-2 and Example 1-7 is also possible. That is, an area of a specific type of GUI part displayed in the active window is the target of the compression method 1. In this case, even if there is a specific type of GUI component in an inactive window, the compression method 2 is applied to the area of the GUI component instead of the compression method 1.
[0028]
As yet another example (referred to as Example 1-8), the “active window” in Example 1-2 can be replaced with “a specific type of GUI component”. For the purpose of explaining Example 1-8, it is assumed that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. 4 as in Example 1-7. In this case, the screen image processing unit 102 cuts out only the area of the GUI component 403 from the screen image of the screen 200 in FIG. 4 and compresses the cut-out screen image using the compression method 1.
[0029]
Furthermore, variations exactly the same as those of Example 1-7 are possible for Example 1-8.
[0030]
Next, the screen image transmission system according to the second embodiment of the present invention will be described.
FIG. 5 is a block diagram showing the configuration of the screen image transmission system according to the second embodiment.
In this embodiment, in addition to the first embodiment, the information processing apparatus 2 includes a GUI component specifying unit 500. In the first embodiment, “active window”, “window in the foreground in the depth direction”, “specific type GUI component”, and the like are objects of the cutout and compression method 1. In the embodiment, the GUI component specified by the GUI component specifying unit 500 is the target of the clipping or compression method 1.
As Example 2-1, the screen of the information processing apparatus 1 is the screen 200 of FIG. 2 as in Example 1-1. At this time, the screen image processing unit 102 compresses the entire screen image of the screen 200 of FIG. 2 acquired by the screen image acquisition unit 103 using the compression method 2 of Example 1-1. The compressed screen image is transmitted / received by the screen image transmitting unit 104 and the screen image receiving unit 105 and displayed by the screen image display unit 106. Since the entire screen image displayed by the screen image display means 106 is compressed by the compression method 2, the data size is small, but the display reproducibility is not so high. Therefore, the user of the information processing apparatus 2 designates a GUI component to be displayed more finely using the GUI component designation unit 500 from the screen image displayed by the screen image display unit 106.
[0031]
Specifically, at least one point is pointed on a displayed screen image by a pointing device such as a mouse provided in the information processing apparatus 2. For example, the screen image 200 shown in FIG. 2 displayed by the screen image display means 106 (actually, after the compression / decompression by the compression method 2 is performed, the screen image obtained by the screen image acquisition means 103 is more Suppose that a point inside the window 202 is pointed on.
[0032]
The image image processing unit 102 receives the coordinate value pointed from the GUI component designating unit 500, and further determines which GUI component in the screen 200 of FIG. 2 is the coordinate value. In this example, since the point pointed to was inside the window 202, it is determined that the designated GUI component is the window 202. The same applies when a plurality of points are specified. For example, when one point is specified inside each of the window 202 and the window 201, the GUI in which the window 202 and the window 201 are specified is specified. Judged as a part. Further, since the designated GUI component is determined to be the window 202, the image image processing unit 102 compresses the area of the window 202 using the compression method 1 and the other area using the compression method 2. Subsequent operations are basically the same as those in Example 1-1.
[0033]
As a result, in the next screen image displayed by the screen image display means 106, the area of the window 202 is displayed with high definition, and the display reproducibility of the area is improved. In this example 2-1, the processing after the GUI component is designated by the GUI designating component 500 is the same processing as the example 1-1, that is, the compression method 1 and the compression method 2 are selectively used.
[0034]
As another example (referred to as Example 2-2), the processing after the GUI component is designated by the GUI designating component 500 is the same processing as in Example 1-2, that is, the region extraction and compression method. A process of performing compression by 1 can also be used. In Example 2-2, as in Example 2-1, the entire screen image acquired by the screen image acquisition unit 103 is initially compressed by the compression method 2. However, the GUI component is specified by the GUI component specifying unit 500. After that, only the designated GUI part area is cut out, and the cut-out screen image is compressed using the compression method 1.
[0035]
Next, a screen image transmission system according to a third embodiment of the present invention will be described.
FIG. 6 is a block diagram showing the configuration of the screen image transmission system of the third embodiment.
In this embodiment, the information processing apparatus 1 includes a screen information monitoring unit 600. The screen information acquisition unit 101 acquires the screen information of the information processing apparatus 1 every time the screen of the information processing apparatus 1 changes or every predetermined fixed time (for example, 10 seconds).
The screen information monitoring unit 600 monitors whether the screen information acquired by the screen information acquisition unit 101 includes information regarding a specific type of GUI component, and only when the information is included, the screen image acquisition unit A command for acquiring a screen image is issued to 103.
[0036]
As an example 3-1, it is assumed that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. 7 and subsequently changed as shown in the screen 200 of FIG. That is, at the time of the screen 200 in FIG. 7, one window 701 is displayed in the screen, and the window 801 is newly displayed, resulting in the screen 200 in FIG. However, unlike the window 701, the window 801 is a warning message display window which is a kind of a special type of window, and the warning message display window is a window of the type “ALERTWIN”. Furthermore, it is assumed that the specific type of GUI component monitored by the screen information monitoring unit 600 is a type of window called ALERTWIN. In this case, the screen information monitoring unit 600 does not include a window of the type “ALERTWIN” in the screen information acquired by the screen information acquisition unit 101 at the time of the screen of FIG. Do not issue an instruction to obtain a screen image. On the other hand, at the time of the screen in FIG. 8, since there is a window of the type “ALERTWIN” in the screen information acquired by the screen information acquisition unit 101, a command for acquiring a screen image to the screen image acquisition unit 103. Issue.
[0037]
When the screen image acquisition unit 103 receives a command from the screen information monitoring unit 600, the screen image acquisition unit 103 acquires a screen image of the information processing apparatus 1. This screen image is transmitted / received by the screen image transmitting means 104 and the screen image receiving means 105 and displayed by the screen image display means 106.
[0038]
As another example (referred to as Example 3-2), the GUI component of the specific type monitored by the screen information monitoring unit 600 displays a character string “new mail is coming” inside. Suppose that the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. 9 and then changes as shown in the screen 200 of FIG. That is, at the time of the screen 200 in FIG. 9, it is assumed that one window 901 is displayed in the screen, and that the window 1001 is newly displayed, resulting in the screen 200 in FIG. In this case, the screen information monitoring unit 600 displays a character string “new mail is coming” in the screen information acquired by the screen information acquiring unit 101 at the time of the screen of FIG. Since there is no window, a command for acquiring a screen image is not issued to the screen image acquiring unit 103. On the other hand, at the time of the screen of FIG. 10, the screen information acquired by the screen information acquisition unit 101 includes a window (window 1001) displaying a character string “new mail is coming” inside. Therefore, a command for acquiring a screen image is issued to the screen image acquiring unit 103. The subsequent processing is the same as in Example 3-1.
[0039]
As can be seen from Example 3-1 and Example 3-2 described above, the screen image transmission system according to this embodiment indicates that when specific information is displayed on the screen of the information processing apparatus 1. It detects and transmits and displays the screen image of the information processing apparatus 1 on the information processing apparatus 2. Thereby, the occurrence of an event that can be detected by the screen change of the information processing apparatus 1 can be effectively remotely monitored. Further, since the transmission of the screen image from the information processing apparatus 1 to the information processing apparatus 2 is limited only when specific information is displayed on the information processing apparatus 1, the screen of the information processing apparatus 1 has changed. Compared to the case where the screen image is always transmitted, the communication data amount can be reduced.
[0040]
Next, a screen image transmission system according to a fourth embodiment of the present invention will be described.
FIG. 11 is a block diagram illustrating a configuration of a screen image transmission system according to the fourth embodiment of this invention.
In this embodiment, the screen image processing means 102 included in the first embodiment is added to the screen image transmission system of the third embodiment. That is, in the screen image transmission system of the third embodiment, the screen image acquired by the screen image acquisition unit 103 is transmitted and received as it is, but in this embodiment, the screen image of the first embodiment is used. As in the case of the moving image transmission system, the screen image acquired by the screen image acquisition unit 103 is processed by the screen image processing unit 102 and then transmitted and received.
[0041]
As Example 4-1, similarly to Example 3-1, the screen of the information processing apparatus 1 is as shown in the screen 200 of FIG. 7 and subsequently changed as shown in the screen 200 of FIG. It is assumed that the specific type of GUI component monitored by the information monitoring unit 600 is a window of a type called ALERTWIN. In this case, the screen information monitoring unit 600 issues a command for acquiring a screen image to the screen image acquiring unit 103 at the time of the screen 200 in FIG.
When the screen image acquisition unit 103 receives a command from the screen information monitoring unit 600, the screen image acquisition unit 103 acquires a screen image of the information processing apparatus 1. Next, the screen image processing means 102 divides the screen image acquired by the screen image acquisition means 103 into a window area of type ALERTWIN and other areas, and the window area of type ALERTWIN uses compression method 1. In other areas, the compression method 2 is used to compress the screen image. The compression method 1 and the compression method 2 are the same compression methods as in Example 1-1.
The screen image processed in this way by the screen image processing means 102 is transmitted / received by the screen image transmitting means 104 and the screen image receiving means 105 and displayed by the screen image display means 106.
[0042]
In this example 4-1, the screen image processing method in the screen image processing means 102 is a method for selectively using the compression method 1 and the compression method 2 as in the method in the example 1-1.
[0043]
On the other hand, as another example (referred to as Example 4-2), the screen image processing method in the screen image processing means 102 is cut out and compressed by the compression method 1 in the same manner as the method in Example 1-2. This is also possible. In this example 4-2, the screen image processing means 102 cuts out the area of the window of type ALERTWIN and deletes other areas from the screen image of the screen 200 of FIG. The image is compressed using compression method 1.
[0044]
As can be seen from Example 4-1 and Example 4-2 described above, the screen image transmission system according to this embodiment includes information from the information processing apparatus 1 in addition to the screen image transmission system according to the third embodiment. It is possible to further reduce the data amount of the screen image transmitted to the processing device 2.
[0045]
Next, an example of the configuration of the screen image transmission source computer 1200 in each of the embodiments described above will be described. FIG. 12 is a block diagram showing the configuration of the computer 1200. The computer 1200 is connected to the Internet via an Internet connection device 1214 (modem, terminal adapter, dial-up router, etc.). Thereby, the information processing apparatus 1200 can transmit a screen image to another information processing apparatus via the Internet. Further, a display 1213 which is a display device, a keyboard 1209 and a mouse 1212 which are input devices are provided.
In a computer 1200 shown in FIG. 12, a computer program for realizing the functions described in the above embodiments is stored in a ROM 1202, a hard disk 1206, a DVD 1205 (Digital Versatile Disc), a CD (Compact Disc) 1208, and an FD (Flexible Disc). It can be recorded on various recording media such as 1211, read out to the RAM 1203, and executed by the CPU 1201. Further, when recorded on the DVD 1205, the CD 1208, and the FD 1211, the data can be read via the DVD drive 1204, the CD drive 1207, and the FD drive 1210, respectively.
[0046]
The preferred embodiments and examples have been described above, but the present invention is not necessarily limited to the above-described embodiments and examples, and various modifications can be made within the scope of the technical idea. .
[0047]
【The invention's effect】
As described above, according to the present invention, it is possible to optimize the balance between the display reproducibility on the screen of the transmission destination information processing apparatus and the amount of communication data between the transmission source and transmission destination information processing apparatuses. is there.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a screen image transmission system according to a first embodiment of the present invention.
FIG. 2 is a diagram showing an example of a screen of the information processing apparatus as a transmission source according to the first embodiment of the present invention.
FIG. 3 is a diagram illustrating a screen example of a transmission source information processing apparatus according to the first embodiment of the present invention;
FIG. 4 is a diagram showing an example of a screen of a transmission source information processing apparatus according to the first embodiment of the present invention;
FIG. 5 is a block diagram showing a configuration of a screen image transmission system according to a second embodiment of the present invention.
FIG. 6 is a block diagram showing a configuration of a screen image transmission system according to a third embodiment of the present invention.
FIG. 7 is a diagram illustrating a screen example of an information processing apparatus as a transmission source according to the third embodiment of the present invention.
FIG. 8 is a diagram illustrating a screen example of a transmission source information processing apparatus according to a third embodiment of the present invention;
FIG. 9 is a diagram illustrating a screen example of an information processing apparatus as a transmission source according to the third embodiment of the present invention.
FIG. 10 is a diagram illustrating a screen example of a transmission source information processing apparatus according to a third embodiment of the present invention;
FIG. 11 is a block diagram showing a configuration of a screen image transmission system according to a fourth embodiment of the present invention.
FIG. 12 is a block diagram showing an example of the configuration of a screen image transmission source computer of the screen image transmission system of the present invention.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1, 2 ... Information processing apparatus, 101 ... Screen information acquisition means, 102 ... Screen image processing means, 103 ... Screen image acquisition means, 104 ... Screen image transmission means, 600 ... Screen information monitoring means.

Claims (9)

In a screen image transmission system comprising screen image acquisition means for acquiring a screen image to be displayed on the information processing apparatus, and screen image transmission means for transmitting the screen image of the information processing apparatus to another information processing apparatus,
Screen information acquisition means for acquiring screen information of the information processing apparatus; a screen image acquired by the screen image acquisition means; a region of a specific screen element in the screen information acquired by the screen information acquisition means; Screen image processing means for processing into a screen image compressed by an image compression method different from other areas, and the screen image transmission means is a separate information processing apparatus for processing the screen image processed by the screen image processing means. A screen image transmission system characterized by transmitting to the screen. In a screen image transmission system comprising screen image acquisition means for acquiring a screen image to be displayed on the information processing apparatus, and screen image transmission means for transmitting the screen image of the information processing apparatus to another information processing apparatus,
Screen information acquisition means for acquiring screen information of the information processing apparatus;
Screen information monitoring means for monitoring a specific screen element in the screen information acquired by the screen information acquisition means;
When the specific screen element is found by the screen information monitoring means, the screen image acquired by the screen image acquisition means is the region of the specific screen element found by the screen information monitoring means and the others. Screen image processing means for processing into a screen image compressed by a different image compression method in the area of
The screen image transmission system transmits the screen image processed by the screen image processing unit to another information processing apparatus.   The screen image transmission system according to claim 1, wherein the screen information acquisition unit acquires screen information of a GUI component displayed on the screen of the information processing apparatus. In a screen image transmission method comprising a screen image acquisition step of acquiring a screen image to be displayed on the information processing device, and a screen image transmission step of transmitting the screen image of the information processing device to another information processing device,
Screen information acquisition step for acquiring screen information of the information processing apparatus;
The screen image acquired by the screen image acquisition step is converted into a screen image compressed by a different image compression method in the region of the specific screen element in the screen information acquired by the screen information acquisition step and the other region. A screen image processing step for processing,
The screen image transmission step includes transmitting the screen image processed in the screen image processing step to another information processing apparatus. In a screen image transmission method comprising a screen image acquisition step of acquiring a screen image to be displayed on the information processing device, and a screen image transmission step of transmitting the screen image of the information processing device to another information processing device,
Screen information acquisition step for acquiring screen information of the information processing apparatus;
A screen information monitoring step for monitoring a specific screen element in the screen information acquired by the screen information acquisition step;
When the specific screen element is discovered by the screen information monitoring step, the screen image acquired by the screen image acquisition step is the region of the specific screen element discovered by the screen information monitoring step and the others. A screen image processing step for processing into a screen image compressed by an image compression method different from that of the area of
The screen image transmitting step transmits the screen image processed by the screen image processing step to another information processing apparatus.   The screen image transmission method according to claim 4, wherein the screen information acquisition step acquires screen information of a GUI component displayed on the screen of the information processing apparatus. A screen image transmission program for causing a computer to function as means for transmitting a screen image of an information processing device to another information processing device,
Computer
Screen image acquisition means for acquiring a screen image to be displayed on the information processing apparatus;
Screen information acquisition means for acquiring screen information of the information processing apparatus;
The screen image acquired by the screen image acquisition unit is converted into a screen image compressed by a different image compression method in the area of the specific screen element in the screen information acquired by the screen information acquisition unit and the other area. Screen image processing means to process,
Screen image transmission means for transmitting the screen image processed by the screen image processing means to another information processing apparatus;
A screen image transmission program characterized by functioning as: A screen image transmission program for causing a computer to function as means for transmitting a screen image of an information processing device to another information processing device,
Computer
Screen image acquisition means for acquiring a screen image to be displayed on the information processing apparatus;
Screen information acquisition means for acquiring screen information of the information processing apparatus;
Screen information monitoring means for monitoring a particular screen element in said screen information acquired by the screen information acquisition unit,
When the specific screen element is found by the screen information monitoring means , the screen image acquired by the screen image acquisition means is the region of the specific screen element found by the screen information monitoring means and the others. Screen image processing means for processing into a screen image compressed by an image compression method different from the area of
The screen image transmitting means for transmitting a screen image of the information processing apparatus processed by the screen image processing means to another information processing apparatus;
A screen image transmission program characterized by functioning as: The screen image transmission program according to claim 7, wherein the screen information acquisition unit acquires screen information of a GUI component displayed on the screen of the information processing apparatus.

Images