JP5653301B2 - Terminal remote system, remote control method, program for remote system - Google Patents

Description

  The present invention relates to a remote system, a remote control method, and a remote system program for remotely supporting a user terminal connected via a public network.

  In recent years, various services are provided to users by connecting a mobile terminal connected to a public network to a Web server or the like. In particular, with the advent of smartphones (high-function mobile phones), it has become possible to perform advanced services that have been provided for personal computers with mobile phones.

  In addition, various functions are installed in the smartphone itself, not the service provided by the server. Therefore, it often takes time for the user to become familiar with all the functions installed. For example, even if a function desired by the user is mounted on a smartphone, the method of setting the function is unknown, so that the user cannot use the function.

  Therefore, in order to make maximum use of such advanced Web services and advanced smartphone functions, the user needs to be familiar with setting operations and functions for the smartphone. Furthermore, when a user unfamiliar with the operation makes settings for the terminal for the first time, setting information that should not be deleted is often deleted, or errors are caused by inappropriate settings. .

  For such a problem, a method for remotely setting a user's terminal or instructing a user from a remote location by performing remote support (remote maintenance) on the user's terminal from the system is known. . For example, in Patent Document 1, the screen information of each client to be supported is acquired on the server side, and the screen information is always displayed in a list on the server, thereby improving the efficiency of support and monitoring for the client. It is disclosed.

Japanese Patent Laid-Open No. 2003-6062

  On the other hand, today's terminals such as smartphones and slate terminals have a vertical display unit and a horizontal display unit. Here, when performing remote support, when displaying the screen information displayed on the display unit of the user's terminal on the support terminal, whether the screen information displayed on the user's terminal is a vertical display, or If the horizontal display cannot be adjusted, it is often difficult for the supporter to support.

  The present invention has been made in view of such problems, and an object thereof is to provide a remote system and a remote control method capable of adjusting the screen on the support side according to the orientation of the vertical display and horizontal display of the terminal. To do.

  The present invention provides the following solutions.

The invention according to the first aspect is a remote system comprising a terminal, a remote terminal for remotely operating the terminal, and a remote server,
The terminal indicates, on the remote server, screen information displayed on the display unit of the terminal and whether the screen information is displayed vertically or horizontally on the display unit. And a module for transmitting the identifier,
The remote server is
A module that receives the screen information displayed on the display unit of the terminal and an identifier indicating the orientation of the screen information and transmits the identifier to the remote terminal;
The remote terminal is
A remote system including a module that receives the screen information and the identifier transmitted from the remote server and displays the screen information in a direction of the screen information based on the identifier.

  According to the first aspect of the invention, the terminal displays, on the remote server, the screen information displayed on the display unit of the terminal and whether the screen information is displayed vertically on the display unit or the horizontal type. The remote server receives the screen information displayed on the display unit of the terminal and the identifier indicating the direction of the screen information, and transmits them to the remote terminal. In response to this, the remote terminal receives the screen information and the identifier transmitted from the remote server, and displays the screen information in the direction of the screen information based on the identifier.

  Therefore, a remote system is provided that can adjust the screen on the support side in accordance with the orientation of the vertical display and horizontal display of the terminal.

  The invention according to the first feature exhibits the same operation and effect not only in the system in the category of the invention but also in the method and the program.

The invention according to the second feature is a remote system comprising a terminal and a remote terminal for remotely operating the terminal,
The terminal indicates the screen information displayed on the display unit of the terminal on the remote terminal and whether the screen information is displayed vertically or horizontally with respect to the display unit. And a module for transmitting the identifier,
The remote terminal is
A remote system including a module that receives the screen information and the identifier transmitted from the terminal and displays the screen information in a direction of the screen information based on the identifier.

  According to the invention relating to the second feature, the terminal displays the screen information displayed on the display unit of the terminal on the remote terminal and whether the screen information is displayed vertically on the display unit. In response, the remote terminal receives the screen information and the identifier transmitted from the terminal, and displays the screen information in the direction of the screen information based on the identifier. indicate.

  Therefore, a remote system is provided that can adjust the screen on the support side according to the orientation of the vertical display and horizontal display of the terminal. However, unlike the invention according to the first aspect, a remote server is required. There is no.

  The invention according to the second feature exhibits the same operation and effect not only in the system in the category of the invention but also in the method and the program.

The invention according to the third feature is the invention according to the first or second feature,
The terminal provides a remote system including a module that determines an identifier indicating a direction of the screen information based on measurement of an acceleration sensor provided in the terminal.

  According to the invention relating to the third feature, the terminal determines an identifier indicating the orientation of the screen information based on measurement of an acceleration sensor provided in the terminal.

  The invention according to a fourth feature is the invention according to the first or second feature, wherein the terminal recognizes the screen information by character recognition of a character displayed on the terminal. Provided is a remote system including a module for determining whether a display is displayed vertically or horizontally.

  According to the present invention, it is possible to provide a remote system and a remote control method capable of adjusting the screen on the support side according to the orientation of the vertical display and horizontal display of the terminal.

FIG. 1 is a configuration diagram of the remote system 1. FIG. 2 is a functional block diagram of the control server 100, the user terminal 10, and the support terminal 150. FIG. 3 is a flowchart illustrating server-type control processing executed by the control server 100, the user terminal 10, and the support terminal 150. FIG. 4 is a flowchart showing a P2P type control process executed by the user terminal 10 and the support terminal 150. FIG. 5 is a vertical screen image diagram displayed on the support terminal 150. FIG. 6 is a vertical screen image diagram displayed on the user terminal 10. FIG. 7 is a horizontal screen image diagram displayed on the support terminal 150. FIG. 8 is a horizontal screen image diagram displayed on the user terminal 10. FIG. 9 is a schematic diagram for explaining the character recognition process.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.

[System configuration of the remote system]
FIG. 1 is a system configuration diagram of a remote system 1 which is a preferred embodiment of the present invention. The remote system 1 includes user terminals 10a and 10b (hereinafter simply referred to as “10”), a control server 100 (remote server), and a public line network 3 (for example, the Internet network, third generation, fourth generation communication network, etc.) And a support terminal 150 (remote terminal).

  The user terminal 10 communicates radio waves with the base station by wireless communication, connects to the exchange from the base station, is connected to the public line network 3, and communicates with the control server 100 via the public line network 3. Connected as possible. The control server 100 and the support terminal 150 may be connected via a LAN (Local Area Network) or may be connected via the public line network 3. Communication in the remote system 1 may be wireless communication or wired communication. In order for the user terminal 10 to connect to the public line network 3, communication may be possible via a network device such as a router.

  The user terminal 10 may be a general information terminal for a user to receive support, and is an information device or an electrical appliance having a function to be described later. The user terminal 10 may be, for example, a white appliance such as a refrigerator or a washing machine in addition to a network device such as a slate terminal 10a, a smartphone 10b, a mobile phone, a composite printer, a television 10a, a router or a gateway, or a computer. Alternatively, it may be a general information home appliance such as a telephone, a netbook terminal, an electronic book terminal, an electronic dictionary terminal, a portable music player, and a portable content playback / recording player.

  The support terminal 150 is a general information terminal used by a support person who supports the user terminal 10.

[Description of each function]
FIG. 2 is a diagram illustrating the functional blocks of the support terminal 150, the control server 100, and the user terminal 10 and the relationship between the functions.

  With reference to FIG. 2, the hardware configuration of each apparatus will be described with reference to a functional block diagram.

  The user terminal 10 is a terminal used by a user who receives remote support. As long as the user terminal 10 includes a control unit 11, a data storage unit 12, a data communication unit 13, an input / output unit 14, and an acceleration sensor 15, a home appliance, a commercial appliance, a portable terminal, and a commercial terminal Either may be sufficient.

  The control unit 11 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The data communication unit 13 is, for example, a WiFi (Wireless Fidelity) device compliant with IEEE 802.11. Alternatively, a wireless device or the like conforming to the IMT-2000 standard such as a third generation mobile communication system is provided (may be a wired LAN connection). Furthermore, the data storage unit 12 includes one or both of an HDD (Hard Disk Drive) and an SSD (Solid State Drive). Further, the input / output unit 14 includes a display unit such as a liquid crystal monitor that displays an image, and an input unit such as a keyboard, a touch panel, and a voice input that accept input from the user.

  The acceleration sensor 15 is a sensor that measures the acceleration of the user terminal 10 and may be any of a mechanical type, an optical type, and a semiconductor type, and the number of detection axes is three axes of the X axis, the Y axis, and the Z axis. It is desirable that By measuring the gravitational acceleration of the earth, the inclination of the user terminal 10 is detected to determine what direction the input / output unit 14 is facing the user. Then, the acceleration sensor 15 determines whether the input / output unit 14 displays the screen information in the vertical type or the screen information in the horizontal type according to the direction, and determines whether the vertical or horizontal identifier is displayed. To decide. Hereinafter, the acceleration sensor 15 will be described as a sensor for determining a vertical or horizontal identifier, but a predetermined sensor such as a gyro sensor may be used as long as the same effect can be obtained.

  The control server 100 is a server that performs remote support settings for the user terminal 10 in response to an operation from the support terminal 150. The control server 100 includes a control unit 101, a data storage unit 102, and a data communication unit 103.

  The control unit 101 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The data communication unit 103 includes a wired or wireless communication device. , HDD (Hard Disk Drive), SSD (Solid State Drive), or the like.

  The support terminal 150 is a terminal used by a supporter who supports the user. The support terminal 150 may be a computer such as a normal personal computer. Since the hardware configuration of the support terminal 150 may be the same as that of the user terminal 10, the description thereof is omitted.

[Server type control processing]
FIG. 3 is a flowchart of server-type control processing executed by the user terminal 10, the control server 100, and the support terminal 150.

  The user terminal 10 receives an operation for requesting support from the user (step S01). An application for receiving remote support is installed in the user terminal 10, and for example, an operation for starting this application is received from the user.

  When the user terminal 10 receives an operation for requesting support from the user (step S01: “YES”), the user terminal 10 connects to the control server 100 to indicate that there is a support request. And the process proceeds to step S02. When the user terminal 10 does not accept an operation requesting support from the user (step S01: “NO”), the process of step S01 is looped.

  Next, the control server 100 requests the user terminal 10 to acquire screen information (step S02).

  In principle, the screen information is the entire screen image displayed on the user terminal 10. For example, when the screen image exists beyond the area of the input / output unit 14 of the user terminal 10 (when there is an area displayed when the screen of the user terminal 10 is scrolled), the area of the display unit is exceeded. Including parts.

  In response to this request, the user terminal 10 transmits the requested screen information to the control server 100 (step S03).

  Next, the control server 100 receives the screen information transmitted from the user terminal 10 and determines an identifier based on the screen information (step S04). Note that the case where the identifier is determined by the control server 100 is a case where the user terminal 10 does not have the acceleration sensor 15 or the predetermined sensor, as will be described later. In this case, whether the input / output unit 14 is displaying the screen information in the vertical type or the screen information in the horizontal type is determined based on the character recognition of the characters displayed on the display unit.

  That is, as illustrated in FIG. 9, an image 90 or an image 91 corresponding to screen information is acquired from the user terminal 10. At this time, the user terminal 10 associates the direction of the surface constituting the input / output unit 14 of the user terminal 10 with the direction of the surface of the image 90 and the image 91 in advance. Then, the control server 100 performs character recognition (OCR) of the text in the vertical direction (Y direction) and the horizontal direction (X direction) on the acquired image 90 and image 91 in the direction in which the character recognition is completed. Determine whether screen information is displayed vertically or horizontally. Then, a vertical or horizontal identifier is determined.

  In FIG. 9, the character “setting” is recognized. The character recognition here may be determined from the result of recognizing a plurality of characters, since it is often difficult to determine whether the character to be recognized is vertical or horizontal if only one character is recognized.

  In the character recognition described above, the object to be recognized is not limited to characters, and may be any character or icon.

  When the user terminal 10 has the acceleration sensor 15 or a predetermined sensor, the user terminal 10 itself displays the screen information in the vertical type or the screen information in the horizontal type. It is possible to determine whether In this case, the user terminal 10 determines either the vertical or horizontal identifier, and transmits this identifier to the control server 100 together with the screen information. In this case, the process proceeds to step S05 without executing the process of step S04.

  Next, the control server 100 transmits the screen information and the determined identifier to the support terminal 150 (step S05).

  The support terminal 150 receives the screen information and the identifier transmitted from the control server 100, and displays the image information in a vertical type or a horizontal type according to the identifier (step S06).

  FIG. 6 shows, as an example, screen information 158 of the user terminal 10b displayed vertically on the support terminal 150 as shown in FIG. 5 when the screen information 54 is displayed vertically on the user terminal 10b. .

  FIG. 8 shows, as an example, screen information 158 of the user terminal 10b displayed horizontally on the support terminal 150 as shown in FIG. 7 when the screen information 54 is displayed horizontally on the user terminal 10b.

  In the processes from step S03 to step S06, it is necessary to determine the identifier every time the screen information displayed on the user terminal 10 is updated. Therefore, since these processes are processes to be executed sequentially, for example, the processes may be executed repeatedly at regular intervals (such as 1 second).

[P2P control processing]
Next, the P2P type control process directly executed by the user terminal 10 and the support terminal 150 will be described instead of using the control server 100 as described above. FIG. 4 is a flowchart of the P2P type control process executed by the user terminal 10 and the support terminal 150.

  The user terminal 10 receives an operation for requesting support from the user (step S10). An application for receiving remote support is installed in the user terminal 10, and for example, an operation for starting this application is received from the user.

  When the user terminal 10 accepts an operation for requesting support from the user (step S10: “YES”), the user terminal 10 connects to the support terminal 150 and indicates that the support request has been made. And the process proceeds to step S11. When the user terminal 10 does not accept an operation for requesting support from the user (step S10: “NO”), the process of step S10 is looped.

  Next, the support terminal 150 requests the user terminal 10 to acquire screen information (step S11).

  In response to this request, the user terminal 10 transmits the requested screen information to the support terminal 150 (step S12).

  Next, the user terminal 10 determines an identifier based on the screen information (step S13). That is, as shown in FIG. 9, an image 90 or an image 91 corresponding to screen information is acquired. At this time, the user terminal 10 associates the direction of the surface constituting the input / output unit 14 of the user terminal 10 with the direction of the surface of the image 90 and the image 91 in advance. Then, the user terminal 10 performs text character recognition (OCR) on the acquired image 90 and image 91 in the vertical direction (Y direction) and the horizontal direction (X direction) in the direction in which the character recognition is completed. Determine whether screen information is displayed vertically or horizontally. Then, a vertical or horizontal identifier is determined.

  In the character recognition described above, the object to be recognized is not limited to characters, and may be any character or icon.

  When the user terminal 10 has the acceleration sensor 15 or a predetermined sensor, the user terminal 10 itself displays the screen information in the vertical type or the screen information in the horizontal type. It is possible to determine whether In this case, the user terminal 10 determines either the vertical or horizontal identifier, and transmits this identifier to the support terminal 150 together with the screen information. In this case, the process proceeds to step S14 without executing the process of step S13.

  Next, the user terminal 10 transmits the determined identifier to the support terminal 150 (step S14).

  The support terminal 150 receives the screen information and the identifier transmitted from the user terminal 10, and displays the image information in a vertical type or a horizontal type according to the identifier (step S15).

  FIG. 6 shows, as an example, screen information 158 of the user terminal 10b displayed vertically on the support terminal 150 as shown in FIG. 5 when the vertical screen information 54 is displayed on the user terminal 10b. .

  FIG. 8 shows, as an example, screen information 158 of the user terminal 10b displayed horizontally on the support terminal 150 as shown in FIG. 7 when the horizontal screen information 54 is displayed on the user terminal 10b.

  In the processing from step S12 to step S15, it is necessary to determine the identifier every time the screen information displayed on the user terminal 10 is updated. Therefore, since these processes are processes to be executed sequentially, for example, the processes may be executed repeatedly at regular intervals (such as 1 second).

  Whether the server-type control process or the P2P-type control process described above, the identifier determination may be executed by the support terminal 150 instead of the control server 100 or the user terminal 10.

  The means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program. The program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, CD (CD-ROM, etc.), DVD (DVD-ROM, DVD-RAM, etc.), for example. In this case, the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it. The program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

  1 remote system, 3 public line network, 10 user terminal, 100 control server, 150 support terminal

Claims (6)

A remote system comprising a terminal, a remote terminal for remotely operating the terminal, and a remote server,
The terminal indicates, on the remote server, screen information displayed on the display unit of the terminal and whether the screen information is displayed vertically or horizontally on the display unit. And a module for transmitting the identifier,
The remote server is
A module that receives the screen information displayed on the display unit of the terminal and an identifier indicating the orientation of the screen information and transmits the identifier to the remote terminal;
The remote terminal is
A remote system comprising a module that receives the screen information and the identifier transmitted from the remote server, and displays the screen information in a direction of the screen information based on the identifier. A remote system comprising a terminal and a remote terminal for remotely operating the terminal,
The terminal indicates the screen information displayed on the display unit of the terminal on the remote terminal and whether the screen information is displayed vertically or horizontally with respect to the display unit. And a module for transmitting the identifier,
The remote terminal is
A remote system comprising a module that receives the screen information and the identifier transmitted from the terminal and displays the screen information in a direction of the screen information based on the identifier.   The remote system according to claim 1, wherein the terminal includes a module that determines an identifier indicating a direction of the screen information based on measurement of an acceleration sensor provided in the terminal.   The said terminal is provided with the module which determines whether the said screen information is displayed vertically or horizontally by recognizing the character displayed on the said terminal as the said screen information. Or the remote system of Claim 2. A remote control method comprising a terminal, a remote terminal for remotely operating the terminal, and a remote server,
The terminal indicates, on the remote server, screen information displayed on the display unit of the terminal and whether the screen information is displayed vertically or horizontally on the display unit. Performing the step of transmitting the identifier, and
The remote server is
Receiving the screen information displayed on the display unit of the terminal and an identifier indicating the orientation of the screen information, and transmitting to the remote terminal;
The remote terminal is
A remote control method for receiving the screen information and the identifier transmitted from the remote server, and executing the step of displaying the screen information in a direction of the screen information based on the identifier. A remote system program executable by a remote system comprising a terminal, a remote terminal for remotely operating the terminal, and a remote server,
The terminal indicates the screen information displayed on the display unit of the terminal on the remote server and whether the screen information is displayed vertically or horizontally with respect to the display unit. A terminal program for executing the step of transmitting the identifier;
To the remote server,
Screen information displayed on the display unit of the terminal, an identifier indicating the orientation of the screen information, and a program for a remote server for executing a step of transmitting to the remote terminal;
In the remote terminal,
A remote terminal program for receiving the screen information and the identifier transmitted from the remote server, and causing the screen information to be displayed in a screen information orientation based on the identifier. Remote system program.

Images