JP7845657B2 - Remote control device - Google Patents

Description

This invention relates to a remote control device, a remote control method, a program, and a remote control system.

A well-known technology is used for remotely controlling information processing devices such as personal computers.

For example, Patent Document 1 describes a transmitting-side network I/O box device characterized by comprising a first interface unit that manages the interface with an input device for a local PC, a first change recognition means, a first compression unit, a first coupling unit, a first network I/O unit, a first splitting unit, a first decompression unit, and a first interface means.

Japanese Patent Application Publication No. 08-235093

There are times when it is necessary to remotely operate information processing devices such as personal computers in local network environments or offline environments. In such cases, the technology described in Patent Document 1 requires network I/O box devices on both the controlled and operating sides, making easy remote operation difficult. Thus, a problem arose: the difficulty in easily performing remote operation.

Therefore, the object of the present invention is to provide a remote control device, remote control method, program, and remote control system for solving the above-mentioned problems.

To achieve this objective, a remote control device, which is one form of the present disclosure,
A receiving unit that receives image data in which at least the screen display unit of the operated device is the subject,
A conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the operated device and the image data,
A character recognition unit performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit,
A display unit that displays the processed image data after processing by the character recognition unit,
It has the following configuration:

Furthermore, another form of this disclosure, the remote control method, is
Information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
The system is configured to display the processed image data after character recognition processing.

Furthermore, other forms of this disclosure, such as program,
In an information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
This program implements the process of displaying processed image data after character recognition.

Furthermore, another form of this disclosure, a remote control system,
A remote control device comprising: a receiving unit that receives image data with at least the screen display unit of a device to be operated as its subject; a conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the device to be operated and the image data; a character recognition unit that performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit; and a display unit that displays the processed image data after processing by the character recognition unit,
An imaging device that acquires image data with the screen display unit of the operated device as the subject, and transmits the acquired image data to the remote control device,
It has the following configuration:

The configurations described above make it possible to easily remotely control the information processing device.

This figure shows an example of the configuration of a remote control system in the first embodiment of the present disclosure. This figure shows another example configuration of the remote control system. This is a block diagram showing an example configuration of a remote control device. This figure shows an example of standard information. This figure shows an example of processing by a remote control device. This figure shows an example of processing by a remote control device. This flowchart shows an example of how a remote control device works. This flowchart shows an example of how a remote control device works. This is a block diagram showing another example configuration of a remote control device. This figure shows an example of the hardware configuration of a remote control device in a second embodiment of the present disclosure. This is a block diagram showing an example configuration of a remote control device.

[First Embodiment]
A first embodiment of the present disclosure will be described with reference to Figures 1 to 9. Figures 1 and 2 are diagrams illustrating the general configuration of the remote control system 100. Figure 3 is a block diagram showing an example configuration of the remote control device 500. Figure 4 is a diagram showing an example of standard information 541. Figures 5 and 6 are diagrams showing an example of processing by the remote control device 500. Figures 7 and 8 are flowcharts showing an example of operation by the remote control device 500. Figure 9 is a block diagram showing another example configuration of the remote control device 500.

In the first embodiment of this disclosure, a remote control system 100 for remotely controlling a device 200 located in a local network environment or an offline environment is described. As will be described later, the remote control system 100 acquires image data of the device 200 using an imaging device 300, extracts the screen display portion of the device 200 captured in the acquired image data, and converts the shape of the extracted screen display portion of the device 200 into a predetermined shape. Then, the remote control system 100 performs character recognition processing, such as OCR (Optical Character Recognition), on the converted image data. After that, the remote control system 100 displays the processed image data on the screen.

Furthermore, the remote control system 100 displays the processed image data described above on the screen and transmits operation information to the controlled device 200 in response to operations on the keyboard, mouse, or other input devices. For example, the remote control system 100 transmits operation information to the controlled device 200 via a mouse/keyboard receiver 400 for remote control emulation. This allows the controlled device 200 to recognize operations on the mouse, keyboard, etc. The transmission of operation information may be implemented using known technologies.

Figures 1 and 2 show an example configuration of the remote control system 100. Referring to Figure 1, the remote control system 100 includes, for example, a device to be controlled 200, an imaging device 300, a mouse/keyboard receiver 400 for remote control emulation, and a remote control device 500. As shown in Figure 2, the remote control system 100 may also include a mobile terminal 600 such as a smartphone. As shown in Figures 1 and 2, the remote control device 500 is connected to the imaging device 300 and the mouse/keyboard receiver 400 via a network or the like, enabling them to communicate with each other.

The operated device 200 is an information processing device located in a local network environment or an offline environment. For example, the operated device 200 has a screen display unit such as an LCD (Liquid Crystal Display) for displaying information. Furthermore, the operated device 200 recognizes operations on a keyboard, mouse, etc., according to the acquired operation information. For example, the operated device 200 may be a general information processing device such as a personal computer, tablet, or other portable terminal.

The imaging device 300 is an imaging device such as a camera that acquires image data with at least the screen display unit of the controlled device 200 as the subject. For example, the imaging device 300 acquires time-series image data. The imaging device 300 also transmits the acquired image data to the remote control device 500 via a network N or the like.

For example, the imaging device 300 has a wireless communication function, and can transmit image data to the remote control device 500 using this wireless communication function. The imaging device 300 may also transmit image data to the remote control device 500 using a tethering function or similar function of a mobile terminal 600 that is communicatively connected to the imaging device 300.

The mouse/keyboard receiver 400 is a receiver for remote control emulation that receives operation information for keyboards, mice, etc., from the remote control device 500 via the network N. For example, the mouse/keyboard receiver 400 is connected to the controlled device 200 and outputs the operation information received from the remote control device 500 to the controlled device 200. By outputting operation information to the controlled device 200, the controlled device 200 recognizes the operation of the keyboard, mouse, etc.

For example, the mouse/keyboard receiver 400 has wireless communication capabilities and can receive operation information from the remote control device 500 using these wireless communication capabilities. The mouse/keyboard receiver 400 may also receive operation information from the remote control device 500 using the tethering function of a mobile terminal 600 that is communicatively connected to the mouse/keyboard receiver 400.

The mouse/keyboard receiver 400 may be a known device. For example, the mouse/keyboard receiver 400 may utilize KVM (Keyboard, Video, Mouse) over IP (Internet Protocol).

The remote control device 500 is an information processing device that remotely controls the controlled device 200. Figure 3 shows an example of the configuration of the remote control device 500. Referring to Figure 3, the remote control device 500 has, for example, an operation input unit 510, a screen display unit 520, a communication I/F unit 530, a storage unit 540, and an arithmetic processing unit 550 as its main components.

The operation input unit 510 consists of an operation input device such as a keyboard or mouse. The operation input unit 510 detects the operations of the person operating the remote control device 500 and outputs the results to the calculation processing unit 550.

The screen display unit 520 consists of a screen display device such as an LCD. The screen display unit 520 can display various information stored in the storage unit 540 on the screen in response to instructions from the arithmetic processing unit 550.

The communication interface unit 530 consists of a data communication circuit. The communication interface unit 530 performs data communication with external devices such as the imaging device 300 and the mouse/keyboard receiver 400, which are connected via a communication line.

The storage unit 540 is a storage device such as a hard disk or memory. The storage unit 540 stores processing information and programs 544 necessary for various processes in the arithmetic processing unit 550. The programs 544 are loaded into the arithmetic processing unit 550 and executed to realize various processing functions. The programs 544 are pre-loaded from external devices or recording media via data input/output functions such as the communication interface unit 530 and stored in the storage unit 540. Examples of the main information stored in the storage unit 540 include standard information 541, image data information 542, and processed image data information 543.

The standard information 541 includes information indicating the size of the screen display unit of the operated device 200. For example, the standard information 541 is acquired in advance from an external device via the communication I/F unit 530, or input in advance using the operation input unit 510, and stored in the storage unit 540.

Figure 4 shows an example of standard information 541. Referring to Figure 4, standard information 541 shows the height and width of the screen display unit for each size. Thus, standard information 541 indicates the size of the screen display unit of the operated device 200.

The image data information 542 includes image data received from the imaging device 300. For example, the image data information 542 includes time-series image data. The image data information 542 may also include associated information such as image data identification information, information indicating the date and time the image data was acquired, information indicating the location where the image data was acquired, and other arbitrary information. For example, the image data information 542 is updated each time the receiving unit 551 receives image data from an external device such as a camera or an external information processing device.

The processed image data information 543 includes the processed image data after processing by the conversion unit 553 and the character recognition unit 554, which will be described later. For example, the processed image data information 543 is updated when the character recognition unit 554 performs character recognition processing such as OCR.

The arithmetic processing unit 550 includes a CPU (Central Processing Unit) and other arithmetic devices and their peripheral circuits. The arithmetic processing unit 550 reads and executes the program 544 from the storage unit 540, thereby realizing various processing functions through cooperation between the hardware and the program 544. Examples of the main processing functions realized by the arithmetic processing unit 550 include the receiving unit 551, the extraction unit 552, the conversion unit 553, the character recognition unit 554, the display unit 555, and the operation information transmission unit 556.

The receiving unit 551 receives image data and information indicating the size of the image display unit of the operated device 200 from an external device.

For example, the receiving unit 551 receives image data from the imaging device 300 via the communication interface unit 530. The receiving unit 551 may also receive information from the imaging device 300 indicating the date, time, and location where the image data was acquired, along with the image data itself. Furthermore, the receiving unit 551 stores the received image data and other information as image data information 542 in the storage unit 540.

Furthermore, for example, the receiving unit 551 can acquire information indicating the size of the screen display area of the operated device 200 from the mobile terminal 600 or other external devices via the communication I/F unit 530. The information indicating the size of the screen display area may, for example, indicate the size of the screen display area (e.g., xx type), or it may indicate the height and width of the screen display area.

The extraction unit 552 extracts the screen display unit of the operated device 200, which is the subject, from the image data contained in the image data information 542. The extraction unit 552 may extract the screen display unit from the image data using known means.

For example, the extraction unit 552 extracts the screen display unit using an object detection algorithm such as YOLO (You Only Look Once). The extraction unit 552 may also extract the screen display unit of the operated device 200 using other known methods, such as an object detector created using OpenCV (Open Source Computer Vision Library), or by detecting the screen display unit using a template matching method.

The conversion unit 553 performs a conversion process to transform the shape of at least the portion of the image data corresponding to the extracted screen display area, based on the extraction results from the extraction unit 552 and information indicating the size of the screen display area.

For example, the conversion unit 553 calculates conversion parameters necessary when converting the shape of the screen display area extracted by the extraction unit 552 into a predetermined shape. For example, the conversion unit 553 calculates conversion parameters necessary when converting the shape of the screen display area within the image data into a shape corresponding to the size of the screen display area. Specifically, for example, the conversion unit 553 calculates a homography transformation matrix as a conversion parameter. The conversion unit 553 may calculate the homography transformation matrix using known methods. For example, the conversion unit 553 can calculate the homography transformation matrix by solving a system of equations using the coordinates of the extracted screen display area and the coordinates corresponding to the shape of the screen display area, which are specified according to the size of the screen display area.

Furthermore, the conversion unit 553 converts the image data from which the screen display area has been extracted by performing calculations using the calculated conversion parameters. For example, the conversion unit 553 generates converted image data in which at least the shape within the region corresponding to the screen display area has been converted by performing matrix calculations using the calculated conversion parameters. The conversion unit 553 performs this conversion, which allows for correction of the shape of the screen display area and the display within the image data, even in cases where, for example, the imaging position of the imaging device 300 is misaligned and the screen display area of the operated device 200 cannot be imaged directly from the front.

For example, as illustrated above, the conversion unit 553 generates converted image data by performing homography conversion processing based on the extraction results from the extraction unit 552 and information indicating the size of the screen display area. If the information indicating the size of the screen display area indicates the dimensions of the screen display area, the conversion unit 553 may refer to the standard information 541 to identify information such as height and width corresponding to the dimensions. The conversion unit 553 can then calculate conversion parameters for converting to the shape indicated by the identified height and width.

The character recognition unit 554 performs character recognition processing, such as OCR, based on the converted image data. The character recognition unit 554 may perform character recognition processing using general methods. Furthermore, the character recognition unit 554 stores the image data after character recognition processing as processed image data information 543 in the storage unit 540.

As described above, the character recognition unit 554 performs character recognition processing on the converted image data generated by the conversion unit 553. Performing character recognition processing on the converted image data improves the accuracy of character recognition, especially in cases where the screen display of the operated device 200 cannot be captured directly in front of it due to a misalignment of the imaging position of the imaging device 300.

The display unit 555 displays processed image data and other information on the screen display unit 520. The display unit 555 may also display various other information besides processed image data on the screen display unit 520.

The operation information transmission unit 556 transmits operation information corresponding to operations performed on the operation input unit 510 to the mouse/keyboard receiver 400. For example, when the display unit 555 is displaying processed image data or the like on the screen display unit 520, the operation information transmission unit 556 transmits operation information corresponding to operations performed on the operation input unit 510 to the mouse/keyboard receiver 400. The operation information transmission unit 556 may be implemented using known technologies.

As described above, the remote control system 100 may include a mobile terminal 600. The mobile terminal 600 may be a general-purpose smartphone with tethering capabilities. However, if the imaging device 300 or the mouse/keyboard receiver 400 have wireless communication capabilities, the remote control system 100 does not need to include the mobile terminal 600.

The above is an example of the configuration of the remote control system 100. According to the above configuration, as shown in Figure 5, the remote control device 500 of the remote control system 100 performs character recognition processing after converting the shape of the screen display area in the image data. As a result, accurate character recognition processing can be performed even when the imaging position of the imaging device 300 is shifted.

Furthermore, as shown in Figure 6, the remote control system 100 described in this embodiment allows for the transmission of operation information corresponding to operations on the operation input unit 510 to the mouse/keyboard receiver 400 while the processed image data is displayed on the screen display unit 520. As a result, convenience can be improved when performing remote operations based on image data.

Next, we will explain an example of the operation of the remote control device 500 with reference to Figures 7 and 8. First, we will explain an example of the operation of the remote control device 500 when displaying information on the screen, referring to Figure 7.

Figure 7 is a flowchart illustrating an example of the operation of the remote control device 500. Referring to Figure 7, the receiving unit 551 receives image data from the imaging device 300 (step S101). The receiving unit 551 may also receive information from the imaging device 300 indicating the date, time, and location where the image data was acquired. Furthermore, the receiving unit 551 can acquire information indicating the size of the screen display area of the controlled device 200 from a mobile terminal 600 or other external device.

The extraction unit 552 extracts the screen display unit of the operated device 200, which is the subject, from the image data contained in the image data information 542 (step S102). The extraction unit 552 may extract the screen display unit from the image data using known means.

The conversion unit 553 performs homography conversion processing based on the extraction results from the extraction unit 552 and information indicating the size of the screen display area (step S103). For example, the conversion unit 553 calculates conversion parameters necessary for converting the shape of the screen display area within the image data to a shape corresponding to the size of the screen display area. Furthermore, the conversion unit 553 generates converted image data with the shape of the screen display area converted by performing calculations using the calculated conversion parameters.

The character recognition unit 554 performs character recognition processing, such as OCR, based on the converted image data (step S104). The character recognition unit 554 may perform character recognition processing using a general method.

The display unit 555 displays the processed image data, which is the image data processed by the character recognition unit 554, on the screen display unit 520 (step S105).

The above is an example of the operation of the remote control device 500 when displaying information on the screen display unit 520. Next, with reference to Figure 8, an example of the operation of the remote control device 500 when transmitting operation information will be described.

Figure 8 is a flowchart showing an example of the operation of the remote control device 500. Referring to Figure 8, the operation information transmission unit 556 acquires operation information corresponding to the operation performed on the operation input unit 510 while the display unit 555 is displaying the processed image data on the screen display unit 520 (step S201).

Furthermore, the operation information transmission unit 556 transmits the acquired operation information to the mouse/keyboard receiver 400 (step S202). Subsequently, the mouse/keyboard receiver 400 outputs the received operation information to the device being operated 200, thereby allowing the device to recognize the mouse and keyboard operations.

The above is an example of the operation of the remote control device 500 when transmitting operation information.

Thus, the remote control device 500 includes a conversion unit 553, a character recognition unit 554, and a display unit 555. With this configuration, the character recognition unit 554 can perform character recognition processing using image data converted by the conversion unit 553. Furthermore, the display unit 555 can display the processed image data on the screen display unit 520. As a result, even if the imaging position of the imaging device 300 is slightly off, accurate character recognition processing can be performed, enabling easy and convenient remote control.

Furthermore, the remote control device 500 includes an operation information transmission unit 556. With this configuration, the operation information transmission unit 556 can transmit operation information corresponding to operations on the operation input unit 510 to the mouse/keyboard receiver 400 while the processed image data is displayed on the screen display unit 520. As a result, convenience can be improved when performing remote control based on image data.

Note that the configuration of the remote control device 500 and other components is not limited to the example given in this embodiment. For example, referring to Figure 9, the arithmetic processing unit 550 can implement the resolution correction instruction unit 557 in addition to the processing units described above by reading and executing the program 544.

The resolution correction instruction unit 557 can instruct the imaging device 300 to change its resolution if it determines, based on image data information 542 or the like, that moiré patterns are occurring, or in response to operations on the remote control device 500. By instructing the imaging device 300 to change its resolution, the resolution is changed in the imaging device 300, enabling more comfortable remote operation. The resolution correction instruction unit 557 may determine the presence or absence of moiré patterns using any method of its choosing.

[Second Embodiment]
Next, a second embodiment of the present disclosure will be described with reference to Figures 10 and 11. In the second embodiment of the present disclosure, an overview of the configuration of the remote control device 700, which is an information processing device, will be described.

Figure 10 shows an example of the hardware configuration of the remote control device 700. Referring to Figure 10, the remote control device 700 has the following hardware configuration as an example.
・CPU (Central Processing Unit) 701 (arithmetic unit)
ROM (Read Only Memory) 702 (Storage Device)
・RAM (Random Access Memory) 703 (Storage Device)
• Programs 704 loaded into RAM 703
- Storage device 705 for storing the program group 704
- Drive device 706 for reading and writing to recording medium 710 outside the information processing device.
- Communication interface 707 that connects to the communication network 711 outside the information processing device.
- Input/output interface 708 for data input and output.
• Bus 709 connecting each component

Furthermore, the remote control device 700 can realize the functions of the receiving unit 721, conversion unit 722, character recognition unit 723, and display unit 724 shown in Figure 11 by having the CPU 701 acquire and execute the program group 704. The program group 704 is, for example, stored in advance in the storage device 705 or ROM 702, and the CPU 701 loads and executes it in the RAM 703 or the like as needed. Alternatively, the program group 704 may be supplied to the CPU 701 via the communication network 711, or it may be stored in advance in the recording medium 710, and the drive device 706 may read the program and supply it to the CPU 701.

Figure 10 shows an example of the hardware configuration of the remote control device 700. The hardware configuration of the remote control device 700 is not limited to the case described above. For example, the remote control device 700 may consist of only a part of the configuration described above, such as not having the drive device 706.

The receiving unit 721 receives image data in which at least the screen display unit of the operated device is the subject.

The conversion unit 722 performs a predetermined conversion process based on information indicating the size of the screen display unit of the operated device and the image data.

The character recognition unit 723 performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit 722.

The display unit 724 displays the processed image data after processing by the character recognition unit 723.

Thus, the remote control device 700 includes a conversion unit 722, a character recognition unit 723, and a display unit 724. With this configuration, the character recognition unit 723 of the remote control device 700 can perform character recognition processing using image data that has been converted by the conversion unit 722. Furthermore, the display unit 724 can display the image data after processing by the character recognition unit 723. As a result, even if the imaging position during image capture is slightly off, accurate character recognition processing can be performed, enabling easy and convenient remote control.

Furthermore, the information processing device such as the remote control device 700 described above can be realized by incorporating a predetermined program into the information processing device. Specifically, another embodiment of the present invention is a program for implementing the following processes: receiving image data of at least the screen display unit of the controlled device as the subject; performing a predetermined conversion process based on information indicating the size of the screen display unit of the controlled device and the image data; performing character recognition processing on the converted image data generated as a result of the conversion process; and displaying the processed image data after the character recognition processing.

Furthermore, the remote control method performed by the information processing device described above involves the information processing device receiving image data with at least the screen display unit of the controlled device as its subject, performing a predetermined conversion process based on information indicating the size of the screen display unit of the controlled device and the image data, performing character recognition processing on the converted image data generated as a result of the conversion process, and displaying the processed image data after character recognition processing.

Even an invention such as a program (or recording medium) or a remote control method having the above-described configuration can achieve the same effects and benefits as the remote control device 700 described above, thereby achieving the objectives of the present invention described above. Furthermore, a remote control system comprising a remote control device 700 having the above-described configuration and an imaging device that acquires image data of the screen display unit of the controlled device and transmits the acquired image data to the remote control device can also achieve the same objectives.

<Note>
Some or all of the above embodiments may also be described as follows. The outline of the remote control device and the like in the present invention will be described below. However, the present invention is not limited to the following configuration.

(Note 1)
A receiving unit that receives image data in which at least the screen display unit of the operated device is the subject,
A conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the operated device and the image data,
A character recognition unit performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit,
A display unit that displays the processed image data after processing by the character recognition unit,
A remote control device having
(Note 2)
The remote control device described in Appendix 1,
The conversion unit calculates conversion parameters necessary for converting the shape of the screen display unit in the image data to a shape corresponding to the size of the screen display unit, and performs the conversion process using the calculated conversion parameters.
(Note 3)
A remote control device as described in Appendix 1 or Appendix 2,
The conversion unit calculates a homography transformation matrix as the conversion parameter, which is necessary when converting the shape of the screen display unit in the image data to a shape corresponding to the size of the screen display unit.
(Note 4)
A remote control device described in any one of the items from Appendix 1 to Appendix 3,
The conversion unit is a remote control device that determines the height and width of the screen display unit based on standard information indicating the size of the screen display unit, and performs the conversion process using the determined height and width.
(Note 5)
A remote control device described in any one of the items from Appendix 1 to Appendix 4,
A remote control device having an operation information transmission unit that acquires operation information in response to an operation input unit and transmits the acquired operation information to an external device.
(Note 6)
A remote control device described in any one of the items from Appendix 1 to Appendix 5,
A remote control device having an instruction unit that transmits an instruction to an imaging device that acquires the aforementioned image data to change the resolution.
(Note 7)
Information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
A remote control method for displaying processed image data after character recognition processing.
(Note 8)
In an information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
A program to display processed image data after character recognition.
(Note 9)
A remote control device comprising: a receiving unit that receives image data with at least the screen display unit of a device to be operated as its subject; a conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the device to be operated and the image data; a character recognition unit that performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit; and a display unit that displays the processed image data after processing by the character recognition unit,
An imaging device that acquires image data with the screen display unit of the operated device as the subject, and transmits the acquired image data to the remote control device,
It has a remote control system.
(Note 10)
The remote control system described in Appendix 9,
The remote control device has an operation information transmission unit that acquires operation information corresponding to an operation input unit and transmits the acquired operation information to an external device.
The remote control system includes a receiver that receives the operation information transmitted by the operation information transmission unit and outputs it to the device to be controlled.

The programs described in the above embodiments and appendices are stored in a memory device or recorded on a computer-readable recording medium. For example, the recording medium may be a portable medium such as a flexible disk, optical disk, magneto-optical disk, or semiconductor memory.

The present invention has been described above with reference to the embodiments described above, but the present invention is not limited to the embodiments described above. Various modifications to the structure and details of the present invention can be made within the scope of the present invention, as can be understood by those skilled in the art.

100 Remote control system 200 Controlled device 300 Imaging device 400 Mouse/keyboard receiver 500 Remote control device 510 Operation input unit 520 Screen display unit 530 Communication I/F unit 540 Storage unit 541 Standard information 542 Image data information 543 Processed image data information 544 Program 550 Calculation processing unit 551 Receiving unit 552 Extraction unit 553 Conversion unit 554 Character recognition unit 555 Display unit 556 Operation information transmission unit 557 Resolution correction instruction unit 600 Mobile terminal 700 Remote control device 701 CPU
702 ROM
703 RAM
704 Program group 705 Storage device 706 Drive device 707 Communication interface 708 Input/output interface 709 Bus 710 Recording medium 711 Communication network 721 Receiving unit 722 Conversion unit 723 Character recognition unit 724 Display unit

Claims (9)

A receiving unit that receives image data in which at least the screen display unit of the operated device is the subject,
A conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the operated device and the image data,
A character recognition unit performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit,
A display unit that displays the processed image data after processing by the character recognition unit,
It has,
The system includes an instruction unit that, when it is determined that moiré patterns are occurring based on the aforementioned image data, sends an instruction to the imaging device that acquires the image data to change the resolution.
Remote control device. A remote control device according to claim 1,
The conversion unit calculates conversion parameters necessary for converting the shape of the screen display unit in the image data to a shape corresponding to the size of the screen display unit, and performs the conversion process using the calculated conversion parameters. A remote control device according to claim 2,
The conversion unit calculates a homography transformation matrix as the conversion parameter, which is necessary when converting the shape of the screen display unit in the image data to a shape corresponding to the size of the screen display unit. A remote control device according to any one of claims 1 to 3,
The conversion unit is a remote control device that determines the height and width of the screen display unit based on standard information indicating the size of the screen display unit, and performs the conversion process using the determined height and width. A remote control device according to any one of claims 1 to 4,
A remote control device having an operation information transmission unit that acquires operation information in response to an operation input unit and transmits the acquired operation information to an external device. Information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
Display the processed image data after character recognition processing .
If it is determined that moiré patterns are occurring based on the aforementioned image data, an instruction is sent to the imaging device that acquires the aforementioned image data to change the resolution.
Remote control method. In an information processing device,
The system receives image data in which at least the screen display unit of the operated device is the subject.
Based on the information indicating the size of the screen display unit of the operated device and the image data, a predetermined conversion process is performed.
Character recognition processing is performed on the converted image data generated as a result of the conversion process.
Display the processed image data after character recognition processing .
If it is determined that moiré patterns are occurring based on the aforementioned image data, an instruction is sent to the imaging device that acquires the image data to change the resolution.
A program to perform a process. A remote control device comprising: a receiving unit that receives image data with at least the screen display unit of a device to be operated as the subject; a conversion unit that performs a predetermined conversion process based on information indicating the size of the screen display unit of the device to be operated and the image data; a character recognition unit that performs character recognition processing on the converted image data generated as a result of the conversion process by the conversion unit; a display unit that displays the processed image data after processing by the character recognition unit; and an instruction unit that, when it is determined that moiré patterns have occurred based on the image data, sends an instruction to the imaging device that acquires the image data to change the resolution .
An imaging device that acquires image data with the screen display unit of the operated device as the subject, and transmits the acquired image data to the remote control device,
It has a remote control system. A remote control system according to claim 8 ,
The remote control device has an operation information transmission unit that acquires operation information corresponding to an operation input unit and transmits the acquired operation information to an external device.
The remote control system includes a receiver that receives the operation information transmitted by the operation information transmission unit and outputs it to the device to be controlled.