JP6358982B2 - Remote control device and remote control method - Google Patents

Description

  The present invention relates to a technique for remotely operating a screen of a display device mounted on a moving body.

  As a technique for performing an operation on a display screen from a remote location, Patent Document 1 discloses an image display apparatus using a screen having a function of detecting a position of a light receiving location. In this image display device, when the laser beam of the laser pointer is irradiated onto the screen, the screen detects the position of the irradiation point (spot). Then, by projecting an image with a display mark on the spot position, the position designated by the user with the laser pointer is clearly shown.

  In the projection display device described in Patent Document 2, a spot light image of a laser pointer is read by an image sensor provided inside the projector housing, and a mouse cursor image is created and displayed at the coordinate position of the spot light image. ing.

Japanese Patent Laid-Open No. 4-371063 Japanese Patent Laid-Open No. 9-80372

  The devices described in Patent Documents 1 and 2 are both configured by a projector, and are used in a low-luminance environment such as a lecture or a briefing session, and assume a large number of viewers. However, when the display device is mounted on a moving body such as an automobile, it is usually intended for a small number of viewers in a high-luminance environment, so it is inappropriate to use the devices described in Patent Documents 1 and 2. is there.

  In view of the above problems, an object of the present invention is to provide a remote operation device and a remote operation method capable of intuitively remotely operating a display screen of a display device mounted on a moving body.

A remote control device according to the present invention includes a self-luminous display device mounted on a moving body, an optical indication device that irradiates a part of a display screen of the display device with visible light, and a visible light display screen. An object that optically detects the irradiation position, an object that compares the display position of the object displayed on the display screen and the irradiation position, and detects an object displayed at the position corresponding to the irradiation position among the objects A detection unit; and a process determination unit that determines whether to perform a process corresponding to the object detected by the object detection unit . The optical pointing device includes a first vibration detection sensor that detects vibration of the optical pointing device; A deflection device that deflects the emitted light in a direction that cancels out fluctuations in the emission direction due to vibration, and further includes a second vibration detection sensor that detects the vibration of the moving body, It deflects the emitted light in a direction to cancel out the difference between the vibration of the vibration and the mobile academic instruction device.

The remote operation method according to the present invention irradiates a part of a display screen of a self-luminous display device mounted on a moving body with visible light, and optically detects an irradiation position on the visible light display screen. The display position of the object displayed on the display screen is compared with the irradiation position, and the object displayed at the position corresponding to the irradiation position among the objects is detected, and whether or not the processing corresponding to the detected object is performed is performed. In the determination of the visible light, the vibration of the optical pointing device is detected by the first vibration detection sensor, the vibration of the moving body is detected by the second vibration detection sensor, and the difference between the vibration of the optical pointing device and the vibration of the moving body is detected. Including irradiation of visible light by deflecting the outgoing light in a direction that cancels out .

A remote control device according to the present invention includes a self-luminous display device mounted on a moving body, an optical indication device that irradiates a part of a display screen of the display device with visible light, and a visible light display screen. An object that optically detects the irradiation position, an object that compares the display position of the object displayed on the display screen and the irradiation position, and detects an object displayed at the position corresponding to the irradiation position among the objects A detection unit; and a process determination unit that determines whether to perform a process corresponding to the object detected by the object detection unit . The optical pointing device includes a first vibration detection sensor that detects vibration of the optical pointing device; A deflection device that deflects the emitted light in a direction that cancels out fluctuations in the emission direction due to vibration, and further includes a second vibration detection sensor that detects the vibration of the moving body, It deflects the emitted light in a direction to cancel out the difference between the vibration of the vibration and the mobile academic instruction device. Therefore, it is possible to intuitively remotely operate the display screen of the display device mounted on the moving body. Further, even in an environment where the moving body vibrates, the positional deviation of the emitted light of the optical pointing device due to camera shake is suppressed.

The remote operation method according to the present invention irradiates a part of a display screen of a self-luminous display device mounted on a moving body with visible light, and optically detects an irradiation position on the visible light display screen. The display position of the object displayed on the display screen is compared with the irradiation position, and the object displayed at the position corresponding to the irradiation position among the objects is detected, and whether or not the processing corresponding to the detected object is performed is performed. In the determination of the visible light, the vibration of the optical pointing device is detected by the first vibration detection sensor, the vibration of the moving body is detected by the second vibration detection sensor, and the difference between the vibration of the optical pointing device and the vibration of the moving body is detected. Including irradiation of visible light by deflecting the outgoing light in a direction that cancels out . Therefore, it is possible to intuitively remotely operate the display screen of the display device mounted on the moving body. Further, even in an environment where the moving body vibrates, the positional deviation of the emitted light due to camera shake is suppressed.

It is a figure which shows the state with which the remote control apparatus which concerns on Embodiment 1 of this invention was mounted in the vehicle of a motor vehicle. 1 is a diagram illustrating a configuration of a remote control device according to a first embodiment. It is a figure which shows the hardware constitutions of the remote control processing apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows the example of designation | designated operation of the object using an optical instruction | indication apparatus. It is a figure which shows the structure for transmitting a determination signal from an optical instruction | indication apparatus to a remote control processing apparatus. It is a figure which shows the difference in the pattern of the visible light 9 in selection operation and determination operation. It is a flowchart which shows operation | movement of the remote control processing apparatus which concerns on Embodiment 1 of this invention. It is a block diagram of the remote control apparatus of Embodiment 2 of this invention. It is a figure which shows the internal structure of a display and detector. It is a figure which shows the state by which visible light was irradiated to the display and detector. It is a figure which shows the state which operated the display and detector by the time division. FIG. 10 is a diagram illustrating an optical pointing device in a remote control device according to a third embodiment. It is a figure which shows the structure of the camera-shake suppression mechanism with which the optical indicating device of Embodiment 3 is provided. FIG. 10 is a diagram illustrating an operation of a camera shake suppression mechanism of the optical pointing device according to the third embodiment. FIG. 10 is a diagram illustrating a remote operation processing device and an optical instruction device in a remote operation device according to a fourth embodiment. It is a figure which shows the internal structure of the optical instruction | indication apparatus of Embodiment 4. FIG. FIG. 10 is a diagram illustrating an operation of a camera shake suppression mechanism of the optical pointing device according to the fourth embodiment.

<A. Embodiment 1>
<A-1. Configuration>
FIG. 1 is a diagram showing a state in which a remote control device according to Embodiment 1 of the present invention is mounted on a vehicle 1000 of an automobile, and FIG. 2 is a diagram showing a configuration of the remote control device.

  The remote control device according to the first embodiment includes a display device 1, an optical pointing device 2 that irradiates the display screen of the display device 1 with visible light 9, and an irradiation position detection that optically detects the irradiation position of the visible light 9 on the display screen. A remote operation processing device 7 that detects an object instructed by the optical pointing device 2, and a display control unit 8 that performs display control of the display device 1.

  In Embodiment 1, the remote control device of the present invention is described as being mounted on a vehicle 1000, but the remote control device of the present invention may be mounted on another moving body such as a train. The operation device 1001 connected to the display device 1 by wire is installed in the vicinity of the front seat 1002, and a passenger in the front seat 1002 can operate the display device 1 using this. However, the passenger in the rear seat 1003 does not reach the operation device 1001, and operates the display device 1 using the optical pointing device 2 instead of the operation device 1001.

  The display device 1 is a self-luminous display device such as an LCD (Liquid crystal display) or LED. Since the liquid crystal itself does not emit light, the LCD has a backlight, but in this specification, the LCD is a self-luminous display device in the sense that it is a non-projection type.

  As shown in FIG. 2, the irradiation position detector includes a Y-axis light guide plate 5, an X-axis position detector 6, an X-axis light guide plate 3, and a Y-axis position detector 4. The Y-axis light guide plate 5 and the X-axis light guide plate 3 are disposed in front of the display screen of the display device 1, and the visible light 9 emitted from the optical pointing device 2 is transmitted to the Y-axis light guide plate 5 and the X-axis light guide plate. 3. The light enters the display device 1 in this order. The Y-axis light guide plate 5 guides a part of the incident visible light 9 in the Y-axis direction. Visible light 9 transmitted through the Y-axis light guide plate 5 is incident on the X-axis light guide plate 3, and a part of the visible light 9 is guided in the X-axis direction. Visible light 9 transmitted through the X-axis light guide plate 3 is incident on the display device 1.

  Here, the horizontal direction of the display screen of the display device 1 is the X-axis direction, and the vertical direction is the Y-axis direction. The X-axis position detector 6 is provided on the emission surface of the Y-axis light guide plate 5 along the X-axis position detector 6, and the display screen of the visible light 9 on the display device 1 based on the light reception position of the emitted light from the Y-axis light guide plate 5. The X-axis coordinate of the upper irradiation point (spot 10) is detected. The Y-axis position detector 4 is provided on the emission surface of the X-axis light guide plate 3 along the Y-axis position detector 4 and detects the Y-axis coordinates of the spot 10 based on the light reception position of the emitted light from the X-axis light guide plate 3. To do.

  The remote operation processing device 7 includes an object detection unit 71 and a process determination unit 72. The object detection unit 71 acquires the coordinates of the spot 10 from the X-axis position detector 6 and the Y-axis position detector 4, and acquires display data of the display device 1 from the display control unit 8. Then, the coordinates of the spot 10 are compared with the display data, and the object displayed at the position corresponding to the spot 10 is detected as the object designated by the optical pointing device 2.

  The process determining unit 72 determines whether to perform the corresponding process for the object detected by the object detecting unit 71. The “object handling process” refers to a process of changing the display to the contents to be displayed on the display device 1 when the object is designated. For example, when it is determined in advance that a map around the vehicle 1000 is displayed when the “map display” button is instructed, the process of displaying the map around the vehicle 1000 is a process corresponding to the “map display” button. . The process determining unit 72 determines to perform the corresponding process for the object detected by the object detecting unit 71 when a determination signal (to be described later) is acquired from the optical pointing device 2. Hereinafter, the object determined to be processed by the process determining unit 72 is referred to as “instruction object”.

  The display control unit 8 controls display on the display device 1. In particular, when an instruction object is acquired from the object detection unit 71, display control corresponding to the instruction object is performed.

  FIG. 3 is a diagram illustrating a hardware configuration of the remote operation processing device 7. The remote operation processing device 7 includes a CPU (Central Processing Unit) 75 and a memory 76 such as a RAM (Random Access Memory). The object detection unit 71 and the process determination unit 72 are realized by the CPU 75 executing a program stored in the memory 76. The display control unit 8 is also realized by the CPU executing a program stored in the memory. However, these may be realized, for example, in cooperation with a plurality of CPUs.

<A-2. Specify operation>
FIG. 4 shows an example of an object specifying operation using the optical pointing device 2. On the display screen of the display device 1, a button 101, a button 102, a button 103, a button 104, and a button 105 are displayed as objects. A user who wants to instruct the button 101 directs the optical pointing device 2 toward the display screen while pressing the selection button 21 and irradiates the button 101 with visible light 9. This operation is called a selection operation. When the enter button 22 is pressed in this state, the button 101 that is currently irradiated with the visible light 9 becomes an instruction object. This operation is called a determination operation.

  When the button 105 is instructed after the button 101 is instructed, the direction of the optical instruction device 2 is changed while the selection button 21 is being pressed, and the visible light 9 is irradiated to the button 105 (selection operation). When the determination button 22 is pressed in this state, the button 105 becomes an instruction object (decision operation).

  As described above, according to the remote operation device of the first embodiment, an object is indicated by irradiating visible light 9, so that an arbitrary object can be instructed quickly and intuitively.

  FIG. 5 shows a configuration for transmitting a determination signal from the optical pointing device 2 to the remote control processing device 7. As the configuration, the remote control device according to the first embodiment includes an infrared light emitting element 12 and an infrared light receiving element 13. The infrared light emitting element 12 is provided in the optical pointing device 2, and the infrared light receiving element 13 is connected to the remote operation processing device 7 by wire.

  When the user presses the determination button 22 of the optical pointing device 2, the infrared light emitting element 12 is energized in a certain pattern, thereby generating an infrared signal beam (determination signal). The determination signal emitted from the infrared light emitting element 12 is received by the infrared light receiving element 13, converted into an electrical signal by the infrared light receiving element 13, and transmitted to the remote operation processing device 7. When the remote operation processing device 7 receives the determination signal, the process determination unit 72 determines to perform the corresponding process for the object detected by the object detection unit 71.

  As another method of transmitting the determination signal, as shown in FIG. 5, when the communication antenna 11A is provided in the optical pointing device 2 and the communication antenna 11B is provided in the remote operation processing device 7, respectively, when the determination button 2 is pressed, The determination signal may be transmitted from the communication antenna 11A to the communication antenna 11B as an electromagnetic wave. FIG. 5 shows both a configuration for transmitting a determination signal by infrared rays (infrared light emitting element 12 and infrared light receiving element 13) and a configuration for transmitting a determination signal by electromagnetic waves (communication antenna 11A and communication antenna 11B). However, this does not mean that you have both at the same time.

  Alternatively, the visible light 9 may be used for transmission of the determination signal by changing the pattern of the visible light 9 between the selection operation and the determination operation. FIG. 6 is a diagram illustrating the difference in the pattern of visible light 9 between the selection operation and the determination operation, where the horizontal axis indicates time and the vertical axis indicates signal intensity. Visible light 9 is irradiated in a continuous pattern (first pattern) during the selection operation, whereas it is irradiated in an intermittent pattern (second pattern) during the determination operation. The determination signal may be recognized by the remote operation processing device 7 identifying the difference in the irradiation pattern. That is, the process determination unit 72 determines to perform a process for handling an object displayed at a position corresponding to the spot 10 of the visible light 9 using an intermittent pattern.

  In addition to the visible light pattern, the visible light 9 can also be used for transmission of a decision signal by changing the wavelength or intensity of the visible light 9 between the selection operation and the decision operation.

<A-3. Remote control processing device>
FIG. 7 is a flowchart showing the operation of the remote operation processing device 7. Hereinafter, the operation of the remote operation processing device 7 will be described with reference to FIG. When visible light 9 is irradiated from the optical pointing device 2 onto the screen of the display device 1, the object detection unit 71 acquires the position information of the spot 10 (step S1). Specifically, the X coordinate of the spot 10 is acquired from the X axis position detector 6, and the Y coordinate of the spot 10 is acquired from the Y axis position detector 4.

  Next, the object detection unit 71 acquires position information (X coordinate and Y coordinate on the screen 1) of each object currently displayed on the display device 1 from the display control unit 8 (step S2).

  Then, the object detection unit 71 compares the position information of the spot 10 with the position information of each object, and detects an object displayed at a position corresponding to the position of the spot 10 (step S3). Here, an object displayed at a position included in the spot 10 or an object displayed at a position partially overlapping with the spot 10 is detected. When these objects are not present, an object displayed within a predetermined range from the spot 10 may be detected.

  Next, the process determination unit 72 determines whether or not to perform the corresponding process for the object detected in step S3 (step S4). Here, the process determination unit 72 waits for reception of the determination signal, and determines that the object corresponding process is performed if the determination signal is received within a predetermined period after the object is detected in step S3. In this case, the process determination unit 72 outputs the object detected in step S3 to the display control unit 8 as an instruction object (step S5). On the other hand, if the determination signal is not received within the predetermined period, the process determination unit 72 determines not to perform the object handling process, and returns to step S1 to acquire the position information of the spot 10 again.

<A-4. Modification>
In the above description, the object detection unit 71 and the process determination unit 72 are realized by the CPU 75 in FIG. 3 operating according to the software program stored in the memory 76 or the like. However, instead of this, the object detection unit 71 and the process determination unit 72 may be realized by a signal processing circuit that realizes the operation by a hardware electric circuit. As a concept combining the software object detection unit 71 and the processing determination unit 72 with the hardware object detection unit 71 and the processing determination unit 72, the word “processing circuit” may be used instead of the word “part”. it can.

<A-5. Effect>
The display screen remote control device according to the first embodiment of the present invention irradiates visible light 9 onto a self-luminous display device 1 mounted on a moving body and a partial area of the display screen of the display device 1. The optical pointing device 2, the irradiation position detection unit for optically detecting the irradiation position on the display screen of the visible light 9, the display position of the object displayed on the display screen and the irradiation position are compared, and the irradiation position among the objects. An object detection unit 71 that detects an object displayed at a position corresponding to the object detection unit 71, and a process determination unit 72 that determines whether or not to perform a corresponding process on the object detected by the object detection unit 71. By performing the corresponding processing of the object detected from the irradiation position of the visible light 9, the user can intuitively operate the display device 1 even when away from the display screen. Further, since the display device 1 is a self-luminous type, it can be used even in a low-luminance environment inside the moving body.

  The irradiation position detection unit is provided on the front surface of the display screen of the display device 1 and guides a part of incident light in the Y-axis direction (first direction) and emits it. A light guide plate) and an X-axis guide that is provided in front of the display screen of the display device 1 and guides and transmits the light transmitted through the Y-axis light guide plate 5 in the X-axis direction (second direction different from the first direction). An optical plate 3 (second light guide plate), an X-axis position detector (second direction detector) that detects coordinates in the X-axis direction of the irradiation position from the light emitted from the Y-axis light guide plate 5, and the X-axis light guide plate 3. A Y-axis position detector (first direction detection unit) that detects coordinates in the Y-axis direction of the irradiation position from the emitted light. Therefore, since the irradiation position is detected by a configuration separate from the display device 1, the configuration of the display device 1 itself can be simplified.

  Alternatively, the optical instruction device 2 transmits an electromagnetic wave signal to the process determination unit 72, and the process determination unit 72 determines that the object detection unit 71 performs the corresponding process when the electromagnetic wave signal is received. As described above, the process determination unit 72 can grasp the intention of the user to specify the object corresponding to the irradiation position by receiving the electromagnetic wave signal.

  Alternatively, the optical instruction device 2 transmits an infrared signal to the process determination unit 72, and the process determination unit 72 determines that the object detection unit 71 performs a corresponding process on the object selected when receiving the infrared signal. Thus, the process determination part 72 can grasp | ascertain the intention that a user designates the object corresponding to an irradiation position by reception of an infrared signal.

  Alternatively, the visible light 9 includes the first pattern of visible light 9 and the second pattern of visible light 9, and the process determination unit 72 positions the object at a position corresponding to the irradiation position of the second pattern of visible light 9. It is determined that the corresponding processing of the displayed object is performed. Accordingly, the processing determination unit 72 can grasp the intention of the user to specify the object corresponding to the irradiation position without providing an infrared signal or electromagnetic wave signal communication unit.

  In the remote operation method of the display screen according to the first embodiment of the present invention, visible light 9 is irradiated onto a partial area of the display screen of the self-luminous display device 1 mounted on a moving body. The irradiation position on the display screen is optically detected, the display position of the object displayed on the display screen is compared with the irradiation position, and the object displayed at the position corresponding to the irradiation position among the objects is detected and detected. It is determined whether or not to perform object correspondence processing. By performing the corresponding processing of the object detected from the irradiation position of the visible light 9, the user can intuitively operate the display device 1 even when away from the display screen. Further, since the display device 1 is a self-luminous type, it can be used even in a low-luminance environment inside the moving body.

<B. Second Embodiment>
<B-1. Configuration>
FIG. 8 is a configuration diagram of the remote control device according to the second embodiment. In the first embodiment, the irradiation position detection unit is configured as a separate body from the display device 1, but in the second embodiment, the irradiation position detection unit and the display device are configured as the display / detector 20 in the same device. The point is different. In other respects, the configuration of the remote control device of the second embodiment is the same as that of the remote control device of the first embodiment.

  FIG. 9 shows the internal configuration of the display / detector 20. The display / detector 20 includes a display element 201, a light receiving element 202, a row selection circuit 31, a display drive circuit 32, and a light reception detection circuit 33. The display element 201 and the light receiving element 202 are arranged in pairs on the same substrate, and 20 pieces are arranged in a lattice of 4 rows × 5 columns. Each set of the first row is connected in parallel to the row selection line m1, and so on. A set of the second row, the third row, and the fourth row is connected in parallel to the row selection lines m2, m3, and m4. Further, in the display element 201, the first row set is connected in parallel to the display drive line l1, and the second row, third row, fourth row, and fifth row set are similarly connected to the display drive lines l2, l3, and l4. , L5 in parallel. In the light receiving element 202, the first row set is connected in parallel to the light receiving detection line n1, and the second row, third row, fourth row, and fifth row set are similarly received light detecting lines n2, n3, n4. , N5 in parallel. Here, the display element 201 and the light receiving element 202 are arranged in a lattice shape, but these may be arranged in two different directions in a planar shape.

  The display element 201 is, for example, an LED, and may be a combination of a liquid crystal element and a backlight. When the row selection circuit 31 energizes the row selection lines m1, m2, m3, and m4 with the display drive circuit 32 applying a positive intensity signal to the display drive lines l1, l2, l3, l4, and l5, the display is performed. The element 201 is configured to emit light with an intensity corresponding to the signal intensity applied to the display drive lines l1, l2, l3, l4, and l5.

  The display drive circuit 32 may apply a positive intensity signal simultaneously to the display drive lines l1, l2, l3, l4, and l5, or may sequentially energize in time division. According to the former method, the configuration of the display drive circuit 32 becomes easy, but since the signals flowing through the row selection lines m1, m2, m3, and m4 are added together, the limit of the emission intensity is lowered. According to the latter method, the display drive lines 11, 12, 13, 14, and 15 and the row selection lines m 1, m 2, m 3, and m 4 increase the light emission intensity by instantaneously conducting only the respective display elements 201. Although it can be maintained, the configuration of the display drive circuit 32 becomes complicated.

  In addition, with the row selection circuit 31 energizing the row selection lines m1, m2, m3, and m4, the light reception detection circuit 33 sequentially energizes the light reception detection lines n1, n2, n3, n4, and n5, thereby receiving light at the intersection. Elements 202 are selected sequentially. If the selected light receiving element 202 receives the visible light 9, signal variations appear in the light receiving detection lines n1, n2, n3, n4, and n5. As a result, the position of the spot 10 can be known, and by comparing with the position information of the object displayed on the screen at that time, it is possible to know which object is selected.

  In addition, although FIG. 9 demonstrated as an example the pixel of 4 rows 5 columns, the number of pixels is not restricted to this.

<B-2. Operation>
FIG. 10 shows a state in which the display / detector 20 is irradiated with visible light 9. In FIG. 10, the display element 201 painted in black indicates that the display is being performed, and the light reception element 202 that is superimposed on the spot 10 and painted in black indicates that it is receiving light.

  FIG. 11 shows a state where the display / detector 20 shown in FIG. 10 operates in a time-sharing manner. The row selection circuit 31 sequentially applies a positive intensity signal to the row selection lines m1, m2, m3, and m4. While the positive drive signal is applied to the row selection line m1, the display drive circuit 32 sequentially applies the positive drive signal to the display drive lines l1, l2, l3, and l4. The display elements 201 in columns to 1 row and 4 columns are driven. At the same time, the light reception detection circuit 33 sequentially selects the light reception detection lines n1, n2, n3, n4, and n5. However, since the light reception elements 202 in the first row do not overlap the spot 10, the light reception detection lines n1, n2, and n2 There is no signal fluctuation in n3, n4, and n5.

  In addition, while a signal having a positive intensity is applied to the row selection line m2, the display driving circuit 32 sequentially applies a signal having a positive intensity to the display driving lines l1 and l4. The display element 201 in the row 4 column is driven. At the same time, the light reception detection circuit n1 sequentially selects the light reception detection lines n1, n2, n3, n4, and n5. Here, there are signal fluctuations in the light receiving detection lines n2 and n3. Accordingly, the light reception detection circuit 33 detects that the light receiving elements 202 of 2 rows, 2 columns and 2 rows and 3 columns receive the visible light 9.

  Next, while a positive intensity signal is applied to the row selection line m3, the display drive circuit 32 sequentially applies a positive intensity signal to the display drive lines l1, l2, l3, and l4. The display elements 201 in rows 1 to 3 and 4 are driven. At the same time, the light reception detection circuit n1 sequentially selects the light reception detection lines n1, n2, n3, n4, and n5. Here, there are signal fluctuations in the light receiving detection lines n2 and n3. Therefore, the light receiving detection circuit 33 detects that the light receiving elements 202 in the 3rd row and the 2nd column and the 3rd row and the 3rd column receive the visible light 9.

  The light reception detection circuit 33 detects that the light receiving elements 202 of 2 rows, 2 columns, 2 rows, 3 columns, 3 rows, 2 columns, and 3 rows and 3 columns receive the visible light 9, and thereby the display screen of the spot 10 Get the top coordinates. These coordinates are sent to the remote operation processing device 7. Since other operations are the same as those in the first embodiment, description thereof is omitted.

<B-3. Effect>
In the remote control device according to the second embodiment of the present invention, the irradiation position detector is paired with the display element 201 of the display / detector 20 (display device) and arranged in the first direction and a second direction different from the first direction. The light receiving elements 202 arranged in a plane, the row selection lines m1, m2, m3, and m4 (first detection lines) in which a set of the light receiving elements 202 in the first direction are connected in parallel, and the light receiving elements 202 in the second direction And light receiving detection lines n1, n2, n3, n4, and n5 (second detection lines) connected in parallel. Thereby, it is possible to integrally configure the display device and the irradiation position detection unit.

<C. Embodiment 3>
<C-1. Configuration>
When the optical pointing device 2 is operated in a handheld state, rotation around the X axis and around the Y axis occurs. Even if these rotations are very small, the position of the spot 10 is greatly shaken and observed on the screen of the display device 1 away from the optical pointing device 2. Therefore, in the remote control device according to the third embodiment, the optical pointing device 2 is provided with a camera shake suppression mechanism. The remote operation device according to the third embodiment is the same as the remote operation device according to the first embodiment except for the camera shake suppression mechanism.

  FIG. 12 shows the optical pointing device 2 in the remote control device according to the third embodiment. The optical indicating device 2 according to the third embodiment includes a camera shake suppression mechanism in addition to the configuration of the optical indicating device 2 according to the first and second embodiments. FIG. 13 is a diagram illustrating a configuration of a camera shake suppression mechanism included in the optical pointing device 2 according to the third embodiment. The camera shake suppression mechanism includes an optical deflection element 303 that electrically deflects light emitted from the light emitting element 302 (visible light 9), a rotational vibration detection element 301 that detects the rotation of the optical pointing device 2, and an optical deflection element 303. And a camera shake suppression circuit 304 to be controlled. 12 and 13, the visible light 9 before deflection is indicated by a dotted line, and the visible light 9 after deflection is indicated by a solid line.

  The rotational vibration detection element 301 is composed of, for example, a biaxial angular velocity sensor, detects the amount of rotation of the optical indicating device 2 around the X axis and the Y axis shown in FIG. 12, and outputs these to the camera shake suppression circuit 304. .

  The camera shake suppression circuit 304 controls the optical deflection element 303 so as to deflect the emitted light of the light emitting element 302 in a direction that cancels the rotation of the optical pointing device 2 detected by the rotational vibration detection element 301. Specifically, the deflection amount in the rotation direction around the X axis of the optical deflection element 303 is controlled by the X axis drive signal, and the deflection amount in the rotation direction around the Y axis of the optical deflection element 303 is controlled by the Y axis drive signal. .

  The optical deflection element 303 deflects the light emitted from the light emitting element 302 in the rotation direction around the X axis in accordance with the X axis drive signal from the camera shake suppression circuit 304, and in the rotation direction around the Y axis in accordance with the Y axis drive signal from the camera shake suppression circuit 304. Light emitted from the light emitting element 302 is deflected.

<C-2. Operation>
As shown in FIG. 14, when the optical pointing device 2 rotates θ ₁ around the X axis due to camera shake, the rotational vibration detecting element 301 detects the rotation amount around the X axis of the optical pointing device 2 as θ ₁ . Then, the camera shake suppression circuit 304 controls the optical deflection element 303 so as to deflect −θ _{1 in} the rotation direction around the X axis by the X axis drive signal.

  The optical deflection element 303 deflects the light emitted from the light emitting element 302 based on the X-axis drive signal. As a result, visible light 9 is emitted in the same direction as before the rotation of the optical indicating device 2. In FIG. 14, the emission direction before deflection is indicated by a dotted line, and the emission direction after deflection is indicated by a solid line. If the light is emitted in the direction of the dotted line, the position of the spot 10 greatly deviates due to camera shake, but by deflecting in the direction of the solid line, irradiation can be performed in a spatially stable direction. Accordingly, it is possible to suppress the positional deviation of the spot 10 due to camera shake and to stably indicate a desired object.

<C-3. Effect>
In the remote control device according to the third embodiment of the present invention, the optical pointing device 2 cancels fluctuations in the emission direction due to vibration with the rotational vibration detecting element 301 (first vibration detecting sensor) that detects the vibration of the optical pointing device 2. And an optical deflecting element 303 (deflecting device) for deflecting the emitted light in the direction to be directed. Therefore, the positional deviation of the emitted light of the optical pointing device 2 due to camera shake is suppressed.

<D. Embodiment 4>
<D-1. Configuration>
FIG. 15 shows the remote operation processing device 7 and the optical pointing device 2 in the remote operation device according to the fourth embodiment. The remote operation device according to the fourth embodiment includes a vibration detection sensor 73 that detects the rotation (vibration) of the vehicle 1000 in the remote operation processing device 7. The rotation amount of the vehicle 1000 detected by the vibration detection sensor 73 is transmitted to the optical indicating device 2 as an electromagnetic wave signal via the communication antennas 11B and 11A.

  FIG. 16 shows the internal configuration of the optical pointing device 2 of the fourth embodiment. In addition to acquiring the rotation amount of the optical pointing device 2 from the rotational vibration detection element 301, the camera shake suppression circuit 304 acquires the rotation amount of the vehicle 1000 from the communication antenna 11A. Then, the difference between the rotation amount of the optical pointing device 2 and the rotation amount of the vehicle 1000 is calculated, and the optical deflection element 303 is controlled so as to deflect the emitted light in a direction that cancels the difference.

<D-2. Operation>
FIG. 17 shows a state in which the vehicle 1000 is rotated by θ ₂ around the X axis, and the optical pointing device 2 is rotated by θ ₁ around the X axis as in the situation shown in FIG. In this case, the camera shake suppression circuit 304 calculates a difference θ ₁ −θ ₂ between the rotation amount of the optical pointing device 2 and the rotation amount of the vehicle 1000 and deflects the emitted light in a direction that cancels the difference. That is, the outgoing light is deflected by θ ₂ −θ ₁ around the X axis.

  In FIG. 17, the emission direction of the emitted light before deflection of the optical indicating device 2 is indicated by a dotted line. If the emitted light is deflected so as to cancel only the rotation of the optical indicating device 2 without considering the rotation of the vehicle 1000, the emitted light is in the direction of the one-dot chain line in FIG. However, since the position of the display device 1 fluctuates due to the rotation of the vehicle 1000, the visible light 9 is irradiated below the desired object.

  The hand movement suppression mechanism of the optical pointing device 2 according to the fourth embodiment excludes the rotation amount of the vehicle 1000 itself from the rotation amount of the optical pointing device 2 and then deflects the emitted light in a direction that cancels the rotation amount. The camera shake can be appropriately suppressed even under the condition where the vehicle is running and vibrating.

<D-3. Effect>
The remote control device according to the fourth embodiment of the present invention further includes a vibration detection sensor 73 (second vibration detection sensor) that detects vibration of the vehicle 1000 (moving body), and the optical deflection element 303 (deflection device) is optical. The emitted light is deflected in a direction that cancels out the difference between the vibration of the pointing device 2 and the vibration of the vehicle 1000. Therefore, even in an environment where the vehicle 1000 is vibrating, the positional deviation of the emitted light of the optical pointing device 2 due to camera shake is suppressed.

  It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

  DESCRIPTION OF SYMBOLS 1 Display apparatus, 2 Optical indicating device, 3 X-axis light guide plate, 4 Y-axis position detector, 5 Y-axis light guide plate, 6 X-axis position detector, 7 Remote operation processing apparatus, 8 Display control part, 9 Visible light, 10 spot, 11A, 11B communication antenna, 12 infrared light emitting element, 13 infrared light receiving element, 20 display / detector, 21 selection button, 22 determination button, 31 row selection circuit, 32 display drive circuit, 33 light reception detection circuit, 71 object Detection unit, 72 Process determination unit, 73 Vibration detection sensor, 75 CPU, 76 Memory, 101-105 button, 201 Display element, 202 Light receiving element, 301 Rotational vibration detection element, 302 Light emitting element, 303 Optical deflection element, 304 Hand shake suppression Circuit, 1000 vehicle, 1001 operating device, 1002 front seat, 1003 rear seat, l1, l2, l3, l4, l5 display drive lines, m1, m2, m3, m4 row selection lines, n1, n2, n3, n4, n5 light receiving detection lines.

Claims (7)

A self-luminous display device mounted on a moving body;
An optical indicator that irradiates visible light to a partial area of the display screen of the display device;
An irradiation position detector that optically detects an irradiation position of the visible light on the display screen;
An object detection unit that compares a display position of the object displayed on the display screen with the irradiation position, and detects an object displayed at a position corresponding to the irradiation position among the objects;
A process determining unit that determines whether to perform the corresponding process of the object detected by the object detecting unit;
Equipped with a,
The optical pointing device includes a first vibration detection sensor that detects vibration of the optical pointing device;
A deflecting device that deflects outgoing light in a direction that cancels out fluctuations in the outgoing direction due to the vibration;
With
A second vibration detection sensor for detecting vibration of the moving body;
The deflecting device deflects outgoing light in a direction that cancels out the difference between the vibration of the optical indicating device and the vibration of the moving body;
Remote control device. The irradiation position detector
A first light guide plate that is provided on the front surface of the display screen of the display device, guides a part of incident light in a first direction, and emits the light;
A second light guide plate that is provided in front of the display screen of the display device and guides and transmits the transmitted light of the first light guide plate in a second direction different from the first direction;
A second direction detection unit that detects coordinates in the second direction of the irradiation position from light emitted from the first light guide plate;
A first direction detection unit that detects coordinates of the irradiation position in the first direction from light emitted from the second light guide plate,
The remote control device according to claim 1 . The irradiation position detector
A light receiving element that is paired with the display element of the display device and arranged in a plane in a first direction and a second direction different from the first direction;
A first detection line in which the sets of the light receiving elements in the first direction are connected in parallel;
A second detection line in which the sets of the light receiving elements in the second direction are connected in parallel;
Comprising
The remote control device according to claim 1 . The optical indicating device transmits an electromagnetic wave signal to the processing determination unit,
The process determining unit determines to perform the corresponding process of the object detected by the object detecting unit when the electromagnetic wave signal is received;
The remote control device according to any one of claims 1 to 3 . The optical instruction device transmits an infrared signal to the process determination unit,
The process determining unit determines to perform the corresponding process of the object selected by the object detecting unit when the infrared signal is received;
The remote control device according to any one of claims 1 to 3 . The visible light includes a first pattern of visible light and a second pattern of visible light,
The process determination unit determines to perform a corresponding process for an object displayed at a position corresponding to the irradiation position of the visible light of the second pattern among the objects.
The remote control device according to any one of claims 1 to 3 . Irradiate visible light to a partial area of the display screen of a self-luminous display device mounted on a moving object with an optical indicator ,
Optically detecting the irradiation position of the visible light on the display screen;
Compare the display position of the object displayed on the display screen and the irradiation position, detect an object displayed at a position corresponding to the irradiation position among the objects,
It is determined whether to execute a corresponding process of the object the detection,
In the irradiation with visible light, the first vibration detection sensor detects the vibration of the optical pointing device, the second vibration detection sensor detects the vibration of the moving body, the vibration of the optical pointing device and the vibration of the moving body. Including irradiation of the visible light by deflecting the outgoing light in a direction that cancels the difference of
Remote operation method.

Images