JP5458664B2 - Head mounted display device and communication system - Google Patents

Description

  The present invention relates to a head mounted display and a communication system.

  2. Description of the Related Art Conventionally, a head mounted display device (hereinafter referred to as an “HMD device”) that is used by being mounted on a head for viewing an image or the like is known. Furthermore, an HMD device equipped with an optical communication function has also been proposed (see, for example, Patent Document 1). In the invention of Patent Document 1, the HMD device includes optical communication means having a light emitting unit and a light receiving unit, and optical communication is performed between the HMD devices.

JP 2008-199569 A

  However, in the invention of Patent Document 1, the light emitting unit outputs light toward the user's line of sight in the optical communication means, and the light receiving unit receives light that has arrived from the user's line of sight. Then, the position of the user of the HMD device in the vicinity and the orientation to which the HMD device faces are easily limited, and there is a possibility that an appropriate communication state cannot be established depending on the position of the communication partner.

  Then, an object of this invention is to provide the HMD apparatus and communication system which can establish an appropriate communication state with respect to the other party who wants to communicate in view of the said situation.

The HMD device according to the first invention includes a display unit that is mounted on the user's head by the mounting unit, a position information acquisition unit that acquires the current position of the user, and an orientation in which the user's face is facing. A direction calculation unit to be calculated, a communication unit that performs wireless communication with other communication terminals, an acquisition unit that acquires the current position of the communication terminal to be communicated via the communication unit, the current position of the user , and use and orientation that's face facing the current position information of the communication terminal as the communication target, based on, when the communication terminal in the direction of the bearing face of the user is facing as a communication target is present, and a communication control unit to establish communication with the communication terminal as the communication target.

The second aspect based on the first aspect, the acquisition unit further acquires information of the bearing of the communication terminal as the communication target via the communication unit, the communication control unit, the orientation of the communication terminal as the communication target Based on the information, the communication is established when the positional relationship with the communication terminal to be communicated is established.

The third invention is the first or second aspect, further comprising a display control unit for controlling the display mode of the display unit, the display control unit, the face of the current user location and user is facing Information indicating a relative position with a communication terminal to be communicated with respect to the azimuth is displayed on the display unit.

In a fourth aspect based on the third aspect, the display control section further causes the display section to display the distance between the user and the communication terminal to be communicated.

In a fifth aspect based on the third aspect, the display control unit further causes the display unit to display a relative distance between the user and the communication terminal to be communicated.

  A communication system according to a sixth invention is an HMD device according to any one of the first to fifth inventions, a communication terminal that communicates with a head-mounted display device, and between the head-mounted display device and the communication terminal. And a server device that mediates communication.

A communication system according to a seventh aspect of the present invention includes a display unit that is mounted on the user's head by the mounting unit, a position information acquisition unit that acquires the current position of the user, and an orientation in which the user's face is facing. an azimuth calculating unit that calculates a communication unit, a first head-mounted display device having a first head-mounted display apparatus and a communication unit for performing another communication terminal and the wireless communication, the current location of the user, using and azimuth's face is facing, the current position information of the communication terminal as the communication target and the first head-mounted display device obtains, as a communication target in the direction of the bearing face of the user is facing When a communication terminal exists, the server apparatus includes a communication control unit that mediates communication between the first head mounted display device and the communication terminal to be communicated.
In an eighth aspect based on the seventh aspect, the communication terminal to be communicated includes a display unit mounted on the user's head by the mounting unit, a position information acquisition unit that acquires the current position of the user, A second head-mounted display device having an orientation calculation unit that calculates an orientation in which a user's face is facing, and a communication unit , wherein the server device further acquires information on the orientation of the second head-mounted display device and, the communication control unit, the orientation of the information of the first head-mounted display device and based on the orientation information of the second head-mounted display device, the first head-mounted display device and a second head-mounted display device and face each other position When the relationship is reached, it mediates communication between the first head mounted display device and the second head mounted display device .
A ninth aspect of the invention of the seventh or eighth, the server device further includes a display control unit for controlling the display mode of the display unit of the first head-mounted display device, the display control unit, the first head The display unit of the first head mounted display device uses information indicating the relative position with the communication terminal to be communicated with reference to the current position of the user using the mount display device and the orientation in which the user's face is facing. Control to display on the screen.

In a tenth aspect based on the ninth aspect, the display control unit causes the display unit of the first head mounted display device to further display the distance between the user of the first head mounted display device and the communication terminal to be communicated with. To control.

In an eleventh aspect based on the ninth aspect, the display control unit sets the relative distance between the user of the first head mounted display device and the communication terminal to be communicated to the display unit of the first head mounted display device. Further control is performed to display.

  According to the HMD device of the present invention, it is possible to provide an HMD device and a communication system that can establish an appropriate communication state with a communication partner.

The figure which shows an example of the whole structure of the communication system 100 The figure which shows the external appearance of the HMD apparatus 1 Functional block diagram of the HMD device 1 Functional block diagram of server device 50 The flowchart which shows an example of operation | movement of the HMD apparatus 1 in the communication system 100. The figure which illustrates typically the process of the communication system 100 Flowchart illustrating an example of a communication processing subroutine (step S107) The figure which illustrates typically the process of the communication system 100 The figure which illustrates typically the process of the communication system 100 The figure which illustrates typically the process of the communication system 100

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram illustrating an example of the overall configuration of the communication system 100. The communication system 100 includes HMD devices 1 to 3 and a server device 50. The HMD devices 1 to 3 and the server device 50 are connected to each other via the Internet network 31 via access points 32 to 34. The number of HMD devices and access points is an example, and is not limited to this number. Further, the communication system 100 may share one access point among a plurality of HMD devices. Hereinafter, configurations of the HMD devices 1 to 3 and the server device 50 will be described. Since the HMD devices 1 to 3 have the same configuration, the HMD device 1 will be described here.
<HMD device>
FIG. 2 is a diagram illustrating an appearance of the HMD device 1. The HMD device 1 mainly includes headphones 10 and 11, a connection unit 12, a support arm 13, a display unit 14, and an operation unit 15.

  In FIG. 2, headphones 10 and 11 are connected by a connecting portion 12 to constitute a mounting portion. A support arm 13 is attached to the headphone 10 side, and a display unit 14 is attached to the tip thereof. The display unit 14 includes a display monitor 16 that displays an image, a menu screen, and the like on the left eye of a user (not shown) of the HMD device 1.

  The HMD device 1 also has an operation unit 15 on the outer surface of the headphones 11. A touch panel is adopted as the operation unit 15 and receives an instruction input from the HMD device 1. The instruction input to the selection screen displayed on the display monitor 16 is performed via the touch panel. This touch panel detects the position of a fingertip or the like that touches the surface of the touch panel, and outputs it to a CPU (Central Processing Unit) 28 described later as instruction input information. Note that the CPU 28 may receive an instruction input separately by remote control operation.

  FIG. 3 is a functional block diagram of the HMD device 1. The HMD device 1 includes a display unit 14, an operation unit 15, a GPS (Global Positioning System) device 20, an electronic compass 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, and audio processing. Unit 24, speaker (R) 25 a, speaker (L) 25 b, communication interface unit 26 (hereinafter referred to as “communication I / F unit”), display control unit 27, CPU 28, and bus 29. .

  Among these, the ROM 22, the RAM 23, the sound processing unit 24, the communication I / F unit 26, the display control unit 27, and the CPU 28 are connected to each other via a bus 29.

  The GPS device 20, the electronic compass 21, the ROM 22, the RAM 23, the communication I / F unit 26, the display control unit 27, and the CPU 28 are built in the headphone 11 side. The speaker (R) 25a is built in the headphone 11 side, and the speaker (L) 25b is built in the headphone 10 side.

  The GPS device 20 uses a global positioning system using an artificial satellite, and acquires position information (longitude, latitude) of the HMD device 1 worn by the user from the artificial satellite. The position information of the HMD device 1 indicates current position information where the user is present.

  The electronic compass 21 is a geomagnetic sensor using a semiconductor, and calculates the direction by detecting the north-south geomagnetism of the earth. A detection value indicating the direction detected by the electronic compass 21 is transmitted to the CPU 28.

  The ROM 22 is a non-volatile memory that stores a program for controlling the HMD device 1 in advance. The RAM 23 is a memory that temporarily records position information (longitude, latitude), direction information, video content, and the like.

  The sound processing unit 24 is a circuit that converts sound data into sound. The speaker (R) 25a and the speaker (L) 25b output audio of video content (for example, a movie) displayed on the display monitor 16.

  The communication I / F unit 26 is a communication interface for realizing transmission / reception of data with the access point 32 illustrated in FIG. 1 by a wireless LAN (Local Area Network). The access point 32 is connected to the Internet network 31, and the HMD device 1 can send and receive data to and from the server device 50. The wireless LAN signal standard in the present embodiment is also compatible with, for example, Wi-Fi (Wireless Fidelity), which is an international standard for compensating compatibility between various wireless LAN devices.

  The display control unit 27 controls the display mode of the display monitor 16. For example, the display control unit 27 causes the display unit 14 to display information indicating a relative position with respect to another HMD device based on the position of the user wearing the HMD device 1. Further, the display control unit 27 displays, for example, the distance between the user wearing the HMD device 1 and another HMD device on the display unit 14 (details will be described later).

  The CPU 28 is a processor that performs overall control of the HMD device 1. The CPU 28 controls each unit of the HMD device 1 by executing a program stored in advance in the ROM 22. The CPU 28 also functions as a position information acquisition unit 28a, an orientation information calculation unit 28b, a management information reception unit 28c, an HMD information transmission unit 28d, and a communication control unit 28e.

  The position information acquisition unit 28a acquires position information (longitude and latitude) from the GPS device 20 and specifies the current position of the HMD device 1 worn by the user.

  The azimuth information calculation unit 28b acquires a detection value representing a direction from the electronic compass 21, and calculates the azimuth in which the face of the user wearing the HMD device 1 faces. Specifically, the azimuth information calculation unit 28b, with the user wearing the HMD device 1, as shown in FIG. 2, the azimuth (in the drawing, the vertical direction from the center of the display monitor 16 of the display unit 14) (Vector of arrow V) is calculated. In the present embodiment, the azimuth calculated by the azimuth information calculation unit 28b is handled as the azimuth in which the user's face faces. That is, the direction in which the user's face faces is the same as the direction in which the display unit 14 faces (the vector of the arrow V in the figure).

  In the present embodiment, the direction of the north direction vector detected by, for example, the electronic compass 21 before the product shipment is set so that the direction of the vector of the arrow V matches. For example, when the HMD device 1 is rotated 90 degrees clockwise, for example, when the user rotates the face in the right direction, for example, the north direction vector and the arrow V vector are formed. The angle is 90 degrees, and the direction of the arrow V is facing east. Note that the change in the direction in which the display unit 14 of the HMD device 1 is directed may be measured by a gyro sensor or the like that detects angular velocity. In this way, the azimuth information calculation unit 28b can calculate the direction in which the display unit 14 of the HMD device 1 faces is converted into the azimuth based on the angle formed by the north direction vector and the arrow V.

  The management information receiving unit 28c receives, from the server device 50, position information (longitude, latitude) and direction information of other HMD devices, video content information, and the like. The CPU 28 acquires these information and records them in the RAM 23.

  The HMD information transmission unit 28 d transmits the position information (longitude, latitude) and azimuth information of the HMD device 1 to the server device 50 via the communication I / F unit 26. Further, the HMD information transmission unit 28d transmits a command request to the server device 50 such as a video content distribution request.

The communication control unit 28e establishes communication with the HMD device when there is another HMD device in the direction of orientation based on the position information and direction information of the HMD device 1 and the position information of the other HMD device. . Alternatively, depending on the setting conditions of the HMD device 1, the communication control unit 28 e allows the display unit 14 of the HMD device 1 to face the display unit 14 of the other HMD device based on the orientation information for each other HMD device (see FIG. Communication is established when the direction of the vector of the arrow V shown in FIG. However, the positional relationship that faces each other is not limited to the case where they face each other exactly on a straight line, and may be within a preset allowable range. Moreover, in the following description, the HMD device 1 and another HMD device face each other means that the face of the user of the HMD device 1 faces the face of the user of the other HMD device.
<Server device>
FIG. 4 is a functional block diagram of the server device 50. The server device 50 includes a server device CPU 51, a server device recording unit 52, a server communication I / F unit 53, and a bus 54 as main components. The server device CPU 51, the server device recording unit 52, and the server communication I / F unit 53 are connected to each other via a bus 54.

  The server device CPU 51 comprehensively controls the operation of the server device 50. The server device CPU 51 also functions as an HMD information receiving unit 51a and a management information transmitting unit 51b. In addition, this server apparatus 50 shall be installed in the company which supplies the communication system 100 as an example.

  The HMD information receiving unit 51a receives a command request from each HMD device and periodically receives position information (longitude, latitude) and azimuth information of each HMD device.

  The management information transmission unit 51b transmits the position information (longitude, latitude) and azimuth information of the other HMD devices 2 and 3. In addition, the management information transmission unit 51b distributes video content in response to a request from the HMD device 1.

  The server device recording unit 52 is a rewritable memory, and the first management table 52 a illustrated in FIG. 4 manages information used in the communication system 100. For example, the first management table 52a manages the position information, the direction information, the current communication state, the communication destination HMD device, and the like of each HMD device. The second management table 52b manages data files of video content recorded in the memory.

  Next, the operation of the communication system 100 will be described. FIG. 5 is a flowchart showing an example of the operation of the HMD device 1 in the communication system 100. In this communication system 100, the HMD device 1 can accept an instruction input as to whether or not to share video content with other HMD devices 2 and 3.

  This flowchart is started by the control of the CPU 28 when the CPU 28 of the HMD device 1 receives a power-on instruction input. It is assumed that the server device 50 and the other HMD devices 2 and 3 are powered on.

  Step S101: The CPU 28 periodically acquires position information and orientation information of the HMD device 1. Specifically, the position information acquisition unit 28 a of the CPU 28 periodically acquires position information (longitude, latitude) from the GPS device 20. Further, the azimuth information calculation unit 28b of the CPU 28 acquires a detection value indicating a direction from the electronic compass 21 and calculates the azimuth that the display unit 14 of the HMD device 1 faces as azimuth information. The CPU 28 periodically overwrites and records position information and azimuth information in the RAM 23.

  Step S102: The HMD information transmitting unit 28d of the CPU 28 wirelessly transmits the latest position information and the latest azimuth information of the HMD device 1 through the communication I / F unit 27 as HMD information. In this case, the wirelessly transmitted HMD information is received by the access point 32 (FIG. 1) located at the nearest position. Thereafter, the HMD information is received by the server device 50 via the Internet network 31.

  Upon receiving the HMD information, the server device 50 registers it in the management table 52a shown in FIG. Then, the server device 50 overwrites the management table every time the HMD information is received.

  Step S103: The HMD information transmitting unit 28d of the HMD device 1 periodically sends a command indicating an acquisition request for position information and orientation information of the other HMD devices 2 and 3 to the server device 50 via the communication I / F unit 27. Wireless transmission. Similarly, the other HMD devices 2 and 3 periodically transmit to the server device 50 a command representing an acquisition request for position information and orientation information of the HMD devices other than itself.

  Step S104: The management information receiving unit 28c of the CPU 28 of the HMD device 1 acquires the position information and direction information of the other HMD devices 2 and 3 from the server device 50 via the communication I / F unit 27. The CPU 28 acquires these information and records them in the RAM 23. Similarly, the other HMD devices 2 and 3 also acquire and record position information and orientation information of HMD devices other than itself from the server device 50.

  Step S105: The CPU 28 issues an instruction to the display control unit 27, and the display control unit 27 reads out the position information and orientation information of each HMD from the RAM 23 and causes the display monitor 16 to display the information.

  FIG. 6 is a diagram for schematically explaining the processing of the communication system 100. FIGS. 6A, 6 </ b> C, and 6 </ b> E are diagrams schematically illustrating the positional relationship between the other HMD devices 2 and 3 with the HMD device 1 of the user X as a reference. FIGS. 6B, 6 </ b> D, and 6 </ b> F are diagrams illustrating contents displayed on the display monitor 16 of the HMD device 1. Here, the display control unit 27 schematically shows the relative position of the display monitor 16 relative to other HMD devices (replaced by human marks A and B) with reference to the sign (mark X) representing the HMD device 1. Display.

  Step S106: The CPU 28 determines whether or not the HMD device 1 faces any of the other HMD devices 2 and 3. For example, as shown in FIGS. 6C and 6E, when the HMD device 1 faces one of the other HMD devices 2 and 3 (step S106: Yes), the process proceeds to step S107, which will be described later. A communication processing subroutine is started.

  On the other hand, when the HMD device 1 is not facing any of the other HMD devices 2 and 3 (step S106: No), the process proceeds to step S108. For example, if the display control unit 27 has the positional relationship shown in FIG. 6A, the screen having the content shown in FIG. 6B is displayed on the display monitor 16 of the HMD device 1.

  Step S108: The CPU 28 determines whether or not a power-off instruction input has been received. When the power-off instruction input is not accepted (step S108: No), the process returns to step S101 again, and the above-described processing is repeated. Here, by viewing the screen shown in FIG. 6 (b), the user X can know which direction to face the other HMD device 2 or HMD device 3. For example, when the user X rotates the face rightward so that the HMD device 1 is rotated clockwise and the HMD device 1 and the HMD device 2 face each other, the CPU 28 performs the following step S106. The process proceeds to S107, and a communication processing subroutine to be described later is started.

  On the other hand, when an instruction to turn off the power is received (step S108: Yes), the flowchart shown in FIG. 5 ends.

  Next, a communication processing subroutine will be described. FIG. 7 is a flowchart illustrating an example of a communication processing subroutine (step S107).

  Step S201: The CPU 28 instructs the display control unit 27 so that the display control unit 27 displays a menu screen on the display monitor 16. For example, in the positional relationship illustrated in FIG. 6C, the management information receiving unit 28 c of the user A's HMD device 2 establishes communication with the HMD device 1 from the management information transmitting unit 51 b of the server device 50. Or not, and on the menu screen of the display monitor 16 of the HMD device 2 of the user A, “Do you want to start communication with Mr. X?” Or “Share video content with Mr. X” Is displayed.

  On the other hand, the display control unit 27 of the HMD device 1 of the user X displays a message such as “Waiting for communication permission from Mr. A” on the menu screen of the display monitor 16.

  Step S202: When the CPU 28 receives an instruction input indicating sharing of video content from the operation unit 15, the HMD information transmission unit 28d sends a command requesting so-called streaming delivery of the movie M1, for example, to the server device 50 via the communication I / O. Wireless transmission is performed via the F unit 26. Then, the HMD information receiving unit 51a of the server device 50 receives a command requesting streaming distribution of video content (for example, movie M1) via the server communication I / F unit 53. Then, the management information transmission unit 51a of the server device 50 transmits the moving image data of the movie M1 to the HMD device 1 and the HMD device 2 via the server communication I / F unit 53.

  Further, the server CPU 51 rewrites the communication state of the HMD devices 1 and 2 from “-(not communicating)” to “communicating” in the first management table 52a.

  Step S203: The management information receiving unit 28c receives the moving image data of the movie M1, and temporarily records the moving image data in the RAM 23. The communication control unit 28e instructs the display control unit 27 to sequentially read moving image data from the RAM 23 and display a movie on the sub-screen W of the display monitor 16 (FIG. 6D). Furthermore, the communication control unit 28e transmits a command representing sharing of video content to the HMD device 2. The HMD device 2 can view the movie M1 by receiving the command representing the sharing of the video content.

  Step S204: The communication control unit 28e determines whether the streaming distribution of the video content has ended. When the streaming distribution is completed (step S204: Yes), the process proceeds to step S206 described later. On the other hand, if streaming delivery is being performed (step S204: No), the process proceeds to step S207.

  Step S205: The CPU 28 determines whether or not the orientation information of the HMD device 1 has been changed. When the orientation information of the HMD device 1 is not changed (step S205: No), the process returns to step S203, and the distribution of the video content is continued.

  On the other hand, when the direction information of the HMD device 1 is changed (step S205: Yes), the process proceeds to step S206. An example in which the orientation information is changed is a case where the orientation of the vector V shown in FIG. 2 is changed, for example, when the user X turns his face to the right. The CPU 28 may determine whether or not the orientation information of the HMD device 1 is changed according to the angle at which the HMD device 1 measured by the gyro sensor or the like is rotated by the user.

  Step S206: The communication control unit 28e transmits to the HMD device 2 a command indicating the suspension of video content distribution. As a result, the distribution of the video content is stopped on the display monitor 16 of the HMD device 2. Then, the subroutine shown in FIG. 7 ends, and the process returns to step S108 in the flowchart shown in FIG. Note that the HMD device 2 may be configured to allow viewing until the currently viewed video content ends.

As described above, in the present embodiment, communication can be established in consideration of the position of the user of the HMD device in the vicinity and the orientation of the HMD device. Further, in the present embodiment, communication processing is performed via a wireless LAN instead of optical communication such as infrared rays, so communication is possible even if there is an obstacle that blocks light between the HMD devices. Furthermore, in this embodiment, for example, since communication is established from a wireless LAN through the Internet network, long-distance communication through the Internet network is possible.
(Modification)
Next, a modification of this embodiment will be described. The communication system 100 described above is composed of the HMD devices 1 to 3 and the server device 50. In the communication system according to the modified example of the present embodiment, the HMD devices 1 to 3 are connected via the Internet network 31 via the access points 32 to 34 and exchange information without using the server device 50.

  In this case, the HMD device 1 includes a function equivalent to the first management table 52a and the second management table 52b illustrated in FIG. It is assumed that video content is recorded in advance in the RAM 23 of the HMD device 1. In addition, the HMD information transmission unit 28d of the other HMD devices 2 and 3 directly transmits position information, orientation information, and the like to the HMD device 1. In this way, when the HMD device 1 faces one of the other HMD devices 2 and 3, the communication control unit 28e can establish communication.

Therefore, even in the case of the modification of the present embodiment, an appropriate communication state can be established for the other party that wants to communicate.
<Supplementary items>
(1) In this embodiment, an example of the display mode of the display monitor 16 has been shown. However, for example, the following display mode may be used. FIG. 8 is a diagram for schematically explaining the processing of the communication system 100.

  FIGS. 8A and 8C are diagrams schematically showing the positional relationship of other HMD devices with reference to the HMD device 1 of the user X. FIG. Other HMD devices are represented by pictures representing people.

  Here, for example, when the CPU 28 receives an instruction input for setting the number of displays of the other HMD device users to 5 via the operation unit 15 of the HMD device 1, the management information receiving unit 28c of the CPU 28 Position information of another MHD device is received from the device 50. The CPU 28 calculates the mutual distance based on the positional information of the HMD device 1 and the positional information of the other HMD device, and preferentially selects the other HMD devices that are closer to the HMD device 1. In the example of FIG. 8B, the CPU 28 selects five HMD devices existing in a semicircle having a radius of 100 m or less with the position of the HMD device 1 as the center. Then, the display control unit 27 causes the display monitor 16 to display a person mark associated with the selected HMD device. In this case, the communication control unit 28e of the CPU 28 establishes communication with any of the HMD devices displayed on the display monitor 16.

  Further, as shown in FIG. 8 (c), there are two users of the HMD device in a semicircle within a radius of 100 m centering on the position of the HMD device 1, and within the semicircle within a radius of 150 m, When there are five users, for example, the CPU 28 displays an instruction to display the users of the HMD device within a semicircle having a radius of 150 m or less with the position of the HMD device 1 as the center through the operation unit 15 of the HMD device 1. When receiving the input, the management information receiving unit 28c of the CPU 28 receives the position information of the other MHD device from the server device 50 as described above. The CPU 28 calculates the mutual distance based on the position information of the HMD device 1 and the position information of the other HMD device, and selects an HMD device within a semicircle having a radius of 150 m or less with the position of the HMD device 1 as the center. To do. Then, the display control unit 27 causes the display monitor 16 to display a person mark associated with the selected HMD device (FIG. 8D). At this time, the display control unit 27 may display the relative distance between the user of the HMD device 1 and the user of another HMD device.

  Further, unlike the above embodiment, the user sets the number of human marks (number of other HMD devices) associated with the HMD device to be displayed on the display monitor 16 of the HMD device 1, and the display monitor 16. The display control unit 27 may automatically adjust the distance or angle to be displayed on the display monitor 16 so that the number of human marks displayed on the display becomes the set number. Further, when the number of human marks displayed on the display monitor 16 is less than the set number due to the movement of the user or another user, the display control unit 27 is displayed on the display monitor 16. The display distance is increased so that the number of marks of the person in question becomes the set number, or the angle is automatically adjusted to increase the angle. On the other hand, when the number of human marks displayed on the display monitor 16 is larger than the set number due to the movement of the user or another user, the display control unit 27 displays the mark on the display monitor 16. The display distance is shortened or the angle is automatically adjusted so that the number of marks of the person being displayed is the set number.

Furthermore, the display control unit 27 may perform the display modes described below. FIG. 9 is a diagram for schematically explaining the processing of the communication system 100. FIG. 9A is a diagram schematically showing the positional relationship of other HMD devices with the HMD device 1 of the user X as a reference. Here, the display control unit 27 is, for example, the CPU 28 via the operation unit 15 of the HMD device 1, and the CPU 28 is a user of the HMD device within the range of +45 degrees to −45 degrees with the position of the HMD device 1 as the center. When the instruction input for displaying is received, the display control unit 27 displays the user of the HMD device within +45 degrees to −45 degrees (FIG. 9B).
(2) In the present embodiment, the case where there is one HMD device in the same direction has been illustrated for the sake of simplicity of explanation, but when there are a plurality of HMD devices in the same direction, the CPU 28, for example, Any of the treatments described in the above.

  (A) The communication control unit 28 e illustrated in FIG. 1 establishes communication with the HMD device located closest to the HMD device 1.

  (B) On the server device 50 side shown in FIG. 4, user profile information (name, affiliation, hobby, etc.) is added to the items of the first management table 52a. The management information receiving unit 28c of the HMD device 1 receives the profile information, and the display control unit 27 causes the display monitor 16 to display the profile information. When the CPU 28 receives the input of the selected person via the operation unit 15, the communication control unit 28e establishes communication with the HMD device worn by the selected person (user).

  (C) On the server device 50 side, communication history information is added to the items of the first management table 52a. The management information receiving unit 28c of the HMD device 1 receives the communication history information. The communication control unit 28e establishes communication with the user's HMD device having the highest communication frequency.

(D) The display control unit 27 displays the HMD devices in the same direction on the display monitor 16 of the HMD device 1 so as not to overlap, for example. When the CPU 28 receives an input from the selected HMD device via the operation unit 15, the communication control unit 28e establishes communication with the selected HMD device.
(3) In the present embodiment, the GPS device 20 has acquired the position information (longitude, latitude), but may also acquire altitude information. FIG. 10 is a diagram for schematically explaining the processing of the communication system 100. As shown in FIG. 10, the display control unit 27 may schematically display on the display monitor 16 in consideration of altitude.
(4) In the present embodiment, the communication terminal that communicates with the HMD device 1 is not limited to the HMD device, and may be a mobile phone equipped with a GPS device or an electronic compass.
(5) In the present embodiment, a microphone function may be further mounted so that conversation can be performed between the HMD devices.
(6) In the present embodiment, for example, the server device 50 may register in advance an HMD device that allows communication from the viewpoint of privacy protection. The HMD device 1 may communicate with an HMD device registered in the orientation of the orientation that the device faces.

DESCRIPTION OF SYMBOLS 1 ... HMD apparatus, 20 ... GPS apparatus, 21 ... Electronic compass, 23 ... RAM, 26 ... Communication I / F part, 27 ... Display control part, 28 ... CPU , 28a ... position information calculation unit, 28b ... direction calculation unit, 28c ... management information reception unit, 28d ... HMD information transmission unit, 28e ... communication control unit, 50 ... server device , 51a ... HMD information receiving unit, 51b ... management information transmitting unit

Claims (11)

A display unit mounted on the user's head by the mounting unit;
A position information acquisition unit for acquiring the current position of the user;
An azimuth calculating unit for calculating an azimuth in which the user's face is facing;
A communication unit that performs wireless communication with other communication terminals;
An acquisition unit for acquiring a current position of a communication terminal to be communicated via the communication unit;
The current position of the user, the a orientation face of the user is facing, and the current location information of a communication terminal serving as the communication target, based on the orientation of the bearing face of the user is facing wherein when the communication terminal as the communication target is present, the head mounted display device, characterized in that it comprises a communication control unit and for establishing a communication with the communication terminal serving as the communication target. The head mounted display device according to claim 1 ,
Before SL acquisition unit further acquires the orientation information of the communication terminal serving as the communication target via the communication unit,
The head mounted display device, wherein the communication control unit establishes communication based on information on a direction of the communication terminal serving as a communication target, when a positional relationship is established to face the communication terminal serving as the communication target. . The head mounted display device according to claim 1 or 2,
Further comprising a display control unit for controlling a display mode of said display unit,
The display control unit causes the display unit to display information indicating a relative position with respect to the communication terminal to be communicated with respect to a current position of the user and an orientation in which the user's face is facing. A head-mounted display device. In the head mounted display device according to claim 3,
The display control unit further causes the display unit to display a distance between the user and the communication terminal to be communicated. The head mounted display device. In the head mounted display device according to claim 3,
The display control unit further causes the display unit to display a relative distance between the user and the communication terminal to be communicated. A head mounted display device. A head-mounted display device according to any one of claims 1 to 5;
A communication terminal for communicating with the head mounted display device;
Communication system, comprising a server apparatus that mediates communication between the communication terminal and the head-mounted display device. A display unit mounted on the user's head by the mounting unit, a position information acquisition unit that acquires the current position of the user, an orientation calculation unit that calculates an orientation in which the user's face is facing, and communication A first head mounted display device comprising:
The first head-mounted display device, a communication unit that performs wireless communication with other communication terminals, the current position of the user, the orientation in which the user's face is facing, and the first head-mounted display device It acquires the current position information of the communication terminal as the communication target, a case where the communication terminal the user's face is the communication target by which the direction of orientation opposite is present, and the first head-mounted display device A communication control unit that mediates communication with the communication terminal that is the communication target ;
A communication system comprising: The communication system according to claim 7,
The communication terminal to be communicated includes a display unit that is mounted on a user's head by a mounting unit, a position information acquisition unit that acquires the current position of the user, and an orientation in which the user's face is facing A second head-mounted display device having an azimuth calculating unit for calculating, and a communication unit ,
The server device further acquires information on the orientation of the second head mounted display device ,
The communication control unit includes: the first head mounted display device and the second head mounted display device based on the orientation information of the first head mounted display device and the orientation information of the second head mounted display device . when it is in a positional relationship where the face, a communication system, characterized in that mediates communication between the first head-mounted display device and the second head-mounted display device. The communication system according to claim 7 or claim 8,
The server apparatus further includes a display control unit for controlling the display mode of the display unit of the first head-mounted display device,
Wherein the display control unit uses the first head-mounted display device, wherein the user's current position and the reference and orientation face of the user is facing, the relative location of the communication terminal serving as the communication target Control is performed so as to display information on the display unit of the first head mounted display device. The communication system according to claim 9,
The display controller, to control the distance between the first head mount said communication terminal user and serving as the communication target of the display device so as further to be displayed on the display unit of the first head-mounted display device A featured communication system. The communication system according to claim 9,
The display controller, the first head-mounted display device said user and said display unit further controls so as to display the relative distance said first head-mounted display device of the communication terminal as the communication target A communication system characterized by:

Images