JP5310591B2 - Communication system and head mounted display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication system, wherein the location of a mobile phone can be properly notified to a user and a new mobile phone and a head-mounted display are communicably connected, and to provide the head-mounted display included in the communication system. <P>SOLUTION: The present invention relates to a communication system wherein a mobile phone and a head-mounted display are communicably connected. The mobile phone includes a first human body proximity communicator, and the head-mounted display includes a second human body proximity communicator. When it is determined that communication with the first human body proximity communicator can be performed via the second human body proximity communicator (S206:Yes), in the head-mounted display, a first type location image is presented which indicates that the mobile phone is located in proximity to the body surface of a user (S207). <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a communication system in which a mobile phone capable of performing communication via a mobile phone communication network and a head mounted display mounted on a user's head are communicably connected, and a head included in the communication system It relates to the mount display.

  With regard to the information presentation apparatus, in particular, a proposal has been made regarding an apparatus for controlling the presentation state of content to a user who uses a mobile phone (see, for example, Patent Document 1). Specifically, Patent Document 1 discloses an information presentation device including a mobile phone, an information presentation unit, and an output control unit. Here, the information presentation unit is configured to present content to the user. The output control unit is configured to control the content presentation state by the information presenting unit. Further, the output control unit is configured to cause the information presenting unit to present information based on the incoming call to the mobile phone after the incoming call to the mobile phone. For example, the information presenting unit presents a ring tone or a call sound from a mobile phone to the user from the information presenting unit. Patent Document 1 discloses a configuration in which an information presentation device further includes a content reproduction unit. The content reproducing unit reproduces the recorded content and sends it to the information presenting unit, and the information presenting unit presents the content to the user. The output control unit stops the reproduction of the content in the content reproduction unit after the incoming call to the mobile phone. In Patent Document 1, functions such as an output control unit and a content playback unit can be realized by a head mounted display (HMD) main body, and the HMD main body uses a video display unit (for example, an RSD or a liquid crystal display device). It is said that one HMD can be configured in combination.

  In addition, a technique called human body proximity communication has been proposed. For example, a technique relating to a data communication system that enables direct data communication between data communication devices worn on two human bodies has been proposed (see, for example, Patent Document 2). Specifically, Patent Document 2 includes one reference electrode, at least a transmission electrode and a modulation unit, a first data communication device to be attached to the first human body, one reference electrode, at least a reception electrode, and A second data communication device having a demodulator and attached to the second human body, wherein the first data communication device and the second data communication device are brought into contact with each other by contacting the first human body and the second human body; A technique for transmitting communication data to is disclosed. In addition, the technique relevant to patent document 2 is also proposed (for example, refer patent document 3).

JP 2008-167373 A JP 2002-246987 A Japanese Patent Laid-Open No. 10-229357

  By the way, in recent years, mobile phones have become widespread. Unlike a fixed phone, a mobile phone is not installed and used in a certain place. For example, the mobile phone is put in a pocket of clothes worn by a user, or is carried in a bag or the like. In addition, when the user arrives at the destination or returns home from the outside, it is placed on a table or the like, and stored in a desk drawer or the like. In such a situation, the user may not be able to immediately remember where the mobile phone is.

  The present invention provides a communication system in which a new mobile phone and a head cloak display are communicably connected, and a head cloak display included in the communication system, which can suitably notify the user of the location of the mobile phone. The purpose is to do.

One aspect of the present invention made in view of the above-described conventional problem is that a mobile phone capable of performing communication via a mobile phone communication network and a head mounted display mounted on the user's head are connected to be communicable. In the communication system, the mobile phone performs first-person-body-side communication means for performing near-body communication via the vicinity of the user's body surface and wireless communication having a longer communication distance than the near-body communication. A first wireless communication means , wherein the head mounted display comprises: an image presentation means for presenting a predetermined image; a second human body vicinity communication means for executing the human body vicinity communication; and the first human body vicinity communication means. and near the human body communication determination means for determining whether said second human body proximity communication means the human body proximity communication can be performed through between the second wireless communication means for performing the wireless communication, When it is determined by the human body proximity communication determination means that the human body proximity communication can be performed with the first human body proximity communication means via the second human body proximity communication means, the mobile phone is connected to the user's body surface. A first type location image indicating that the first type location image is present from the image presenting means , and the human body vicinity communication determining means controls the second kind of image between the first human body vicinity communication means and the second body proximity communication means. When it is determined that the human body proximity communication via the human body proximity communication means cannot be performed, and the wireless communication with the first wireless communication means can be performed via the second wireless communication means, the mobile phone communication system in which the second type location images showing that not in a position close to the body surface, characterized in that it comprises an image presentation control means for controlling so as to be presented from the image presentation means It is.

  According to this, it is possible to present the user with the first type location image indicating that the mobile phone is in a position close to the user's body surface. Note that “indicating that the mobile phone is in a position close to the body surface of the user” means “indicating that the mobile phone is within a range in which near-body communication with a head mounted display can be performed”. .

Case mobile phone is not in a position close to the body surface of the user can also be presented of the second kind location image indicating that there is no to the cellular phone close to the body surface of the user's location to the user. Note that “indicating that the mobile phone is not in a position close to the body surface of the user” means “indicating that the mobile phone is not in a range where it can perform near-body communication with a head mounted display”. .

This communication system can also be configured as follows. That is , the head mounted display further includes confirmation means for confirming radio wave intensity in the wireless communication via the second wireless communication means with the first wireless communication means, and the image presentation control means includes: When the human body vicinity communication determining means determines that the human body vicinity communication via the second human body vicinity communication means cannot be executed with the first human body vicinity communication means, the second wireless communication means is used. If possible the wireless communication between the first wireless communication means Te, wherein the information indicating that the mobile phone is not in a position close to the body surface of the user, within the range in accordance with the radio field intensity checked by the check means The second-type location image including information indicating that the mobile phone is present may be controlled to be presented from the image presentation means. .

  According to this, it is possible to present the user with the second type location image indicating that the mobile phone is within the range corresponding to the confirmed radio wave intensity, not the position close to the body surface of the user. The user can know that the mobile phone is located at a predetermined distance according to the radio field intensity.

Further, the portable telephone, further wherein the detecting means for detecting at least one of state information on the state in which the mobile phone is present, the state information detected by said detecting means, notifies the head-mounted display Status information notification means, and the image presentation control means cannot execute the human body proximity communication with the first human body proximity communication means via the second human body proximity communication means by the human body proximity communication determination means. If the wireless communication can be performed with the first wireless communication unit via the second wireless communication unit in the state determined to be included, information corresponding to at least one of the state information notified from the state information notification unit is included. The second type location image may be controlled to be presented from the image presentation unit.

  According to this, the second type location image including information corresponding to the state where the mobile phone is present can be presented to the user. Note that the user can know the location of the mobile phone in a specific manner in accordance with the presence of the mobile phone.

  The detecting means may detect at least brightness of a place where the mobile phone is present as the state information. According to this, the second type location image including information according to the brightness of the location where the mobile phone is present can be presented to the user.

  The detection means may detect at least that the mobile phone is displaced as the state information. According to this, the second type location image including information according to the mobile phone being displaced can be presented to the user.

  The mobile phone further includes incoming information notifying means for notifying the head-mounted display of incoming information indicating that the mobile phone has received an incoming call, and the human body proximity communication determining means includes the incoming information notification. When the incoming call information is received from a means, it may be determined whether or not the human body vicinity communication can be executed with the first human body vicinity communication means via the second human body vicinity communication means. According to this, when there is an incoming call to the mobile phone, the first type location image can be presented to the user.

Another aspect of the present invention is specified as a head-mounted display in any one of the communication systems described above. That is, according to another aspect of the present invention, communication via a mobile phone communication network, near-body communication via the vicinity of the user's body surface, and wireless communication having a longer communication distance than the near-body communication can be performed. A head-mounted display mounted on the user's head that is communicable with a mobile phone, image presenting means for presenting a predetermined image, second human vicinity communication means for executing the human body vicinity communication, Human body vicinity communication determination means for determining whether the human body vicinity communication can be executed with the mobile phone via the second human body vicinity communication means, second wireless communication means for executing the wireless communication, and the human body vicinity When it is determined by the communication determination means that the human body proximity communication can be performed with the mobile phone via the second human body proximity communication means, the mobile phone is connected to the user's body surface. The indicates that in the close positions in one location image, the control as presented from the image presenting unit, the second human body proximity communication means between said mobile phone by the human body proximity communication determination means When the wireless communication with the mobile phone can be performed via the second wireless communication means in a state where it is determined that the human body proximity communication cannot be performed via the mobile phone, the mobile phone is positioned close to the body surface of the user. An image presentation control unit that controls the second type location image indicating that the second type location image is presented from the image presentation unit .

The head mounted display further includes confirmation means for confirming radio field intensity in the wireless communication via the second wireless communication means with the mobile phone, and the image presentation control means is provided near the human body. The mobile phone and the wireless communication device via the second wireless communication device in a state where it is determined by the communication determination device that the human body communication via the second human body communication device cannot be performed with the mobile phone. If it can communicate, as the information indicating that the mobile phone is not in a position close to the body surface of the user, information indicating the that the mobile phone is within the range in accordance with the signal strength it is confirmed by the confirmation means The second type location image including the image may be controlled to be presented from the image presentation unit.

  Further, the image presentation control means is configured to determine whether the human body vicinity communication determination means cannot execute the human body vicinity communication with the mobile phone via the second human body vicinity communication means. When wireless communication with the mobile phone is possible via wireless communication means, information corresponding to at least one state information relating to the state where the mobile phone is detected and notified from the mobile phone is present. Control may be performed so that the second-type location image including the image is presented from the image presentation unit.

  In addition, the human body proximity communication determining means receives the incoming information indicating that the mobile phone has received an incoming call from the mobile phone, and the mobile phone is connected to the mobile phone via the second human body proximity communication means. It may be characterized by determining whether or not human body near-field communication can be performed.

  According to these head mounted displays, the above communication system can be realized, and the above-described excellent functions can be exhibited in the communication system.

  According to the present invention, a communication system in which a new mobile phone and a head cloak display can be suitably notified to the user of the location of the mobile phone, and a head cloak display included in the communication system. Can be obtained.

It is a figure which shows a communication system. It is a figure which shows a head mounted display. It is a figure which shows the flowchart of the process performed with a mobile telephone. It is a figure which shows the flowchart of the process performed with a head mounted display. (A) shows the positional relationship between the mobile phone and the user, and (b) is a diagram showing the first type location image presented on the head mounted display when the positional relationship shown in FIG. It is a figure which shows the flowchart of the process performed with a head mounted display. (A) shows the positional relationship between the mobile phone and the user, and (b) is a diagram showing a second type location image presented on the head mounted display in the positional relationship shown in FIG. 7 (a). (A) shows the positional relationship between the mobile phone and the user, and (b) is a diagram showing a second-type location image presented on the head-mounted display when the positional relationship shown in FIG. (A) shows the positional relationship between the mobile phone and the user, and (b) is a diagram showing a second-type location image presented on the head-mounted display when the positional relationship shown in FIG. (A) shows the positional relationship between the mobile phone and the user, and (b) is a diagram showing a second-type location image presented on the head-mounted display when the positional relationship shown in FIG.

  Embodiments for carrying out the present invention will be described below in detail with reference to the drawings. The present invention is not limited to the configurations described below, and various configurations can be employed in the same technical idea. For example, some of the configurations described below may be omitted or replaced with other configurations. Moreover, you may make it include another structure.

(Communications system)
As shown in FIG. 1, the communication system 100 includes a mobile phone 200 and a head mounted display (hereinafter also referred to as “HMD”) 300. The mobile phone 200 can execute communication via the mobile phone communication network 400. The HMD 300 is worn on the user's head as shown in FIG. 2, and presents a predetermined image to the user. The user visually recognizes the presented predetermined image. In the communication system 100, the mobile phone 200 and the HMD 300 are communicably connected by a predetermined method described later. Specifically, in the communication system 100, when an incoming call is received by the mobile phone 200, the first type location image 500 or the second type location image 510, 520, 530, 540 regarding the location of the mobile phone 200 is presented by the HMD 300. The A user wearing and using the HMD 300 can know the outline of the location where the mobile phone 200 is present from the first-type location image 500 or the second-type location images 510, 520, 530, and 540 presented. Details of the first type location image 500 and the second type location image 510, 520, 530, 540 will be described later.

  As shown in FIG. 1, the mobile phone 200 includes a CPU 210, a ROM 212, a RAM 214, a mobile communication unit 220, a near-body communication unit 230, a local wireless communication unit 240, an optical sensor 250, an acceleration sensor 260, and an operation unit 270. The CPU 210 controls various processes executed by the mobile phone 200. The CPU 210 executes various programs stored in the ROM 212 on the RAM 214. As a result, various functions are executed, and various functional means are configured.

  The mobile communication unit 220 executes communication with the mobile phone communication network 400. The human body vicinity communication unit 230 performs human body vicinity communication via the vicinity of the body surface of the user wearing the mobile phone 200, for example. The local wireless communication unit 240 performs wireless communication having a longer communication distance than human body vicinity communication. As the wireless communication having a longer communication distance than the near-body communication, short-range wireless communication with a communication distance of several meters to several tens of meters or several tens of meters to several hundreds of meters is applicable. Specifically, Bluetooth (registered trademark) or wireless LAN is exemplified.

  The optical sensor 250 detects the brightness of the place where the mobile phone 200 exists. The acceleration sensor 260 detects acceleration acting on the mobile phone by vibration applied to the mobile phone 200 and a change in the posture state of the mobile phone 200. Note that when the mobile phone 200 moves or the position thereof changes, vibration is applied to the mobile phone 200 and the posture state of the mobile phone 200 changes. The operation unit 270 is configured by, for example, a dial key. The user can operate the operation unit 270 to instruct the mobile phone 200 to execute various processes.

As shown in FIG. 1, the HMD 300 includes a CPU 310, a ROM 312, a RAM 314, an image processing unit 320, an image presentation unit 330, a human body vicinity communication unit 340, a local wireless communication unit 350, an optical sensor 360, and an operation unit 370 . The CPU 310 controls various processes executed by the HMD 300. The CPU 310 executes various programs stored in the ROM 312 on the RAM 314. As a result, various functions are executed, and various functional means are configured.

  The image processing unit 320 includes a graphics processing unit (hereinafter also referred to as “GPU”) 322 and a VRAM (Video RAM) 324. The image processing unit 320 generates a predetermined image presented from the image presenting unit 330 based on a command from the CPU 310, for example, a first type location image 500 or a second type location image 510, 520, 530, and 540 described later. Specifically, the GPU 322 performs a reproduction process on predetermined data indicating a predetermined image such as the first type location image 500 or the second type location image 510, 520, 530, or 540 presented from the image presentation unit 330. Execute to generate this predetermined image. The generated predetermined image is stored in the VRAM 324. Note that predetermined data indicating a predetermined image such as the first type location image 500 or the second type location image 510, 520, 530, 540 is stored in, for example, the ROM 312 or a storage area not shown in FIG. Has been.

  The image presentation unit 330 presents a predetermined image such as the first type location image 500 or the second type location image 510, 520, 530, or 540 stored in the VRAM 324 so that the user wearing the HMD 300 can see the image. To do. The image presentation unit 330 scans image light representing a predetermined image such as the first type location image 500 or the second type location image 510, 520, 530, or 540 stored in the VRAM 324 in a two-dimensional direction, and scans the image light. The formed image light is guided to the user's eyes and can be configured using a retinal scanning display that forms a predetermined image on the retina. In addition, a configuration using a liquid crystal display, an organic EL (Organic Electroluminescence) display, or other devices can also be used.

  In the communication system 100, the HMD 300 may be a see-through HMD. In the case of the see-through type HMD 300, the image presentation unit 330 has a configuration corresponding thereto, for example, a half mirror in front of the user's eyes through which image light is guided. According to the see-through type HMD 300, the user can visually recognize the external image even when the user wears the HMD 300 and visually recognizes the first type location image 500 or the second type location image 510, 520, 530, 540. .

  Human body vicinity communication unit 340, local wireless communication unit 350, and optical sensor 360 are configured to perform the same functions as human body vicinity communication unit 230, local wireless communication unit 240, and optical sensor 250 provided in mobile phone 200, respectively. Therefore, these details are the same as described above, and will be omitted. In the HMD 300, for example, as shown in FIG. 2, the optical sensor 360 is installed on the upper surface of a casing in which the above-described components such as the CPU 310 are housed. The operation unit 370 is configured by a predetermined key, for example. The user can operate the operation unit 370 to instruct execution of various processes for the HMD 300.

  In the following description, wireless communication that has a longer communication distance than near-body communication and is performed between the local wireless communication unit 240 and the local wireless communication unit 350 is referred to as short-range wireless communication. Say.

(Processing executed on the mobile phone)
In the communication system 100, the mobile phone 200 executes the process shown in FIG. This process is performed by the CPU 210 executing a program for this process stored in the ROM 212 on the RAM 214. This process is performed, for example, when the power of the mobile phone 200 is turned on or when a command to start this process is input to the mobile phone 200 via the operation unit 270. The CPU 210 that has started this process establishes short-range wireless communication with the HMD 300, specifically, the local wireless communication unit 350 via the local wireless communication unit 240 (S100).

  After executing S100, the CPU 210 determines whether the mobile phone 200 has received an incoming call, in other words, whether the mobile communication unit 220 has received an incoming signal from the mobile phone communication network 400 (S102). If the incoming signal is not received as a result of the determination (S102: No), the CPU 210 waits until the incoming signal is received. On the other hand, when the incoming signal is received (S102: Yes), the CPU 210 acquires the state detected by the optical sensor 250 and the acceleration sensor 260 (S104). Specifically, the brightness detected by the optical sensor 250 and the acceleration detected by the acceleration sensor 260 are acquired.

  In S <b> 106, the CPU 210 notifies the HMD 300 of incoming call information indicating that there has been an incoming call and state information regarding the state detected by the optical sensor 250 and the acceleration sensor 260. Here, the incoming call information includes a destination number and a destination name in addition to information indicating that the incoming call has been received. The state information includes the brightness detected by the optical sensor 250 and the acceleration detected by the acceleration sensor 260. The notification in S106 is performed by short-range wireless communication via the local wireless communication unit 240 established in S100.

  After executing S106, the CPU 210 determines whether a request related to near-body communication has been received from the HMD 300 (S108). It should be noted that the request related to human body proximity communication is transmitted in S203 of the process shown in FIG. As a result of the determination, if a request related to human body proximity communication has not been received (S108: No), the CPU 210 moves the process to S112. On the other hand, when the request regarding the human body vicinity communication is received (S108: Yes), the CPU 210 controls the human body vicinity communication unit 230 and responds to the request from the HMD 300 (S110). And CPU210 transfers a process to S112. Thereby, near-body communication is established with the mobile phone 200. In S112, the CPU 210 determines whether communication with the mobile phone communication network 400 has been started, in other words, whether the user has responded to the incoming call and started the call.

  As a result of the determination in S112, when a call is started (S112: Yes), the CPU 210 returns the process to S102. At this time, the CPU 210 notifies the HMD 300 of information indicating the start of a call. This notification may be performed by either short-range wireless communication via the local wireless communication unit 240 or human body proximity communication via the human body vicinity communication unit 230. For example, if the determination in S108 is negative (S108: No), it may be performed by short-range wireless communication via the local wireless communication unit 240. If the determination in S108 is affirmative (S108: Yes), the determination may be performed by human body proximity communication via the human body vicinity communication unit 230. On the other hand, when the call has not started (S112: No), the CPU 210 returns the process to S104. CPU210 which returned the process to S104 repeats and performs the process of S104-S110 again. At this time, for example, the incoming information and the status information are again notified to the HMD 300 (S106). This process is repeatedly executed until the power of the mobile phone 200 is turned off or a command to stop the process is input to the mobile phone 200 via the operation unit 270.

(Processing executed by HMD)
In the communication system 100, the HMD 300 executes the processes shown in FIGS. This process is performed by the CPU 310 executing a program for this process stored in the ROM 312 on the RAM 314. This process is performed, for example, when the power of the HMD 300 is turned on or when a command to start this process is input to the HMD 300 via the operation unit 370. The CPU 310 that has started this process establishes short-range wireless communication with the mobile phone 200, specifically, the local wireless communication unit 240 via the local wireless communication unit 350 (S200).

  The short-range wireless communication can be established either in a configuration established in response to a request from the mobile phone 200 to the HMD 300 or in a configuration established in response to a request from the HMD 300 to the mobile phone 200. For example, when requesting from the HMD 300, the CPU 310 transmits this request to the mobile phone 200 via the local wireless communication unit 350 in S200.

  After the short-range wireless communication with the mobile phone 200 is established in S200, the CPU 310 determines whether the incoming call information and the status information are received from the mobile phone 200 (S202). The incoming call information and status information are notified in S106 of the process shown in FIG. 3 described above, and are received by the HMD 300 via the local wireless communication unit 350.

  As a result of the determination in S202, when the incoming call information and the status information are not received (S202: No), the CPU 310 waits until these are received. On the other hand, when the incoming call information and the status information are received (S202: Yes), the CPU 310 controls the human body vicinity communication unit 340 and transmits a request regarding the human body vicinity communication to the mobile phone 200 (S203). Then, CPU 310 controls image processing unit 320 and image presenting unit 330, and presents an incoming image indicating that mobile phone 200 is currently receiving an incoming call (S204). The user can know that the incoming call is being received by visually recognizing the incoming call image.

In addition, CPU 310 controls human body vicinity communication unit 340, and is communication with mobile phone 200 via human body vicinity communication unit 340, specifically, human body vicinity communication possible with human body vicinity communication unit 230? (S206). In S <b> 206, the CPU 310 determines whether or not the response of the near-body communication performed by the mobile phone 200 in S <b> 110 of the process illustrated in FIG. 3 is received by the near-body communication unit 340.
For example, when the user is wearing the mobile phone 200 as shown in FIG. 5A, it is possible to communicate through the vicinity of the user's body surface, and it is determined in S206 that the near-body communication is possible. The On the other hand, as shown in FIGS. 7 (a), 8 (a), 9 (a), and 10 (a), the mobile phone 200 is not located close to the user's body surface, for example, away from the user. If it is within the range, communication via the vicinity of the user's body surface cannot be performed, and it is determined that the human body vicinity communication cannot be executed in S206.

  If the result of the determination in S206 is that human body vicinity communication is possible (S206: Yes), the CPU 310 controls the image processing unit 320 and the image presentation unit 330, and the mobile phone 200 is positioned close to the body surface of the user of the HMD 300 In other words, the first-type location image 500 indicating that the user is wearing the mobile phone 200 is presented (S207). The first type location image 500 is a location image as shown in FIG. 5B, for example. By visually recognizing the first type location image 500 as shown in FIG. 5B, the user can know that the incoming mobile phone 200 is in a position close to the user's body surface. In S207, in addition to the first type location image 500, a character (character image) of “CALL” indicating that the mobile phone 200 is receiving a call is also presented. Therefore, in S207, an image including the first type location image 500 as shown in FIG. 5B is presented instead of the incoming image presented in S204. In addition to “CALL”, the other party number and the other party name included in the incoming call information received after S200 may be presented.

  In S207, “CALL” is not included, and the first-type location image 500 and the incoming image presented in S204 may be presented while being sequentially switched at a predetermined timing. Even with such a configuration, it is possible to notify the user that a call is being received and the location where the mobile phone 200 is present. Subsequently, CPU 310 determines whether a call is started on mobile phone 200 (S208). In S208, the CPU 310 determines whether or not the information indicating the start of the call notified from the mobile phone 200 is received when the determination in S112 of FIG. 3 is affirmed (S112: Yes). Information indicating the start of a call is received by either short-range wireless communication via the local wireless communication unit 350 or human body vicinity communication via the human body communication unit 340. For example, if the determination in S206 is negative (S206: No), S216, S218, S222, and S224 of the process shown in FIG. 6 to be described later are executed and the process returns to S208. It may be performed by short-range wireless communication via the communication unit 350. If the determination in S206 is affirmative (S206: Yes), it is preferable that the determination is made by human body proximity communication via the human body proximity communication unit 340. This is the same as in the case where the determination in S112 of the process shown in FIG. 3 described above is affirmed (S112: Yes) and a call is started.

  As a result of the determination, when information indicating the start of a call has not been received (S208: No), the CPU 310 returns the process to S202. CPU310 which returned the process to S202 repeats and performs the process of S202-S207 again. At this time, if the determination in S112 of the process shown in FIG. 3 is negative (S112: No), the incoming call information and the status information are notified again in S106. Determine if it was received again. On the other hand, when the information indicating the start of the call is received (S208: Yes), the CPU 310 displays the first type location image 500 presented in S207 or the second presented in S216, S218, S222, and S224 in FIG. The presentation of the seed location images 510, 520, 530, and 540 is stopped. At this time, CPU 310 also stops presenting the characters “CALL”. After executing S209, the CPU 310 returns the process to S202.

  When the user operates the operation unit 370 to input a command to stop the presentation of the image including the first type location image 500 or the second type location image 510, 520, 530, 540, the CPU 310 performs processing May be returned to S202. When the mobile phone 200 is found by presentation of an image including the first type location image 500 or the second type location image 510, 520, 530, 540, the first type location image 500 or the second type location image 510, 520, 530. , 540 has no particular meaning. In such a case, a configuration that can stop the presentation of the first type location image 500 or the second type location image 510, 520, 530, 540 with the intention of the user is suitable.

  As a result of the determination in S206, if the human body vicinity communication cannot be executed (S206: No), the CPU 310 shifts the process to S210 shown in FIG. In S210, the CPU 310 controls the local wireless communication unit 350 to confirm the radio field intensity in the short-range wireless communication established in S200. Then, the CPU 310 determines the distance from the mobile phone 200 from the radio wave intensity confirmed in S210 (S211). In the HMD 300, for example, a table in which the relationship between the radio wave intensity and the distance is registered is stored in the ROM 312. In step S211, the CPU 310 determines a distance according to the radio wave intensity according to this table. Subsequently, the CPU 310 determines whether the mobile phone 200 is stationary (S212). In S212, CPU 310 determines whether mobile phone 200 is stationary according to the acceleration included in the state information determined to have been received in S202. When the acceleration does not change with a predetermined value, specifically, when the acceleration sensor 260 receives only the gravitational acceleration, the amount of change in acceleration is 0, and the CPU 310 determines that the mobile phone 200 is stationary. To do. On the other hand, when the amount of change in acceleration is greater than 0, CPU 310 determines that mobile phone 200 is not stationary, in other words, mobile phone 200 is displaced.

  As a result of the determination in S212, when the CPU 310 is stationary (S212: Yes), the CPU 310 compares the brightness detected by the optical sensor 360 with the brightness included in the state information, and both brightnesses have the same brightness. It is determined whether or not there is (S214). As a result of the determination, if the brightness is equivalent (S214: Yes), the CPU 310 controls the image processing unit 320 and the image presenting unit 330 to present the second type location image 510 indicating the first state. (S216). Here, the second-type location image 510 (the same applies to second-type location images 520, 530, and 540 described later) is a location image indicating that the mobile phone 200 is not in a position close to the body surface of the user of the HMD 300. is there. The first state means that the mobile phone 200 is within the range corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 (within the radio wave intensity confirmed in S210) and the user exists. It is in a stationary state in a place with the same brightness as the place where it is.

  The second type location image 510 presented in S216 is a location image as shown in FIG. 7B, for example. The user visually recognizes the second type location image 510 indicating the first state as shown in FIG. 7B, so that the incoming mobile phone 200 is about 2 m away from the user, for example on a table. Alternatively, it is possible to know that the user is in a place with the same brightness as the place where the user exists, such as on a stationary object such as a table. In FIG. 7B, “2 m” corresponds to the distance according to the radio wave intensity determined in S211. In S216, in addition to the second-type location image 510 indicating the first state, a character (character image) “CALL” indicating that the mobile phone 200 is receiving a call is also presented. Therefore, in S216, an image including the second-type location image 510 as shown in FIG. 7B is presented instead of the incoming image presented in S204.

  If the brightness is not equivalent as a result of the determination in S214 (S214: No), the CPU 310 controls the image processing unit 320 and the image presenting unit 330 to present the second type location image 520 indicating the second state. (S218). Here, the second state means that the mobile phone 200 is stationary in a place corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 and in a place darker or brighter than the place where the user exists. It is in a state of being. For example, when the result of the comparison in S214 is darker than the place where the user is present, the second type location image 520 presented in S218 is a location image as shown in FIG. 8B, for example. The user visually recognizes the second type location image 520 indicating the second state as shown in FIG. 8B, so that the incoming mobile phone 200 is about 2 m away from the user, such as a desk drawer. You can know that you are in a dark place, such as in a stationary object like a drawer. In S218, in addition to the second type location image 520 indicating the second state, a character (character image) of “CALL” indicating that the mobile phone 200 is receiving a call is also presented. Therefore, in S218, an image including the second type location image 520 as shown in FIG. 8B is presented instead of the incoming image presented in S204.

  If the result of determination in S212 is that the camera is not stationary (S212: No), the CPU 310 proceeds to S220. Here, the process of S220 is the same as that of S214 described above, and details thereof are omitted. As a result of the determination in S220, when the brightness is equivalent (S220: Yes), the CPU 310 controls the image processing unit 320 and the image presentation unit 330 to display the second type location image 530 indicating the third state. Present (S222). Here, the third state is a place where the mobile phone 200 is within the range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 and has a brightness equivalent to the place where the user exists. Is moving (carried).

  The second type location image 530 presented in S222 is a location image as shown in FIG. 9B, for example. The user visually recognizes the second type location image 530 indicating the third state as shown in FIG. 9B, so that the incoming mobile phone 200 is equivalent to the location where the user exists. It can be known that the location of the brightness is moving about 1 m away from the user. In S222, in addition to the second-type location image 530 indicating the third state, a character (character image) “CALL” indicating that the mobile phone 200 is receiving a call is also presented. Therefore, in S222, an image including the second type location image 530 as shown in FIG. 9B is presented instead of the incoming image presented in S204.

  If the brightness is not equivalent as a result of the determination in S220 (S220: No), the CPU 310 controls the image processing unit 320 and the image presentation unit 330 to present the second type location image 540 indicating the fourth state. (S224). Here, the fourth state means that the mobile phone 200 moves within a range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 and in a darker or brighter place than the place where the user exists. Is in a state of being carried (carried). For example, the second type location image 540 presented in S224 when the result of the comparison in S220 is darker than the location where the user exists is, for example, a location image as shown in FIG. The user visually recognizes the second type location image 540 indicating the fourth state as shown in FIG. 10B, so that the incoming mobile phone 200 is about 1 m away from the user and the user holds it. You can know that you are in a dark place, for example in a bag or in a portable item like a bag. In S224, in addition to the second-type location image 540 indicating the fourth state, a character (character image) “CALL” indicating that the mobile phone 200 is receiving a call is also presented. Therefore, in S224, an image including the second type location image 540 as shown in FIG. 10B is presented instead of the incoming image presented in S204.

  In S216, S218, S222, and S224, the CPU 310 performs second type location images 510 and 520 shown in FIG. 7B, FIG. 8B, FIG. 9B, or FIG. , 530, and 540, the process returns to S208 of FIG.

  Note that “2 m” in FIG. 8B and “1 m” in FIG. 9B and FIG. 10B correspond to the radio wave intensity determined in S211 as in FIG. 7B. It corresponds to the distance. Further, in S216, S218, S222, and S224 as in the case of the first type location image 500 in S207, the second type location images 510, 520, 530, and 540 and the incoming image presented in S204 are predetermined. It may be configured to be presented while being sequentially switched at the timing. Furthermore, in addition to “CALL”, a destination number and a destination name included in the incoming call information received after S200 may be presented.

(Modification)
The configuration of the present embodiment can also be as follows. For example, in the above description, the mobile phone 200 includes the optical sensor 250 and the acceleration sensor 260 and the HMD 300 includes the optical sensor 360. However, the optical sensor 250 and the acceleration sensor 260 of the mobile phone 200 may be omitted, and the optical sensor 360 of the HMD 300 may be omitted. In this case, the notification of the state information is omitted in S106 of the process executed by the mobile phone 200 shown in FIG. In S202 of the process executed by the HMD 300 shown in FIG. Further, after the processes of S212, S214, and S220 shown in FIG. 6 are omitted and S211 is executed, the mobile phone 200 is within a range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300. A second-type location image indicating the presence is presented.

  In addition, in the mobile phone 200 and the HMD 300, the optical sensors 250 and 360 may be omitted. In this case, state information including the state detected by the acceleration sensor 260 is notified in S106 shown in FIG. 3, and reception of this state information is determined in S202 shown in FIG. Moreover, each process of S214 and S220 shown in FIG. 6 is abbreviate | omitted, and each 2nd type location image according to the judgment result of S212 is each shown. Specifically, when the determination in S212 is affirmed (S212: Yes), the mobile phone 200 is within a range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 and in a stationary state. A second-type location image indicating the presence is presented. On the other hand, if the determination in S212 is negative (S212: No), the mobile phone 200 is moving within the range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 (carried). The second type location image indicating that is present) is presented.

  Further, the mobile phone 200 may be configured such that the acceleration sensor 260 is omitted. In this case, state information including the state detected by the optical sensor 250 is notified in S106 shown in FIG. 3, and reception of this state information is determined in S202 shown in FIG. Further, the process of S212 shown in FIG. 6 is omitted, and after executing S211, the same determination as in S214 (or S220) is made. Then, the second type location image corresponding to the determination result is presented. Specifically, when the determination in S214 is affirmed (S214: Yes), the mobile phone 200 is within a range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300, and the user exists. A second type location image indicating that the place is at a brightness equivalent to that of the present place is presented. On the other hand, if the determination in S214 is negative (S214: No), the location where the mobile phone 200 is within the range corresponding to the distance corresponding to the radio wave intensity determined in S211 from the user of the HMD 300 and the user exists A second type location image is presented that indicates a darker or brighter location.

100 Communication System 200 Mobile Phone 210, 310 CPU
212, 312 ROM
214,314 RAM
220 Mobile communication unit 230, 340 Human body vicinity communication unit 300 HMD
320 Image processing unit 330 Image presentation unit 400 Mobile phone communication network 500 Type 1 location image

Claims (10)

A communication system in which a mobile phone capable of performing communication via a mobile phone communication network and a head mounted display mounted on a user's head are communicably connected,
The mobile phone is
First human body proximity communication means for performing human body proximity communication via the user's body surface vicinity ;
First wireless communication means for performing wireless communication with a long communication distance compared to the human body vicinity communication ,
The head mounted display is
Image presentation means for presenting a predetermined image;
Second human body proximity communication means for performing the human body proximity communication;
Human body proximity communication determining means for determining whether or not the human body proximity communication via the second human body proximity communication means can be executed with the first human body proximity communication means;
Second wireless communication means for performing the wireless communication;
When it is determined by the human body vicinity communication determining means that the human body vicinity communication can be executed with the first human body vicinity communication means via the second human body vicinity communication means, the mobile phone is connected to the user's body surface. A first type location image indicating that the first type location image is present from the image presenting means , and the human body vicinity communication determining means controls the second kind of image between the first human body vicinity communication means and the second body proximity communication means. When it is determined that the human body proximity communication via the human body proximity communication means cannot be performed, and the wireless communication with the first wireless communication means can be performed via the second wireless communication means, the mobile phone communication system in which the second type location images showing that not in a position close to the body surface, characterized in that it comprises an image presentation control means for controlling so as to be presented from the image presentation means . The head mounted display further includes:
A confirmation means for confirming a radio field intensity in the wireless communication via the second wireless communication means with the first wireless communication means;
The image presentation control means is in a state where it is determined by the human body vicinity communication determining means that the human body vicinity communication cannot be executed with the first human body vicinity communication means via the second human body vicinity communication means. If possible the wireless communication between the first wireless communication means via the second wireless communication means, the said cellular phone as the information indicating that there is no at a position close to the body surface of the user, which is confirmed by the confirmation means 2. The control according to claim 1 , wherein the second-type location image including information indicating that the mobile phone is within a range according to radio wave intensity is presented from the image presentation unit. Communications system. The mobile phone further includes:
Detecting means for detecting at least one state information relating to a state in which the mobile phone is present;
It said state information detected by said detecting means, and a state information notifying means for notifying the head-mounted display,
The image presentation control means is in a state where it is determined by the human body vicinity communication determining means that the human body vicinity communication cannot be executed with the first human body vicinity communication means via the second human body vicinity communication means. When the wireless communication can be performed with the first wireless communication unit via the second wireless communication unit, the second type location image including information corresponding to at least one of the state information notified from the state information notification unit, communication system according to claim 1 or claim 2, wherein the controller controls so as to be presented from the image presentation means. The communication system according to claim 3 , wherein the detection unit detects at least brightness of a place where the mobile phone is present as the state information. It said detecting means, as the state information, the communication system according to claim 3 or claim 4, characterized in that to detect that at least the mobile telephone is displaced. The mobile phone further includes:
Incoming information indicating that an incoming call has been received by the mobile phone, the incoming information notifying means for notifying the head mounted display,
When the incoming information is received from the incoming information notification means, the human body proximity communication determining means can execute the human body proximity communication with the first human body proximity communication means via the second human body proximity communication means. The communication system according to any one of claims 1 to 5 , wherein the communication system is determined. Communicating with a mobile phone capable of executing communication via a mobile phone communication network, near-body communication via the vicinity of the user's body surface, and wireless communication having a longer communication distance than the near-body communication , the user's A head mounted display mounted on the head,
Image presentation means for presenting a predetermined image;
Second human body proximity communication means for performing the human body proximity communication;
Human body proximity communication determination means for determining whether the human body proximity communication can be executed with the mobile phone via the second human body proximity communication means;
Second wireless communication means for performing the wireless communication;
When it is determined by the human body vicinity communication determination means that the human body vicinity communication can be executed with the mobile phone via the second human body vicinity communication means, the position where the mobile phone is close to the body surface of the user The first-type location image indicating that the image is present is controlled to be presented from the image presenting means , and the human body vicinity communication determining means is used to communicate with the mobile phone via the second human body vicinity communication means. When it is determined that human body proximity communication cannot be performed and the wireless communication can be performed with the mobile phone via the second wireless communication means, the mobile phone is not in a position close to the body surface of the user. A head-mounted display comprising: an image presentation control unit configured to control so that the second type location image is presented from the image presentation unit . The head mounted display further includes:
Confirmation means for confirming radio field intensity in the wireless communication via the second wireless communication means with the mobile phone;
In the state where the image presentation control means determines that the human body proximity communication cannot be performed with the mobile phone via the second human body communication means by the human body proximity communication determination means. If possible the wireless communication with the portable telephone through the unit, said as the information indicating that the mobile phone is not in a position close to the body surface of the user, within the range in accordance with the radio field intensity checked by the check means The head-mounted display according to claim 7 , wherein the second-type location image including information indicating that the mobile phone is present is controlled to be presented from the image presentation unit. In the state where the image presentation control means determines that the human body proximity communication cannot be performed with the mobile phone via the second human body communication means by the human body proximity communication determination means. Including information corresponding to at least one state information related to a state in which the mobile phone is detected and notified from the mobile phone when wireless communication with the mobile phone is possible via means The head-mounted display according to claim 7 or 8 , wherein the second-type location image is controlled to be presented from the image presentation unit. The human body vicinity communication determining means receives the incoming information indicating that the mobile phone has received an incoming call from the mobile phone, and the human body vicinity via the second human body vicinity communication means with the mobile phone. The head mounted display according to any one of claims 7 to 9 , wherein it is determined whether or not communication can be performed.

Images