JP6802640B2 - Wearable devices, programs and information processing methods - Google Patents

Description

Some aspects of the present invention relate to wearable terminals, programs and information processing methods.

In recent years, a technology related to augmented reality called AR (Augmented Reality) has become widespread, and navigation using AR has also been considered. For example, Patent Document 1 discloses a head-up display that superimposes and displays an image on a landscape in a real space. In the head-up display, the facility name is displayed as a balloon on the landscape of the real space.

Japanese Unexamined Patent Publication No. 2014-006147

However, in Patent Document 1, no consideration is given to the display method when the information on the actual landscape is displayed without being superimposed on the actual landscape.

Some aspects of the present invention have been made in view of the above-mentioned problems, and provide a wearable terminal, a program, and an information processing method capable of preferably presenting guidance information related to navigation to a user. It is one of the purposes.

The wearable terminal according to the present invention is a wearable terminal that can be worn by a user, and is a route acquisition means for acquiring a route to the set destination by the user, and a route acquisition means for guiding the user to the route. A display device that non-transparently displays route guidance information indicating a point on the route in a part of the user's field of view, and a mounting member for mounting the wearable terminal on the user. A mounting member that determines the positional relationship between the actual environment visual field area in which the user can visually recognize the actual environment and the route guidance display area in which the route guidance information is non-transparently displayed by the display device. A display control means for displaying the route guidance information on the display device in the direction of a point on the route within the route guidance display area in the user's field of view.

The program according to the present invention is a wearable terminal that can be worn by the user, and provides route guidance information indicating a point on the route for guiding the route to the set destination to the user in the field of view of the user. A display device that partially displays non-transparently and a mounting member that enables the wearable terminal to be mounted on the user, and is a real environment in which the user can visually recognize the real environment in the field of view of the user. A route from the user to the destination on a wearable terminal including a wearing member that determines a positional relationship between the visual field region and the route guidance display area in which the route guidance information is non-transparently displayed by the display device. And the function of displaying the route guidance information on the display device in the direction of the point in the route guidance display area in the user's field of view.

The information processing method according to the present invention is a wearable terminal that can be worn by a user, and provides route guidance information indicating a point on the route for guiding the route to a set destination to the user. A display device that displays non-transparently in a part of the field of view and a mounting member that enables the wearable terminal to be worn by the user, and the user can visually recognize the actual environment in the user's field of view. A wearable terminal including a mounting member that determines the positional relationship between the real environment visual field area and the route guidance display area in which the route guidance information is non-transparently displayed by the display device until the user reaches the destination. The step of acquiring the route of the above and the step of displaying the route guidance information on the display device in the direction of the point in the route guidance display area in the user's field of view.

In the present invention, the "part", "means", "device", and "system" do not simply mean physical means, but the "part", "means", "device", and "system". Including the case where the function of "" is realized by software. Further, even if the functions of one "part", "means", "device", or "system" are realized by two or more physical means or devices, two or more "parts" or "means", The functions of "device" and "system" may be realized by one physical means or device.

According to the present invention, there is provided a wearable terminal, a program, and an information processing method capable of preferably presenting guidance information related to navigation to a user.

It is a figure for demonstrating the specific example of the usage situation of the wearable terminal in embodiment. It is a figure which shows the specific example of the user's field of view which uses the wearable terminal shown in FIG. It is a figure which shows the specific example of the user's field of view which uses the wearable terminal shown in FIG. It is a figure which shows the specific example of the user's field of view which uses the wearable terminal shown in FIG. It is a figure which shows the specific example of the appearance of the wearable terminal in an embodiment. It is a functional block diagram which shows the functional structure of the wearable terminal in embodiment. It is a flowchart for demonstrating the processing flow of the wearable terminal shown in FIG. It is a figure which shows the specific example of the hardware composition which can realize the wearable terminal shown in FIG.

An embodiment of the present invention will be described below. In the following description and description of the reference drawings, the same or similar configurations are designated by the same or similar reference numerals, respectively.

1 to 6 are diagrams for explaining an embodiment. Hereinafter, embodiments will be described along the following flow with reference to these figures. First, in "1.", an outline of the usage pattern of the wearable terminal according to the embodiment will be described together with a specific example of the user's field of view. Then, "2." describes the appearance of the wearable terminal, and "3." describes the functional configuration of the wearable terminal. Next, "4." describes the processing flow of the wearable terminal, and "5." describes a specific example of the hardware configuration capable of realizing the wearable terminal. After "6.", the effects and the like according to the present embodiment will be described.

(1. Overview)
(1.1 Overall overview)
First, a specific example of the operation and usage of the wearable terminal 100 according to the present embodiment will be described with reference to FIG. In the example of FIG. 1, the user U is equipped with a wearable terminal 100, and the wearable terminal 100 is provided with a display device 110. The wearable terminal 100 has a route guidance function (navigation function) that guides the route R to the destination G set in advance by the user U. The destination G can be set according to an operation by the user U, for example.

For route guidance, the wearable terminal 100 can appropriately communicate with the information providing server 200. In the information providing server 200, the route information 211 for the user U to search for the route R to the destination G, the point where the user U is likely to be mistaken on the route R, and the intersection or branch which is the point where the user U should be correctly guided. Guidance position information 213 (corresponding to the position provided in the turn-by-turn information described later), and facility position information 215 regarding the position of facility C on the route R are managed on the database (DB) 210. There is. Further, the information providing server 200 provides a route search service, and the wearable terminal 100 can search for a route R to the destination G by appropriately communicating with the information providing server 200. Further, the wearable terminal 100 can acquire information on the positions of the destination G, the facility C, and the like on the route R from the information providing server 200, if necessary.

For route guidance, the display device 110 of the wearable terminal 100 displays route guidance information according to the direction of the user U, the distance to the facility C on the route R, and the like. Here, the route guidance information displayed on the display device 110 is, for example, information such as a traveling direction at an intersection or an intersection (hereinafter, also referred to as a guidance position) in which the user U should turn or pass in the immediate vicinity. It can include turn-by-turn information, destination information related to destination G, facility information related to facility C existing on the route R, and the like. It should be noted that these route guidance information is generated based on the route information 211, the guidance position information 213, and the facility position information 215 acquired from the information providing server 200.

At this time, considering the field of view of the user U, the actual environment can be visually recognized in a part of the area (for example, the upper area of the user's field of view; hereinafter, the area is also referred to as the real environment field of view area), and a part of the field of view In the area (for example, the lower area of the visual field. Hereinafter, the area is also referred to as a route guidance display area), the route guidance information can be confirmed by the display device 110. As a result, when the user U looks at the actual environment, the wearable terminal 100 can confirm the route guidance information according to the actual environment. More specifically, for example, route guidance information that may include the position and name of the nearest intersection or branch on the route R, turn-by-turn information indicating the direction to be taken, and destination information indicating the direction of the destination. , It is displayed on the display device 110 according to the direction in which the user U faces. As a result, the user U can follow the route R to reach the destination G while confirming the route guidance information by comparing it with the real world.

(1.2 Specific example of user's field of view when presenting route guidance information)
Hereinafter, a specific example of the user's field of view when the route guidance information is displayed on the display device 110 by the wearable terminal 100 according to the present embodiment will be described with reference to FIGS. 2a to 2c. 2a, 2b, and 2c are diagrams showing specific examples of the field of view of the user U when the wearable terminal 100 is attached, respectively.

As shown in FIG. 2a, the field of view of the user U includes a real environment field of view area 40 in which the real environment can be visually recognized, and turn-by-turn information 310, destination information 330, and facility information 350, which are route guidance information by the display device 110. Includes a route guidance display area 30 on which at least one is displayed. In the examples of FIGS. 2a, 2b, and 2c, the route guidance display area 30 is located below the actual environment visual field area 40 in the vertical direction, but the present invention is not limited to this. For example, the route guidance display area 30 may come to the upper part, the left part, or the right part of the real environment visual field area 40. The positional relationship between the route guidance display area 30 and the actual environment visual field area 40 is determined according to the arrangement position of the display device 110 on the wearable terminal 100. In the following example, the case where the route guidance display area 30 is located below the actual environment visual field area 40 in the vertical direction will be mainly described.

The real environment visual field area 40 is an area for the user U to visually recognize the real environment. In the examples of FIGS. 2a, 2b and 2c, nothing is described in the actual environment visual field area 40, but in reality, the actual environment such as roads and buildings, moving objects such as automobiles and people, the sky and the ground Is visually recognized by the user U in the real environment visual field area 40.

The route guidance display area 30 is an area for the user U to visually recognize the route guidance information displayed by the display device 110. When the entire display screen of the display device 110 is set as the route guidance display area 30, the display screen of the display device 110 corresponds to the route guidance display area 30.

Here, the route guidance display area 30 is a non-transparent display area. That is, the user U cannot confirm the actual environment on the route guidance display area 30. In other words, the route guidance information is not superimposed on the actual environment from the user's field of view.

In the example of FIG. 2a, turn-by-turn information 310, destination information 330, and facility information 350 are displayed on the route guidance display area 30 as route guidance information. The turn-by-turn information 310 is information for notifying the user U of the position of the nearest intersection or branch on the route R and the direction to go. In the example of FIG. 2a, the turn-by-turn information 310 includes name information 311, traveling direction image 313, distance information 315, and direction display image 317.

The name information 311 is information on a character string related to the name of the intersection or branch indicated by the turn-by-turn information 310. The user U confirms whether or not he / she is following the correct route R by comparing the name of the intersection or branch confirmed by the sign or the like in the real environment visual field area 40 with the name described in the name information 311. It is possible to do.

The traveling direction image 313 is an image showing the direction in which the user should proceed at the guidance position which is an intersection or a branch indicated by the turn-by-turn information 310. In the example of FIG. 2a, the traveling direction image 313 indicates that the user U should turn right at the “XX intersection”.

The distance information 315 is information indicating the distance from the position of the user U, that is, the position of the wearable terminal 100 to the guide position indicated by the turn-by-turn information 310. Here, the user position can be specified by, for example, the GPS (Global Positioning System) function of the wearable terminal 100. Further, the coordinates of the guide position indicated by the turn-by-turn information 310 can be acquired as the guide position information 213 from the information providing server 200. Therefore, the distance from the user position to the guide position can be calculated as the Euclidean distance from these positions. Alternatively, by acquiring the route information 211 from the information providing server 200, it is conceivable that the travel route distance required for the user U to actually arrive at the guidance position via the road, railroad, or the like.

The direction display image 317 is an image for showing the user U the direction in which the guide position such as an intersection is located. When the turn-by-turn information 310 is arranged so that the horizontal center of the turn-by-turn information 310 substantially coincides with the direction of the guide position, a fixed image can be used for the direction display image 317.

The contents included in the turn-by-turn information 310 are not limited to the name information 311, the traveling direction image 313, the distance information 315, and the direction display image 317. For example, it is conceivable to include an image of the guide position or not to include information such as a distance.

The destination information 330 is information for the user U to notify the direction of the destination G following the route R. In the example of FIG. 2a, the destination information 330 includes a destination image 331 and a direction display image 333.

The destination image 331 is an image for showing the user that the information is about the destination G that the user U should aim for. In the example of FIG. 2a, the image of the checkered flag is used for the destination image 331.

The direction display image 333 is an image for showing the user U the direction in which the destination G is located. When the destination information 330 is arranged so that the horizontal center of the destination information 330 substantially coincides with the direction of the destination G, a fixed image can be used for the direction display image 333.

The content included in the destination information 330 is not limited to the destination image 331 and the direction display image 333. For example, it is conceivable to include character string information such as the name of the destination G and information on the distance to the destination G in the destination information 330.

The facility information 350 is information for notifying the user U of information about the facility C, which is a mark for following the route R. For example, information on a convenience store, a supermarket, a gas station, a public facility, etc., which serves as a landmark between the current position of the user U on the route R and the latest guidance position, is presented to the user U as facility information 350. Can be considered. Although only one facility information 350 is shown in the example of FIG. 2a, a plurality of facility information 350s may be shown in the route guidance display area 30. In the example of FIG. 2a, the facility information 350 includes a facility type image 351 and a distance information 353, and a direction display image 355.

The facility type image 351 shows the user the type of facility C that serves as a mark for the user U when following the route R. For example, it is conceivable to use a facility type such as a convenience store, a supermarket, or a gas station, and an icon image showing a chain thereof for the facility type image 351.

The distance information 353 is information indicating the distance from the position of the user U, that is, the position of the wearable terminal 100, to the facility position of the facility C indicated by the facility information 350. The location information of the facility C can be acquired as the facility location information 215 from the information providing server 200. Therefore, the distance from the user position to the facility position can be calculated as the Euclidean distance between these positions. Alternatively, by acquiring the route information 211 from the information providing server 200, it is conceivable that the travel route distance required for the user U to actually arrive at the facility position via the road, railroad, or the like.

The direction display image 355 is an image for showing the user U the direction in which the facility C is located. When the facility information 350 is arranged so that the horizontal center of the facility information 350 substantially coincides with the direction of the destination G, a fixed image can be used for the direction display image 355.

Here, the display control contents including the display position and display mode of the turn-by-turn information 310, the destination information 330, and the facility information 350, which are the route guidance information, are the intersections, branches, and destinations corresponding to the respective route guidance information. It is determined according to the distance from the user U to the position of G or the facility C and / or the direction of each position as seen from the user U.

The horizontal position of the route guidance information is determined according to the direction of the guidance position as seen from the user U, the position of the destination G, and the position of the facility C. Specifically, the wearable terminal 100 controls so that the corresponding route guidance information is displayed on a straight line connecting the position of the user U, the guidance position, the position of the destination G, and the position of the facility C. As a result, the user U can intuitively grasp in which direction the facility C is located at the intersection or the destination G related to the displayed route guidance information.

Further, the vertical position of the route guidance information can be determined according to the distance from the user U to the guidance position, the position of the destination G, and the position of the facility C. In the example of FIG. 2a, among the route guidance information, the turn-by-turn information 310 and the destination information 330 are in the vicinity of the actual environment visual field area 40 in the route guidance display area 30, and the facility information 350 is in the route guidance display area 30. It is displayed in the middle of the vertical direction. This is because, at least for the facility information 350, the display position in the vertical direction is changed according to the distance from the user U to the facility C. Specifically, the display position of the facility information 350 for the facility C having a short distance is closer to the actual environment visual field area 40 than the display position of the facility information 350 for the facility C having a farther distance. Further, as the user U approaches the facility C, the display position may be gradually or gradually brought closer to the real environment visual field area 40.

By doing so, the user U can easily visually grasp whether the distance to the facility C is short or long. Further, since it is considered that the information of the facility C closer to the user U has a higher need to refer to the information, the facility information 350, which has a high need for reference, is arranged at a position closer to the actual environment visual field area 40, so that the user can refer to the information 350. U can visually recognize the facility information 350 without moving his / her line of sight significantly. Also, if all the route guidance information is arranged in the same row in the horizontal direction, it may not be possible to arrange the route guidance information completely, but by shifting the position in the vertical direction according to the distance in this way, the arrangement in the horizontal direction It is possible to have a margin in the position.

Further, it is considered that the turn-by-turn information 310 and the destination information 330 have a high degree of reference from the user U. Therefore, by arranging these pieces of information in the vicinity of the real environment visual field area 40 without moving according to the distance, the user U can confirm the information without moving the line of sight significantly.

However, the display form is not limited to this, and for example, for a part or all of the turn-by-turn information 310, the destination information 330, and the facility information 350, the display position in the vertical direction is set according to the distance from the user U. You may change it. For example, by gradually or stepwise moving the display positions of both the turn-by-turn information 310 and the facility information 350 in the vertical direction according to the distance, the user U can easily establish the distance relationship between the guide position and the position of the facility C. I can grasp it.

In addition, the display mode of the route guidance information (for example, facility information 350) according to the distance may be changed in various ways other than the position in the vertical direction. For example, it is conceivable to display the facility information 350 related to the facility C having a short distance larger than the facility information 350 related to the facility C having a long distance, or to display the facility information 350 with a low transmittance.

In the display state of FIG. 2a, when the user U moves the face direction in the horizontal direction, the relative direction from the user U to the guide position, the position of the facility C, and the position of the destination G changes. The horizontal display position of the route guidance information also moves. In particular, when the position of the destination G or the relative direction of the guidance position from the user U deviates from the display range of the route guidance display area 30, the route guidance display is as illustrated in FIGS. 2b and 2c. It is conceivable to arrange the route guidance information near the left or right end of the region 30.

FIG. 2b is a diagram showing a specific example of the user's field of view when the guide position and the destination G are located on the left side of the route guidance display area 30. In the example of FIG. 2b, the turn-by-turn information 310 and the destination information 330 are displayed near the left end of the route guidance display area 30 and near the real environment visual field area 40. At this time, the direction display images 317 and 333 show the left direction instead of the upper direction as shown in FIG. 2b. As a result, even if the direction of the destination G or the direction of the guidance position to be indicated by the turn-by-turn information 310 deviates from the range of the route guidance display area 30, the user U can grasp those directions. Further, by arranging the turn-by-turn information 310, which is considered to be more important in following the route R, at a position closer to the actual environment visual field area 40 than the destination information 330, the user U can use the turn-by-turn information 310. It becomes easier to grasp.

Further, for facility information 350, which is considered to be relatively less likely to be referenced by user U than turn-by-turn information 310 and destination information 330, the direction of the corresponding facility C is the display of the route guidance display area 30. When it is out of the range, it can be hidden as shown in FIG. 2b.

Further, when either the guidance position indicated by the turn-by-turn information 310 or the direction of the destination position of the destination G deviates from the display range of the route guidance display area 30, as shown in FIG. 2c, The route guidance information related to the destination G or the guidance position outside the display range may be displayed near the left end or the right end of the route guidance display area 30.

(2. Appearance of wearable device)
Next, a specific example of the appearance of the wearable terminal 100 will be described with reference to FIG. As shown in FIG. 3, the wearable terminal 100 according to the present embodiment is a spectacle-shaped terminal worn on the head of the user U, and is a display for displaying information so as to cover a part of the field of view of the user U. Devices 110a and 110b (in this embodiment, also collectively referred to as a display device 110) are provided.

The wearable terminal 100 includes a display device 110, a front portion 120, temple portions 130a and 130b (hereinafter, also collectively referred to as temple portions 130), and support members 140a and 140b (hereinafter, collectively referred to as support member 140). It has a cable 145 and a cable 145. The front portion 120 and the temple portion 130 have the same mechanism as ordinary eyeglasses, and by adding the display device 110 and the support member 140 to the mechanism of the eyeglasses, the wearable terminal 100 processes various information. And functions such as presentation are realized.

The display device 110 is a device having a display function for presenting information to the user U. When the wearable terminal 100 is attached, the display device 110 is located on the side opposite to the face of the user U with the front portion 120 interposed therebetween. As shown in FIG. 2, the display device 110 is integrally formed with the support member 140, and for example, the control unit 150 included in the support member 140 controls the display on the display device 110. The display device 110 may be rotatably provided with respect to the support member 140 in order to adjust the display position.

The front portion 120 includes rim portions 121a and 121b (hereinafter, also collectively referred to as rim portion 121), a bridge portion 123, and pad portions 125a and 125b (hereinafter, collectively referred to as pad portion 125). When the wearable terminal 100 is attached by the user U, the front portion 120 is located in front of the face of the user U.

The rim portions 121a and 121b are members formed in a circumferential shape around the openings 127a and 127b (hereinafter, also collectively referred to as the opening 127). The opening 127 is provided so that the user U can visually recognize the actual environment and the display contents of the display device 110. A lens for correcting the visual acuity of the user U may be fitted in the opening 127. The rim portions 121a and 121b are adjacent to each other in the horizontal direction via the bridge portion 123.

The rim portion 121 does not necessarily have to be formed in a circumferential shape, and particularly when the wearable terminal 100 does not have a lens, the rim portion 121 and the bridge portion 123 do not provide the openings 127a and 127b. The temple portions 130 on both sides may be connected in a straight line.

When the wearable terminal 100 includes a lens, the lens may be supported by the temple portion 130 and the bridge portion 123 without having the rim portion 121 on the front portion 120. Further, when a single-lens lens is used, the bridge portion 123 is also unnecessary, and the single-lens lens may be supported by the temple portions 130a and 130b.

The pad portion 125 is a member for mounting the wearable terminal 100 on the face of the user U, and is fixed to the rim portion 121 and / or the bridge portion 123. When the wearable terminal 100 is attached by the user U, the pad portion 125 supports the wearable terminal 100 on both sides of the nose bridge of the user U. The wearable terminal 100 is locked and / or supported on the face of the user U by the pad portion 125 and the modern portions 131a and 131b (hereinafter, also collectively referred to as the modern portion 131) included in the temple portion 130 described later. It is installed by.

The temple portion 130 is a substantially linear member provided to support the front portion 120 on both sides of the face of the user U. In FIG. 2, the temple portion 130 extends from the front portion 120 in the depth direction. The temple portion 130 may be rotatably attached to the front portion 120 for convenience of carrying. The temple portion 130 has a modern portion 131 as described above.

As described above, the modern portion 131 is a member for mounting the wearable terminal 100 on the face of the user U, and the modern portion 131 is on the side opposite to the front portion 120 of the temple portion 130 in the vertical lower direction and the inner direction. It is formed to draw a gentle arc. When the wearable terminal 100 is worn by the user U, the modern unit 131 is locked to the upper part of the user U's ear in the vertical direction.

The support member 140 is a member for supporting the display device 110, and the support member 140 is physically supported by the temple portion 130. In order to allow the user U to adjust the position of the display device 110, the support member 140 may be rotatably provided with respect to the temple portion 130. Inside the support member 140, it is possible to have a control device, a position information acquisition device for acquiring position information by GPS (Global Positioning System), an orientation sensor for acquiring a direction, and the like.

The support members 140a and 140b are connected to each other by a cable 145. The devices inside the support members 140a and 140b can communicate with each other via the cable 145, and the display contents of the display devices 110a and 110b can be linked by the communication.

It is not always necessary to provide the cable 145 independently. For example, a communication line through which each device inside the support members 140a and 140b can communicate may be embedded in the front portion 120 of FIG. Alternatively, it is conceivable that the devices inside the support members 140a and 140b communicate wirelessly. In these cases, the cable 145 is unnecessary.

Further, in the example of FIG. 2, the wearable terminal 100 is realized by adding the display device 110 and the support member 140 to the front portion 120 and the temple portion 130 corresponding to ordinary eyeglasses, but the wearable terminal 100 The realization method is not limited to this. For example, the display device 110 may be supported by the front portion 120, or the front portion 120, the support member 140, and the display device 110 may be integrally formed. Further, it is conceivable to have one opening 127 like single-lens goggles without providing two openings 127 like the openings 127a and 127b. Further, the method of attaching the wearable terminal 100 to the user U does not necessarily depend on the pad portion 125 and the modern portion 131, but also for forming the front portion 120 in close contact with the face and fixing it to the head in a circumferential shape. It is also conceivable to attach it with a strap.

(3. Specific example of functional configuration)
Hereinafter, the functional configuration of the wearable terminal 100 according to the present embodiment will be described with reference to FIG. FIG. 4 is a block diagram showing a functional configuration of the wearable terminal 100 according to the present embodiment. The wearable terminal 100 is roughly divided into a control unit 150 and a database (DB) 160. Further, the control unit 150 includes a current position acquisition unit 151, a direction acquisition unit 152, a target position setting unit 153, a route search unit 154, a guide position passage determination unit 155, a relative position calculation unit 156, and a display control unit 157.

The current position acquisition unit 151 specifies the current position of the user U who wears the wearable terminal 100. As a method of specifying the current position of the user U, for example, the current position of the user U is acquired as, for example, latitude and longitude by receiving radio waves sequentially transmitted from satellites constituting GPS (Global Positioning System). Can be considered. In addition, for example, a signal transmitted from a base station of a mobile phone or a wireless LAN in the vicinity may be used, or the movement of the user U obtained from an acceleration sensor or the like may be used.

The direction acquisition unit 152 identifies the direction in which the user U wearing the wearable terminal 100 is facing. Various means for specifying the direction can be considered. For example, it is conceivable to specify the direction by combining a geomagnetic sensor, an acceleration sensor, or the like.

The target position setting unit 153 sets the position of the destination G to which the user U should go in providing the route guidance service. The destination G can be set based on, for example, an operation by the user U. More specifically, for example, after displaying information about various facilities C around the user U on the display device 110 of the wearable terminal 100, the user U selects the facility C as the destination G from the display devices 110. The target position setting unit 153 sets the destination G by setting or receiving the setting input of the coordinate position directly from the user U. At this time, for example, when a predetermined facility C is designated as a destination G by the user U, the coordinate position (latitude / longitude) of the destination G is provided as, for example, facility position information 215 of the facility C. It can be specified by acquiring it from the server 200 or reading it from the facility location information 163 stored in advance in the DB 100. The position of the destination G set by the target position setting unit 153 is stored in the DB 160 as the target position information 161.

The route search unit 154 is a route R for the user U to head to the destination G from the current position of the user U acquired by the current position acquisition unit 151 and the position of the destination G set by the target position setting unit 153. To explore. As the method, for example, it is conceivable to acquire the route R by requesting the information providing server 200 to search for a route by using the information of the current position and the position of the destination G. Information on the route R obtained as a result of the search, the facility position of the facility C on the route R, the guidance position such as an intersection, etc. is stored in the DB 160 as, for example, facility position information 163, guidance position information 165, and route information 167. It is stored. In addition, each information necessary for providing the route guidance to the user U can be acquired by the sequential route search unit 154 from the information providing server 200 or the DB 160.

The guide position passage determination unit 155 determines whether or not the user has passed the intersection or branch that is the guide position. If the current position acquisition unit 151 detects a predetermined number (for example, 5 points) of the position coordinates within a certain distance (for example, 10 m) from the guide position which is an intersection or a branch, the guide position passage determination unit 155 will use the user U. Can be determined to have passed the guide position on the route R. Alternatively, when the coordinate position of the user who is at least a predetermined distance (for example, 10 m) ahead of the guide position on the route R is detected a plurality of times, it may be determined that the guide position has been passed. If the guide position passage determination unit 155 determines that the guide position has been passed, the route guidance providing unit 158 described later reads the guidance position information 165 regarding the next guidance position on the route R from the DB 160, or the information providing server. After acquiring from 200, the turn-by-turn information 310 based on the acquisition is displayed on the display device 110.

The relative position calculation unit 156 uses the current position of the user U acquired by the current position acquisition unit 151, the direction of the user U acquired by the direction acquisition unit 152, and the target position information 161, facility position information 163, and guide position stored in the DB 160. Based on the information 165, the relative position to the destination G, the position of the facility C, and the guidance position from the position and direction of the user U is calculated. The relative position includes the position of the destination G and the facility C as seen from the current direction of the user U, the relative direction to the guidance position, and the relative distance from the current position of the user to the position of the destination G and the like. Is done. The relative distance can be a straight line distance (Euclidean distance) from the user's position to the position of the destination G or the like. Alternatively, by referring to the route information 167 stored in the DB 160, the relative position calculation unit 156 can calculate the required travel distance from the current position of the user U to the destination G or the like.

The display control unit 157 determines the display content to be displayed on the display device 110. In particular, the route guidance providing unit 158 included in the display control unit 157 displays route guidance information 110 which may include turn-by-turn information 310, destination information 330, and facility information 350 in order to guide the route R to the user U. To display. As described above, the display position for the route guidance providing unit 158 to display the route guidance information on the display device 110 is the relative position between the destination G or the like corresponding to each information and the user U calculated by the relative position calculation unit 156. Move at any time according to. Further, at least for the turn-by-turn information 310, when the guide position passage determination unit 155 determines that the user U has passed the corresponding guide position, the turn-by-turn information 310 related to the next guide position on the route R is displayed. , The route guidance providing unit 158 causes the display device 110 to display.
The DB 160 manages the target position information 161, the facility position information 163, the guide position information 165, and the route information 167.

The target position information 161 is information regarding the coordinate position (latitude / longitude) of the destination G set by the target position setting unit 153. Further, the facility position information 163 is information regarding the coordinate position of the facility C existing on the route R, for example, the information is provided to the user U as the facility information 350 at the time of the route guidance by the route guidance providing unit 158. The facility position information 163 may include not only the coordinate position but also the facility type and the icon image required for displaying the facility information 350 on the display device 110.

The guide position information 165 is information regarding coordinate positions related to intersections, branches, and the like for which guidance should be presented to the user U as turn-by-turn information 310. The guide position information 165 may include not only the coordinate position but also information such as the direction in which the user U should follow the route R and the name of the intersection.
The route information 167 is information about the route R to guide the user U as a result of the search by the route search unit 154.

(4. Process flow)
Hereinafter, the processing flow of the wearable terminal 100 according to the present embodiment will be described with reference to FIG. Each processing step described later can be arbitrarily changed in order or executed in parallel within a range that does not cause a contradiction in the processing contents, and even if another step is added between each processing step. good. Further, the step described as one step for convenience can be executed by being divided into a plurality of steps, and the step described as one step can be executed as one step for convenience.

First, the target position setting unit 153 sets the position of the destination G that the user U should aim for (S501). Various methods for setting the position of the destination G are conceivable. For example, the facility C to be the destination G is selected in response to the operation input of the user U, and the coordinate position with respect to the facility C is set as the target position. Things can be considered. The target position is stored in the DB 160 as target position information 161 by the target position setting unit 153.

Next, the route search unit 154 searches for the route R from the current position of the user U to the destination G (S503). As this method, for example, it is conceivable to send a search request in which the start point (that is, the current position of the user U) and the target point (the position of the destination G) are set to the information providing server 200, and receive the response. Be done. The route R information acquired by the route search unit 154 is stored in the DB 160 as the route information 167. At this time, the facility position information 163 regarding the facility C on the route R, the guidance position information 165 regarding the guidance position also on the route R, and the like can be received from the information providing server 200 and stored in the DB 160.

The route guidance providing unit 158 receives the result of the search by the route search unit 154 and starts the guidance regarding the route R. First, the guide position information 165 regarding the latest guide position on the route R and the facility position information 163 regarding the facility C on the route R up to the guide position are acquired from the DB 160 or the information providing server 200 (S505, S507).

Further, the current position acquisition unit 151 acquires the current position of the user U (S509), and the direction acquisition unit 152 identifies the direction in which the user U is facing by using an acceleration sensor, a geomagnetic sensor, or the like (S511). The relative position calculation unit 156 calculates the relative direction and relative distance between the position and direction of the user U and the position of the nearest guide position, destination G, or the like (S513). The route guidance providing unit 158 causes the display device 110 to display the route guidance information using the calculated relative direction and relative distance (S515). Specifically, for example, as shown in FIG. 2a, the guide position and the distance to the facility position are shown on the turn-by-turn information 310 and the facility information 350, or the horizontal and vertical display positions are shown in relative directions and relative directions. It is decided based on the distance.

After that, if the user U has not arrived at the destination G or has not passed the guidance position indicated as the turn-by-turn information 310 (No of S517 and S519), the route guidance providing unit 158 Returns to S509 and continues route guidance. If the user U is determined by the guide position passage determination unit 155 that the user U has passed the nearest guide position on the route R (Yes in S519), the process returns to S505 and the guide position information 165 regarding the next guide position is obtained. Read and continue route guidance. On the other hand, if it is determined that the user U has arrived at the destination G (Yes in S517), the route guidance providing unit 158 ends the route guidance.

(5. Hardware configuration)
Hereinafter, an example of a hardware configuration in the case where the internal processing of the wearable terminal 100 described above is realized by a computer will be described with reference to FIG. As shown in FIG. 6, the wearable terminal 100 includes a control unit 150, a storage unit 183, a communication interface (I / F) unit 187, a sensor 189, a display device 110, and an input unit 191. Each unit has a bus line 193. Connected via.

The control unit 150 includes a CPU (Central Processing Unit, not shown), a ROM (Read Only Memory, not shown), a RAM (Random Access Memory) 181 and the like. The control unit 150 is configured to be able to realize information processing as the wearable terminal 100 described above by executing the control program 185 stored in the storage unit 183. For example, the current position acquisition unit 151, the direction acquisition unit 152, the target position setting unit 153, the route search unit 154, the guide position passage determination unit 155, and the display control unit 157, which have been described with reference to FIG. 4, are temporarily stored in the RAM 181. After that, it can be realized as a control program 185 that operates on the CPU.

Further, in addition to the code included in the control program 185, the RAM 181 temporarily holds a part or all of the target position information 161, the facility position information 163, the guide position information 165, and the route information 167 stored in the DB 160. .. Further, the RAM 181 is also used as a work area when the CPU executes various processes.

The storage unit 183 is a non-volatile storage medium such as an HDD (Hard Disk Drive) or a flash memory. The storage unit 183 stores an operating system (OS), an application, and various data for realizing a function as a general computer. Further, the storage unit 183 stores the control program 185 and the DB 160 that stores the data used by the control program 185. As described above, the current position acquisition unit 151, the direction acquisition unit 152, the target position setting unit 153, the route search unit 154, the guide position passage determination unit 155, and the display control unit 157 shown in FIG. 4 are realized by the control program 185. can do.

The communication I / F unit 187 is a device for wirelessly performing data communication with, for example, an external server. The acquisition of the target position information 161, the facility position information 163, the guide position information 165, and the route information 167 from the information providing server 200 can be sequentially performed by, for example, the communication I / F unit 187 according to the control by the control program 185. ..

The sensor 189 is for detecting the direction of the wearable terminal 100, that is, the direction in which the user U is facing, and the movement of the user U. The sensor 189 can include, for example, a geomagnetic sensor 189a, an acceleration sensor 189b, and the like.

As described above, the display device 110 is a display device for presenting various information such as route guidance information to the user U. Specific examples of the display device 110 include a liquid crystal display, an organic EL (Electro-Luminescence) display, and the like. The input unit 191 is a device for receiving an operation input from the user U. Specific examples of the input unit 191 include various buttons and a touch panel.

(6. Effect of this embodiment)
As described above, the wearable terminal 100 according to the present embodiment does not show the actual environment to the user U, that is, the non-transparent route guidance display area 30 for providing the route guidance information to the user U. It has a function to display on. At this time, the wearable terminal 100 changes the display mode of the route guidance information according to the relative positional relationship between the user position of the user U and the facility position of the facility C. Specifically, for example, the horizontal position of the route guidance information is adjusted so that the route guidance information substantially matches the direction of the target guidance position or the position of the destination G. Regarding the position of the route guidance information in the vertical direction, for example, the route guidance information may be displayed in the vicinity of the actual environment visual field area 40, or the route guidance information regarding a point having a short distance may be displayed as a route guidance regarding a point having a long distance. It may be displayed closer to the real environment visual field area 40 than the information. As a result, the user can confirm the information that is considered to have a particularly high degree of reference by the user U without moving his / her line of sight so much.

(7. Appendix)
The configurations of the above-described embodiments may be combined or some components may be replaced. Further, the configuration of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the gist of the present invention.

30: Route guidance display area 40: Real environment field of view area 100: Wearable terminal 110: Display device 120: Front part 121: Rim part 123: Bridge part 125: Pad part 127: Opening 130: Temple part 131: Modern part 140: Support member 145: Cable 150: Control unit 151: Current position acquisition unit 152: Direction acquisition unit 153: Target position setting unit 154: Route search unit 155: Guide position passage determination unit 156: Relative position calculation unit 157: Display control unit 158 : Route guidance provider 160: Database (DB)
161: Target position information 163: Facility position information 165: Guidance position information 167: Route information 181: RAM
183: Storage unit 185: Control program 187: Communication interface unit 189: Sensor 191: Input unit 193: Bus line 200: Information providing server

Claims (7)

A wearable device that can be worn by the user
A route acquisition means for acquiring a route to the set destination by the user, and
Route guidance information indicating a point on the route for guiding the route to the user, and route guidance information including facility guidance information of a facility which is a point on the route is a part of the field of view of the user. A display device that displays non-transparently
A mounting member for enabling the wearable terminal to be worn by the user, the real environment visual field region in which the user can visually recognize the real environment, and the display device non-transparently. A mounting member that determines the positional relationship with the route guidance display area where route guidance information is displayed, and
In the route guidance display area in the user's field of view, the route guidance information is displayed on the display device in the direction of a point on the route, and the user position of the user and the facility position of the facility are displayed. It is provided with a display control means that changes the display control content of the facility guidance information according to the distance to and from .
When the user position and the facility position are the first distance, the display control means displays the facility guidance information. The first display position is between the user position and the facility position. When the second distance is longer than the distance, the display control means is closer to the actual environment visual field area in the route guidance display area than the second display position for displaying the facility guidance information.
Wearable device. The route guidance information includes at least one piece of information, that is, information about the destination, which is a point on the route, and turn-by-turn information about an intersection or a branch.
The wearable terminal according to claim 1. The display control means causes the display device to display the route guidance information on the actual environment visual field area side in the route guidance display area.
The wearable terminal according to claim 1 or 2. When the direction of the point is outside the display range of the route guidance display area, the display control means transmits the route guidance information related to the point to the end of the route guidance display area on the direction side. Display near the part,
The wearable terminal according to any one of claims 1 to 3. The mounting member is positioned so that the route guidance display area is below the actual environment visual field area in the vertical direction.
The wearable terminal according to any one of claims 1 to 4 . A wearable device that can be worn by the user
The route guidance information indicating a point on the route for guiding the route to the set destination to the user, and the route guidance information including the facility guidance information of the facility which is the point on the route, is provided to the user. A display device that displays non-transparently in a part of the field of view of
A mounting member for enabling the wearable terminal to be worn by the user, the actual environment visual field region in which the user can visually recognize the actual environment, and the display device opaquely. A wearable terminal provided with a mounting member that determines the positional relationship with the route guidance display area on which route guidance information is displayed.
A function for the user to acquire a route to the destination, and
The route guidance information is displayed on the display device in the direction of the point in the route guidance display area in the user's field of view, and the distance between the user position of the user and the facility position of the facility is increased. It is a program for executing the function of changing the display control content of the facility guidance information .
When the distance between the user position and the facility position is the first distance, the first display position for displaying the facility guidance information is such that the distance between the user position and the facility position is longer than the first distance. It is closer to the actual environment visual field area in the route guidance display area than the second display position for displaying the facility guidance information when the distance is two.
program. A wearable device that can be worn by the user
The route guidance information indicating a point on the route for guiding the route to the set destination to the user, and the route guidance information including the facility guidance information of the facility which is the point on the route, is provided to the user. A display device that displays non-transparently in a part of the field of view of
A mounting member for enabling the wearable terminal to be worn by the user, the actual environment visual field region in which the user can visually recognize the actual environment, and the display device opaquely. A wearable terminal including a mounting member that determines a positional relationship with a route guidance display area on which route guidance information is displayed
The step of acquiring the route to the destination by the user, and
The route guidance information is displayed on the display device in the direction of the point in the route guidance display area in the user's field of view, and the distance between the user position of the user and the facility position of the facility is increased. There line and a step of changing the display control the contents of the facility guide information,
When the distance between the user position and the facility position is the first distance, the first display position for displaying the facility guidance information is such that the distance between the user position and the facility position is longer than the first distance. It is closer to the actual environment visual field area in the route guidance display area than the second display position for displaying the facility guidance information when the distance is two.
Information processing method.

Images