JP6841665B2 - Display system, server, electronic device and map display method - Google Patents

Description

The present invention relates to a display system that displays disability information useful for persons with disabilities and the like, and more particularly to a technique for filtering disability information based on biological information of a wheelchair user.

Accelerometers, gyro sensors, etc. are attached to vehicles such as wheelchairs, obstacle points such as steps and slopes on the road surface are detected from sensor information acquired by traveling on the road surface, and the detected obstacle points are displayed on a map. Guidance is provided on routes that avoid obstacles. A map in which obstacle points (obstacle points) such as steps and slopes are displayed on the road surface is sometimes called a barrier-free map.

The barrier-free map displays steps and slopes of the road surface, and there is an information processing device disclosed in Patent Document 1 as a technique for displaying external factors such as obstacle points. This information processing device displays a map that associates biological information such as the user's heart rate and blood pressure with external factors such as uphill, and presents useful information on the traveling route in running and the like.

Japanese Unexamined Patent Publication No. 2015-195830

FIG. 14 is a diagram illustrating a problem of a display device for displaying a conventional barrier-free map. As shown in the figure, various sensors such as an acceleration sensor and a gyro sensor are attached to the wheelchair used by the users U2, U3, and U4, and the information acquired from the sensors as the wheelchair travels is the information obtained from the users U2, U3. , It is uploaded to the failure point analysis server 1000 as travel sensor information via the U4 smartphone. The failure point analysis server 1000 creates a barrier-free map based on a large number of uploaded travel sensor information, and distributes the created barrier-free map to the user. For example, a barrier-free map 1200 including obstacle points such as steps and slopes is displayed on a display device 1100 such as a smartphone owned by the user U1. The barrier-free map 1200 is, so to speak, a map in which obstacle points are superimposed on a road map.

However, the barrier-free map 1200 shows all obstacle points, from a slope with a light slope of 1 ° to a slope with a relatively slope of 7 °, and a road with a step of 1 cm to a road with a step of 6 cm. Information is displayed, and it is not always easy to see, and it makes me feel annoyed. Furthermore, the ease or difficulty of running for the user varies depending on the difference in the disability level, physical strength, motor skill, sensitivity, wheelchair ability, etc. of the user who uses the wheelchair. For example, if the user U1 feels that he / she can travel normally if the step is 1 cm and the gradient is about 1 °, the information indicating those obstacle points is not useful for the user U1.

The present invention solves such a conventional problem, and an object of the present invention is to provide a display system capable of displaying failure information that may be an obstacle for a user.

The display system according to the present invention is a display system including a server and an electronic device capable of displaying information provided by the server, and the server is an acquisition means for acquiring biometric information of a user of the electronic device. , A storage means for storing road obstacle information in association with the road, a selection means for selecting obstacle information that may be an obstacle for the user of the electronic device based on the biometric information, and an obstacle selected by the selection means. It has a providing means for providing map information including information to the electronic device, and the electronic device includes a display means for displaying map information including failure information provided by the providing means.

Preferably, the electronic device includes a transmitting means for transmitting the biometric information of the user to the server. Preferably, the transmission means transmits the position information related to the biometric information to the server, and the selection means selects the failure information that may be a failure for the user from the failure information searched based on the position information. To do. Preferably, the transmitting means transmits the user's identification information related to the biometric information to the server, and the storage means stores the user's biometric information identified by the identification information in association with the road. , The selection means searches for obstacle information that may be an obstacle for the user identified by the identification information. Preferably, the selection means updates the standard of obstacle information that may be an obstacle for each user based on the biometric information of each user accumulated in the storage means. Preferably, the display system further includes a biometric information measuring device that measures biometric information, the biometric information measuring device transmitting the measured biometric information to the server. Preferably, the biological information is an electroencephalogram of the user. Preferably, the biological information is the heart rate of the user. Preferably, the biological information is the blood pressure value of the user. Preferably, the server includes a route search means for searching a route to a destination based on a road map including obstacle information selected by the selection means, and the providing means searches for a route searched by the route search means. Provided to the portable terminal. Preferably, the obstacle information includes road slope information or step information.

The server according to the present invention is a server that provides map information to an electronic device, and is an acquisition means for acquiring biometric information of a user from the electronic device and a storage means for storing road obstacle information in association with the road. A selection means for selecting obstacle information that may be an obstacle for the user of the electronic device based on the biometric information, and a providing means for providing the electronic device with map information including the obstacle information selected by the selection means. Have.

The electronic device according to the present invention is an electronic device capable of displaying map information provided by a server, and includes an acquisition means for acquiring biometric information of a user, a transmission means for transmitting the biometric information to the server, and the like. It has a receiving means for receiving map information with obstacle information which may be an obstacle for the user, which is generated based on the biological information, from the server, and a display means for displaying the map information.

The map display method according to the present invention is a map display method of an electronic device capable of displaying map information provided by a server, in which a step of acquiring a user's biometric information by an acquisition means and a step of transmitting the biometric information by a transmission means are described. The step of transmitting the map information to the server, the step of receiving the map information with the failure information generated based on the biometric information for the user, and the step of receiving the map information from the server, and the display means receiving the map information. Has a step to display.

According to the present invention, since the failure information is selected and displayed based on the biometric information of the user, the failure information to be referred to can be automatically selected. That is, in the present invention, the cost of checking the contents of each failure information and manually selecting the information can be selected without incurring such a cost. Further, in the case of guiding a route avoiding an obstacle point, the cost related to reroute (research of the guide route) is reduced. Even if the route is searched once, it is necessary to reroute by passing through the passable obstacle points, but since the passable obstacle points are filtered in advance, the cost related to the reroute is reduced. .. Furthermore, even if the driving ability of the user who uses the wheelchair changes, the change in the biometric information is automatically reflected, so that the obstacle information on the map can be displayed in an optimized state at all times.

It is a figure which shows the structure of the display system which concerns on embodiment of this invention. It is a block diagram which shows the structure of the electroencephalogram measuring apparatus which concerns on Example of this invention. It is a figure which shows the functional structure of the transmission program of the electroencephalogram measuring apparatus which concerns on embodiment of this invention. It is a block diagram which shows the structure of the server which concerns on embodiment of this invention. It is a figure which conceptually explains the map data which concerns on embodiment of this invention. It is a figure which conceptually explains the relationship between the link which concerns on embodiment of this invention, and an obstacle point. It is a figure explaining the learning information which concerns on embodiment of this invention. It is a figure which shows the functional structural example of the map image generation program which concerns on embodiment of this invention. FIG. 9A is a diagram for explaining a learning method of the discomfort tendency learning unit according to the embodiment of the present invention, and FIG. 9B is a diagram showing an example of using learning information. It is a block diagram which shows the structure of the portable terminal which concerns on Example of this invention. It is a figure which shows the functional structure of the display program which concerns on embodiment of this invention. FIG. 12 (A) is a display example of a map image including conventional obstacle point information, and FIG. 12 (B) is a display example of a map image including filtered obstacle point information according to an embodiment of the present invention. It is a flow chart which shows the whole operation of the display system which concerns on embodiment of this invention. It is a flow chart which shows the whole operation of the display system which concerns on embodiment of this invention. It is a figure explaining the problem of the conventional barrier-free map.

Next, an embodiment of the present invention will be described in detail with reference to the drawings. The display system according to the embodiment of the present invention includes a server, a display device for displaying information distributed from the server, and a biometric information acquisition device for acquiring biometric information of a wheelchair user. The server preferably stores map data including link data related to roads and node data related to intersections and the like, and the link data is associated with obstacle information that may be an obstacle in traveling in a wheelchair or the like. Further, the server includes a function of determining what kind of obstacle the user feels uncomfortable when passing through the obstacle based on the biological information acquired from the biological acquisition information, and filtering the obstacle information based on the determination result. ..

The display device may be an electronic device that can communicate with the server and has a display medium that can be visually recognized by the user such as a wheelchair. For example, a multifunctional mobile phone such as a smartphone, a portable information terminal, or a lap. It can be a top or laptop computer. The display device may be fixedly attached to a wheelchair or the like, or may be removable. In the following examples, an example in which a portable terminal such as a smartphone is used as a display device will be shown.

The biometric information acquisition device acquires the biometric information of the wheelchair user and uploads the acquired biometric information to the server. The biological information is not particularly limited, but may be a user's brain wave, heart rate, sweating, blood pressure value, or the like. The biological information acquisition device can include, for example, an electroencephalogram measuring headset capable of measuring an electroencephalogram, a heart rate sensor for detecting a user's heart rate, a sweating sensor for measuring a user's sweating amount, and the like, and is used by a wheelchair user. Measure the degree of stress in. For example, in the case of an electroencephalogram measurement headset, beta waves, delta waves, theta waves, and alpha waves emitted from the user are measured, and beta waves are normal, and delta waves, theta waves, or alpha waves are abnormal (stress). ), The stress state of the user can be detected by the type of brain wave. Further, if the heart rate or blood pressure value of the user becomes higher than the normal value, it is possible to detect that the user is under stress. Preferably, the biometric information acquisition device is worn on the user or wheelchair, and the biometric information is transmitted to the server by using the communication function built in the biometric information acquisition device or the communication function built in the portable terminal. The server learns the determination of the degree of stress associated with the running of the user and the tendency thereof, and applies this to the filtering technology. In the following examples, an example in which an electroencephalogram measuring device is used as a biological information acquisition device is shown.

FIG. 1 is a diagram showing a configuration of a display system according to an embodiment of the present invention. The display system 1 according to the present embodiment includes an electroencephalogram measuring device 10, a server 20, and a portable terminal 30. The server 20 and the portable terminal 30 can send and receive data in both directions through wireless communication 40 such as Wi-Fi (registered trademark) and other public communication lines. Further, the electroencephalogram measuring device 10 and the portable terminal 30 can perform short-range wireless communication 50 such as Bluetooth (registered trademark), and the measurement result of the electroencephalogram measuring device 10 is transmitted to the server 20 via the portable terminal 30. Can be sent to.

FIG. 2 is a block diagram showing a configuration of an electroencephalogram measuring device according to this embodiment. The electroencephalogram measuring device 10 includes a communication unit 100, an electroencephalogram detection unit 110, a storage unit 120, and a control unit 130, and has a headset structure that can be attached to the head of a wheelchair user, for example, as shown in FIG. Can include.

The communication unit 100 enables data transmission / reception with the outside, and in this embodiment, establishes a short-range wireless communication 50 with the portable terminal 30 to transmit / receive data. Alternatively, in another aspect, the communication unit 100 may establish wireless communication with the server 20 and directly send and receive data to and from the server.

The electroencephalogram detection unit 110 detects the electroencephalogram of a wheelchair user. The brain wave to be detected is, for example, a beta wave, a delta wave, a theta wave, an alpha wave, or the like, or brain waves of other frequencies may be detected. The detection result of the electroencephalogram detection unit 110 is provided to the control unit 130 or stored in the storage unit 120. The storage unit 120 stores programs, data, and the like to be executed by the control unit 130 of the electroencephalogram measuring device 10.

In a preferred embodiment, the control unit 130 is composed of a microcontroller including a ROM, a RAM, and the like, and the ROM or the RAM can store various programs for controlling the operation of each unit of the electroencephalogram measuring device 10. In this embodiment, the transmission program 200 that transmits the detection result of the brain wave detection unit 110 to the server 20 via the portable terminal 30 is executed.

FIG. 3 is a diagram showing a functional configuration of the transmission program 200 according to the present embodiment. The transmission program 200 includes an electroencephalogram acquisition unit 210 and an electroencephalogram information transmission unit 220. The electroencephalogram acquisition unit 210 acquires the user's electroencephalogram information detected by the electroencephalogram detection unit 110. The brain wave acquisition unit 210 may acquire brain wave information at regular intervals, or may acquire brain wave information when the brain wave changes, for example, when the beta wave changes to the alpha wave. Furthermore, it is also possible to acquire electroencephalogram information in response to a request from the server 20 or the portable terminal 20.

The electroencephalogram information transmission unit 220 transmits the electroencephalogram information acquired by the electroencephalogram acquisition unit 210 to the server 20 via the portable terminal 30. As will be described later, when the electroencephalogram information is transmitted to the server 20, the position information of the portable terminal 30 and the identification information for identifying the user of the wheelchair are added to the electroencephalogram information, and the information is acquired at which position on the server side. It is identified who the brain wave is. The user identification information can be, for example, a number unique to the portable terminal 30, a number unique to the electroencephalogram measuring device 10, or a nickname determined by the user himself / herself.

Next, the configuration of the server 20 according to this embodiment is shown in FIG. As shown in the figure, the server 20 according to the present embodiment includes a communication unit 300, a storage unit 310, and a control unit 320. However, this configuration is an example, and may include other configurations.

The communication unit 300 enables data transmission / reception to and from the outside. In this embodiment, wireless communication 40 is established with the portable terminal 30 via a network or the like, and data is transmitted and received. The storage unit 310 stores programs, map data, and the like executed by the control unit 320 of the server 20. FIG. 5 is a diagram showing a schematic configuration of map data. The map data 311 includes link data 312 and node data 313. Link data 312 is data related to roads connecting intersections, such as the longitude and latitude of the start point node and the end point node of the road, the type of road (national road, general road, prefectural road, expressway, toll road, etc.), and the traveling direction of the road. It includes information such as (eg, left or right), width, regulation (eg, one-way), number of lanes, and so on. The node data 313 includes data such as an intersection node flag indicating whether or not the node is an intersection, and a connection relationship between an entry link connected to the node and an escape link exiting the node.

Further, in this embodiment, the obstacle point (obstacle point) information 314 that becomes an obstacle when traveling in a wheelchair or the like is stored in association with the link data 312. The obstacle point information 314 includes, for example, slope information regarding the slope (slope) of the road and step information regarding the step of the road. As shown in FIG. 6A, the gradient information 315 includes the gradient and the coordinate information indicating the point or area where the gradient occurs, and the step information 316 is the coordinate information indicating the step and the point or area where the step occurs. And include. The coordinate information may be the center point (latitude, longitude) of the gradient or the step, or may be a plurality of points (latitude, longitude) indicating the region of the gradient or the step.

As shown in FIG. 5, the failure point information 314 is stored in association with the link data 312. FIG. 6B is a diagram conceptually showing the existence of obstacle points on the link (road). The coordinate information of the gradient information 315 and the step information 316 is associated with the start point node or the end point node of the link. For example, the coordinate information of the gradient information 315 and the step information 315 is associated with the offset value P from the start point node or the end point node. The node. For example, the 2 ° gradient SL-1 is represented by the offset value P1 from the start point node (in this case, the gradient information 315 specifies the coordinates of the center of the gradient SL-1), and the 1 cm step ST is the start point node. Is represented by the offset value P2 (in this case, the step information 316 specifies the coordinates of the center of the step ST), and the 4 ° gradient SL-2 is represented by the offset values P3 and P4 from the end point node (this). In the case, the gradient information 315 specifies the coordinates of the start point and the end point of the gradient SL-2). In this way, by referring to the obstacle point information 314 associated with the link data 312, the road including the obstacle point can be identified, and which position or area of the road including the obstacle point has a step or a slope. Can be identified.

In the above example, the gradient information 315 and the step information 316 are provided with coordinate information in order to be able to identify the position of the gradient or the step in the link, but the present invention is not limited to this and is within one link. When there is at least one step or slope in the gradient information 315 and the step information 316, the gradient information 315 and the step information 316 are associated with the link data by including the link data instead of the coordinate information. You may do so. When such an association is made, one section of the link is treated as indicating an obstacle point.

Further, in the above example, the obstacle point information is shown to be associated with the link data, but if there is an obstacle point other than the road, for example, in a vacant lot or a parking lot, the obstacle point information is the vacant lot or It can also be associated with facility data indicating a parking lot.

Next, a method of generating obstacle point information as shown in FIG. 6 will be described. There are several methods for generating obstacle point information, but in the first method, the obstacle point information is created and stored together with the map data when the map data is generated. In this case, the obstacle point information is updated regularly or irregularly together with the update of the map data, and the latest obstacle point information can be obtained. The second method is to attach a position detection means such as GPS and various sensors such as a vibration sensor and an inclination sensor to a wheelchair used by a plurality of users U2 to U4 as shown in FIG. 14, and when the wheelchair travels on the road. The wheelchair transmits the position information and the information from the sensor to the server 20, and the server 20 generates the failure point information in real time based on the received position information and the sensor information, or updates the generated failure point information. To do. For example, a vibration sensor or an acceleration sensor can detect the degree of a step, and an inclination sensor or an acceleration sensor can detect the degree of a road gradient. In this embodiment, the obstacle point information can be created by using the first and / or the second method. However, the method of generating the obstacle point information is not limited to the above example, and other methods may be used.

The storage unit 310 according to the present embodiment further stores learning information indicating the tendency of the user to feel insensitive or stressed at what kind of obstacle point for each user who uses the wheelchair. FIG. 7 shows an example of learning information. For example, if each of the users U1 to U4 shown in FIG. 14 has a step, how many cm or more of the step is unpleasant, and if it is a gradient, how many times or more the gradient is unpleasant is stored as learning information. Will be done. It can be seen that the user U1 feels uncomfortable with a step of 2 cm or more, and the user U2 feels uncomfortable with a gradient of 2 ° or more and a step of 3 cm or more.

In a preferred embodiment, the control unit 320 is composed of a microcontroller including a ROM, a RAM, and the like, and the ROM or the RAM can store various programs for controlling the operation of each unit of the server 20. In this embodiment, the control unit 320 creates learning information for each user based on the brain wave information of the user in the wheelchair, filters the obstacle points based on the learning information, and generates a map image. Execute program 400.

FIG. 8 is a diagram showing a functional configuration example of the map image generation program 400. The map image generation program 400 includes an unpleasant tendency learning unit 410, a request acquisition unit 420, a learning information acquisition unit 430, an obstacle point information selection unit 440, a map image information generation unit 450, and a map image information providing unit 460.

The discomfort tendency learning unit 410 acquires brain wave information (including position information of the portable terminal 30 and user identification information) transmitted from the brain wave measuring device 10 via the portable terminal 30, and is based on this information. The discomfort tendency of each user is learned, and learning information as shown in FIG. 7 is created. FIG. 9A is a diagram for explaining the operation of the discomfort tendency learning unit according to the present embodiment, and FIG. 9B is a diagram for explaining an example of the learning method.

First, when the electroencephalogram measuring device 10 can acquire the electroencephalogram information indicating discomfort or stress of the user, the position information indicating where the electroencephalogram information was detected, and the identification information for identifying who the electroencephalogram is. The discomfort tendency learning unit 410 refers to the obstacle point information 314 shown in FIG. 6 and learns what kind of obstacle the user feels uncomfortable. For example, the obstacle point information 314 having the same position information as the position information included in the electroencephalogram information or having a certain range of position information adjacent to the position information is searched, and the number of gradients or the step of how many cm makes the person feel uncomfortable. judge. For example, if the position where the unpleasant brain wave information is acquired is within a certain range from (X3, Y3) or (X3, Y3), it is determined that the user feels unpleasant or stressed due to the gradient of 7 °. To do. In addition, the position information included in the electroencephalogram information is placed on the link by approximation processing such as map matching, and based on the positional relationship between the link and the obstacle point information as shown in FIG. It is also possible to determine if the disability was unpleasant at the point. For example, as shown in FIG. 9B, if the position information P included in the electroencephalogram information is corrected to P'by the map matching process, it can be understood that the step ST of 1 cm is unpleasant.

Assuming the above grasping method, several learning methods can be considered. The learning method by the discomfort tendency learning unit 410 is not particularly limited, but for example, by using artificial intelligence capable of trend analysis, if each user feels uncomfortable with a gradient of more than a few times and a gradient of less than a few times. It is possible to learn the boundary value of whether or not a step of several centimeters or more is unpleasant, or a step of several centimeters or more is unpleasant and a step of less than several centimeters is not unpleasant. Alternatively, as another method, a certain threshold value may be set to learn the discomfort tendency of the user (threshold value learning). For example, based on the transmitted electroencephalogram information, when a gradient of N ° or more is unpleasant n times, learning is performed such that "a gradient of N ° or more is unpleasant". Similarly, regarding the step, when the step of M cm or more is unpleasant m times, it can be learned that "the step of M cm or more is unpleasant". In this way, the discomfort tendency learning unit 410 accumulates learning information for each user in the storage unit 310. The discomfort tendency learning unit 410 can always update the discomfort tendency of the user based on the brain wave information. For example, until now, the gradient of 3 ° or more was unpleasant, but the gradient of 3 ° is unpleasant. It is also possible to learn that a gradient of 4 ° or more is unpleasant because it is less likely to be felt.

The request acquisition unit 420 transmits the display position information (position information of the current location and destination of the portable terminal 30, etc.) of the portable terminal 30 to be displayed on the map display and the user identification information transmitted from the portable terminal 30. Get the map information request including. The display position information includes, for example, latitude / longitude information of the current location and destination of the portable terminal 30.

The learning information acquisition unit 430 searches the learning information accumulated in the storage unit 310 by the discomfort tendency learning unit 410 based on the user's identification information included in the map information request, and acquires the learning information of the corresponding user. ..

The obstacle point information selection unit 440 selects (filters) the obstacle point information 314 stored in the storage unit 310 based on the learning information acquired by the learning information acquisition unit 430. The obstacle point information selection unit 440 selects the obstacle point information that the identified user feels uncomfortable. For example, when the learning result that the user feels uncomfortable with a gradient of 5 ° or more is acquired, the gradient information excluding the gradient of 0 ° to 4 ° is acquired. In the case of step information, when the learning result that the user feels uncomfortable with a gradient of 3 cm or more is acquired, the step information excluding the step of 0 to 2 cm is acquired. That is, the obstacle point information selection unit 440 selects only the obstacle point information that the user feels uncomfortable from the obstacle point information.

The map image information generation unit 450 generates map image information to be provided to the portable terminal 30. The map image information includes obstacle point information selected by the obstacle point information selection unit 440, that is, obstacle point information 314 which is presumed to be unpleasant for the user. Further, the map image information can include map data for displaying the map image on the portable terminal 30. However, if the portable terminal 30 has such map data, it is not essential for the map image information generation unit 450 to include the map data as the map image information. The map image information providing unit 460 provides the map image information generated by the map image information generating unit 450 to the portable terminal 30 via the wireless communication 40.

Next, the portable terminal according to this embodiment will be described. FIG. 10 is a block diagram showing a configuration of a portable terminal according to the present embodiment. The portable terminal 30 includes a communication unit 500, an input unit 510, a display unit 520, a voice output unit 530, a position information calculation unit 540, a storage unit 550, and a control unit 560.

As shown in FIG. 1, the communication unit 500 establishes a wireless communication 40 with the server 20. The communication unit 500 further establishes a short-range wireless communication 50 with the electroencephalogram measuring device 10 and receives the electroencephalogram information transmitted from the electroencephalogram measuring device 10. The input unit 510 has a function of receiving an input from the user, and provides the input from the user to the control unit 560 via a user interface such as a button or a touch panel. The display unit 520 includes a display medium such as a liquid crystal display, displays a map image based on the map image information provided by the server 20, and displays an image stored in the storage unit 550. The voice output unit 530 has a function of outputting the voice information stored in the storage unit 550 and the voice information provided by the server 20. The position information calculation unit 540 calculates the current location of the portable terminal 30 (the current location of the user who owns the portable terminal 30) based on a GPS signal or the like transmitted from a GPS satellite. The storage unit 550 can store a program for executing a unique function of the portable terminal 30, an application program downloaded from an external server including the server 20, and the like. Further, the storage unit 550 can store basic map data necessary for the map image display unit 640 to display the map image, that is, link data, node data, facility data, etc. for map display. it can.

In a preferred embodiment, the control unit 560 includes a ROM, a RAM, a microcontroller, and the like, and the ROM or the RAM can store various programs for controlling the operation of each unit of the portable terminal 30. In this embodiment, the control unit 560 executes the display program 600 for displaying the failure point information filtered for each user.

FIG. 11 shows a functional configuration of the display program according to the present embodiment, and the display program 600 includes an electroencephalogram information mediation unit 610, a map display request unit 620, a map image information acquisition unit 630, and a map image display unit 640. ..

The electroencephalogram information mediator 610 acquires the electroencephalogram information transmitted from the electroencephalogram measuring device 10 and transmits the electroencephalogram information to the server 20. When the electroencephalogram information is transmitted to the server 20, the position information calculated by the position information calculation unit 540 is added to the electroencephalogram information and transmitted. By adding the position information, it is possible to grasp at which position the user's unpleasant brain wave was detected in the analysis of the server 20. Further, the electroencephalogram information mediator 610 adds identification information for identifying the user to the electroencephalogram information. By adding the identification information, it becomes clear who the brain wave information is, and as shown in FIG. 7, learning information for each user can be generated.

The map display request unit 620 transmits a map information request to the server 20. The map information request transmitted by the map display request unit 620 includes display position information, and the display position information includes, for example, the current location position information calculated by the position information calculation unit 540 or the user input from the input unit 510. It can include information on the destination you want to go to. In addition, the map display request includes identification information for identifying the user, whereby the learning information acquisition unit 430 can acquire the learning information for each user. The map image information acquisition unit 630 acquires the map image information provided by the map image information providing unit 460.

The map image display unit 640 displays a map image on the display unit 520 based on the map image information acquired by the map image information acquisition unit 630. In the display of the map image, the obstacle point information is superimposed on the road map. It should be noted here that the obstacle point information displayed on the road map is only the obstacle point information selected by the obstacle point information selection unit 440, which the user feels uncomfortable or stressed.

FIG. 12A is a conventional display example of obstacle point information, and FIG. 12B is a display example of obstacle point information according to this embodiment. In FIG. 12 (A), all obstacle point information (gradient information and step information) associated with the link data is displayed regardless of the discomfort or stress of the user, whereas in FIG. 12 (B). ) Displays the information on the obstacle points that the user feels uncomfortable or stressed by filtering the information on the obstacle points. In the example of the figure, the obstacle point information having a gradient of 3 ° or more and a step of 3 cm or more is filtered.

Next, the operation flow of the display system according to this embodiment is shown in FIGS. 13A and 13B. FIG. 13A is a diagram showing a learning operation of a user's unpleasant tendency mainly based on brain waves in the display system 1, and FIG. 13B is a diagram showing a filtering operation of obstacle point information based on the learning result.

In FIG. 13A, first, the electroencephalogram acquisition unit 210 acquires the electroencephalogram information of the wheelchair user (S100), and the electroencephalogram information transmission unit 220 transmits the electroencephalogram information to the portable terminal 30 (S102). The electroencephalogram information mediator 610 of the portable terminal 230 adds position information and user identification information to the received electroencephalogram information (S104), and transmits these information to the server 20 (S106). In addition, "*" in the figure indicates that position information and identification information were added to the electroencephalogram information. The discomfort tendency learning unit 410 of the server 20 receives the brain wave information including the position information and the identification information, stores the user's brain wave information and the position information in the storage unit 310, and learns the user's discomfort tendency (S108). ). The operations of steps S100 to S108 may be performed at any time by using the acquisition of the electroencephalogram by the electroencephalogram acquisition device 10 as a trigger, or may be performed in response to a request from the portable terminal 30 or the server 20. May be good. When the operation shown in FIG. 13 is executed once or a plurality of times, the learning result of a specific user is accumulated in the storage unit 310.

When the user instructs the display of the map image via the input unit 510 or the display program 600 is activated in the portable terminal 30, the map display request unit 620 requests the map display as shown in FIG. 13B. Is executed for the server 20 (110). The request includes display position information and user identification information. The request acquisition unit 420 acquires the map information request from the portable terminal 30 (S112), and the learning information acquisition unit 430 obtains the learning information of the user based on the user's identification information included in the map information request. Read from the storage unit 310 (S114). The obstacle point information selection unit 440 filters the obstacle point information that the user feels uncomfortable or stressed based on the learning information of the user (S116). The map image information generation unit 450 generates map image information including filtered obstacle point information (S118), and the generated map image information is provided to the portable terminal 30 by the map image information providing unit 460 (S. 118). S120). The map image information acquisition unit 630 acquires the provided map image information (S122), and displays a map image including the obstacle point information filtered by the map image display unit 640 (S124).

As described above, according to the present embodiment, since the biometric information of the user is acquired and the obstacle point information is filtered based on the biometric information, it is possible to display the obstacle point information useful for the user. Furthermore, if the learning function is also used, the trend of discomfort or stress for the user is estimated, and the obstacle point information is filtered based on the estimation, so that the optimum obstacle point information for the user can be presented. Even if the driving ability of the user who uses the wheelchair changes, the biometric information of the user is sequentially accumulated, and by learning it, filtering that reflects the change of the biometric information of the user is automatically performed. Can be done.

Next, a modified example of the embodiment of the present invention will be described. In the above embodiment, the server 20 has a function of filtering the failure point information, but this function can also be held by the portable terminal 30. In this case, the portable terminal 30 receives learning information (information on how much obstacle the user feels uncomfortable or stressed) based on the user's biological information acquired by the learning information acquisition unit 430 of the server 20. The portable terminal 30 may filter the failure point information included in the map image information transmitted from the server 20 based on the learning information. For example, map image information including failure point information as shown in FIG. 12A is provided from the server 20 to the portable terminal 30, and the portable terminal 30 filters the failure point information included therein to be filtered in FIG. The map image information including the obstacle point information as shown in (B) is displayed.

In another aspect, both the server 20 and the portable terminal 30 may have a filtering function. In this case, when the portable terminal 30 receives the map image information including the filtered obstacle point information from the server 20, the portable terminal 30 may be able to further filter the map image information. In this case, in the portable terminal 30, the user can set a standard for filtering. For example, the user makes a setting so that the obstacle point information is not displayed if the gradient is several times or less and the step is several centimeters or less.

Furthermore, it is assumed that the automatic filtering of obstacle point information does not always match the user's criteria. Therefore, as another modification, the portable terminal 30 is provided with a modification means for modifying a criterion that makes the user feel uncomfortable or stressful. Specifically, the portable terminal 30 receives an input from the user for correcting the criterion of discomfort. For example, the user inputs whether it is unpleasant if the gradient is many times or more, or unpleasant if the step is several centimeters or more. When the portable terminal 30 receives an input regarding the discomfort standard, the portable terminal 30 transmits information regarding the discomfort standard to the server 20. When the discomfort tendency learning unit 410 of the server 20 receives the information regarding the discomfort standard, the discomfort tendency is corrected according to the information.

Next, a second embodiment of this embodiment will be described. In the second embodiment, route guidance is performed using filtering of obstacle point information. For example, at the time of requesting the map information of FIG. 13B (S110), the portable terminal 30 simultaneously requests the server 20 to search for the optimum route to the destination. The optimum route here is an optimum route from the starting point to the destination as performed by a normal navigation device, and is a route avoiding obstacle points for the user as much as possible. When the server 20 receives a request for route search, the server 20 filters the obstacle point information (S116), and then searches for the optimum route based on the filtered road map. Then, the server 20 provides the portable terminal 30 with a road map image including the filtered obstacle point information together with the searched optimum route. As a result, the user can reach the destination by the optimum route that avoids the unpleasant obstacle point as much as possible.

In addition, after providing route guidance once, if the user passes through an unfiltered obstacle point that can be passed, it will be necessary to reroute (reroute search), but the obstacle points that can be passed in advance are filtered. Therefore, the processing related to rerouting is reduced, and the communication cost between the portable terminal 30 and the server 20 is reduced.

In the above examples and modifications, brain waves are used as the biometric information of the user, but the biometric information for learning the discomfort tendency may be the heart rate or blood pressure value of the user. good. For example, when the heart rate or blood pressure value rises above a certain threshold value, it can be determined that the user is uncomfortable, and the discomfort point can be learned.

In the above-described embodiment and modification, the electroencephalogram measuring device 10 and the portable terminal 30 are shown as separate devices, but the portable terminal 30 may be configured to incorporate the electroencephalogram measuring device 10. Further, in addition to the brain wave measuring device 10, a biometric information measuring device such as a heart rate sensor for detecting the heart rate of the user and a sphygmomanometer for detecting the blood pressure value may be built in the portable terminal 30.

Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications and modifications are made within the scope of the gist of the invention described in the claims. It can be changed.

1: Display system 10: Brain wave measuring device 20: Server 30: Portable terminal 40: Wireless communication 50: Short-range wireless communication 100: Communication unit 110: Brain wave detection unit 120: Storage unit 130: Control unit 200: Transmission program 210: Brain wave acquisition unit 220: Brain wave information transmission unit 300: Communication unit 310: Storage unit 311: Map data 312: Link data 313: Node data 314: Obstacle point information 315: Gradient information 316: Step information U1, U2, U3, U4: A user

Claims (13)

A display system that includes a server and an electronic device that can display information provided by the server.
The server
Acquisition means for acquiring biometric information and location information of each user,
A storage means for storing obstacle information in association with link data, which represents coordinates indicating coordinates indicating points or areas where road obstacles occur.
A learning means that identifies obstacle information that makes the user feel uncomfortable with road obstacles based on the user's biological information and location information, and creates learning information based on the identification results.
A selection means for selecting obstacle information that is unpleasant for the user of the electronic device based on the learning information, and
It has a providing means for providing map information including failure information selected by the selecting means to the electronic device.
The electronic device
A display system including display means for displaying map information including failure information provided by the providing means. The acquisition means further acquires user identification information, the learning means generates learning information for each of a plurality of users, and the selection means is learning information based on the user identification information of the electronic device. The display system according to claim 1, wherein the disability information is selected based on the searched learning information. The display system according to claim 2, wherein the electronic device includes a transmission means for transmitting biometric information, location information, and identification information of a user to the server. The display system according to claim 1, wherein the display system further includes a biometric information measuring device that measures biometric information, and the biometric information measuring device transmits the measured biometric information to the server. The display system according to claim 1 or 4 , wherein the biological information is an electroencephalogram of the user. The display system according to claim 1 or 4 , wherein the biological information is the heart rate of the user. The display system according to claim 1 or 4 , wherein the biological information is a blood pressure value of the user. The server includes a route search means for searching a route to a destination based on a road map including obstacle information selected by the selection means, and the providing means carries the route searched by the route search means. The display system according to any one of claims 1 to 7 , provided to a type terminal. The display system according to any one of claims 1 to 8 , wherein the obstacle information includes road slope information or step information. The display system according to claim 1, wherein the electronic device is mounted on a wheelchair. The display system according to claim 1, wherein the electronic device is a smartphone. A server that provides map information to electronic devices
Acquisition means for acquiring biometric information and location information of each user,
A storage means for storing obstacle information in association with link data, which represents coordinates indicating coordinates indicating points or areas where road obstacles occur.
A learning means that identifies obstacle information that makes the user feel uncomfortable with road obstacles based on the user's biological information and location information, and creates learning information based on the identification results.
Based on the learning information , a selection means for selecting obstacle information that is unpleasant for the user of the electronic device, and
A server having a providing means for providing map information including failure information selected by the selecting means to the electronic device. The acquisition means further acquires user identification information, the learning means generates learning information for each of a plurality of users, and the selection means is learning information based on the user identification information of the electronic device. The server according to claim 12 , wherein the server searches for and selects failure information based on the searched learning information.

Images