JP7543082B2 - Information presentation device, information presentation method, and information presentation program - Google Patents

Description

The present invention relates to an information presentation device, an information presentation method, and an information presentation program.

In recent years, technology has been developed that uses emotion estimation devices such as computers to estimate the emotions of people based on their behavior, such as the voice and facial expressions emitted by the people.

For example, Patent Document 1 discloses a facility satisfaction calculation device that, when a vehicle visits a facility in a specific area for an event or shopping, an emotion estimation unit calculates the satisfaction of the facility by estimating the emotion of the occupant within a specified time after the vehicle leaves the facility.

JP 2018-055550 A

However, in the facility satisfaction calculation device of Patent Document 1, for example, when estimating the emotions of a passenger, if an event occurs that affects the emotions of the passenger, it may not be possible to calculate a correct level of satisfaction with the facility.

The present invention has been made in consideration of the above points, and aims to provide an information presentation device, an information presentation method, and an information presentation program that are capable of obtaining evaluation results of presented information based on the user's emotions while suppressing the influence of emotions unrelated to the presented information.

The invention described in claim 1 is an information presentation device that includes an information presentation unit that presents recommended information to a vehicle occupant, an emotion estimation unit that estimates the emotion of the occupant, and an evaluation unit that evaluates the presentation of the recommended information based on the estimation result of the emotion of the occupant after the information presentation unit presents the recommended information.

The invention described in claim 10 is an information presentation method for an information presentation device that presents recommended information to an occupant of a vehicle, comprising an information presentation step in which an information presentation unit presents the recommended information to the occupant of the vehicle, an emotion estimation step in which an emotion estimation unit estimates the emotion of the occupant, and an evaluation step in which an evaluation unit evaluates the recommended information based on the estimation result of the emotion of the occupant after the information presentation unit presents the recommended information.

The invention described in claim 11 is an information presentation program that causes a computer mounted on an information presentation device that presents recommended information to a vehicle occupant to execute an information presentation step in which an information presentation unit presents the recommended information to the vehicle occupant, an emotion estimation step in which an emotion estimation unit estimates the emotion of the occupant, and an evaluation step in which an evaluation unit evaluates the recommended information based on the estimation result of the emotion of the occupant after the information presentation unit presents the recommended information.

1 is a perspective view of a front seat portion of a vehicle equipped with an information display device according to a first embodiment of the present invention; 1 is a functional block diagram of an information presentation device 10 according to a first embodiment of the present invention. 3 is a flow diagram of an operation routine of the information presentation device 10 according to the first embodiment of the present application. FIG. 3 is a flow diagram of an operation routine of the information presentation device 10 according to the first embodiment of the present application. FIG. 1 is a top view of an automobile equipped with an information display device according to a first embodiment of the present invention. FIG. 11 is a functional block diagram of an information presentation device 10 according to a second embodiment of the present invention. FIG. 11 is a flow diagram of an operation routine of the information presentation device 10 according to the second embodiment of the present application. FIG. 11 is a functional block diagram of an information presentation device 10 according to a third embodiment of the present invention. FIG. 11 is a flow diagram of an operation routine of the information presentation device 10 according to the third embodiment of the present application. FIG. 11 is a functional block diagram of an information presentation device 10 according to a fourth embodiment of the present invention. FIG. 11 is a flow diagram of an operation routine of the information presentation device 10 according to the fourth embodiment of the present invention.

In the following, preferred embodiments of the present invention will be described. However, these may be modified and combined as appropriate. In the following description and accompanying drawings, substantially the same or equivalent parts are denoted by the same reference numerals. In the following description, video will be described as including both moving images and still images.

Hereinafter, an information presentation system 100 including an information presentation device 10 according to a first embodiment of the present invention will be described with reference to the accompanying drawings. In the first embodiment, an example will be described in which the information presentation device 10 is mounted on an automobile M.

Figure 1 is a diagram showing an example of the front seat portion of an automobile M as a vehicle equipped with an information presentation device 10 according to Example 1 of the present application. As an example of installation, Figure 1 shows a case where the information presentation device 10 is installed in the center console CC portion of the front seat of the automobile M.

The in-vehicle camera 21 is a camera capable of capturing images of occupants of the automobile M. The in-vehicle camera 21 is provided, for example, on the dashboard DB, and is oriented so as to capture images of occupants in the cabin of the automobile M, particularly the facial expressions or upper bodies of the occupants. The in-vehicle camera 21 may be disposed in a position where it can capture images of the facial expressions, body movements, and other conditions of the occupants. For example, the in-vehicle camera 21 may be provided on the rearview mirror RM or on the ceiling near the top edge of the windshield FG. The in-vehicle camera 21 is also connected to the information presentation device 10 so as to be able to communicate with the information presentation device 10, and is capable of transmitting a signal of the captured image to the information presentation device 10.

Note that multiple in-vehicle cameras 21 may be installed in the passenger compartment of the automobile M. For example, in-vehicle cameras 21 capable of capturing images of the driver's seat and passenger seat occupants may each be provided on the dashboard DB, and in-vehicle cameras 21 capable of capturing images of the rear seat occupants may each be provided on the rear surface of the driver's seat and passenger seat or on the rear surface of the headrest. In addition, the in-vehicle cameras 21 may be configured to capture images of the entire body of the occupants, not just the upper body.

The in-vehicle microphone 22 is a microphone device that picks up sounds inside the vehicle, and is arranged, for example, on the dashboard DB. The in-vehicle microphone 22 may be arranged anywhere, such as on the rearview mirror RM or the steering wheel, as long as it is capable of picking up sounds inside the vehicle. The in-vehicle microphone 22 is communicatively connected to the information presentation device 10, and is capable of transmitting signals of the collected sounds to the information presentation device 10.

The in-vehicle camera 21 and the in-vehicle microphone 22 are an in-vehicle situation acquisition device 20 that allows the information presentation device 10 to acquire in-vehicle situation information within the cabin of the automobile M. The information presentation device 10 is equipped with at least one of the in-vehicle camera 21 and the in-vehicle microphone 22.

The speaker 31 is provided, for example, on the interior side of the pillar P or the door DR. The speaker 31 is communicatively connected to the information presentation device 10 and can emit sounds such as music and voices based on the control of the information presentation device 10.

The display 32 is, for example, a liquid crystal display or other display capable of displaying images. The display 32 is, for example, arranged on the dashboard DB. The display 32 may be arranged in a location that can be seen by the occupants in the vehicle cabin. For example, the display 32 may be attached to the center console CC in the dashboard DB. The display 32 is communicably connected to the information presentation device 10, and is capable of displaying a screen based on the control of the information presentation device 10. The display 32 may be a touch panel monitor that combines a display such as a liquid crystal display capable of displaying images with a touch panel. In this case, the display 32 is capable of transmitting a signal representing an input operation to the touch panel received from the occupant to the information presentation device 10.

The speaker 31 and the display 32 are an information presentation device 30 that allows the information presentation device 10 to present information to passengers in the vehicle M.

The GPS receiver 41 is a device that receives signals (GPS signals) from GPS (Global Positioning System) satellites. The GPS receiver 41 is arranged, for example, on a dashboard DB. Note that the GPS receiver 41 may be arranged anywhere as long as it can receive GPS signals. The GPS receiver 41 is communicably connected to the information presentation device 10, and is capable of transmitting received GPS signals to the information presentation device 10.

Figure 2 shows the configuration of the information presentation device 10. The information presentation device 10 is a device in which a memory unit 53, a control unit 55, an input unit 57, and an output unit 59 cooperate with each other via a system bus 51, for example.

The storage unit 53 is composed of, for example, a hard disk device, a solid state drive (SSD), flash memory, etc., and stores various programs such as the operating system and software for the terminal.

The various programs may be obtained, for example, from another server device or the like via a network, or may be recorded on a recording medium and read via various drive devices. In other words, the various programs stored in the memory unit 53 (including a program for executing the processing in the information presentation device 10, which will be described later) can be transmitted via a network, and can also be recorded on a computer-readable recording medium and transferred.

The storage unit 53 also stores, for example, map information and facility information corresponding to the map information. The facility information recorded in the storage unit 53 includes category information such as restaurants, shopping facilities, tourist attractions such as scenic spots, and amusement facilities. The facilities or tourist attractions included in each category are classified into multiple subcategories. For example, facilities included in the restaurant category are classified into subcategories such as Japanese food, Chinese food, and pasta restaurants. The information presentation device 10 may be connected to the Internet by wireless communication, and information about the facilities stored in the storage unit 53 may be added or word-of-mouth information about the facilities may be updated as needed by acquiring information via the Internet.

The control unit 55 is configured with a CPU (Central Processing Unit) 55A, a ROM (Read Only Memory) 55B, a RAM (Random Access Memory) 55C, etc., and functions as a computer. The CPU 55A reads and executes various programs stored in the ROM 55B and the storage unit 53 to realize various functions.

The input unit 57 is an interface unit that communicatively connects the information presentation device 10 and the in-vehicle situation acquisition device 20. The information presentation device 10 can receive a video signal from the in-vehicle camera 21 and an audio signal from the in-vehicle microphone 22 via the input unit 57. The information presentation device 10 can also receive a signal of the current position information of the automobile M from the GPS receiver 41 via the input unit 57.

The output unit 59 is communicatively connected to the speaker 31 and the display 32, and can transmit an audio signal to the speaker 31 to output sound, or transmit a video or image signal to the display 32 to display an image.

As described above, the information presentation device 10 receives a signal of the current location information of the automobile M from the GPS receiver 41 via the input unit 57. The control unit 55 can present recommended information such as facilities that should be recommended to the occupants of the automobile M in the vicinity of the automobile M or in the direction of travel, based on the location information of the automobile M received via the input unit 57 and the map information recorded in the memory unit 53. At this time, the control unit 55 functions as an information presentation unit. In other words, the information presentation device 10 includes the control unit 55 as an information presentation unit that presents recommended information to the occupants of the automobile M.

As described above, the information presentation device 10 receives video of the interior of the vehicle, including the occupants of the vehicle M, from the in-vehicle camera 21 via the input unit 57. The information presentation device 10 also receives audio, including the voices of the occupants in the vehicle interior of the vehicle M, from the in-vehicle microphone 22 via the input unit 57. The information presentation device 10 acquires information on the behavior of the occupants, such as facial expressions or movements, from the received video. Alternatively, the information presentation device 10 acquires information on the voices of the occupants or sounds generated by the movements of the occupants from the audio received from within the vehicle interior. Hereinafter, the behavior and voices of the occupants are also simply referred to as the behavior of the occupants. The control unit 55 extracts the behavior and voices of the occupants from the video and audio received via the input unit 57, and is capable of inferring the emotions of the occupants from the extracted behavior and voices.

For example, the control unit 55 infers the emotion of the occupant based on the facial expression, gestures, and other movements of the occupant captured by the in-vehicle camera 21, or the volume or tone of the occupant's voice input by the in-vehicle microphone 22. At this time, the control unit 55 functions as an emotion estimation unit. In other words, the information presentation device 10 includes the control unit 55 as an emotion estimation unit that estimates the emotion of the occupant.

In estimating the emotion of the occupant by the control unit 55, for example, the control unit 55 estimates the emotion by comparing the facial expression or voice of the occupant when calm, which is recorded in advance in the storage unit 53, with the extracted and acquired facial expression or voice. Specifically, for example, the emotion is estimated by comparing the shape of the eyes or mouth of the facial expression of the occupant. Also, for example, the control unit 55 estimates the emotion from the amount of movement of each part of the body of the occupant when calm, which is recorded in advance in the storage unit 53, by comparing with the amount of movement of each part of the body, particularly the upper body, of the occupant when calm. Also, for example, the control unit 55 estimates the emotion of the occupant by comparing the voice state of the occupant when calm, such as the volume and tone of voice, which is recorded in advance in the storage unit 53, with the extracted voice state. Also, for the above facial expression, the amount of movement of each part of the body, and the voice state, the difference from when calm, which is recorded in advance, may be measured as each feature amount, and the emotion of the occupant may be estimated from the distribution tendency of each feature amount.

In addition, the estimation of the occupant's emotions by the control unit 55 is not limited to the above-described estimation by the control unit 55 comparing the data with the occupant's data previously recorded in the memory unit 53. For example, the control unit 55 may infer the occupant's emotions from the video and audio in the vehicle cabin by deep learning using an artificial intelligence (AI) program stored in the memory unit 53.

The control unit 55 may estimate the emotions of only the occupant in the driver's seat, or of a specific occupant that has been set in advance. The control unit 55 may estimate the emotions of all occupants in the cabin of the automobile M. In that case, for example, the emotion of the occupant who is estimated to be the most emotional among the occupants in the cabin of the automobile M may be used as a representative value, or the emotions of all occupants in the cabin of the automobile M may be estimated and quantified, and then the average value of the quantified values may be used as a representative value.

After presenting the recommended information to the occupants in the cabin of the automobile M, the information presentation device 10 estimates the emotions of the occupants as described above and evaluates the recommended information. Specifically, the control unit 55 evaluates the presented recommended information according to the estimated emotions obtained after the presentation of the recommended information, and changes the content of the category of recommended information to be presented thereafter and the frequency of presentation. At this time, the control unit 55 functions as an evaluation unit. In other words, the information presentation device 10 includes the control unit 55 as an evaluation unit that evaluates the presentation of the recommended information based on the estimation result of the emotions of the occupants after the presentation of the recommended information by the control unit 55 as an information presentation unit.

Specifically, for example, suppose that the information presentation device 10 presents, as recommended information, information about a well-regarded pasta restaurant in the direction of travel of the automobile M, and then it is estimated that the emotions of the occupants in the cabin of the automobile M have shifted from a calm state to positive emotions such as joy and enjoyment. At this time, the information presentation device 10 determines that the occupants currently in the cabin prefer information in the restaurant category, and in particular in the subcategory of pasta restaurants. In this case, the information presentation device 10 makes changes in the presentation of subsequent recommended information, such as increasing the frequency of presentation of the pasta restaurant and facilities in the same category or subcategory.

On the other hand, if the information presentation device 10 predicts that the occupant's estimated emotion has changed from a calm state to a negative emotion such as anger or disgust after presenting the recommended information, the control unit 55 will make changes such as reducing the frequency of presenting facilities belonging to the same category or subcategory in future presentations of recommended information.

In other words, by repeatedly presenting and evaluating recommended information, the information presentation device 10 is able to present more recommended information that matches the preferences of the occupant.

When estimating the occupant's emotions after presenting the recommended information as described above, it is preferable that the occupant's emotions are calm when the recommended information is presented. For example, when the recommended information is presented, if an influencing event (hereinafter also simply referred to as an event) that affects the occupant's emotions occurs, such as an argument between occupants in the vehicle cabin, a traffic jam outside the vehicle, or another vehicle suddenly cuts in front of the vehicle, the occupant may not be emotionally calm. In such a case, even if the recommended information is presented and the occupant's emotions after the presentation of the recommended information are estimated, the recommended information may not be evaluated appropriately due to the occupant's emotions affected by the event. In other words, it is preferable to evaluate the recommended information when the occupant's emotions are calm when the recommended information is presented.

Therefore, the information presentation device 10 may estimate the emotions of the occupants as described above before presenting the recommended information. Specifically, the control unit 55 may present the recommended information only if the emotions of the occupants in the vehicle cabin are calm at the time of presenting the recommended information or immediately before. Furthermore, the control unit 55 may suspend the presentation of the recommended information until the emotions of the occupants in the vehicle cabin are estimated to be calm at the time of presenting the recommended information or immediately before. This enables the information presentation device 10 to more appropriately evaluate the recommended information.

In other words, the control unit 55 as an information presenting unit does not present recommended information during a period in which the emotion of the occupant estimated by the control unit 55 as an emotion estimating unit is in a specific state.

Below, an example of an operation routine of the information presentation device 10 when functioning as an information presentation device is described.

FIGS. 3 and 4 are diagrams showing information presentation routines R1 and R2 as examples of operation routines. The information presentation routine R1 shown in FIG. 3 shows the operation routine of the information presentation device 10 up to the presentation of recommended information. The information presentation routine R2 shown in FIG. 4 shows the operation routine of the information presentation device 10 after the presentation of recommended information. The information presentation routines R1 and R2 are executed, for example, consecutively. The information presentation routines R1 and R2 are executed repeatedly, for example, when the information presentation device 10 is powered on.

When the information presentation routine R1 is started, the control unit 55 first searches for recommended information to be recommended to the occupant in the vehicle M (step S101). Specifically, the control unit 55 compares the position information of the GPS receiver 41 received via the input unit 57 with the map information and facility information recorded in the memory unit 53, and searches for recommended information that can be provided to the occupant regarding facilities around the vehicle M, in the direction of travel, or on the set route.

Next, the control unit 55 determines whether the search has found recommended information that should be recommended to the occupant in the vehicle M (step S102). In this determination, for example, if recommended information is found in the search in step S101, the control unit 55 compares the found recommended information with information about the occupant, such as the occupant's preferences, and if the recommended information is recommended information that should be recommended to the occupant, determines that recommended information to be recommended to the occupant has been found.

In step S102, if the control unit 55 determines that no recommended information has been found that should be recommended to the occupant of the vehicle M (step S102: No), the control unit 55 repeats the process of step S101 to search for recommended information.

In step S102, if the control unit 55 determines that recommended information that should be recommended to the occupants in the automobile M has been found (step S102: Yes), the control unit 55 estimates the emotions of the occupants in the passenger compartment of the automobile M (step S103). As described above, the control unit 55 estimates the emotions of the occupants based on the video and audio data of the occupants received from the in-vehicle situation acquisition device 20 via the input unit 57.

Next, the control unit 55 determines whether the occupant's emotions are calm based on the estimation result (step S104).

In step S104, if the control unit 55 determines that the occupant is not emotionally calm (step S104: No), the control unit 55 repeatedly executes the process of step S103 and waits until it is determined that the occupant is emotionally calm.

If the control unit 55 determines in step S104 that the occupant is calm (step S104: Yes), the operation routine of the information presentation device 10 shown in FIG. 4 transitions to information presentation routine R2, and as an information presentation step, the control unit 55 presents recommended information to the occupant (step S105). The recommended information is output from the information presentation device 30 via the output unit 59. Specifically, the control unit 55 presents the recommended information to the occupant by outputting audio information from the speaker 31 and image information from the display 32 via the output unit 59.

Next, as an emotion estimation step, the control unit 55 estimates the emotion of the occupant again (step S106). In this step, similar to the processing in step S103, the control unit 55 estimates the emotion of the occupant based on the video and audio data of the occupant received from the in-vehicle situation acquisition device 20 via the input unit 57.

Next, as an evaluation step, the control unit 55 evaluates the recommended information based on the estimated emotion (step S107). The control unit 55 records the evaluation result of the recommended information in the storage unit 53, and in the search for recommended information in the subsequent step S101, changes the search conditions or extraction frequency of facilities, etc. that belong to the same category or subcategory as the currently evaluated recommended information.

As described above, the information presentation method of the information presentation device 10 includes an information presentation step in which the control unit 55 as an information presentation unit presents recommended information to an occupant of the automobile M, an emotion estimation step in which the control unit 55 as an emotion estimation unit estimates the emotion of the occupant, and an evaluation step in which the control unit 55 as an evaluation unit evaluates the recommended information based on the estimation result of the emotion of the occupant after the control unit 55 as an information presentation unit presents the recommended information.

This allows the information display device 10 to repeatedly perform its operation routine, making it possible to display more recommended information that matches the preferences of the occupant.

Note that the above-mentioned emotion estimation in step S106 and the process of reflecting the evaluation in step S107 do not necessarily have to be performed within this flow. For example, video and audio data of the occupants when the recommended information is presented may be stored, and the emotion estimation in step S106 and the process of reflecting the judgment of the evaluation of the recommended information in step S107 may be performed later based on the stored data.

The information presentation system 200 of the second embodiment will be described below. The information presentation system of the second embodiment, like the information presentation system 100 of the first embodiment, includes an in-vehicle situation acquisition device 20 consisting of an in-vehicle camera 21 and an in-vehicle microphone 22 connected to the information presentation device so as to be capable of communicating information, and an information presentation device 30 consisting of a speaker 31 and a display 32.

In the first embodiment, in order to properly evaluate the recommended information presented by the information presentation device 10, a case has been described in which the presentation of the recommended information is suspended until it is estimated that the emotions of the occupants in the vehicle cabin are calm before the presentation of the recommended information. However, the information presentation device may, for example, determine whether an event that affects the emotions of the occupants has occurred inside or outside the vehicle, and then determine whether to present the recommended information.

Figure 5 is a top view of an automobile M as a vehicle equipped with an information presentation system 200 including an information presentation device 10A according to Example 2 of the present application. The configuration of the information presentation system 200 including the information presentation device 10A in Example 2 is basically the same as that of Example 1 described above, but differs in that it has an outside-vehicle situation acquisition device 40 including an outside-vehicle camera 42, an outside-vehicle microphone 43, and an outside-vehicle sensor 44 that acquire information indicating the situation outside the automobile M.

The exterior camera 42 is a camera capable of capturing images of the surroundings of the automobile M. The exterior camera 42 includes, for example, a front camera 42A that is provided on the front grille GR and oriented to capture the image ahead of the automobile M in the traveling direction, side cameras 42B and 42C that are provided on each of the side mirrors SM and capable of capturing images of the sides, and a rear camera 42D that is oriented to capture the image behind the automobile M. The exterior camera 42 may be disposed in a position that can capture images of at least the front of the automobile M. For example, the exterior camera 42 may be provided on the rearview mirror RM (see FIG. 1) or on the upper end of the windshield FG (see FIG. 1) or on the ceiling near the upper end. The exterior camera 42 is also connected to the information presentation device 10A so as to be able to communicate with the information presentation device 10A, and is capable of transmitting a signal of the captured image to the information presentation device 10A.

The exterior microphone 43 is a microphone device that receives sounds around the automobile M, and is arranged, for example, on the bumper of the automobile M. The exterior microphone 43 may be arranged anywhere, such as on the side mirror SM or the front grill GR, as long as it is capable of receiving sounds around the automobile M. The exterior microphone 43 is connected to the information presentation device 10A so as to be able to communicate with it, and is capable of transmitting signals of the collected sounds to the information presentation device 10A.

The external sensor 44 is, for example, a sensor capable of detecting objects around the automobile M, and is arranged, for example, on the front grill GR of the automobile M. The external sensor 44 is, for example, an object detection sensor such as a LIDAR (Laser Imaging Detection and Ranging) that scans a pulsed laser light and generates a ranging image that visualizes the distance to a reflecting object from the time it takes to receive the reflected light from the reflecting object. The external sensor 44 is also communicably connected to the information presentation device 10A, and is capable of transmitting a signal of ranging data to the information presentation device 10A.

Note that multiple external sensors 44 may be installed so as to be able to detect the entire periphery outside the vehicle M. For example, an external sensor 44 capable of detecting the front of the vehicle M may be provided on the front grille GR, an external sensor 44 capable of detecting the rear of the vehicle M may be provided on the rear bumper RB or back door BD of the vehicle M, and an external sensor 44 capable of detecting each side of the vehicle M may be provided on each side mirror SM or door DR.

The exterior camera 42, the exterior microphone 43, the exterior sensor 44, and the aforementioned GPS receiver 41 constitute an exterior situation acquisition device 40 that allows the information presentation device 10A to acquire exterior situation information about the automobile M.

The configuration of the information presentation device 10A is shown in FIG. 6. As described above, the configuration of the information presentation device 10A is basically the same as that of the information presentation device 10 of Example 1. Furthermore, explanations of parts that overlap with the information presentation device 10 will be omitted.

The input unit 57 is an interface unit that communicatively connects the information presentation device 10A and the vehicle exterior situation acquisition device 40 in addition to the vehicle interior situation acquisition device 20. The information presentation device 10A can receive a video signal from the vehicle exterior camera 42, an audio signal from the vehicle exterior microphone 43, and a distance measurement data signal from the vehicle exterior sensor 44 via the input unit 57. The information presentation device 10A can also receive, via the input unit 57, a signal of the current position information of the automobile M from the GPS receiver 41, as well as road congestion information, weather information, and the like.

When presenting recommended information, if the information presentation device 10A determines that an event that may affect the emotions of the occupants has occurred inside or outside the vehicle, it will suspend the presentation of the recommended information until it is determined that the event has been resolved.

Specifically, the control unit 55 determines whether an event that affects the emotions of the occupants has occurred based on the in-vehicle situation information and the outside-vehicle situation information received from the in-vehicle situation acquisition device 20 and the outside-vehicle situation acquisition device 40 via the input unit 57. At this time, the control unit 55 functions as a situation determination unit. In other words, the information presentation device 10A includes the control unit 55 as a situation determination unit that determines whether or not an influencing event that is estimated to affect the emotions of the occupants has occurred in the cabin of the automobile M or outside the automobile M. Furthermore, the control unit 55 as an information presentation unit does not present recommended information during the period in which it is determined that an influencing event has occurred.

For example, when an argument or the like occurs between occupants in the vehicle cabin, the control unit 55 determines that an argument is occurring between occupants in the vehicle cabin based on the video of the occupants captured by the in-vehicle camera 21 or the voice of the occupants input by the in-vehicle microphone 22. Specifically, for example, the control unit 55 determines that an argument is occurring between occupants as an event that affects the emotions of the occupants in the vehicle cabin based on the facial expressions, mouth movements, gestures, and other actions of the occupants in the video signal input from the in-vehicle camera 21. Also, for example, the control unit 55 determines that an event that affects the emotions of the occupants in the vehicle cabin is occurring when it detects a sudden change in tone, such as an occupant shouting loudly, or a specific word voice in the audio signal input from the in-vehicle microphone 22.

The control unit 55 may also predict whether an event that may affect the emotions of the occupants may occur, for example, from the vehicle exterior situation information input from the vehicle exterior situation acquisition device 40. Specifically, when the vehicle M travels straight through an intersection, the GPS receiver 41 detects that the vehicle M is approaching the intersection, and the exterior camera 42 and exterior sensor 44 detect oncoming vehicles and pedestrians, thereby predicting a sudden right turn by an oncoming vehicle, a pedestrian running out into the road, etc.

For example, when another vehicle suddenly cuts in front of the vehicle M outside the vehicle, the control unit 55 determines that another vehicle has suddenly cut in front of the vehicle M based on the image of the front of the vehicle M captured by the exterior camera 42 or the detection of an object in front of the vehicle M measured by the exterior sensor 44. Examples of events that affect the emotions of the occupants outside the vehicle include detecting a transition in a signal in front from the image of the exterior camera 42, detecting the sound of an emergency vehicle siren around the vehicle M from the sound of the exterior microphone 43, or detecting traffic congestion information along the path of the vehicle M from the data received by the GPS receiver 41.

As a result, the information presentation device 10A can determine or predict for itself whether an event that will affect the emotions of the occupants has occurred based on the in-vehicle situation information and the outside-vehicle situation information received from the in-vehicle situation acquisition device 20 and the outside-vehicle situation acquisition device 40, and can present recommended information at an appropriate timing that takes safety into consideration.

Below, an example of an operation routine of the information presentation device 10A when functioning as an information presentation device is described.

Figure 7 is a diagram showing information presentation routine R3 as an example of an operation routine. Information presentation routine R3 shown in Figure 7 shows the operation routine of information presentation device 10A up to the presentation of recommended information. Note that the processing of steps S201 and S202 of information presentation routine R3 corresponds to steps S101 and S102 of information presentation routine R1 shown in Figure 3, respectively, and the processing content is also similar, so a description thereof will be omitted. In addition, the routine after the presentation of recommended information is the same as information presentation routine R2 shown in Figure 4. In the description of this Example 2, a description of information presentation routine R2 shown in Figure 4, which overlaps with Example 1, will be omitted.

After the control unit 55 determines in step S202 that it has found recommended information, the control unit 55 acquires in-vehicle situation information from the in-vehicle situation acquisition device 20 (step S203).

Next, the control unit 55 determines whether an event that may affect the emotions of the occupants has occurred within the vehicle cabin based on the vehicle interior situation information (step S204).

In step S204, if the control unit 55 determines that an event that affects the emotions of the occupants has occurred in the vehicle cabin (step S204: Yes), the control unit 55 repeatedly executes the process of step S203 and waits until it is determined that the event in the vehicle cabin has been resolved.

In step S204, if the control unit 55 determines that no event that affects the emotions of the occupants has occurred in the vehicle cabin (step S204: No), the control unit 55 acquires outside-vehicle situation information from the outside-vehicle situation acquisition device 40 (step S205).

Next, the control unit 55 determines whether an event that may affect the emotions of the occupants is occurring outside the vehicle based on the outside-vehicle situation information (step S206).

In step S206, if the control unit 55 determines that an event that may affect the emotions of the occupants has occurred outside the vehicle (step S206: Yes), the control unit 55 repeatedly executes the process of step S203 and waits until it is determined that the event inside and outside the vehicle has been resolved.

In step S206, if the control unit 55 determines that no event that may affect the emotions of the occupants has occurred outside the vehicle (step S206: No), the control unit 55 proceeds to the processing of the information presentation routine R2, which is the routine following the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

This allows the information presentation device 10A to present recommended information at an appropriate time with greater consideration given to safety.

In this second embodiment, a case has been described in which it is determined whether an event that affects the emotions of the occupants has occurred inside the vehicle cabin, and then it is determined whether an event that affects the emotions of the occupants has occurred outside the vehicle. However, the order in which it is determined whether an event that affects the emotions of the occupants has occurred inside or outside the vehicle is not limited to this. For example, it may be determined first whether an event that affects the emotions of the occupants has occurred outside the vehicle, or the determination processes may be performed at the same time.

In the first and second embodiments, a case has been described in which the information presentation device 10 or the information presentation device 10A suspends the presentation of the recommended information until it is able to present the recommended information. However, the timing of presenting the recommended information is not limited to this. For example, if it is urgent to present the recommended information, the information presentation device may present the recommended information after appealing to the occupant to calm the occupant's emotions.

Recommended information that is urgent may be, for example, when a fork in the road to a facility searched for as recommended information is approaching. In this case, the information presentation device needs to present the recommended information before the automobile M passes the fork in the road. Therefore, it is preferable for the information presentation device to present the recommended information while suppressing the emotions of the occupants.

Figure 8 shows the configuration of an information presentation system 300 including an information presentation device 10B according to a third embodiment of the present invention. The configuration of the information presentation device 10B is basically the same as that of the information presentation device 10 according to the first embodiment, but differs in that it includes a stimulus generator 60 that generates a stimulus to suppress the emotions of the occupants. Note that a description of the configuration that overlaps with the information presentation device 10 will be omitted.

When the information presentation device 10B estimates that the passenger in the vehicle is not calm, the information presentation device 10B generates a stimulus via the output unit 59 to suppress the passenger's emotions to a calm state. The stimulus to suppress the passenger's emotions is a stimulus that stimulates the passenger's five senses and provides a relaxing effect. Specifically, for example, a sound logo that attracts the passenger's attention, a preset name of the passenger, or a voice or audio content or video content that has a relaxing effect may be mentioned. In this case, the stimulus generation unit 60 outputs from the speaker 31 or the display 32. In addition, a massage using a vibrator built into the seat in the vehicle or a relaxing smell may be generated from an aroma pot installed in the vehicle. The above-mentioned stimulus to suppress the passenger's emotions may be the generation of any one of the stimuli, or multiple stimuli may be generated simultaneously. In other words, the information presentation device 10B includes a stimulus generation unit 60 that emits a stimulus to suppress the passenger's emotions.

When presenting recommended information that requires urgent action, if it is estimated that the emotions of the occupants in the vehicle cabin are calm, the information presentation device 10B promptly presents the recommended information. When presenting recommended information that requires urgent action, if it is estimated that the emotions of the occupants in the vehicle cabin are not calm, the information presentation device 10B presents the recommended information after generating a stimulus to suppress the emotions of the occupants from the stimulus generation unit 60. In other words, when the emotions of the occupants estimated by the control unit 55 as the emotion estimation unit are in a specific state, the control unit 55 as the information presentation unit presents the recommended information after the stimulus generation unit 60 emits a stimulus to suppress the emotions of the occupants. In other words, when the emotions of the occupants estimated by the control unit 55 as the emotion estimation unit are in a specific state, the control unit 55 as the information presentation unit does not present the recommended information if the presentation of the recommended information is not urgent, and presents the recommended information after outputting a stimulus to suppress the emotions of the occupants if the presentation of the recommended information is urgent.

This allows the information presentation device 10B to properly evaluate the presented recommended information even when it is estimated that the passengers in the vehicle are not calm when presenting urgent recommended information.

Below, an example of an operation routine of the information presentation device 10B when functioning as an information presentation device is described.

Figure 9 is a diagram showing information presentation routine R4 as an example of an operation routine. Information presentation routine R4 shown in Figure 9 shows the operation routine of information presentation device 10B up to the presentation of recommended information. Note that the processing of steps S301 to S303 in information presentation routine R4 corresponds to steps S101 to S103 of information presentation routine R1 shown in Figure 3, respectively, and the processing content is also similar, so a description thereof will be omitted. In addition, the routine after the presentation of recommended information is the same as information presentation routine R2 shown in Figure 4. In the description of this Example 3, a description of information presentation routine R2 shown in Figure 4 that overlaps with Example 1 will be omitted.

In the processing of steps S301 to S303, the control unit 55 discovers recommended information and estimates the emotions of the occupants in the vehicle cabin.

Next, the control unit 55 determines whether the occupant's emotions are calm based on the estimation result (step S304).

In step S304, if the control unit 55 determines that the occupant's emotions are calm (step S304: Yes), the control unit 55 proceeds to the processing of the information presentation routine R2, which is the routine following the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

If the control unit 55 determines in step S304 that the occupant is not calm (step S304: No), the control unit 55 determines whether the recommended information found in step S301 is urgent (step S305). For example, the control unit 55 makes this determination by comparing the current position of the automobile M received by the GPS receiver 41 with the map information recorded in the memory unit 53, and determining whether the branch point to the route to the recommended information is within a predetermined distance.

In step S305, if the control unit 55 determines that the recommended information is not urgent (step S305: No), the control unit 55 returns to the processing of step S303 and waits until it is estimated that the occupant's emotions are calm or until the recommended information becomes urgent.

In step S305, if the control unit 55 determines that the recommended information is urgent (step S305: Yes), the control unit 55 causes the stimulus generating unit 60 to output a stimulus that suppresses the occupant's emotions via the output unit 39 (step S306). As described above, the stimulus that suppresses the occupant's emotions is a stimulus that stimulates the five senses of the occupant and provides a relaxing effect.

After the process of this step is performed, the control unit 55 may wait for a predetermined time until it is considered that the occupant's emotion is suppressed. The predetermined time until it is considered that the occupant's emotion is suppressed may be changed variably according to the type of the estimated emotion of the occupant. For example, if the estimated emotion of the occupant is joy, fun, or the like, the control unit 55 may estimate that it will take a short time to transition to a calm state and shorten the waiting time. On the other hand, if the estimated emotion of the occupant is anger, sadness, or the like, the control unit 55 may estimate that it will take a long time to transition to a calm state and shorten the waiting time. That is, the control unit 55 as the evaluation unit evaluates the presentation of the recommended information based on the estimation result of the emotional state of the occupant at the time when the first time has elapsed since the recommended information was presented by the control unit 55 as the information presentation unit as the emotion of the occupant used in the evaluation of the provision of the recommended information, and the control unit 55 as the evaluation unit changes the first time based on the estimation result of the emotion of the occupant at the time of the presentation of the recommended information.

The control unit 55 may also estimate the occupant's emotions again after this step and repeatedly output stimuli to suppress the occupant's emotions until the occupant's emotions are suppressed.

The control unit 55 may also variably change the time for which a stimulus to suppress the occupant's emotion is generated depending on the type of the estimated emotion of the occupant. That is, the control unit 55 as an information presenting unit changes the length of time for which the stimulus generating unit 60 emits a stimulus to suppress the emotion to the occupant based on the result of estimation by the control unit 55 as an emotion estimating unit of the emotional state of the occupant when the control unit 55 as an information presenting unit is about to present the recommended information.

Then, the control unit 55 proceeds to the processing of the information presentation routine R2, which is the routine following the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

This allows the information presentation device 10B to properly evaluate the presented recommended information even when it is estimated that the passengers in the vehicle are not calm when presenting urgent recommended information.

In the third embodiment, even when the presentation of the recommended information is urgent, in order to properly evaluate the recommended information presented by the information presentation device 10, a case has been described in which a stimulus that suppresses the emotions of the occupant is generated if the occupant is not calm when the recommended information is presented, and then the recommended information is presented. However, the information presentation device may, for example, determine whether an event that affects the emotions of the occupant has occurred inside or outside the vehicle, and if an event that affects the emotions of the occupant has occurred, generate a stimulus that suppresses the emotions of the occupant before presenting the recommended information.

In other words, when the control unit 55 as an information presenting unit determines that an event has occurred when attempting to present the recommended information, the control unit 55 presents the recommended information after the stimulus generating unit 60 emits a stimulus to the occupant to suppress their emotions. In other words, when the control unit 55 as a situation determining unit determines that an event has occurred, the control unit 55 as an information presenting unit does not present the recommended information if the presentation of the recommended information is not urgent, and presents the recommended information after outputting a stimulus to suppress the occupant's emotions if the presentation of the recommended information is urgent.

Figure 10 shows the configuration of an information presentation system 400 including an information presentation device 10C according to Example 4 of the present application. The configuration of the information presentation device 10C in Example 4 is basically the same as that of the information presentation device 10B in Example 3 described above, but differs in that it has an outside-vehicle situation acquisition device 40 including an outside-vehicle camera 42, an outside-vehicle microphone 43, and an outside-vehicle sensor 44 that acquire information indicating the situation outside the automobile M. In addition, the outside-vehicle situation acquisition device 40 is the same as that of the information presentation device 10A in Example 2 described above.

When presenting the recommended information, if the information presentation device 10C determines that an event that may affect the emotions of the occupants has occurred inside or outside the vehicle, the information presentation device 10C presents the recommended information after generating a stimulus that suppresses the emotions of the occupants from the stimulus generation unit 60.

As a result, the information presentation device 10B can properly evaluate the presented recommended information even if an event that may affect the emotions of the occupants occurs inside or outside the vehicle when presenting urgent recommended information.

Below, an example of an operation routine of the information presentation device 10C when functioning as an information presentation device is described.

Figure 11 is a diagram showing information presentation routine R5 as an example of an operation routine. Information presentation routine R5 shown in Figure 11 shows the operation routine of information presentation device 10C up to the presentation of recommended information. Note that the processing of steps S401 and S402 in information presentation routine R5 corresponds to steps S101 and S102 of information presentation routine R1 shown in Figure 3, respectively, and the processing content is also similar, so a description thereof will be omitted. In addition, the routine after the presentation of recommended information is the same as information presentation routine R2 shown in Figure 4. In the description of this Example 4, a description of information presentation routine R2 shown in Figure 4, which overlaps with Example 1, will be omitted.

After the control unit 55 determines in step S402 that it has found recommended information, the control unit 55 acquires in-vehicle situation information from the in-vehicle situation acquisition device 20 (step S403).

Next, the control unit 55 determines whether an event that may affect the emotions of the occupants has occurred within the vehicle cabin based on the vehicle interior situation information (step S404).

In step S404, if the control unit 55 determines that no event that affects the emotions of the occupants has occurred in the vehicle cabin (step S404: No), the control unit 55 acquires outside-vehicle situation information from the outside-vehicle situation acquisition device 40 (step S405).

Next, the control unit 55 determines whether an event that may affect the emotions of the occupants is occurring outside the vehicle based on the outside-vehicle situation information (step S406).

In step S406, if the control unit 55 determines that no event that may affect the emotions of the occupants has occurred outside the vehicle (step S406: No), the control unit 55 proceeds to the processing of the information presentation routine R2, which is the routine following the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

If the control unit 55 determines in step S404 or step S406 that an event that affects the emotions of the occupants has occurred inside or outside the vehicle (step S404: Yes or step S406: Yes), the control unit 55 determines whether the recommended information found in step S401 is urgent (step S407). This determination is the same as step S305 of the information presentation routine R4 shown in FIG. 9. Specifically, for example, the control unit 55 compares the current position of the automobile M received by the GPS receiver 41 with the map information recorded in the memory unit 53, and determines whether the branch point to the route leading to the recommended information is within a predetermined distance, etc.

In step S407, if the control unit 55 determines that the recommended information is not urgent (step S407: No), the control unit 55 returns to the processing of step S403 and waits until it is determined that the events inside and outside the vehicle have been resolved or until the recommended information becomes urgent.

In step S407, if the control unit 55 determines that the recommended information is urgent (step S407: Yes), the control unit 55 causes the stimulus generating unit 60 to output a stimulus that suppresses the occupant's emotions via the output unit 39 (step S408). As described above, the stimulus that suppresses the occupant's emotions is a stimulus that stimulates the five senses of the occupant and provides a relaxing effect.

As in Example 2, after executing the processing of this step, the control unit 55 may wait for a predetermined time until it is considered that the occupant's emotion is suppressed. The predetermined time until it is considered that the occupant's emotion is suppressed may be variably changed depending on the type of the estimated emotion of the occupant. The control unit 55 may estimate the emotion of the occupant again after this step and repeatedly output stimuli to suppress the emotion of the occupant until the emotion of the occupant is suppressed.

Then, the control unit 55 proceeds to the processing of the information presentation routine R2, which is the routine following the presentation of the recommended information shown in FIG. 4, and evaluates the presented recommended information.

As a result, the information presentation device 10B can properly evaluate the presented recommended information even if an event that may affect the emotions of the occupants occurs inside or outside the vehicle when presenting urgent recommended information.

Note that each of the above-mentioned embodiments 1 to 4 is merely an example. For example, each of the above-mentioned embodiments can be combined.

For example, the information presentation device 10 of Example 1 and the information presentation device 10B of Example 3 may be combined, and even if the recommended information is urgent information, a determination may be made as to whether to present or halt the presentation of the recommended information depending on the type of emotion of the occupant in the vehicle. Specifically, if the emotion of the occupant is not calm, a determination may be made based on the type of emotion of the occupant to present the recommended information after generating a stimulus to suppress the emotion of the occupant, or to halt the presentation of the emotion information of the occupant.

In addition, for example, by combining all the embodiments, a determination may be made as to whether the occupant's emotions are calm or not, whether there is an event inside the vehicle that affects the emotions, and whether there is an event outside the vehicle that affects the emotions, and then whether to present recommended information after generating a stimulus that suppresses the occupant's emotions, or to suspend the presentation of the occupant's emotional information.

Specifically, for example, if an event that will affect the occupant's emotions is determined or predicted within the vehicle cabin even if the occupant is emotionally calm, the recommended information may be presented after generating a stimulus that suppresses the occupant's emotions. On the other hand, if an event that will affect the occupant's emotions is determined or predicted outside the vehicle even if the occupant is emotionally calm, the presentation of the recommended information may be suspended.

For example, if an event that affects the occupant's emotions is occurring inside the vehicle cabin but not outside the vehicle, a stimulus that suppresses the occupant's emotions may be generated before the presentation of recommended information. On the other hand, if an event that affects the occupant's emotions is not occurring inside the vehicle cabin but is occurring outside the vehicle, the presentation of recommended information may be suspended.

In addition to the above combination examples, further patterns for presenting recommended information may be added based on the type of estimated occupant emotion.

In addition, in Examples 1 to 4, the information presentation devices 10, 10A, 10B, and 10C are all described as devices attached to the automobile M, but are not limited to this. The information presentation device of the present invention may be a portable device such as a smartphone or tablet carried by a user. In this case, the portable device as the information presentation device of the present invention may be communicatively connected wirelessly or via wires to at least some of the in-vehicle situation acquisition device 20, the information presentation device 30, the outside-vehicle situation acquisition device 40, and the stimulus generation unit 60 mounted on the automobile M.

Alternatively, the information presentation device of the present invention may be a server device installed outside the automobile M. In this case, the portable device as the information presentation device of the present invention may be communicatively connected to at least a part of the in-vehicle situation acquisition device 20, the information presentation device 30, the outside-vehicle situation acquisition device 40, and the stimulus generation unit 60 mounted on the automobile M via a wireless network.

REFERENCE SIGNS LIST 100 Information presentation system 200 Information presentation system 300 Information presentation system 400 Information presentation system 10 Information presentation device 20 In-vehicle situation acquisition device 21 In-vehicle camera 22 In-vehicle microphone 30 Information presentation device 31 In-vehicle speaker 32 Display 40 Outside-vehicle situation acquisition device 41 GPS receiver 42 Outside-vehicle camera 43 Outside-vehicle microphone 44 Outside-vehicle sensor 51 System bus 53 Memory unit 55 Control unit 57 Input unit 59 Output unit 60 Stimulus generation unit

Claims (13)

an information presentation unit that presents recommended information to a vehicle occupant;
An emotion estimation unit that estimates an emotion of the occupant;
an evaluation unit that evaluates presentation of the recommended information based on the emotion of the occupant estimated by the emotion estimation unit after the presentation of the recommended information by the information presentation unit ;
Equipped with
the information presentation unit does not present the recommended information during a period in which the emotion of the occupant estimated by the emotion estimation unit before the presentation of the recommended information by the information presentation unit is in a specific state . an information presentation unit that presents recommended information to a vehicle occupant;
An emotion estimation unit that estimates an emotion of the occupant;
an evaluation unit that evaluates presentation of the recommended information based on the emotion of the occupant estimated by the emotion estimation unit after the presentation of the recommended information by the information presentation unit;
A stimulus generating unit that generates a stimulus to the occupant to suppress the emotion ;
Equipped with
The information presentation device is characterized in that, when the emotion of the occupant estimated by the emotion estimation unit before the information presentation unit presents the recommended information is in a specific state, the information presentation unit presents the recommended information after the stimulus generation unit emits a stimulus to the occupant to suppress the emotion. The information presentation device according to claim 2, characterized in that the information presentation unit changes the length of time for which the stimulus generation unit emits a stimulus to suppress emotions to the occupant, based on a result of estimation by the emotion estimation unit of the emotional state of the occupant at the time when the information presentation unit is to present the recommended information. The information presentation device according to claim 2 or 3, characterized in that when the emotion of the occupant estimated by the emotion estimation unit before the information presentation unit presents the recommended information is in a specific state, if presentation of the recommended information is not required urgently, the information presentation unit does not present the recommended information , and if presentation of the recommended information is required urgently , presents the recommended information after outputting a stimulus to suppress the emotion of the occupant. the evaluation unit evaluates the presentation of the recommended information based on an estimation result of an emotional state of the occupant at a time point when a first time has elapsed since the presentation of the recommended information by the information presentation unit, as an emotion of the occupant to be used for evaluating the provision of the recommended information;
The information presentation device according to any one of claims 1 to 4, characterized in that the evaluation unit changes the first time period based on an estimation result of an emotion of the occupant after the presentation of the recommendation information. an information presentation unit that presents recommended information to a vehicle occupant;
An emotion estimation unit that estimates an emotion of the occupant;
an evaluation unit that evaluates presentation of the recommended information based on the emotion of the occupant estimated by the emotion estimation unit after the presentation of the recommended information by the information presentation unit;
A situation determination unit that determines whether or not there is an impact event that is estimated to affect the emotions of the occupant in a cabin of the vehicle or outside the vehicle ;
Equipped with
The information presentation device, wherein the information presentation unit does not present the recommended information during a period in which it is determined that the influencing event is occurring. an information presentation unit that presents recommended information to a vehicle occupant;
An emotion estimation unit that estimates an emotion of the occupant;
an evaluation unit that evaluates presentation of the recommended information based on the emotion of the occupant estimated by the emotion estimation unit after the presentation of the recommended information by the information presentation unit;
A stimulus generating unit that generates a stimulus to the occupant to suppress the emotion;
a situation determination unit that determines whether or not there is an impact event that is estimated to have an impact on the emotions of the occupant inside or outside the vehicle;
Equipped with
The information presentation device is characterized in that, when it is determined that the impact event has occurred when the information presentation unit is about to present the recommended information, the stimulus generating unit presents the recommended information after emitting a stimulus to the occupant to suppress their emotions. The information presentation device according to claim 7, characterized in that when the situation determination unit determines that the impact event has occurred, the information presentation unit does not present the recommended information if presentation of the recommended information is not urgent, and presents the recommended information after outputting a stimulus to suppress the emotions of the occupant if presentation of the recommended information is urgent . A computer installed in an information presentation device that presents recommended information to a vehicle occupant,
an information presentation step of presenting the recommendation information to the occupant of the vehicle;
an emotion estimation step of estimating an emotion of the occupant;
an evaluation step of evaluating the recommendation information based on the emotion of the occupant estimated by the emotion estimation step after the presentation of the recommendation information in the information presentation step;
A program for executing
The information presentation step is characterized in that the recommended information is not presented during a period during which the emotion of the occupant estimated by the emotion estimation step before the presentation of the recommended information in the information presentation step is in a specific state. A computer installed in an information presentation device that presents recommended information to a vehicle occupant,
an information presentation step of presenting the recommendation information to the occupant of the vehicle;
an emotion estimation step of estimating an emotion of the occupant;
an evaluation step of evaluating the recommendation information based on the emotion of the occupant estimated by the emotion estimation step after the presentation of the recommendation information in the information presentation step;
a stimulus generating step of generating a stimulus for suppressing an emotion of the occupant;
A program for executing
The information presentation step is characterized in that, if the emotion of the occupant estimated by the emotion estimation step before the presentation of the recommended information in the information presentation step is in a specific state, the recommended information is presented after a stimulus for suppressing the emotion is issued to the occupant by the stimulus generation step. A computer installed in an information presentation device that presents recommended information to a vehicle occupant,
an information presentation step of presenting the recommendation information to the occupant of the vehicle;
an emotion estimation step of estimating an emotion of the occupant;
an evaluation step of evaluating the recommendation information based on the emotion of the occupant estimated by the emotion estimation step after the presentation of the recommendation information in the information presentation step;
A situation determination step of determining whether or not there is an impact event that is estimated to affect the emotions of the occupant in a cabin of the vehicle or outside the vehicle;
A program for executing
The information presentation step includes not presenting the recommended information during a period in which it is determined that the influencing event is occurring. A computer installed in an information presentation device that presents recommended information to a vehicle occupant,
an information presentation step of presenting the recommendation information to the occupant of the vehicle;
an emotion estimation step of estimating an emotion of the occupant;
an evaluation step of evaluating the recommendation information based on the emotion of the occupant estimated by the emotion estimation step after the presentation of the recommendation information in the information presentation step;
a stimulus generating step of generating a stimulus for suppressing an emotion of the occupant;
a situation determination step of determining whether or not there is an impact event inside or outside the vehicle that is estimated to affect the emotions of the occupant;
A program for executing
The information presentation step is characterized in that, if it is determined that the impact event has occurred when the recommended information is to be presented, the recommended information is presented after a stimulus for suppressing the occupant's emotions is issued by the stimulus generation step. A computer-readable recording medium storing the information presentation program according to any one of claims 9 to 12 .

Images