JP7470171B2 - Information processing device and emotion induction method - Google Patents

Description

The present invention relates to an information processing device and an emotion induction method.

Technologies for controlling a person's emotional state have been proposed in the past (see, for example, Patent Document 1).

JP 2020-124392 A

When a passenger travels in a vehicle, it is preferable that the passenger's emotions are appropriate for the destination, and it would be ideal if the passenger could be guided to emotions appropriate for the destination while traveling. However, the proposed technology is merely a technology that guides the emotions of an individual staying in a specified space to emotions appropriate for that specified space.

In one aspect, the objective is to provide an information processing device etc. that can appropriately guide the emotions of passengers in a vehicle.

An information processing device according to one aspect includes a first acquisition unit that acquires a plurality of levels of content corresponding to a plurality of levels of emotions that induce an emotion of a passenger in a vehicle upon arrival at the destination, the plurality of levels of content corresponding to the plurality of emotions that induce the emotion of the passenger, the plurality of levels of emotion being determined based on the destination, a second acquisition unit that acquires detection information regarding the passenger detected using a predetermined sensing device, an estimation unit that estimates the emotion of the passenger based on the acquired detection information, an output control unit that selects and outputs the content of the level that corresponds to the estimated emotion of the passenger to an output device provided in the vehicle, and a third acquisition unit that acquires a remaining required time from a current location of the vehicle to the destination, the output control unit determining the remaining required time based on the remaining required time and a total output time of the remaining content. The output of content is controlled, and the estimation unit, after outputting the content corresponding to one stage, determines whether the occupant's emotion has transitioned to an emotion of the next stage following the first stage, and when it is determined that the emotion has transitioned to the next stage, outputs the content corresponding to the next stage, and a model that has been trained to estimate the transition time until the transition to the next stage when the detection information is input, is provided with a transition time estimation unit that inputs the acquired detection information into a model that has been trained with the occupant's past detection information and transition time to estimate the transition time, and the output control unit determines whether to output the content corresponding to the next stage based on the estimated transition time and the output time of the content corresponding to the next stage.

In one aspect, it is possible to appropriately induce the emotions of passengers in a vehicle.

FIG. 1 is an explanatory diagram showing a configuration example of an emotion induction system. 1 is a block diagram showing an example of the configuration of an information processing device; FIG. 2 is a schematic diagram showing the interior of a vehicle. FIG. 2 is an explanatory diagram illustrating an example of a record layout of a content DB. FIG. 11 is an explanatory diagram showing an example of a procedure for emotion induction processing; FIG. 11 is an explanatory diagram showing an example of an emotion transition process. 11 is a flowchart illustrating an example of a processing procedure executed by an information processing device. FIG. 11 is an explanatory diagram showing an example of a record layout of a content DB according to the second embodiment; FIG. 11 is an explanatory diagram showing an example of a procedure of emotion induction processing according to the second embodiment; FIG. 11 is an explanatory diagram showing an example of an emotion transition process according to the second embodiment. FIG. 11 is a block diagram showing a storage unit according to a third embodiment. 13 is a flowchart illustrating an example of a processing procedure executed by an information processing device according to the third embodiment. 13 is a flowchart showing a processing procedure executed by an information processing device according to embodiment 4.

Hereinafter, the present invention will be described with reference to the drawings showing an embodiment thereof.
(Embodiment 1)
1 is an explanatory diagram showing a configuration example of an emotion induction system. In this embodiment, an emotion induction system is described that induces an emotion of a passenger U in a vehicle C to be appropriate for the destination when the vehicle C arrives at the destination.

Figure 1 illustrates a state in which a passenger U is riding in a vehicle C. The vehicle C is a vehicle used (owned) by the passenger U. Note that the vehicle C may be a vehicle with an automatic driving function. The vehicle C is not limited to a vehicle owned by the passenger U, and may be a vehicle used only by the passenger U, such as a taxi. Although the passenger U is shown as being only one person in Figure 1, there may be passengers (multiple passengers U). In this system, for example, when the passenger U uses the vehicle C to commute from his/her home (first location) to his/her workplace (second location), the passenger U's emotions are induced to emotions appropriate to the destination, etc. by presenting (outputting) content such as images and sounds to the passenger U inside the vehicle C.

In the following examples, the departure point of passenger U is described as being his/her home, but this embodiment may also be applied when passenger U travels from his/her workplace to another location (such as a business trip destination). In other words, the departure point may be passenger U's base and is not limited to his/her home. In addition, in this embodiment, the destination is described as passenger U's final destination (such as his/her workplace), but the destination may also be an intermediate point before the final destination (such as the nearest station).

The vehicle C is equipped with an information processing device 1, a sensing device SM, a display DS, an in-vehicle navigation device NB, a lighting device IM, a speaker SP, a fragrance device AF, and an air conditioning device AC. Each device is connected to each other for communication via the in-vehicle network of the vehicle C.

The information processing device 1 is a computer mounted on the vehicle C, and transmits and receives information to and from the sensing device SM, etc. The information processing device 1 may be an embedded computer such as an ECU (Electronic Control Unit), or may be a computer externally attached to the vehicle C. The information processing device 1 outputs multiple contents to the passenger U via an output device such as a display DS, for guiding the passenger U to a specific emotion according to the destination, etc. Specifically, as described below, the information processing device 1 sequentially outputs multiple stages of content corresponding to each of the multiple stages of emotions in accordance with the output order in order to gradually guide the passenger U to a specific emotion that is the final target, and guides the passenger U to the final target emotion.

The content is content that stimulates the five senses of the passenger U, and includes, for example, images and sounds, as well as light emitted by the lighting device IM, fragrance emitted by the fragrance device AF, and hot and cold air blown out by the air conditioning device AC. Although not shown, the content may also include vibrations generated by a vibration device and mist sprayed by a spray device.

The information processing device 1 estimates the current emotion of the passenger U based on detection information about the passenger U detected using the sensing device SM. The detection information may include images of the passenger U, sounds inside the vehicle (passenger U's speech), and the like, as well as biometric information of the passenger U (body temperature, breathing, pulse, electrocardiogram, etc.) detected using a specified biosensor. The information processing device 1 determines whether the estimated emotion of the passenger U has transitioned to an emotion corresponding to the next stage following the stage (first stage) of the content currently being output, and if it determines that the emotion has transitioned to an emotion corresponding to the next stage, it outputs the content corresponding to the next stage.

Until the vehicle C arrives at the destination, the information processing device 1 sequentially outputs each content to cause the passenger U's emotions to change in sequence, guiding him/her to emotions appropriate to the destination, etc.

FIG. 2 is a block diagram showing an example of the configuration of the information processing device 1. The information processing device 1 includes a control unit 11, a communication unit 12, an input interface 13, an output interface 14, and a storage unit 15.

The control unit 11 includes an arithmetic processing unit 110 such as an MPU (Micro-Processing Unit), a CPU (Central Processing Unit), and a GPU (Graphics Processing Unit), a ROM (Read Only Memory) 111, and a RAM (Random Access Memory) 112.

The communication unit 12 is a module that executes communication processing via the network N, and communicates with the outside world using communication protocols such as LTE (Long Term Evolution, registered trademark), 4G (4th Generation), and 5G (5th Generation). The communication unit 12 also performs short-range wireless communication with devices inside the vehicle using communication protocols such as Wi-Fi (Wireless Fidelity, registered trademark) and Bluetooth (registered trademark).

The input interface 13 is an interface that communicates with the sensing device SM, the in-vehicle navigation device NB, and the operation unit OP, and is used to acquire information transmitted from these devices.

The sensing device SM includes, for example, a camera SM1 that captures images of the interior of the vehicle C, and a microphone SM2 that collects sound inside the vehicle. Note that these are just examples of the sensing device SM, and any device that can detect the state or movement of the passenger U may be used. For example, the sensing device SM may include a vital sensor that detects the biometric information of the passenger U (body temperature, breathing, pulse, electrocardiogram, etc.) and a pressure sensor installed in the seat ST, and the detection results of these devices may also be used as detection information. Furthermore, the sensing device SM is not limited to a device installed in the vehicle C, and may be a wearable device worn by the passenger U.

The in-vehicle navigation device NB is a means for calculating the route and travel time from the departure point to the destination, as well as the remaining time from the current location to the destination, and for acquiring traffic information from an external source. It is installed on the dashboard, etc.

The operation unit OP is a means for accepting input operations from the passenger U, and may be, for example, a touch panel, a software keyboard, physical buttons, a pointing device, etc., and is installed on the dashboard, etc.

In this embodiment, the sensing device SM, the in-vehicle navigation device NB, and the operation unit OP are devices installed in the vehicle C, but these devices may be realized as portable devices (e.g., a smartphone) capable of communicating with the information processing device 1.

In addition, in this embodiment, the operation input means (operation unit OP) that accepts operations from the passenger U is described as a physical device, but this embodiment is not limited to this. For example, as described below, the camera SM1 may be a camera with a distance sensor (infrared sensor, etc.) or a compound eye camera, etc., and may recognize the hand movements (gestures) of the passenger U to enable operation input.

The output interface 14 is an interface for communicating with the lighting device IM, speaker SP, fragrance device AF, air conditioning device AC, and display DS, and transmitting information to these devices.

The lighting device IM is a means for illuminating the interior space of the vehicle to stimulate the five senses of the passenger U, and is provided with units for adjusting the light quantity, light color, and irradiation angle, and is installed inside the vehicle. The speaker SP is a means for outputting sound content to stimulate the five senses of the passenger U, and is installed on the dashboard, etc. The fragrance device AF is a means for emitting fragrance to stimulate the five senses of the passenger U, and is provided with a storage container filled with multiple aromatic liquids, a fan for emitting vaporized aromatic liquid, and a unit for adjusting the emission direction and amount of fragrance, and is installed on the dashboard, etc. The air conditioning device AC is a means for blowing out hot and cold air to stimulate the five senses of the passenger U, and is provided with a hot and cold air switching unit and a unit for adjusting the blowing direction and amount, and is installed on the dashboard, etc. The display DS is an image display means, and in this embodiment, as described below, is configured as a display means with the vehicle window as a display area.

Figure 3 is a schematic diagram showing the interior of vehicle C. Figure 3 shows the interior of vehicle C as seen from the rear seat. The vehicle C according to this embodiment will be described with reference to Figure 3.

Vehicle C according to this embodiment is configured so that the body area around the vehicle windows is as small as possible, and the area of the vehicle windows is as large as possible. Specifically, each pillar of vehicle C (A pillar, B pillar, C pillar, roof pillar, etc., shown by thick lines in FIG. 3) is formed long and thin, and is configured so that the visibility range blocked by the pillars is narrow. Vehicle C has vehicle windows (windshield, front door glass, rear door glass, etc.) between each pillar. Also, the entire roof of vehicle C according to this embodiment is made of roof glass.

As described above, the vehicle C is equipped with a display DS as a display means using the vehicle windows as a display area, and displays images on the vehicle windows. Specifically, the vehicle C displays images on each of a number of vehicle windows, such as the windshield, front door glass, rear door glass, roof glass, and rear glass. The display DS is, for example, a projector using the vehicle windows as a screen, but the vehicle windows themselves may also be configured as transparent displays, and the specific display means is not particularly limited. Also, for example, the roof portion may not be a vehicle window (glass) but may be shielded, and an image may simply be displayed (projected) on the roof.

Vehicle C also has one or more cameras SM1 (three in FIG. 3) installed on the pillars to capture images of the interior of the vehicle. Vehicle C also has a lighting device IM installed on the pillars to turn on the lights. Although not shown, other devices (speakers SP, fragrance device AF, etc.) are also installed.

As described above, in this embodiment, the interior of the vehicle C is designed as a space for experiencing content. The information processing device 1 outputs content to each output device, including the display DS, and guides the passenger U to a desired emotion before arriving at the destination.

Note that in this embodiment, the subject is a vehicle C designed as an experiential space for the content, but the vehicle to which the content is output may be a general vehicle, and the design (configuration) of the vehicle is not particularly limited.

Returning to FIG. 2, the explanation will be continued. The memory unit 15 is a storage such as a HDD (Hard Disk Drive) and SSD (Solid State Drive), and stores a program P for executing the processing according to this embodiment, as well as a content DB (Database) 151 and a first model 51. The content DB 151 is a database that stores data of each content. The first model 51 is an emotion estimator that estimates the emotion of the passenger U based on detection information detected by the sensing device SM, and is, for example, a machine learning model generated by learning training data. The first model 51 is expected to be used as a program module that constitutes part of artificial intelligence software.

In this embodiment, the content is described as being stored in local storage, but the content may also be obtained and output from a computer on the cloud (such as a server for content distribution).

The information processing device 1 may also include a reading unit that reads a non-transitory computer-readable recording medium D, such as a memory card or an optical disk, and may read and execute the program P from the recording medium D.

Figure 4 is an explanatory diagram showing an example of a record layout of content DB151. Content DB151 includes a user ID column, a travel pattern column, a content ID column, a content name column, an emotion column, a content column, and an output time column. The user ID column stores a user ID for identifying each user (passenger U). The travel pattern column stores a user's travel pattern that is set in advance in association with the user ID. For example, the travel pattern column stores a departure point (first location) and a destination (second location) corresponding to each pattern.

The content ID column, content name column, emotion column, content column, and output time column each store, in association with a user ID and a movement pattern, a content ID for identifying each of the multiple stages of content corresponding to each pattern, the content name of each stage, the emotion of passenger U that is the transition condition to each stage, the content data, and the output time of the content.

For example, taking a travel pattern from home to work (commuting) as an example, the information processing device 1 first outputs content for awakening the passenger U as the first stage content. The information processing device 1 then determines whether the content has caused the passenger U's emotions to transition to an "awakened state", and if it determines that the passenger U has transitioned to an "awakened state", it outputs the next stage content that stimulates competitive spirit. The information processing device 1 outputs the content for each stage in the order according to the content ID.

For ease of explanation, in Figure 4, the emotions in the emotion column that are the content transition conditions are illustrated in brackets [ ], but in reality, the parameters that are key for emotion estimation (an index of arousal/non-arousal and an index of pleasantness/unpleasantness) described below are stored. Each content and its transition conditions will be described in detail later.

In this embodiment, it is described that content corresponding to each movement pattern is prepared for each passenger U, but the content may be common to all passengers U.

Figure 5 is an explanatory diagram showing an example of the procedure for emotion induction processing. Below, the emotion induction processing procedure executed by the information processing device 1 is explained.

For example, the information processing device 1 and the in-vehicle navigation device NB start in response to the start of the power source of the vehicle C. After starting up, the in-vehicle navigation device NB accepts input of the destination from the passenger U and starts the vehicle C to the destination. The in-vehicle navigation device NB refers to predetermined map data to sequentially calculate the remaining time required to travel from the current location of the vehicle C to the destination, and transmits the calculated remaining time to the information processing device 1.

Meanwhile, the information processing device 1 identifies one or more passengers U seated in each seat ST, such as the driver's seat or passenger seat, who is to be the output target of the content (emotion induction target). For example, the information processing device 1 accepts a designation input of the target passenger U via the operation unit OP. Alternatively, the information processing device 1 may accept a designation input of the passenger U by voice input via the microphone SM2, or the like. Alternatively, the information processing device 1 may recognize the passenger U from an image captured by the camera SM1 and automatically identify the target passenger U.

Note that, although the above describes operation input to the operation unit OP (touch panel, etc.) or voice input as an example of an operation means, this embodiment is not limited to this. For example, the information processing device 1 may use the camera SM1 as a camera with a distance sensor, or a compound eye camera, etc., to recognize the hand movements (gestures) of the passenger U, and accept operation inputs based on the hand movements. For example, when identifying a passenger U, the information processing device 1 identifies the target passenger U by recognizing the gesture of the passenger U raising his/her hand from an image captured by the camera SM1. In this way, the information processing device 1 may accept operation inputs by recognizing the hand movements of the passenger U. This also applies to the subsequent processes.

The information processing device 1 reads out data of content to be presented to the passenger U from the content DB 151. Specifically, the information processing device 1 reads out data of multiple stages of content from the content DB 151, the content being for guiding the passenger U to have a specific emotion upon arrival at the destination, and corresponding to each of the multiple stages leading to the specific emotion.

More specifically, content is prepared for each passenger U according to the destination (travel pattern) of vehicle C. FIG. 5 illustrates, as an example, an output example of content during a commute from passenger U's home as a starting point to his/her workplace as a destination. In this case, as illustrated in FIG. 4, the information processing device 1 obtains content that induces passenger U's emotions from a non-awakened state to an awakened state, content that induces passenger U's emotions from an awakened state to a competitive state, content that induces passenger U's emotions from a competitive state to a state that recalls work goals, and content related to the day's work. The information processing device 1 outputs the content for each stage in sequence, and ultimately induces passenger U's emotions to a state where he/she is motivated for work.

In this embodiment, the final target emotion (specific emotion) is determined according to the destination, but the final target emotion may be determined based on other elements (information). For example, the final target emotion may be determined according to the departure date and time of the vehicle C (current date and time) and/or a passenger other than the passenger U, in addition to or instead of the destination. For example, the information processing device 1 stores the departure date and time (e.g., time zone) and the passenger (e.g., the passenger's user ID) in addition to the destination in the content DB 151 in association with the content. The information processing device 1 then estimates the final target emotion according to the destination, departure date and time, and passenger of the vehicle C, and reads out the content corresponding to the estimated emotion from the content DB 151. The departure date and time may be identified from the current date and time, and the passenger may be identified from the image captured by the camera SM1. This allows the content to be output to be selected more flexibly, and the passenger U to be guided to a desired emotion.

In this way, the information processing device 1 only needs to be able to determine a specific emotion as the final goal depending on the destination, departure date and time, and/or passengers, and the (estimated) criteria for the final goal emotion is not limited to the destination.

In the content DB 151, emotions (states) that are output conditions for the content of each stage are stored in association with the content of each stage. In the example of FIG. 4, the emotion associated with the first stage content ("awakening") is "Null", because it is assumed that the emotion of the passenger U is in a non-awakening state in the initial state (immediately after departing from home). As will be described later, when the information processing device 1 outputs the content of one stage, it determines whether the emotion of the passenger U has transitioned to the emotion that is the output condition for the next stage, and outputs the content of the next stage if the emotion of the passenger U has transitioned.

In the example of FIG. 5, the information processing device 1 first assumes that the passenger U is in a non-awakened state, and selects and outputs content for guiding the passenger U to an awakened state. Specifically, the information processing device 1 irradiates illumination light from the lighting device IM, outputs sound (music, etc.) from the speaker SP, outputs fragrance from the fragrance device AF, and/or blows hot and cold air to the passenger U using the air conditioning device AC. Note that these are examples of content, and the information processing device 1 may also, for example, display images on the display DS (car window).

Before outputting the content, the information processing device 1 first determines whether the remaining required time acquired from the in-vehicle navigation device NB is equal to or greater than the output time of the content specified in the content DB 151. If it is determined that it is equal to or greater than the remaining required time, the information processing device 1 outputs the content. On the other hand, if it is determined that the output time of the content will exceed the remaining required time, the information processing device 1 ends the series of processes without outputting the content.

When determining whether the output time of the content is equal to or longer than the remaining required time, the information processing device 1 may refer to traffic information around the vehicle C and increase or decrease the threshold remaining required time. Traffic information is data indicating, for example, the presence or absence of congestion, traffic accidents, etc. on the route to the destination or in the vicinity thereof. The information processing device 1 obtains the traffic information via the network N and increases or decreases the remaining required time depending on the presence or absence of congestion, etc. This makes it possible to determine the appropriateness of content output taking into account the current traffic conditions.

The information processing device 1 outputs the content and at the same time sequentially acquires detection information related to the passenger U from the sensing device SM and estimates the current emotions of the passenger U. As described above, the detection information includes images of the passenger U captured by the camera SM1, sounds (utterances of the passenger U) collected by the microphone SM2, etc. In addition to this, the detection information may also include biometric information of the passenger U, detection results detected by a pressure sensor installed in the seat ST, etc.

The information processing device 1 estimates the emotion from an image of the passenger U, etc. There is no particular restriction on the specific emotion estimation method, but for example, when an image of the passenger U is input, the information processing device 1 estimates the emotion using a first model 51 that has been trained to estimate the current emotion of the passenger U. The first model 51 is, for example, a neural network such as a CNN (Convolutional Neural Network) generated by deep learning. Note that, as described below, the input to the first model 51 may include biometric information of the passenger U, etc.

In this embodiment, the information processing device 1 estimates the emotions of the passenger U using a first model 51 that estimates the emotions of a person in accordance with the Russell Circle Theory. Specifically, as described below, the information processing device 1 calculates an index (Valence) that indicates the degree of pleasure and discomfort, and an index (Arousal) that indicates the degree of arousal and non-arousal, in order to express the emotions of the passenger U based on the Russell Circle Theory. Note that, as described below, the Russell Circle Theory is an example of emotion expression, and the information processing device 1 may express the emotions of the passenger U based on other theories.

Figure 6 is an explanatory diagram showing an example of an emotion transition process. In Figure 6, a Russell circle is conceptually illustrated. The Russell circle theory is a theory that explains human emotions in a space in which the first axis represents the degree of pleasantness/unpleasantness, and the second axis represents the degree of arousal/unarousal (sleepiness). The Russell circle theory is publicly known, so a detailed explanation will be omitted here.

The information processing device 1 estimates the emotions of the passenger U in accordance with the Russell circle in FIG. 6. Specifically, the information processing device 1 calculates a pleasant/unpleasant index corresponding to the first axis and an arousal/unarousal index corresponding to the second axis, and estimates a position in the space of the Russell circle corresponding to the emotions of the passenger U from each index. For example, the first model 51 has learned training data in which the correct values of the pleasant/unpleasant index and the arousal/unarousal index are associated with training images of people. The information processing device 1 inputs an image of the passenger U into the first model 51 that has been trained to calculate each index, and calculates each index.

For example, the information processing device 1 defines the emotions that are the output conditions (transition conditions) for the content at each stage as regions in the space of the Russell circle. To explain the content in Figure 5 as an example, as shown in Figure 6, the regions corresponding to the first stage emotion (non-awakening state) are set to be regions located in the third and fourth quadrants, i.e., regions with a low index of awakening/non-awakening (regions with a high degree of non-awakening). The information processing device 1 first assumes that the emotion of the occupant U in the initial stage is located in this region, and outputs content for inducing the emotion of the occupant U to an awakening state.

Then, the information processing device 1 sequentially determines whether the passenger U's emotion has transitioned to an area corresponding to the next stage, and outputs the content of each stage. In the example of FIG. 5 and FIG. 6, the information processing device 1 first determines whether the emotion has transitioned to an area located in the first and second quadrants, i.e., an area with a higher index of awakening/non-awakening than the first stage, as an area corresponding to the second stage emotion (awakened state). When the emotion has transitioned to the second stage, the information processing device 1 then determines whether the emotion has transitioned to an area located in the second quadrant, i.e., an area with a high index of awakening/non-awakening and a low index of pleasantness/unpleasantness (an area high in the unpleasant direction), as an area corresponding to the third stage emotion (a state in which a competitive spirit is aroused). When the emotion has transitioned to the third stage, the information processing device 1 determines whether the emotion has transitioned to an area located in the first quadrant, i.e., an area with a high index of awakening/non-awakening and a high index of pleasantness/unpleasantness, as an area corresponding to the fourth stage emotion (a state in which a goal is recalled).

In addition, in the content DB151, content is prepared according to the destination (travel pattern) of the passenger U, and the target emotion varies depending on the destination and the output of the content at each stage. Accordingly, the spatial area of the Russell circle that is the output condition of the content at each stage is also set separately.

In the above, the first model 51 handles emotion estimation processing as a regression problem for calculating an index, but it may also be handled as a classification problem for classifying which region in the space of the Russell circle it belongs to. In addition, a neural network is given above as an example of the first model 51, but it may also be a model based on other learning algorithms, such as a decision tree or SVM (Support Vector Machine). In addition, in this embodiment, emotion estimation is performed using a machine learning model, but emotion estimation (index calculation) may also be performed by simple rule-based pattern matching.

In addition, in this embodiment, the emotions of the passenger U are expressed in accordance with Russell Circle Theory, but this is only one example, and the emotions of the passenger U may also be expressed in accordance with general emotional patterns such as "happiness" and "sadness."

Although this embodiment will be described as performing emotion estimation from images, other detected information (audio, biometric information, etc.) may also be input to the first model 51 to estimate emotions. In this case, for example, the first model 51 may be configured as a multimodal model having separate input layers and intermediate layers for extracting features of detected information of each modality (type), and emotion estimation may be performed by combining the features extracted in each intermediate layer in a fully connected layer before the output layer.

Returning to FIG. 5 for further explanation, after outputting the first stage content, the information processing device 1 determines whether the emotion of the occupant U has transitioned to an emotion corresponding to the next stage. Specifically, the information processing device 1 determines whether the emotion of the occupant U has transitioned from a non-awake state to an wakeful state. The wakeful state refers to a state in which the occupant has escaped from a non-awake state (a state of strong drowsiness), and refers to a state in which the wakefulness/non-awake index is higher than that of the first stage, as illustrated in FIG. 6.

When it is determined that the passenger U has transitioned to an awakened state, the information processing device 1 determines whether the output time for the next stage of content is equal to or longer than the required time remaining, and then outputs content that stimulates the competitive spirit of the passenger U. The content in question is, for example, information about competing companies, information about acquaintances of the passenger U (work colleagues, friends from school days, etc.), and the like, and is information about the passenger U's competitors.

For example, the information processing device 1 is preset with competitors of the user's workplace, acquaintances, etc. The information processing device 1 acquires this information via the network N and stores it in the content DB 151. For example, in the case of information on competitors, the information processing device 1 acquires information on competitors from websites that publish stock prices, business news, etc. In the case of information on acquaintances, the information processing device 1 acquires articles posted on SNS by acquaintances, blog articles, etc. The information processing device 1 acquires this information from an external API (Application Programmable Interface) and displays it on the display DS. Note that, for example, the information processing device 1 may also output content in combination with audio from the speaker SP.

The information processing device 1 then determines whether the emotions of the passenger U have transitioned to a state in which competitive spirit is aroused. A state in which competitive spirit is aroused refers to a state in which motivation for work is higher than in the second stage, and refers to a state in which the arousal/non-arousal index is high and the pleasure/displeasure index is low, as illustrated in FIG. 6. If it is determined that a transition has been made to a state in which competitive spirit is aroused, the information processing device 1 determines whether the output time for the next stage of content is equal to or less than the remaining required time, and then outputs content that evokes the passenger U's goal.

Content that evokes a purpose is, for example, information about historical figures, information about currently active business executives, etc., and specifically, web pages and videos that contain this information. For example, the information processing device 1 searches for this information on the web using a web search engine, and stores it as content in the content DB 151. The information processing device 1 displays this content on the display DS in a state in which the passenger U's competitive spirit in business is aroused, and induces the passenger U to further increase his or her motivation. Of course, in addition to displaying images, audio, etc. may also be combined.

The information processing device 1 then determines whether the emotions of the passenger U have transitioned to a state in which the goal has been recalled. The state in which the goal has been recalled indicates a state in which the passenger is more motivated to work than in the third stage, and indicates a state in which the arousal/non-arousal index is high and the pleasure/displeasure index is high, as illustrated in FIG. 6. If it is determined that the passenger U has transitioned to a state in which the goal has been recalled, the information processing device 1 determines whether the output time for the next stage of content is equal to or less than the remaining required time, and then outputs content related to the passenger U's work.

For example, the information processing device 1 is preset with account information for an application (such as a scheduler) that manages the passenger U's schedule, etc. The information processing device 1 acquires work-related information from various applications. This information may include, for example, the passenger U's schedule, work tasks, e-mails, etc. The information processing device 1 displays this information on the display DS as final stage content and presents it to the passenger U. The information processing device 1 displays this content until the remaining required time reaches zero.

By outputting the content for each of the above stages, the passenger U is gradually guided from a drowsy state to a state of high motivation for work during the commute. After arriving at the destination, the information processing device 1 and the in-vehicle navigation device NB end the series of processes when power supply from the vehicle C is stopped.

Figure 7 is a flowchart illustrating an example of a processing procedure executed by the information processing device 1. The processing contents executed by the information processing device 1 will be described with reference to Figure 7.

The control unit 11 of the information processing device 1 accepts input of the destination of the vehicle C (step S11). Note that, for example, the control unit 11 may automatically determine the destination from the current date and time, the position information of the vehicle C, etc. The control unit 11 identifies the passenger U to whom the content is to be output (step S12).

The control unit 11 estimates a specific emotion as a final goal according to the destination input in step S11, and acquires content for inducing the emotion of the passenger U to the estimated specific emotion from the content DB 151 (step S13). Specifically, the control unit 11 acquires multiple stages of content corresponding to each of the multiple stages of emotions leading to the specific emotion as a final goal. For example, the control unit 11 reads out from the content DB 151 content that corresponds to the destination input in step S11 and to the passenger U identified in step S12. As described above, the control unit 11 may estimate a final goal emotion according to the departure date and time of the vehicle C and/or the passengers in addition to or instead of the destination.

The control unit 11 outputs the first stage of the content among the multiple stages of content acquired in step S13 (step S14). If the remaining output time of the content has already exceeded the required time at the time of step S14, the control unit 11 ends the series of processes without outputting the content. After outputting the first stage of the content, the control unit 11 acquires detection information related to the passenger U from the sensing device SM (step S15). Specifically, the control unit 11 acquires an image of the passenger U, audio inside the vehicle, etc.

The control unit 11 estimates the current emotions of the passenger U based on the acquired detection information (step S16). For example, when the control unit 11 receives detection information (such as a captured image of the passenger U), it calculates each index using a first model 51 that has been trained to calculate an index representing the degree of arousal/non-arousal and an index representing the degree of comfort/discomfort.

The control unit 11 determines whether the emotion of the passenger U has transitioned to the next emotion level of the content being output (step S17). If it is determined that the emotion has not transitioned to the next level (S17: NO), the control unit 11 returns the process to step S15. If it is determined that the emotion has transitioned to the next level (S17: YES), the control unit 11 obtains the remaining time to the destination from the in-car navigation device NB (step S18).

The control unit 11 determines whether the output time of the next stage content is equal to or less than the remaining required time acquired in step S18 (step S19). If it is determined that the output time is not equal to or less than the remaining required time (S19: NO), the control unit 11 proceeds to step S21. If it is determined that the output time is equal to or less than the remaining required time (S19: YES), the control unit 11 outputs the next stage content (step S20).

The control unit 11 determines whether the remaining time is zero, i.e., whether the destination has been reached (step S21). If it is determined that the destination has not been reached (S21: NO), the control unit 11 returns the process to step S15. If it is determined that the destination has been reached (S21: YES), the control unit 11 ends the series of processes.

In the above, multiple contents are output sequentially without stopping, but if vehicle C stops temporarily (such as to stop at a convenience store), the output of the contents may be resumed from the point where it was paused.

In the above description, it has been explained that there is not much difference between the time required to travel from the departure point to the destination and the total output time when all content is output, but depending on the destination, there may be cases where there is still time left even after the last content (in the above example, content related to business) is output. In this case, for example, when outputting intermediate content (for example, content of the second and/or third stage in the above example), the information processing device 1 may compare the remaining time required with the total output time of the remaining content and extend the output time of the intermediate content. For example, the information processing device 1 may calculate the difference between the remaining time required and the total output time of the remaining content, and repeatedly output the intermediate content for the time of this difference. This makes it possible to suitably control the output of content so that the destination is reached just when the last content is output.

In addition, although the above describes a case where multiple levels of content are output in sequence according to the order of the levels, the present embodiment is not limited to this, and content may be output in an order different from the predefined content order at any time.

For example, using the example in Figure 5, when outputting third stage content that evokes the passenger U's goal, if the passenger U's emotions revert to the previous second stage emotions, the process may be resumed by returning to the second stage and restarting the procedure of outputting content that stimulates competitive spirit.

In addition, for example, when the destination is very close to the departure point and there is insufficient time to output the content of all stages, the information processing device 1 may output only the content of the final stage (in the above case, the content related to the passenger U's work).

In this way, the information processing device 1 only needs to be able to select and output one of multiple pieces of content depending on the passenger U's emotions and the remaining time required, and does not need to output the content in a predefined stage.

Although the above describes a case where the workplace is the destination, the destination is not limited to the workplace and may be any location, such as a theme park, a zoo, a commercial facility, an art museum, or a hospital. Accordingly, various types of content are expected to be output by the information processing device 1.

As described above, according to this embodiment 1, the passenger U's emotions can be appropriately induced to specific emotions according to the destination, etc.

(Embodiment 2)
In the first embodiment, a case where a passenger U moves from a base (first location) such as a home to a workplace (second location) has been described. On the other hand, the present system may be applied to the return journey when moving from a workplace to a home. In this embodiment, a form in which the content is changed depending on whether it is an outbound journey or a return journey will be described. Note that the same reference numerals are used for parts that overlap with the first embodiment, and the description will be omitted.

Figure 8 is an explanatory diagram showing an example of a record layout of content DB 151 according to embodiment 2. Content DB 151 according to this embodiment stores different contents according to whether the travel pattern is an outbound or inbound trip according to the departure point and destination, even for the same route travel pattern.

Specifically, in the travel pattern column of content DB151, for example, when traveling between home and workplace (workplace), an outward journey starting from home and the workplace as a destination, and a return journey starting from the workplace and the home as a destination, are stored as separate travel patterns. In addition, the content ID column, content name column, emotion column, content column, and output time column each store the content ID, content name, passenger U's emotion that is the transition condition, content, and content output time of different contents in association with the outward or return travel pattern.

Figure 9 is an explanatory diagram showing an example of the procedure for emotion induction processing according to embodiment 2. Figure 10 is an explanatory diagram showing an example of an emotion transition process according to embodiment 2. An overview of this embodiment will be described based on Figures 9 and 10.

Figures 9 and 10 show an example of processing on the return journey when passenger U travels from his/her workplace to his/her home. When passenger U returns home, the information processing device 1 determines that the travel pattern is related to the return journey from his/her workplace, for example, from the destination input by passenger U and the current location (starting point) of vehicle C. The information processing device 1 reads out content corresponding to the travel pattern from content DB 151. The content is content for inducing passenger U to a calm state of emotion, in contrast to the outbound journey, and is made up of multiple stages of content corresponding to each of the multiple stages of emotion leading to a calm state that is the final goal.

Specifically, the information processing device 1 acquires content that induces the emotions of the passenger U from an uncomfortable state to a comfortable state, content that induces the emotions from a comfortable state to a state in which a sense of security is evoked, content that induces the emotions from a state in which a sense of security is evoked to a state in which a sense of happiness is evoked, and content related to the passenger U's future plans.

The uncomfortable state refers to a state in which passenger U's emotions (mood) have not shifted away from work, and refers to a state in which the comfort/unpleasant index is low, as shown as the first stage in Figure 10. The comfortable state refers to a state in which passenger U's emotions have been detached from work, and refers to a state in which the comfort/unpleasant index is high, as shown as the second stage in Figure 10.

The state in which a sense of security is evoked refers to a state in which the emotions of the passenger U are less aroused than in the second stage, and refers to a state in which the arousal/non-arousal index is low and the pleasure/displeasure index is high, as shown as the third stage in Figure 10. The state in which a sense of happiness is evoked refers to a state in which the emotions of the passenger U are more aroused than in the third stage, and refers to a state in which the arousal/non-arousal index is high and the pleasure/displeasure index is high, as shown as the fourth stage in Figure 10.

First, the information processing device 1 assumes that the passenger U is feeling uncomfortable and outputs a first stage of content that induces the passenger U to feel comfortable. For example, the information processing device 1 irradiates illumination light using the lighting device IM, outputs fragrance using the fragrance device AF, automatically adjusts the air conditioning using the air conditioning device AC, and/or outputs sound (music, etc.) from the speaker SP. Before outputting the content, the information processing device 1 determines whether the remaining output time of the content is within the required time. This point is the same for the subsequent processes.

After outputting the content, the information processing device 1 determines whether the passenger U's emotions have transitioned to a comfortable state corresponding to the second stage. If the passenger U has transitioned to a comfortable state, the information processing device 1 outputs content that evokes a sense of security in the passenger U. The content is, for example, a reading of a specific story (audio output) or a display of entertainment information. The information processing device 1 stores these contents in advance in the content DB 151, and if the passenger U has transitioned to a comfortable state, the information processing device 1 outputs the content to guide the passenger U's emotions in a positive direction.

Next, the information processing device 1 determines whether the passenger U's emotions have transitioned to a state in which a sense of security is evoked. If it is determined that the emotions have transitioned to a state in which a sense of security is evoked, the information processing device 1 outputs content that evokes a sense of happiness in the passenger U. The content is content that awakens the passenger U's emotions more than the second stage, and is, for example, information about people (family members, etc.) related to the passenger U. Specifically, the information processing device 1 displays memories with the family (photos, etc.) and events that occurred with the family on that day (chat messages to the passenger U, articles posted on SNS, etc.) on the display DS. For example, the information processing device 1 reads out information corresponding to family memories from the content DB 151, and also obtains and displays messages, etc. from a chat application used by the passenger U.

The information processing device 1 then determines whether the emotion of the passenger U has transitioned to a state in which a sense of happiness is aroused. If it is determined that the emotion has transitioned to a state in which a sense of happiness is aroused, the information processing device 1 displays the passenger U's future schedule (e.g., the weekend) on the display DS. The information processing device 1 obtains the schedule from an application such as a scheduler used by the passenger U, and outputs it as the fourth stage content.

In this way, the information processing device 1 outputs different content groups depending on whether the journey is an outbound or inbound journey, even when traveling between the same two locations. This makes it possible to induce the passenger U's emotions into an appropriate state depending on whether the journey is an outbound or inbound journey.

This embodiment is the same as the first embodiment except that different content is output depending on whether it is an outbound or inbound journey, so detailed explanations of the flow charts, etc. will be omitted in this embodiment.

(Embodiment 3)
In the first embodiment, a form has been described in which the output time of the content is compared with the remaining required time when outputting each of the multiple stages of content to determine whether the content output is appropriate. On the other hand, when the present system is used every day for commuting, etc., it is expected that the transition time of the passenger U's emotions required by the presentation of the content will take a similar amount of time. In the present embodiment, a machine learning model that learns the transition time required for emotion induction is constructed (generated), and the appropriateness of the content output is determined according to an estimated value of the transition time based on the model.

FIG. 11 is a block diagram showing the storage unit 15 according to the third embodiment. The storage unit 15 of the information processing device 1 according to the present embodiment stores a second model 52 in addition to a content DB 151 and a first model 51. The second model 52 is a machine learning model that has learned predetermined training data, and is a model that estimates the transition time until a transition to the next stage of emotion when detection information of the occupant U is input. The second model 52 is expected to be used as a program module that constitutes part of artificial intelligence software.

The second model 52 is, for example, a neural network such as a CNN constructed by deep learning, similar to the first model 51. For example, the second model 52 learns, as training data, pairs of an image of a person and the transition time required for the person to transition to a target next stage of emotion when content is presented (output) to the person.

Specifically, the second model 52 has learned training data including an image of the passenger U (user) of the vehicle C in which the information processing device 1 in which the second model 52 is installed is installed, and the transition time to the next stage required by the output of the content to the passenger U. For example, when the passenger U uses the system, the information processing device 1 stores an image of the passenger U at the time of content output and an actual value of the transition time to the emotion corresponding to the next stage of the content, in association with the user ID of the passenger U and the content ID of the content output to the passenger U. The information processing device 1 uses the image of the passenger U, the user ID representing the passenger U, and the content ID representing the content to be output as training input data, and provides the actual value of the transition time to the second model 52 as a correct answer value, and causes the second model 52 to learn. The learning itself may be performed by a device other than the information processing device 1 (for example, a server computer on the cloud).

When outputting the content for each stage, the information processing device 1 inputs an image of the passenger U, etc., into the second model 52 and estimates the emotion to be induced in the output content, i.e., the transition time to the next emotion stage. For example, when outputting the content for the second stage, the information processing device 1 estimates the transition time from the second emotion stage to the third emotion stage.

The information processing device 1 compares the estimated transition time with the remaining time required to reach the destination. If the transition time is within the remaining time required, the information processing device 1 outputs the content.

Figure 12 is a flowchart showing an example of a processing procedure executed by the information processing device 1 according to embodiment 3. When it is determined that the output time of the next stage content is within the remaining required time (S19: YES), the information processing device 1 executes the following processing.

The control unit 11 of the information processing device 1 inputs the detection information of the passenger U acquired from the sensing device SM to the second model 52, and estimates the transition time required for the passenger U's emotion to transition to the emotion corresponding to the next stage of the content newly output in step S20 (step S301). Specifically, as described above, the control unit 11 inputs an image of the passenger U, etc., to the second model to estimate the transition time.

The control unit 11 determines whether the estimated transition time is within the remaining required time (step S302). If it is determined that the estimated transition time is not within the remaining required time (S302: NO), the control unit 11 transitions to step S21. If it is determined that the estimated transition time is within the remaining required time (S302: YES), the control unit 11 outputs the next stage of content (step S20).

As described above, according to this third embodiment, it is possible to predict the time required for the passenger U's emotional transition and determine whether or not to output content.

(Embodiment 4)
In the first embodiment, a form in which multiple contents are output in a predetermined order has been described. On the other hand, it is also possible to simultaneously determine whether or not each content has transitioned to an emotion that is an output condition for each content, and output each content as soon as the output condition is satisfied. In the present embodiment, a form in which multiple contents are output simultaneously without specifying the output order will be described.

Figure 13 is a flowchart showing the processing procedure executed by the information processing device 1 according to embodiment 4. After receiving input of a destination (step S11) and identifying a passenger U to whom content is to be output (step S12), the information processing device 1 executes the following processing.

The control unit 11 of the information processing device 1 acquires from the content DB 151 the content that corresponds to the destination input in step S11 and to the passenger U identified in step S12 (step S401). Specifically, the control unit 11 acquires multiple pieces of content that correspond to each of the multiple emotions that are output conditions.

Unlike embodiment 1, the content group according to this embodiment does not specify the order in which the content is output, i.e., the stages. Content DB151 specifies only the emotions that are associated with each piece of content and that serve as output conditions, and when the emotion of passenger U matches the emotion that is the output condition for each piece of content, the information processing device 1 outputs the content that satisfies the output conditions.

The control unit 11 acquires detection information related to the passenger U from the sensing device SM (step S402). The control unit 11 estimates the emotions of the passenger U based on the acquired detection information (step S403).

The control unit 11 compares the emotions of the output conditions of each content defined in the content DB 151 with the emotions of the passenger U estimated in step S403, and determines whether there is any corresponding content that satisfies the output conditions (step S404). If it is determined that there is no corresponding content (S404: NO), the control unit 11 returns the process to step S402.

If it is determined that the relevant content is present (S404: YES), the control unit 11 obtains the remaining time to the destination (step S405). The control unit 11 determines whether the output time of the relevant content is within the remaining required time (step S406). If it is determined that the output time is within the remaining required time (S406: YES), the control unit 11 outputs the relevant content (step S407).

In this embodiment, since the content is output as soon as the output conditions are satisfied, it is assumed that other content is being output when the relevant content is output in step S407. In this case, for example, it is preferable for the information processing device 1 to output the relevant content simultaneously with the content being output.

For example, a case will be described where an image is displayed on the display DS as content. In this case, the information processing device 1 displays an image related to the content in a display location on the display DS different from the image related to the content being output. For example, the information processing device 1 displays an image related to the content in a vehicle window different from the vehicle window where the image related to the content being output is displayed.

For example, the information processing device 1 displays the content that starts to be output first on the windshield, and displays the content that starts to be output subsequently on a vehicle window other than the windshield (e.g., the front door glass). When the content being displayed on the windshield ends, the information processing device 1 moves the content being displayed on another vehicle window to the windshield and displays it there.

Note that the above is an example of simultaneous output (display), and the present embodiment is not limited to this. For example, the information processing device 1 may give priority to displaying the latest content (relevant content) on the windshield, and move the previous content to another car window, etc.

After executing the process of step S407, or if the result of step S406 is NO, the control unit 11 determines whether or not the destination has been reached (step S408). If it is determined that the destination has not been reached (S408: NO), the control unit 11 returns the process to step S402. If it is determined that the destination has been reached (S408: YES), the control unit 11 ends the series of processes.

As described above, according to the fourth embodiment, multiple contents may be output simultaneously in parallel without specifying the output order.

The technical features (constituent elements) described in each embodiment can be combined with each other, and new technical ideas are formed at the points of combination. The embodiments disclosed here are all illustrative and not restrictive.

The scope of the present invention is defined by the claims rather than the above meaning, and is intended to include all modifications within the scope and meaning equivalent to the claims.

REFERENCE SIGNS LIST 1 Information processing device 11 Control unit 110 Arithmetic processing unit 111 ROM
112 RAM
12 Communication unit 13 Input interface 14 Output interface 15 Storage unit 151 Content DB
51 First model 52 Second model C Vehicle U Passenger ST Seat IM Lighting device SP Speaker AF Fragrance device AC Air conditioning device SM Sensing device SM1 Camera SM2 Microphone NB On-board navigation device DS Display OP Operation unit N Network

Claims (10)

a first acquisition unit that acquires a plurality of stages of content corresponding to each of a plurality of stages of emotions that induce a passenger in a vehicle to have a specific emotion based on a destination when the passenger arrives at the destination;
A second acquisition unit that acquires detection information regarding the passenger detected by using a predetermined sensing device;
an estimation unit that estimates an emotion of the passenger based on the acquired detection information;
an output control unit that selects and outputs the content corresponding to the estimated emotion of the passenger to an output device provided in the vehicle;
a third acquisition unit that acquires a remaining required time from a current location of the vehicle to a destination,
the output control unit controls output of the content based on the remaining required time and a total output time of the remaining content;
the estimation unit determines whether or not the emotion of the passenger has transitioned to an emotion of a next stage subsequent to the first stage after outputting the content corresponding to the first stage;
When it is determined that the emotion has transitioned to the next emotion level, the output control unit outputs the content corresponding to the next emotion level;
a trained model for estimating a transition time until a transition to the next stage when the detection information is input, the trained model including the past detection information and transition times of the occupant being input with the acquired detection information, the trained model including the transition time estimation unit estimating the transition time;
The output control unit determines whether to output the content corresponding to the next stage based on the estimated transition time and an output time of the content corresponding to the next stage.
Information processing device. the output control unit outputs content that induces an emotion of the occupant from a non-awakened state to an awakened state as the content corresponding to the one stage,
The output control unit determines whether or not an emotion of the occupant has transitioned to the awakening state,
The information processing device according to claim 1 , wherein when it is determined that the occupant has transitioned to the wakefulness state, the output control unit outputs information about a competitor of the occupant as content that stimulates the occupant's competitive spirit. the estimation unit determines whether or not the emotion of the passenger has transitioned to a state in which the passenger's competitive spirit has been aroused after outputting content that arouses the passenger's competitive spirit;
The information processing device according to claim 2 , wherein the output control unit outputs content that reminds the rider of a goal when it is determined that the rider has transitioned to a state in which the competitive spirit is aroused. the output control unit outputs, as the content corresponding to the one stage, content for inducing an emotion of the passenger from an uncomfortable state to a comfortable state;
The estimation unit determines whether or not the emotion of the occupant has transitioned to the comfortable state,
The information processing device according to any one of claims 1 to 3 , wherein when the output control unit determines that the passenger has transitioned to the comfortable state, the output control unit outputs a voice reading a predetermined story or entertainment information as content that evokes a sense of security in the passenger. the estimation unit determines whether or not an emotion of the passenger has transitioned to a state in which a sense of security is evoked after outputting content that evokes a sense of security in the passenger;
The information processing device according to claim 4 , wherein the output control unit outputs content that recalls a person related to the passenger when it is determined that the state has transitioned to a state in which a sense of security is evoked. The information processing device according to claim 1 , wherein the output control unit determines whether or not to output the selected content based on the remaining required time and an output time of the content. A fourth acquisition unit that acquires traffic information around the vehicle,
The information processing device according to claim 6 , wherein the output control unit increases or decreases the remaining required time in accordance with the traffic information. The information processing device according to any one of claims 1 to 7, wherein the first acquisition unit acquires the multiple stages of content that differ depending on whether the vehicle travels on an outbound route starting from a first point that is the passenger's base and traveling to a specified second point as the destination, or on whether the vehicle travels on a return route starting from the second point and traveling to the first point as the destination. a goal estimation unit that estimates the specific emotion as a final goal according to a destination of the vehicle, a departure date and time, or a passenger other than the passenger;
The information processing device according to claim 1 , wherein the first acquisition unit acquires the plurality of stages of content corresponding to the estimated specific emotion. acquiring a content for inducing an emotion of a passenger in a vehicle to a specific emotion based on a destination when the passenger arrives at the destination, the content corresponding to each of the multiple emotion levels for inducing the specific emotion;
Obtaining detection information regarding the passenger detected using a predetermined sensing device;
Estimating the emotion of the passenger based on the acquired detection information;
Selecting and outputting the content corresponding to the estimated emotion of the passenger to an output device installed in the vehicle;
Obtaining the remaining time required to travel from the current location of the vehicle to the destination;
Controlling output of the content based on the remaining required time and a total output time of the remaining content;
After outputting the content corresponding to the first stage, it is determined whether or not the emotion of the passenger has transitioned to an emotion of a next stage following the first stage;
When it is determined that the emotion has transitioned to the next emotion level, the content corresponding to the next emotion level is output.
a trained model for estimating a transition time until a transition to the next stage when the detection information is input, the model having learned the past detection information and transition time of the occupant being inputted with the acquired detection information to estimate the transition time;
Based on the estimated transition time and an output time of the content corresponding to the next stage, it is determined whether or not to output the content corresponding to the next stage.
An emotion induction method in which processing is performed by a computer.

Images