JP7429440B2 - Estimation device, estimation system, estimation method, and estimation program for transient complex emotions - Google Patents

Description

The present disclosure relates to a technique for estimating temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

Various methods have been proposed for evaluating human emotions, such as a method of measuring biological information and evaluating it in real time, and a psychological evaluation method using a questionnaire sheet (for example, Patent Document 1).

JP2017-74356A

However, human emotions include transient complex emotions that arise from a complex combination of negative and positive emotions, such as ``excitement,'' ``thrill,'' and ``embarrassment.'' Depending on the evaluation method used, there is a problem in that complex emotions cannot be evaluated or a satisfactory evaluation level cannot be obtained.

Therefore, it is desired to appropriately estimate temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

In order to solve at least part of the above problems, the present disclosure adopts the following various aspects.

A first aspect provides an estimation device that estimates a temporary complex emotion caused by a complex combination of negative emotions and positive emotions. The estimation device according to the first aspect includes an acquisition unit that acquires the amount of change in oxygenated hemoglobin concentration in the forehead region and brain wave information before and after the subject contacts the object; The apparatus includes an estimating equation prepared in advance that uses brain wave information as a variable, and an estimating section that estimates the complex emotion using the obtained change amount of the oxygenated hemoglobin concentration and the brain wave information.

According to the estimation device according to the first aspect, a pre-prepared estimation formula that uses the amount of change in oxygenated hemoglobin concentration and brain wave information as variables, and the acquired amount of change in oxygenated hemoglobin concentration and brain wave information are used. Since complex emotions are estimated using the above method, it is possible to appropriately estimate temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

In the estimation device according to the first aspect, the brain wave information may include at least an amount of change in α waves and an amount of change in β waves in the occipital region. Among brain wave information, alpha and beta waves can appropriately estimate complex emotions.

In the estimation device according to the first aspect, the brain wave information may be an amount of change in β waves and an amount of change in α waves. Complex emotions can be estimated more appropriately using beta waves and alpha waves.

In the estimation device according to the first aspect, the brain wave information may be an amount of change in β waves/α waves. By using β waves/α waves, complex emotions can be estimated more appropriately.

In the estimation device according to the first aspect, the complex emotion may be an emotion of excitement. Crush is a complex emotion of positive and negative emotions, and it is also a useful emotion in marketing.

In the estimation device according to the first aspect, the estimation formula allows the subject to view a plurality of pre-prepared images that make the person feel the complex emotion and a plurality of pre-prepared images that do not make the person feel the compound emotion. By regression analysis, using the amount of change in the oxygenated hemoglobin concentration and the electroencephalogram information during the event as explanatory variables, and using the actual measured value of the complex emotion using images that make you feel the complex emotion and images that do not make you feel the complex emotion as the objective variable. Estimation device, which is the calculated formula. In this case, an estimation formula for estimating the complex emotion can be appropriately obtained.

A second aspect provides an estimation system that estimates a temporary complex emotion caused by a complex combination of negative emotions and positive emotions. An estimation system according to a second aspect includes any one of the estimation devices according to the first aspect, a concentration measuring device that measures the oxygenated hemoglobin concentration in the forehead region, and an electroencephalogram measuring device that measures brain wave information. , and an output device that outputs estimation information of the complex emotion estimated by the estimation device.

According to the estimation system according to the second aspect, a pre-prepared estimation formula that uses the amount of change in oxygenated hemoglobin concentration and brain wave information as variables, and the acquired amount of change in oxygenated hemoglobin concentration and brain wave information are used. Since complex emotions are estimated using the above method, it is possible to appropriately estimate temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

The third aspect provides an estimation method for estimating a temporary complex emotion caused by a complex combination of negative emotions and positive emotions. The estimation method according to the third aspect acquires the amount of change in oxygenated hemoglobin concentration and brain wave information in the forehead region before and after the subject contacts the object, and calculates the amount of change in oxygenated hemoglobin concentration and brain wave information in the forehead region. The method includes estimating the complex emotion using a pre-prepared estimation formula having as a variable, the obtained change amount of the oxygenated hemoglobin concentration, and the brain wave information.

According to the estimation method according to the third aspect, a pre-prepared estimation formula that uses the amount of change in oxygenated hemoglobin concentration and electroencephalogram information as variables, and the obtained amount of change in oxygenated hemoglobin concentration and electroencephalogram information are used. Since complex emotions are estimated using the above method, it is possible to appropriately estimate temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

A fourth aspect provides an estimation program that estimates a temporary complex emotion caused by a complex combination of negative emotions and positive emotions. The estimation program according to the fourth aspect includes a function for acquiring the amount of change in oxygenated hemoglobin concentration in the forehead region and brain wave information before and after the subject contacts the object, and the amount of change in oxygenated hemoglobin concentration in the forehead region. and a function for estimating the complex emotion using a pre-prepared estimation formula in which variables include and electroencephalogram information, and the acquired change amount of the oxygenated hemoglobin concentration and the electroencephalogram information, are realized by a computer. to prepare for something.

According to the estimation program according to the fourth aspect, a pre-prepared estimation formula that uses the amount of change in oxygenated hemoglobin concentration and brain wave information as variables, and the acquired amount of change in oxygenated hemoglobin concentration and brain wave information are used. Since complex emotions are estimated using the above method, it is possible to appropriately estimate temporary complex emotions caused by a complex combination of negative emotions and positive emotions.

The estimation program according to the fourth aspect may be stored in a computer-readable medium, such as a CD, DVD, Blu-ray disc, or semiconductor memory.

FIG. 1 is an explanatory diagram showing an example of an estimation device and an estimation system according to a first embodiment. FIG. 1 is an explanatory diagram showing an example of an estimation device and an estimation system according to a first embodiment. FIG. 1 is an explanatory diagram showing the estimation system according to the first embodiment by functional units. FIG. 2 is a block diagram showing the functional internal configuration of the estimation device according to the first embodiment. An explanatory diagram showing a procedure for obtaining an actual measured value of excitement using an image. An explanatory diagram showing an example of a survey form used when obtaining an actual measurement value of excitement using an image. FIG. 3 is an explanatory diagram showing an example of a measurement channel included in the concentration measuring device. An explanatory diagram showing the amount of change in each brain wave component for an exciting image and a non-exciting image. An explanatory diagram showing an example of a regression coefficient, a constant term, and a correlation in an estimation formula. 3 is a graph showing a correlation between an estimated value calculated using an estimation formula using an oxygenated hemoglobin concentration value as a variable and an actual value. 3 is a graph showing the correlation between estimated values calculated using an estimation formula using oxygenated hemoglobin concentration values and alpha waves as variables, and actual measured values. 3 is a graph showing the correlation between estimated values calculated using an estimation formula using oxygenated hemoglobin concentration values and β waves as variables, and actual measured values. 3 is a graph showing a correlation between an estimated value calculated using an estimation formula using an oxygenated hemoglobin concentration value and β waves/α waves as variables, and an actual value. 2 is a graph showing the correlation between estimated values calculated using an estimation formula using oxygenated hemoglobin concentration values, alpha waves, and beta waves as variables, and actual measured values. 5 is a flowchart showing each processing step of a complex emotion estimation process executed by the estimation device according to the first embodiment.

Conventional emotion estimation methods use biological measurements such as brain activity to evaluate simple sensibilities and emotions such as comfort and displeasure, but they can also evaluate negative emotions such as agitation and happiness. It has been difficult to appropriately evaluate complex emotions that are a combination of positive emotions, such as "excitement," "thrill," and "embarrassment." Furthermore, since complex emotions are temporary emotions, it is difficult to evaluate temporary complex emotions in a timely manner using a method using a questionnaire. The inventors of the present invention have intensively studied methods for appropriately estimating complex emotions. Hereinafter, an estimation device, an estimation system, an estimation method, and an estimation program according to the present disclosure will be described based on embodiments with reference to the drawings.

First embodiment:
1 and 2 show an example of an estimation device and an estimation system according to the first embodiment. The estimation device 100 may be realized as a computer 100 such as a desktop computer or a notebook computer (not shown) as shown in FIG. 1, or a tablet terminal or a smartphone (hereinafter simply referred to as a "smartphone") as shown in FIG. It may also be realized as The computer 100 may be connected to the display device 31 by wire or wirelessly. When the computer 100 functions as an estimating device, the estimating system 10 is configured by the display device 31, the electroencephalogram measuring device 41 for measuring brain wave information, and the concentration measuring device 42 for measuring the oxygenated hemoglobin concentration. When the smartphone 100 functions as an estimation device, the display unit 21 is included in the smartphone 100, and the estimation system 10 is configured by the electroencephalogram measuring device 41 and the concentration measuring device 42. The computer 100 and the smartphone 100 and the electroencephalogram measuring device 41 and the concentration measuring device 42 may be connected wirelessly or by wire. The wireless connection is realized, for example, by wireless communication compliant with short-range wireless communication standards such as WIFI (registered trademark) and BLUETOOTH (registered trademark).

The electroencephalogram measuring device 41 is, for example, a well-known simple electroencephalograph, has a headset having a plurality of electrodes, and detects the subject's brain waves by attaching the headset to the subject's head. The detected brain waves include θ waves, α waves, and β waves. In this embodiment, the average value of the signal values of each wave measured by electrodes located at the back of the head is acquired as the measured value of each wave. In this embodiment, the amount of change in brain waves before and after the subject contacts an object, for example, a product, is used, and the amount of change in each brain wave component is referred to as brain wave information. Coming into contact with an object means perceiving the design of the product (actual object or image), the sound of the product, the scent of the product, the taste of the product, and the feel of the product through the five human senses: sight, hearing, smell, taste, and touch. It means to do. Note that the amount of change in the brain waves may be output by the electroencephalogram measuring device 41, or the estimating device 100 may calculate the temporal change in the brain waves measured by the electroencephalogram measuring device 41, that is, the amount of change. The concentration measuring device 42 is, for example, a wearable fNIRS device (optical topography device), and has a mounting section that includes a plurality of optical sensor channels, that is, a near-infrared light source and a detection section, and the mounting section is attached to a subject. The amount of change in oxygenated hemoglobin concentration (the amount of change in the amount of oxygenated hemoglobin) is obtained by placing it on the forehead of the patient. In this embodiment, the amount of change in oxygenated hemoglobin concentration is acquired for each channel. As the concentration measuring device 42, an MRI (magnetic resonance imaging apparatus) may be used. Further, in this embodiment, as described above, the amount of change in oxygenated hemoglobin concentration before and after the subject comes into contact with an object, for example, a product, is used. Note that the amount of change in the oxygenated hemoglobin concentration may be output by the concentration measuring device 42, or the estimating device 100 may calculate the time change in the concentration measured by the concentration measuring device 42, that is, the amount of change. Also good.

The estimation results are displayed on the display device 31 and the display unit 21. As the estimation result, a pattern whose area changes depending on the degree of complex emotion, for example, the degree of excitement as a percentage, 10 levels, or other numerical values, is displayed. Since a tablet terminal or a smartphone can be used as the display device 31, the estimation result may be transmitted from the computer 100 to the tablet terminal or smartphone by wireless communication. In this case, the estimation results can be sent to the user's smartphone. Note that the computer 100 may be a server computer that functions as a server connected to a plurality of terminals via a wired or wireless network. In this case, the computer 100 receives brain wave information and oxygenated hemoglobin from a plurality of various client terminals. Concentrations are uploaded, estimated values are calculated at the server computer, and the calculated estimated values can be transmitted from the server computer to various client terminals.

FIG. 3 is an explanatory diagram showing the estimation system 10 according to the first embodiment by functional units. The estimation device 100 includes an acquisition section F1 and an estimation section F2. The acquisition unit F1 is connected to the electroencephalogram measuring device 41 and the oxygenated hemoglobin concentration measuring device 42 by wire or wirelessly, and acquires changes in theta waves, alpha waves, and beta waves measured by the electroencephalogram measuring device 41 as brain wave information. The amount of change in the oxygenated hemoglobin concentration or the oxygenated hemoglobin concentration is acquired from the concentration measuring device 42. The estimating unit F2 estimates a complex emotion using an estimating equation that uses as variables the electroencephalogram information acquired by the acquiring unit F1 and the amount of change in oxygenated hemoglobin concentration. The complex emotion estimated by the estimation unit F2 is output to the display unit 21 or the display device 31.

FIG. 4 is a block diagram showing the functional internal configuration of the estimation device 100 according to the first embodiment. The estimation device 100 includes a central processing unit (CPU) 101, a memory 102, an input/output interface 103, and a clock generator (not shown). The CPU 101, memory 102, input/output interface 103, and clock generator are connected via an internal bus 104 so that they can communicate in both directions. The memory 102 includes a memory that non-volatilely and read-only stores a complex emotion estimation program Pr1 for estimating a complex emotion, such as a ROM, and a memory that can be read and written by the CPU 101, such as a RAM. The CPU 101, that is, the estimation device 100 functions as an acquisition unit F1 and an estimation unit F2 by expanding the complex emotion estimation program Pr1 stored in the memory 102 into a readable/writable memory and executing it. Note that the CPU 101 may be a single CPU, may be multiple CPUs that execute each program, or may be a multitasking type or multithreading type CPU that can simultaneously execute multiple programs. Also good. Note that the acquisition unit F1 and the estimation unit F2 may be realized in hardware as a logic circuit.

The input/output interface 103 is a physical and logical wireless or wired interface used to connect the estimation device 100 with various other devices, and is, for example, a known interface such as a USB terminal, a LAN terminal, or a serial bus terminal. It can be realized as a terminal or a wireless receiving unit according to each wireless protocol. In the first embodiment, a display unit 21 having a liquid crystal panel, a display device 31, an electroencephalogram measuring device 41, and a concentration measuring device 42 are connected to the input/output interface 103 via signal lines, respectively. Note that the output device that outputs the estimated information may include a printing device that outputs, that is, prints the estimated impression on a printing medium, for example, paper, in place of or together with the display device 31. It's okay to be beaten.

Determining the estimation formula:
We analyzed the brain activity and level of excitement of 16 women when they viewed images of cosmetics. In the experiment for analysis, the procedure shown in Figure 5 was performed for the test subject, with one cycle consisting of presenting an image for 20 seconds and resting for 20 seconds, using five cosmetic images. An experiment was carried out to make the images visible. Prior to the actual test, one cycle was performed using a practice image, and then a total of two cycles were performed: one cycle using an "exciting image" and one cycle using a "non-exciting image." The "image that excites you" and the "image that does not excite you" are images prepared based on the survey results obtained by presenting the images to the aforementioned 16 women. In each cycle, while at rest after presenting the image, the subjects were asked to answer the appropriate level from the seven levels of the survey form shown in FIG. 6 as the degree of excitement. At the same time, the brain activity state was measured using an electroencephalogram measuring device 41 and a concentration measuring device 42. The seven-point evaluation obtained by the questionnaire is used as a Tokimeki score of 0 to 6 points.

Regarding brain activity, for both electroencephalograms and oxygenated hemoglobin concentration, the amount of change in the average value for 10 seconds during image presentation relative to the average value for 10 seconds before each image presentation, that is, the amount of change in brain activity, was calculated and analyzed. Using. As the average value for 10 seconds, a value per second obtained by dividing the total value of the electroencephalogram signal value and oxygenated hemoglobin concentration for 10 seconds by the measurement period of 10 seconds may be used, or a value per second may be used. A value divided by a number may also be used. Regarding brain waves, θ waves (4-7 Hz), α waves (8-13 Hz), β waves (20-25 Hz), and β/α, which is the ratio of α waves and β waves, were calculated. The average value of the excitement score for the 3 images with high excitement scores out of the 5 ``exciting images'', the average value of the amount of change in brain activity during image presentation, and the excitement score of the 5 ``images that are not exciting'' Partial least squares regression analysis (PLS) was performed using the average value of the excitement score and the average value of the amount of change in brain activity during image presentation for the three images with low values. Specifically, we performed partial least squares regression analysis using the average value of excitement scores as the objective variable and the amount of change in oxygenated hemoglobin concentration in the forehead and the amount of change in brain waves in the occipital region as explanatory variables, and calculated the degree of excitement from brain activity. We found an estimation formula to quantify the Note that for the oxygenated hemoglobin concentration, measurement values from a total of 10 channels, channel 7 to channel 16 shown in FIG. The average of the values was used.

As shown in FIG. 8, among the brain waves, the θ wave showed a negative amount of change in both the exciting image IMP and the non-exciting image IMN, and therefore was unsuitable as an index of the emotion of excitement. On the other hand, alpha waves showed a negative amount of change in the excited image IMP, and a positive amount of change in the non-exciting image IMN, confirming that they are appropriate as an indicator of the feeling of excitement. In addition, a positive amount of change in β waves was observed in the exciting image IMP, and a negative amount of change was observed in the non-exciting image IMN, so it was confirmed that it is more suitable as an index of the feeling of excitement. Therefore, alpha waves and beta waves were used as brain wave measurements. Further, as will be described later, it can be said that β waves, which show a positive change amount in relation to exciting images, are a more suitable indicator.

The basic equation of the estimation equation is as follows.
Degree of excitement = K7 (CH7) + K8 (CH8) + K9 (CH9) + K10 (CH10) + K11 (CH11) + K12 (CH12) + K13 (CH13) + K14 (CH14) + K15 (CH15) + K16 (CH16) + Kα (α wave) + Kβ (β wave) + Kαβ (β wave/α wave) + constant term (Equation 1)
Here, K7 to K16 are the regression coefficients of the corresponding channels CH, Kα is the regression coefficient of α waves, Kβ is the regression coefficient of β waves, and Kαβ is the regression coefficient of β waves/α waves. , each regression coefficient corresponding to the explanatory variables shown in FIG. 9 is used. Note that the regression coefficients corresponding to each explanatory variable shown in FIG. 9 are merely examples, and the regression coefficients are not limited to these coefficient values. (CHn) is the measurement value of each channel, (α wave) is the measurement value of α wave, (β wave) is the measurement value of β wave, (β wave/α wave) is the measurement value of β wave/α is the value of the wave. Depending on the explanatory variable used, a corresponding regression coefficient is applied to equation (1) and used. Note that the estimation formula may be determined by another linear regression method that approximates a straight line or by a generalized linear model such as logistic regression.

In the above estimation formula (Equation 1), the explanatory variables are (1) amount of change in oxygenated hemoglobin concentration (Oxy-Hb), (2) Oxy-Hb + α wave, (3) Oxy-Hb + β wave, (4) Oxy- When using Hb + β wave/α wave and (5) Oxy-Hb + α wave + β wave, respectively, the estimated value obtained by substituting the measured values obtained by the electroencephalogram measuring device 41 and the concentration measuring device 42, and the estimation formula ( We verified the correlation between the average value (actually measured value) of the excitement score used to obtain Equation 1). Figure 10 shows (1) the amount of change in oxygenated hemoglobin concentration (Oxy-Hb), Figure 11 shows (2) Oxy-Hb + α wave, Figure 12 shows (3) Oxy-Hb + β wave, and Figure 13 shows (4) ) Oxy-Hb+β wave/α wave, FIG. 14 is a graph when (5) Oxy-Hb+α wave+β wave is used as an explanatory variable (measurement parameter). In addition, the correlation coefficient R obtained for each explanatory variable is (1) Oxy-Hb: 0.536, (2) Oxy-Hb + α wave: 0.594, (3) Oxy-Hb + β wave: 0.639, (4) Oxy-Hb + β wave/α wave: 0.650, (5) Oxy-Hb + α wave + β wave: 0.726. Therefore, the estimated value obtained when using alpha waves or beta waves as the electroencephalogram information as an explanatory variable has a better correlation with the actual value than when using only Oxy-Hb as an explanatory variable. Furthermore, even better correlations are obtained when β waves are used as explanatory variables as EEG information, and even better correlations are obtained when α waves and β waves are used as explanatory variables as EEG information. Among them, it was verified that the best correlation was obtained when Oxy-Hb, alpha waves, and beta waves were used as explanatory variables, that is, the accuracy of estimating complex emotions could be improved the most.

Estimating complex emotions using an estimation device:
The estimation process executed by the estimation device 100 will be explained. FIG. 15 is a flowchart showing each processing step of the estimation process executed by the estimation device 100 according to the first embodiment. More specifically, this is realized by the CPU 101 executing the complex emotion estimation program Pr1.

First, in a state where the object to be tested to see whether or not the subject has exciting feelings is not brought into contact with the subject, that is, before the subject is brought into contact with the object, the CPU 101 transmits brain wave information via the input/output interface 103. Obtain (step S100). The acquired brain wave information is the average value of each brain wave component in the measurement period of 10 seconds before the subject comes into contact with the object, and the average value of each brain wave component is calculated in the brain wave measuring device 41 and sent to the input/output interface. 103, and the CPU 101 may calculate the average value of each brain wave component for 10 seconds input from the electroencephalogram measurement device 41. Furthermore, each brain wave component may be at least the measured value of a plurality of alpha waves and beta waves obtained from each electrode, or the average value of a single alpha wave and beta wave measured by each electrode, i.e. , an α-wave average value, and a β-wave average value. In the former case, the CPU 101 calculates an α wave average value and a β wave average value.

The CPU 101 obtains the oxygenated hemoglobin concentration from the concentration measuring device 42 (step S102). The obtained oxygenated hemoglobin concentration is the average value of the measured values in each channel during the 10 second measurement period before the subject comes into contact with the object, and the average value of the measured values in each channel in the concentration measuring device 42 is It may be calculated and input to the input/output interface 103, or the CPU 101 may calculate the average value of the measured values of each channel for 10 seconds input from the concentration measuring device 42. Although step S100 and step S102 are explained separately for ease of explanation, step S100 and step S102 are executed simultaneously, that is, during the same 10 second measurement period.

Next, after the subject comes into contact with the object for which it is desired to verify whether or not he/she feels excited, the CPU 101 acquires the amount of change in the brain wave information (step S104). Specifically, the average value of each brain wave component for 10 seconds after the subject came into contact with the object is acquired, and the average value of each brain wave component acquired before the subject came into contact with the object in step S100. The amount of change, ie, the difference, is obtained. The CPU 101 obtains the amount of change in oxygenated hemoglobin concentration (step S106). Specifically, the average value of oxygenated hemoglobin concentration for 10 seconds after the subject came into contact with the object is acquired for each channel, and in step S102, the average value of the oxygenated hemoglobin concentration for 10 seconds after the subject came into contact with the object is The amount of change in oxygenated hemoglobin concentration of the channel relative to the average value, that is, the difference, is obtained. Steps S104 and S106 are also performed simultaneously, ie during the same 10 second measurement period.

The CPU 101 uses the estimation formula (Formula 1) to obtain the estimated value of the complex emotion, in this embodiment, the "feeling of excitement" (step S108). Specifically, the values of the amount of change in alpha waves and beta waves, which are brain wave information, and the amount of change in oxygenated hemoglobin concentration, obtained in steps S104 and S106, are substituted into the estimation formula (Equation 1) as variables. Calculate estimated information of complex emotions. The calculated composite emotion estimation information takes, for example, an estimated value between 0 and 6, where 6 means that the degree of "excitement" is the strongest, and 0 means that the degree of "excitement" is the weakest. means. Note that as the estimation formula (Formula 1), it is preferable to use an estimation formula that uses β waves/α waves as variables related to brain wave information, and it is more preferable to use an estimation formula that uses α waves and β waves.

The CPU 101 displays the acquired composite emotion estimated value on the display unit 21 or the display device 31 as an output device (step S110), and ends this processing routine. The estimated impression value displayed on the display unit 21 or the display device 31 may be displayed as a value from 0 to 100, or may be replaced with a value from 0 to 10, or may be displayed by dividing 0 to 6 into seven levels. When the value is 5 and 6, it is replaced with the words "I feel excited", when the value is 0 and 1, it is "I don't feel excited", and when the value is 2 to 4, it is replaced with the words "I am neither". Also good.

As described above, according to the estimation device 100 according to the present embodiment, a pre-prepared estimation formula that uses as variables the amount of change in oxygenated hemoglobin concentration and brain wave information before and after the subject contacts the target object. Since complex emotions are estimated using the obtained change amount of oxygenated hemoglobin concentration and brain wave information, it is possible to appropriately estimate transient complex emotions caused by a complex combination of negative and positive emotions. can do. More specifically, in addition to the amount of change in oxygenated hemoglobin concentration, brain wave information, especially the average value of alpha waves and beta waves, or the average value of beta waves/alpha waves, is used, so negative emotions can be detected. It is possible to estimate a complex emotion that appropriately reflects the emotions and positive emotions. That is, alpha waves are exclusively useful for evaluating negative complex emotions, such as a decrease in the feeling of relaxation, or an increase in the feeling of agitation, and beta waves are useful for evaluating exclusively positive complex emotions, such as changes in the feeling of activity. In other words, it is useful for evaluating increases in happiness and enjoyment, and by using these brain wave components, it is possible to accurately estimate complex emotions that are a complex combination of negative and positive emotions. can. Furthermore, since the complex emotion can be estimated at the timing when the subject comes into contact with the object, it is possible to accurately estimate the transient complex emotion.

Other embodiments:
(1) In the above embodiments, the obtained estimated value may be shown numerically or graphically. When displayed as a graph, it is possible to prompt the user to grasp the estimation intuitively, and when displayed as a numerical value, the estimation can be shown more specifically and directly.

(2) In the above embodiment, the emotion of "excitement" is used as the complex emotion to be estimated, but other complex emotions such as "thrill" or "embarrassment" may also be used. . In this case, the level of the complex emotion can be estimated using the estimation formula (Formula 1) by having the experimental subject view the image or video and determining the regression coefficient using the method described above.

(3) In the above embodiment, the average value of each brain wave component obtained from each electrode was used for brain wave information, but the average value for each electrode or for each electrode group including multiple electrodes was used. Also good. Furthermore, for the oxygenated hemoglobin concentration, the average value of each channel was used, but the average value of each channel group including a plurality of channels may be used. It is desirable that the electrode group and the channel group are configured by adjacent electrodes and channels in order to improve the measurement significance. Furthermore, as the electroencephalogram information and oxygenated hemoglobin concentration, the median, maximum, mode, and minimum values may be used instead of the average value, and the measurement period of 5 seconds may be replaced with 10 seconds. , 15 seconds may be used, or even instantaneous values at predetermined points in time may be used.

Although the present disclosure has been described above based on various embodiments, the embodiments described above are for facilitating understanding of the present disclosure, and do not limit the present disclosure. This disclosure may be modified and improved without departing from its spirit or the scope of the claims, and this disclosure includes equivalents thereof.

DESCRIPTION OF SYMBOLS 10... Estimation system, 100... Estimation device, 101... Central processing unit (CPU), 102... Storage part, 21... Display part, 31... Display device, F1... Acquisition part, F2... Estimation part.

Claims (9)

An estimation device for estimating a temporary complex emotion caused by a complex combination of negative emotions and positive emotions,
an acquisition unit that acquires the amount of change in oxygenated hemoglobin concentration in the forehead region and brain wave information before and after the subject contacts the object;
an estimating unit that estimates the complex emotion using a pre-prepared estimation formula that uses the amount of change in the oxygenated hemoglobin concentration and the brain wave information as variables, and the obtained amount of change in the oxygenated hemoglobin concentration and the brain wave information; and,
An estimation device comprising: The estimation device according to claim 1,
The brain wave information includes at least an amount of change in α waves and an amount of change in β waves in the occipital region. The estimation device according to claim 2,
The estimating device wherein the brain wave information is an amount of change in β waves and an amount of change in α waves. The estimation device according to claim 2,
The estimating device wherein the brain wave information is an amount of change in β waves/α waves. The estimation device according to any one of claims 1 to 4,
The estimating device wherein the complex emotion is an emotion of excitement. The estimation device according to any one of claims 1 to 5,
The estimation formula calculates the amount of change in the oxygenated hemoglobin concentration when the subject views a plurality of pre-prepared images that make one feel the complex emotion and a plurality of pre-prepared images that do not make the subject feel the complex emotion. and an equation calculated by regression analysis using the electroencephalogram information as an explanatory variable and an objective variable as an actual value of a complex emotion using an image that makes you feel the complex emotion and an image that does not make you feel the complex emotion. An estimation system for estimating temporary complex emotions caused by a complex combination of negative emotions and positive emotions,
The estimation device according to any one of claims 1 to 6,
a concentration measuring device that measures the oxygenated hemoglobin concentration in the forehead;
An electroencephalogram measuring device that measures brainwave information,
an output device that outputs estimation information of the complex emotion estimated by the estimation device;
An estimation system comprising: An estimation method for estimating a temporary complex emotion caused by a complex combination of negative emotions and positive emotions,
Obtain the amount of change in oxygenated hemoglobin concentration in the forehead area and brain wave information before and after the subject comes into contact with the object,
estimating the complex emotion using a pre-prepared estimation formula that uses the amount of change in the oxygenated hemoglobin concentration and the brain wave information as variables, and the obtained amount of change in the oxygenated hemoglobin concentration and the brain wave information;
An estimation method comprising: An estimation program that estimates temporary complex emotions caused by a complex combination of negative emotions and positive emotions,
A function for acquiring the amount of change in oxygenated hemoglobin concentration in the forehead area and brain wave information before and after the subject comes into contact with the object;
Estimating the complex emotion using a pre-prepared estimation formula that uses the amount of change in oxygenated hemoglobin concentration and the brain wave information as variables, and the acquired amount of change in the oxygenated hemoglobin concentration and the brain wave information. An estimation program that realizes functions using a computer.

Images