JP6859010B2 - Time-lapse sensory evaluation system and time-lapse sensory evaluation method - Google Patents

Description

The present invention relates to a temporal sensory evaluation system and a temporal sensory evaluation method.

There are known methods for grasping a psychological state from eye-gaze measurement and analyzing interest in each type of product (see, for example, Patent Documents 1 and 2 and Non-Patent Documents 1 and 2).

Patent Document 1 is a questionnaire system that collects questionnaire response information from questionnaire respondents, and includes a display unit that displays the questionnaire response results on a display screen, a touch sensor, a gyro sensor, and an acceleration sensor. A questionnaire response device having at least one physical sensor selected from a pressure sensor, an illuminance sensor, a camera, and a sound collecting microphone, and a server device capable of connecting to the questionnaire response device via a communication line are provided for a questionnaire. The answer information acquisition means for acquiring the answer information regarding the physical operation of the questionnaire answer device and / or the external situation of the questionnaire answer device detected by the answer device, and the answer information acquired by the answer information acquisition means. A display means for displaying the answer result of the questionnaire on the display screen and an answer information transmitting means for transmitting the answer information to the server device are provided, and the server device receives the answer information transmitted from the questionnaire answer device. A questionnaire system including an answer information receiving means for receiving an answer and an answer information storing means for storing the answer information received by the answer information receiving means is described.

Patent Document 1 provides a questionnaire answering device having a display unit for displaying answer results and a physical sensor having a line-of-sight tracking function, etc. As a result of the questionnaire, we will collect information on potential thoughts, consciousness, tendencies, desires, etc. that the respondents themselves have not clearly recognized. " Regarding the line of sight, "Products that the respondent has been looking at for a long time, products that have been the first to look at, products that have been the last to stay in the line of sight after looking at each product, etc. are recommended to the respondents. It is also possible to send product information about the product to the questionnaire response device 1 to encourage the purchase of the product ”(paragraph 0121).

Patent Document 2 includes a display means for displaying a question in a questionnaire, an input means for inputting an answer to the question, and a reaction time measuring means for measuring the reaction time from the time when the question is displayed to the time when the answer is input. , Answers and reaction times are associated and stored as input data, and answers are aggregated based on input data obtained from a plurality of respondents stored in the storage means to obtain question results and reactions. A questionnaire analyzer including an analysis means for obtaining a predetermined analysis index for time and an output means for outputting at least a predetermined analysis index for reaction time in a predetermined format as an analysis result by the analysis means is described.

In Patent Document 2, in addition to measuring the reaction time from the time when the question is displayed in the questionnaire response (manual) to the time when the answer is input, the response focuses on the movement of the respondent's line of sight and the gaze point. It is described that the psychology of a person is quantified and expressed. Regarding gaze measurement, "Predetermined analytical indexes related to gaze are gaze time, number of round trips, target gaze time, number of gaze points, selection start-reaction time difference, selection start-reaction gaze distance, reaction gaze position, within the target. It is desirable to include at least one of the number of gaze points, statistical pupil diameter, gaze time in non-target area, number of blinks, and initial gaze ”(paragraph 0019), which was generally preferred in the examples. Is described as "when selected, it is selected rather quickly (reaction time), and the gaze time of the image of the object is long" (paragraph 0113).

In Non-Patent Document 1, the relationship between the order in which consumers turn their eyes and the residence time and the preference for products is verified. This document suggests that a relationship was found between the residence time in the product and the high palatability.

In Non-Patent Document 2, the line of sight when manually answering the sensory evaluation questionnaire is measured, and the relationship between the movement of the line of sight and the answer result is examined. This document suggests that differences in eye movements do not affect response evaluation results.

International release WO2014 / 185423 Japanese Unexamined Patent Publication No. 2014-81913

Food Quality and Preference 39 (2015) 46-55 Food Quality and Preference 48 (2016) 185-194 AROMA RESEARCH No. 53 Vol. 14 (No. 1 2013) 29-35

Neither Patent Documents 1 and 2 and Non-Patent Documents 1 and 2 intentionally pay close attention to the options (evaluation items, etc.) to be answered, and describe the time resolution of sensory evaluation and the switching speed of evaluation items. There was no.

On the other hand, as a sensory evaluation method for capturing changes over time, a method called TDS (Temporal Dominance of Senations) is known (see Non-Patent Document 3). The TDS method is a method in which a subject selects the flavor that he / she feels most strongly at a certain point in time, and averages and clearly indicates the change over time in the flavor selected by each subject. The method introduced in Non-Patent Document 3 is the most at that time among the evaluation items (words) showing the sensory characteristics presented on the PC (personal computer) screen when the test object is continuously sensory evaluated. This is a method in which a strongly felt evaluation item is manually selected by manually operating an input means, sensory evaluated, and the selection result is continuously recorded. However, the method of manually operating the input means introduced in Non-Patent Document 3 requires an operation using a mouse click or a finger such as a touch panel as a method of selecting a flavor, and is an operation of flavor evaluation and manifestation of intention. It was a difficult method to evaluate, as it had to be done in parallel. In fact, on page 33 of Non-Patent Document 3, "I don't feel uncomfortable, but it takes more training and familiarity to select the term I want to select in real time." It is stated that there was a problem such as "No".

As described above, the conventional sensory evaluation system over time has been required to be further improved in terms of increasing the time resolution of the sensory evaluation.

An object to be solved by the present invention is to provide a novel sensory evaluation system over time that can be suitably used for sensory evaluation over time.

As a result of diligent studies to solve the above problems, the present inventors have conducted sensory evaluation of a test object over time based on two or more evaluation items, and the present inventors have two or more subjects. When selecting an evaluation item by directing the line of sight to any of the evaluation items of, the subject identifies the evaluation item to which the line of sight is directed by gaze measurement, and the subject is directing the line of sight to the evaluation item. It was found that the above-mentioned problems can be solved by associating the time zone with the evaluation items in the line-of-sight retention time zone.

Specifically, the present invention and preferred configurations of the present invention are as follows.
[1] A temporal sensory evaluation system used for a temporal sensory evaluation in which a subject evaluates a test object in a temporal sensory evaluation based on two or more visually presented evaluation items.
Based on the measured information on the subject's line of sight, the subject directs his / her gaze to the specific means for identifying the evaluation item to which the subject is looking, and the evaluation item specified by the specific means. A temporal sensory evaluation system comprising an associating means for associating a line-of-sight residence time zone with the evaluation item in the line-of-sight retention time zone.
[2] The time-dependent sensory evaluation system according to [1], wherein the evaluation item is sensory information or impression information.
[3] The time-dependent sensory evaluation system according to [1] or [2], wherein the evaluation item is sensory information perceived by the sense of smell, taste, or both.
[4] The time-dependent sensory evaluation system according to [3], wherein the subject's line of sight is measured by the line-of-sight measuring means.
[5] Each of the evaluation items has different feature portions that can be distinguished by image recognition of the line-of-sight measuring means, and the line-of-sight measuring means recognizes the evaluation item as an image and detects the type of the feature portion. The temporal sensory evaluation system according to [4], which identifies the evaluation items based on the above-mentioned evaluation items.
[6] The time-dependent sensory evaluation system according to any one of [1] to [5], comprising a recording means for recording the line-of-sight residence time zone and evaluation items in the line-of-sight residence time zone.
[7] The temporal sensory evaluation system according to any one of claims [1] to [6], which has an output means for outputting a graph or a table based on the association result.
[8] The temporal sensory evaluation system according to any one of [1] to [7], which has an analysis means for deriving the number of switchings or switching speeds of evaluation items based on the association result.
[9] A temporal sensory evaluation method in which a subject evaluates a test object in a temporal manner based on two or more evaluation items visually presented.
The measurement process for measuring the line of sight of the subject and
A specific step of identifying the evaluation item to which the subject is looking, based on the measured information on the subject's line of sight, and
A time-dependent sensory evaluation method including a step of associating a line-of-sight retention time zone in which the subject is looking at the identified evaluation item with the evaluation item in the line-of-sight retention time zone.
[10] The time-dependent sensory evaluation method according to [9], wherein the specification of the evaluation item is repeated two or more times.
[11] The time-dependent sensory evaluation method according to [9] or [10], wherein the test object is a food or drink, a cosmetic or a flavor.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a novel sensory evaluation system over time, which can be suitably used for sensory evaluation over time.

FIG. 1 is a diagram showing evaluation items used in Example 1. FIG. 2A is a graph showing the analysis result of the line-of-sight method (selection of evaluation items by line-of-sight) of Example 1 for the gummy A as a stacked bar graph of the actual line-of-sight retention time zone. FIG. 2B is a graph showing the analysis result of the line-of-sight method of Example 1 for the gummy B as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 3A is a graph showing the analysis result of the hand-pushing method (selection of evaluation items by mouse click) of Comparative Example 1 for the gummy A as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 3B is a graph showing the analysis result of the hand-pushing method of Comparative Example 1 for the gummy B as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 4 is a diagram showing the evaluation items used in Example 2. FIG. 5 is a graph expressing the analysis result of the line-of-sight method in the first sensory evaluation of Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 6 is a graph expressing the analysis result of the line-of-sight method in the second sensory evaluation of Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 7 is a graph expressing the analysis result of the hand-pushing method in the first sensory evaluation of Comparative Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 8 is a graph expressing the analysis result of the hand-pushing method in the second sensory evaluation of Comparative Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 9 is a scale used as an answer column for Q1 in the subject's subjective evaluation questionnaire. FIG. 10 is a scale used as an answer column for Q2 in the subject's subjective evaluation questionnaire. FIG. 11 is a scale used as an answer column for Q3 in the subject's subjective evaluation questionnaire.

Hereinafter, the present invention will be described in detail. The description of the constituent elements described below may be based on typical embodiments or specific examples, but the present invention is not limited to such embodiments. In this specification, the numerical range represented by using "~" means a range including the numerical values before and after "~" as the lower limit value and the upper limit value.

[Sensory evaluation system over time]
The temporal sensory evaluation system of the present invention is a presentation means for presenting two or more evaluation items related to a test object to a subject, and the subject temporally evaluates a test object based on two or more evaluation items. When the subject selects an evaluation item by directing his / her line of sight to one of two or more evaluation items, the line-of-sight measuring means for identifying the evaluation item to which the subject is looking at, and the subject as the evaluation item An associating means for associating the line-of-sight residence time zone in which the line of sight is directed with the evaluation item in the line-of-sight retention time zone is provided.

With this configuration, the temporal sensory evaluation system of the present invention can be suitably used for sensory evaluation over time. In particular, the temporal sensory evaluation system of the present invention preferably has a high time resolution of sensory evaluation. The "time resolution" of the sensory evaluation means "the frequency with which the evaluation items selected in one sensory evaluation are switched".

The time-dependent sensory evaluation method may need to respond in a timely and quick manner according to what is felt from the subject, for example, changes in various sensations, emotions, impressions, and the like. A series of manual operations such as "eating" and "clicking" is complicated for the subject, and there is a discrepancy between the timing when the subject feels that it is present and the timing when the subject responds to the feeling. There was a problem that the sensory evaluation over time was not properly performed, such as not being able to answer all the flavors that were felt due to the lack of operation time.

On the other hand, the present invention is an invention that can provide a means for solving this problem. Due to the high time resolution of the sensory evaluation, it is possible to perform the sensory evaluation that more reflects the consciousness and intention of the subject. Specifically, in the present invention, by using the line-of-sight measuring means, the burden of manual work of the subject is reduced, the manifestation of intention is relatively easy, and an immediate answer is made possible to change the consciousness and intention of the subject. It can be communicated quickly and easily (build an environment where you can concentrate on sensory evaluation). As a result, the accuracy and detail of the sensory evaluation over time can be significantly improved. Furthermore, due to the high time resolution of sensory evaluation in the temporal sensory evaluation system of the present invention, evaluations that have been overlooked in conventional manual sensory evaluations (new evaluation answers and accurate identification of evaluation switching timings) ) Can also be confirmed.

It should be noted that the excellent "speed of switching of evaluation items" is also a secondary effect of the present invention. The "speed of switching" means "the speed at which the selected evaluation item switches to another evaluation item". It is also a secondary effect of the present invention that the workload of the subject can be reduced. Furthermore, since the system of the present invention can reduce the movement by eliminating the manual work as compared with the conventional temporal sensory evaluation, it operates on the physiological response data even if various physiological response data are acquired in parallel as described later. There is also an advantage that the influence of is hard to come out.

Hereinafter, preferred embodiments of the temporal sensory evaluation system of the present invention will be described.

<Test object>
The test object is not particularly limited. The temporal sensory evaluation system of the present invention as long as what can be felt from the subject (for example, various sensations, emotions, impressions, etc.) can be changed over time for the subject presented with the subject. Can be used particularly preferably, but it may not change with time.

The test object may be tangible or intangible. If it is tangible, various articles can be mentioned, and if it is intangible, various information such as voice, music, image, and video can be mentioned.

Specific examples of goods include various consumer goods. More specifically, foods and drinks, cosmetics, fragrances, health products, furniture, various electric appliances used by humans, clothing, pharmaceuticals and the like can be mentioned. Alternatively, a combination of two or more of these may be used. Among these, the test object is preferably a food or drink, a cosmetic product, or a flavoring agent. These are because their flavors and aromas are likely to change over time. The temporal sensory evaluation system of the present invention can be used particularly effectively when the transition of what a human can perceive from a test object is rapid, and is particularly suitable for foods and drinks in which a wide variety of flavor transitions occur rapidly due to eating. Can be used.

Examples of foods and drinks include various alcoholic beverages, soft drinks, nutritional supplements, confectionery, delicatessen, retort pouch foods, bread, rice, etc. Examples of cosmetics include various perfumes, detergents, and softeners. Agents, health products, etc. can be mentioned, but are not limited to these. The perfume is not particularly limited as long as it can be used for the purpose of perfume in foods and drinks, cosmetics and other articles.

<Presentation means>
The temporal sensory evaluation system includes a presentation means for presenting two or more evaluation items related to the test object to the subject.

The presentation means is not particularly limited as long as it can present two or more evaluation items related to the test object to the subject. The presenting means may be a two-dimensional plane or a three-dimensional solid.

Examples of the presentation means include a touch panel, a display attached to a PC, a television, a whiteboard, a blackboard, paper, wood, plastic, and a projected object capable of projecting an image. When the evaluation item is three-dimensional, the presentation means may be defined as a plane or space on which the evaluation item is arranged.

The presentation means is preferably a display capable of projecting an image such as a touch panel, a personal computer, or a television, or a projected object capable of projecting the image. It is preferable to present a figure or an image in which two or more evaluation items are arranged on a display or a screen of a projected object.

In addition to the evaluation items, the elements that the presenting means can include include a gazing point and a blank part (that is, a part that is not an evaluation item or a gazing point). It is more preferable that the presentation means includes one or more selected from the gazing point and the blank portion in addition to the evaluation items. Further, it is particularly preferable that the evaluation item, the gazing point, and the blank portion are composed only.

Hereinafter, preferred embodiments of these elements will be described in detail.

(Evaluation item)
Two or more evaluation items are presented to the subject by the presentation means, and the subject selects the evaluation item by directing the line of sight in the sensory evaluation. The evaluation items are not particularly limited as long as they can be visually identified.

The evaluation item is not particularly limited as long as it represents a viewpoint to be evaluated for the test object (sometimes abbreviated as an evaluation viewpoint in the present specification).

The evaluation item may be, for example, what the subject can feel by receiving a stimulus by presenting the test object, and the sensation felt from the test object (for example, the sense of sight, hearing, taste, and smell that can be perceived by a human sensory organ). , Tactile sensation, warm sensation, cold sensation, texture, balance sensation, somatic sensation, etc.), emotional sensation felt by the test object, or impression of the test object.

More specifically, sensory terms, phrases, sentences, or other information (sweet, cold, soft, smooth, etc.) that can be felt from the subject; emotional terms, phrases, sentences, or other information (swelling). Or luxury, calmness, anxiety, etc.); Impression terms, phrases, sentences, or other information such as color (each color or color name identifiable by the subject, such as red, blue, yellow), shape (square, etc.) Polygons, circles including ellipses, donuts, and other non-standard two-dimensional shapes, or three-dimensional shapes or shape names), patterns (two-dimensional or three-dimensional patterns or textures or their names); photographs or pictures, etc. Images (including landscapes, animals, still objects, people, etc.), sentences, phrases such as proverbs and poems, various proper nomenclature (seasons, country / region names, person names, various product names such as food and drink and cosmetics) , Song title, etc.), light brightness, etc. In addition, images related to sensations, emotions, and impressions (including landscape images, images of objects and patterns, and moving images) may be used, and various pictograms such as pictograms, icons, and pictograms displayed on mobile phones, smartphones, and the like may be used. A combination of two or more of these may be used.

The evaluation item may be a group of terms including a plurality of terms that can give rise to the same sensation. For example, one evaluation item can be configured by arranging a plurality of terms such as "forest, mountain, grassland" adjacent to each other as a group of terms that make the image of a plant.

Alternatively, the evaluation item may be a group of terms including a plurality of evaluation viewpoints that the subject can feel at the same time. For example, a group of terms composed of emotion and color information such as "refreshing + light blue" or "energetic + yellow" can be set as one evaluation item.

The evaluation item may have an arbitrary shape, and may have a flat surface or a three-dimensional structure. When the evaluation item is an image or an image, it may be a flat image or an image or an image or an image that can be viewed stereoscopically.

Further, among the two or more evaluation items, there may be an evaluation item indicating that nothing is felt, or an evaluation item indicating that there is no applicable item.

In the present invention, it is preferable that the evaluation item is sensory information or impression information. As the term of the sensory information, any term of the sense sense felt by the five senses can be used, and among them, the flavor term is preferable. Flavor means the sensations felt by the sense of smell, taste, or both. Flavor terms may be aroma, taste, or both.

Since the evaluation items are selected by the subject by directing the line of sight, it is difficult to direct the line of sight when the evaluation viewpoint is expressed by characters or symbols, or when the area is small such as by using a small image as the evaluation viewpoint. In some cases, it may be difficult to identify the evaluation item to which the subject is looking by the line-of-sight measuring means (described later). In that case, the evaluation viewpoint can be posted in a plane or three-dimensional figure of an arbitrary shape having a certain area, and the entire figure can be defined as an evaluation item selected by the subject with his / her line of sight. The shape of the figure can be arbitrarily designed according to the characteristics of the evaluation viewpoint itself.

The size of the figure is arbitrary, and may be appropriately adjusted so that the subject can easily direct his / her line of sight.

The shape of the figure is also arbitrary, but it is preferable that each figure has the same size from the viewpoint of making the ease of directing the line of sight the same and improving the accuracy of the sensory evaluation.

There is no particular limitation on the mode in which the evaluation viewpoint is posted in the figure, and the evaluation viewpoint is displayed in a plane figure formed of various lines including dotted lines, wavy lines, and broken lines, and is composed of a cloth or plastic sheet or a solid. Examples include a mode of posting by pasting on a figure to be displayed, a mode of posting in a square frame of a display, and the like.

1 and 4 show specific examples when the figure is used as an evaluation item. In FIG. 1, each evaluation viewpoint (flavor term in FIG. 1) is posted in the broken line quadrangle, and the entire broken line quadrangle is defined as an evaluation item selected by the subject with his / her line of sight. Similarly, in FIG. 4, the entire quadrangle formed by a straight line is defined as an evaluation item.

Examples of evaluation viewpoints that are not necessarily considered to be highly necessary to be posted in figures include color samples, shapes, patterns, images, lights, and images that can occupy a certain area or more by themselves. However, these may also be posted in the figure.

The evaluation items may be arranged in any presentation means, but it is preferable that the evaluation items are arranged in the same manner in terms of the required time and ease of movement of the line of sight from the viewpoint of the subject during the sensory evaluation to each evaluation item. .. For example, it is preferable to arrange the presentation means so that any point, for example, the shortest distance from the center of the presentation means to each evaluation item is equal. Further, when moving the line of sight from one evaluation item to another, it is preferable to arrange the line of sight so that it is difficult for the line of sight to pass over the evaluation items that are not intended to be selected. As the arrangement of each evaluation item, a grid pattern (mesh) shape, a radial shape, a random shape, a linear shape, a regular polygonal shape, a circle or an arc shape can be exemplified.

-Features-
A feature unit may be provided for the evaluation item. In particular, when the eye-gaze measuring means described later distinguishes which evaluation item the subject is looking at by image recognition of each evaluation item, a feature portion is provided for the evaluation item from the viewpoint of ensuring the accuracy of the evaluation. Is preferable.

In image recognition by the line-of-sight measuring means, the evaluation items may be identified based on the difference between two or more evaluation items that are different from each other, but it is difficult to identify by image recognition because the difference between the evaluation items themselves is small. If it seems, it is preferable that each of the evaluation items has different feature portions that can be distinguished by image recognition of the line-of-sight measuring means. For example, it is more preferable to design each evaluation item so that it can be easily identified as an image by different colors and patterns of the evaluation items (that is, the above-mentioned evaluation viewpoint itself or the above-mentioned figure on which it is posted). That is, the feature unit makes it easy to distinguish the evaluation items from each other, which is different from the evaluation items themselves. It is preferable that the feature portion is different from the evaluation viewpoint itself or the silhouette (outer frame) of the above-mentioned figure on which the evaluation viewpoint itself is posted. Among these, it is preferable that the feature portion is designed so that each evaluation item can be easily identified as an image as being different from each other by adding a pattern or a symbol. If the silhouettes and sizes of the evaluation items are significantly different from each other, there may be a difference in the ease of gazing of the subject. Therefore, it is particularly preferable to add patterns and symbols without changing the size and silhouette of the evaluation items.

(Note)
It is preferable that the presentation means is provided with a gazing point at an arbitrary position.

The gaze point can be used to indicate that it is before the start point of the sensory evaluation in the first stage of the sensory evaluation and that it is the end point of the end of the sensory evaluation in the final stage. For example, by asking the subject to look at the gazing point between the start of the sensory evaluation of the test object and the first look at the evaluation item, and after the sensory evaluation is completed, other than that. It can be guaranteed that the time zone indicates the intention about the sensory evaluation of the test object. That is, the start point and end point of the sensory evaluation can be clarified. Providing a gazing point also has the advantage of eliminating the need for additional movements (vocalization, raising hands, etc.) of the subject to indicate the end point at which the sensory evaluation has been completed. As a result, the end point of the sensory evaluation can be clarified, the time resolution of the sensory evaluation can be made higher, and the workload of the subject can be reduced.

When setting a gaze point to the above purpose, make sure that the shortest distance from the gaze point to each evaluation item is the same so that the line of sight from the gaze point does not change. It is preferable to arrange it. As such an arrangement of each evaluation item, a regular polygonal shape or a circular shape in which the gazing point is aligned with the center of gravity of the figure can be exemplified. However, if the number of evaluation items to be placed on the screen of the presentation means is large, it is not necessary to place the gaze points so that the shortest distances from the gaze points to all the evaluation items are the same. The gazing point may be arranged so that the shortest distances to a plurality of evaluation items are equal.

(Blank part)
From the viewpoint of the accuracy of image recognition, it is preferable that the presentation means is provided with a blank portion (hereinafter, blank portion) between each evaluation item. However, it is preferable to appropriately adjust the size (width, length, area, etc.) of the blank portion so that the time required for moving the line of sight from one evaluation item to another evaluation item does not become too long. The time resolution of the sensory evaluation can be further improved by adjusting the size of the blank portion to a certain size so that the moving time of the blank portion of the line of sight does not become too long.

<Gaze measuring means>
In the temporal sensory evaluation system of the present invention, when a subject temporally evaluates a test object based on two or more evaluation items, the subject directs his / her eyes to one of the two or more evaluation items. When the evaluation item is selected, the line-of-sight measurement means for specifying the evaluation item to which the subject is looking is provided.

In the present invention, it is assumed that the evaluation item is selected when the subject is looking at the evaluation item.

The line-of-sight measurement means is not particularly limited, and any mechanism may be used as long as it can detect the line-of-sight (where in the field of view) of the subject. The line-of-sight measuring means can be arbitrarily selected according to the characteristics of the presenting means and the evaluation item. In the line-of-sight measuring means, it is preferable to perform the line-of-sight detection process of the subject by using software attached to the line-of-sight measuring means, other arbitrary software or a program executed by the CPU of a general-purpose PC, or the like.

Usually, the line-of-sight measuring means detects the movement of the eyes of the subject (preferably the movement of the pupil) to grasp the direction of the line of sight, and detects the place where the line of sight is directed in the field of view of the subject. At that time, usually, a line-of-sight measuring means including a means for detecting the visual field (for example, a camera) and a means for detecting the movement of the pupil is used. The means for detecting the visual field and the means for detecting the movement of the pupil may be integrated or separate, and the number of each may be arbitrary.

As the form of the line-of-sight measuring means, eyeglass type, headset type, display type, and all other forms that can be used can be used in the present invention. The line-of-sight measuring means may be a stationary type or a portable type. Among the portable types, a wearable type that can be worn by the subject is preferable from the viewpoint that the movement of other parts of the subject's body is less likely to be reflected in the means for detecting the movement of the pupil (for example, a camera). Among them, the eyeglass type is more preferable. The eye for measuring the line of sight may be binocular or monocular. In the case of one eye, it does not matter whether it is the left or right eye, but depending on the person, it may be difficult for one eye to move the line of sight as intended compared to the other. It is preferable to examine the eye on the side showing the intended line of sight in advance and to measure the eye showing the intended line of sight of the subject.

In addition, you may use two or more kinds of line-of-sight measurement means in combination.

The line-of-sight measuring means preferably includes a line-of-sight calibration means. As the line-of-sight calibration means, any software such as software attached to the line-of-sight measurement means, any other software or program executed by the CPU of a general-purpose PC can be used.

As described above, the line-of-sight measuring means preferably has a function of distinguishing different evaluation items such as characters and designs from each other by image recognition. That is, it is preferable that the line-of-sight measuring means includes an image recognition means. As the image recognition means, as with the calibration means, any software such as software attached to the line-of-sight measurement means and any other software or program executed by the CPU of the general-purpose PC can be used. It is more preferable that the line-of-sight measuring means identifies the evaluation item based on the type of the feature portion detected by image-recognizing the evaluation item.

The sampling rate of the line-of-sight measuring means is not particularly limited. A line-of-sight measuring means having a sampling rate of about 25 to 2000 Hz is usually available, and the number of evaluation items, the viewpoint of wanting to evaluate the test object, and the subject can be felt from the test object (when the test object is food or drink). , Flavor, etc.) may be set appropriately according to the purpose and / or the solution problem such as the characteristics of expression. Generally, the higher the sampling rate, the faster the eye movements can be captured.

<Association means>
The temporal sensory evaluation system of the present invention includes associating means for associating the time when the subject is looking at a certain evaluation item (referred to as the line-of-sight retention time zone) with the evaluation item in that time zone.

By this association, it is possible to obtain data on how the evaluation viewpoint of the test object, which is represented by two or more evaluation items, changes over time.

The association method is not particularly limited. As the associating means, for example, software attached to the line-of-sight measuring means, other arbitrary software or a program executed by the CPU of a general-purpose PC, or the like, which can perform a process of associating a line-of-sight retention location with time can be mentioned. Two or more of these may be used in combination. In the description of various parts of the present specification such as the associating means and the recording means, "PC" is an example of a device having a CPU, and in the present invention, a device having a CPU other than the PC may be used instead of the PC. Examples of devices having a CPU other than a PC include PDAs, mobile phones, smartphones, game consoles, televisions, and the like.

By using the software attached to the line-of-sight measuring device as the associating means, the line-of-sight retention time zone for a certain evaluation item and the evaluation item in that time zone are continuously recorded in the recording means (described later), so that both are used. It is preferable to associate. Further, the association result may be output to the output means (described later) in real time, or may be output later.

<Recording means>
It is preferable that the temporal sensory evaluation system of the present invention includes a recording means for recording the line-of-sight residence time zone and the evaluation items in the line-of-sight residence time zone.

When the storage area of the PC is used as the recording means for recording the line-of-sight retention time zone and the evaluation items in the line-of-sight retention time zone, each type of obtained data can be stored in the internal storage area of the PC. When storing, it is preferable to record the line-of-sight retention time zone and the evaluation items in that time zone in a state of being linked by the above-mentioned association means. Alternatively, the information may be stored in an arbitrary external storage device connected to the PC via an arbitrary cable or USB, and the information is transmitted to the server device via the communication line, and the server device has a receiving function and a recording means. It may be stored in. Examples of the recording means include a memory, a hard disk, and various disks.

<Output means>
The temporal sensory evaluation system of the present invention may further include an output means for outputting the result of associating the line-of-sight retention time zone in which the subject is looking at the evaluation item with the evaluation item in the line-of-sight retention time zone. preferable.

The output means is not particularly limited, and may be, for example, a means for outputting the analysis result of the association in a format that is easy to see. For example, software attached to the line-of-sight measuring means, or any other software or program executed by the CPU of a general-purpose PC may be used. Examples of the output format include, but are not limited to, text format, csv format, xls or xlsx format, doc format or docx format, pdf format, and the like.

As a further specific example of the output means, for example, a display can be used, and a display attached to a PC having software and / or a CPU used as an association means may be used, or another display may be used. As another specific example, a printer and a projector can be mentioned.

One or more of the output means illustrated above can be used in combination.

The association result stored in the above-mentioned recording means can be read and output by the output means, or the association result can be directly output by the output means in real time.

The output means may output the association result in any expression. For example, a stacked bar graph, a numerical table, a circle or donut graph, a radar chart, a bubble graph, a line graph, etc. showing the relationship between each evaluation item and its line-of-sight residence time can be exemplified. The temporal sensory evaluation system of the present invention preferably has an output means for outputting a graph or table based on the association result. In the expression, it may be expressed as the length of the line-of-sight residence time zone for each evaluation item, or may be expressed as the ratio of the line-of-sight residence time zone between the evaluation items, and a desired expression mode can be adopted.

<Analysis means>
The temporal sensory evaluation system of the present invention may further include means for performing various analyzes based on the result of associating the evaluation item with the line-of-sight residence time.

In the analysis means, for example, the number of times that the evaluation item in the line-of-sight residence time zone is switched over time may be derived. For example, it is useful when it is desired to grasp the number of times the evaluation items are switched as an index of the changeability of the flavor of the food or drink (test object).

An analysis may be performed to derive yet another parameter by using the derivation result of the number of times that the evaluation item is switched over time in the line-of-sight retention time zone. Other parameters include the type of evaluation item and the speed at which the evaluation item is switched. The type of evaluation item can be derived as the number of evaluation items that the subject is looking at (selected). The speed of switching of evaluation items can be derived as the number of times of switching of evaluation items per unit time.

The analysis means may be capable of performing a plurality of analyzes as illustrated above. It is preferable that the temporal sensory evaluation system of the present invention has an analysis means for deriving the number of switchings or the switching speed of evaluation items based on the association result.

The analysis means is not particularly limited, and examples thereof include software attached to the line-of-sight measurement means, arbitrary statistical analysis software, software used as the association means, and / or general-purpose software attached to a PC having a CPU. ..

Further, the result analyzed by the analysis means may also be output in any format by the above-mentioned output means. There are no particular restrictions on how to express the analysis results, and graphs, numerical tables, numerical lists listing numerical values, etc. may be used.

<Other devices>
The temporal sensory evaluation system may include other devices.

Examples of other devices include a means for reinforcing the manifestation of intention by the line of sight, a physiological response measuring device other than the line-of-sight measuring means, and the like.

As a means for reinforcing the manifestation of intention by the line of sight, for example, an input means such as a button or a mouse can be mentioned.

Physiological response measuring devices that can be combined with the temporal sensory evaluation system of the present invention include brain activity measuring devices such as NIRS and MRI; temperature measuring devices such as thermista sensors, thermocouple sensors, and thermography; sphygmomanometers; A device that captures electrical signals derived from the movement of a living body, for example, a device that acquires an electrocardiogram, an electrocardiogram, an electrocardiogram, or a gastrocamera; a pulse wave meter; a sphygmomanometer; a blood flow meter; It may be ancillary); a sphygmomanometer; a sphygmomanometer; etc.

The advantage of combining the temporal sensory evaluation system of the present invention with other physiological response measuring devices is that it is possible to use hands; it is possible to attach a biological sensor (such as a temperature sensor) to a finger or hand. Compared to the case where the hand is used for evaluation, the physiological response noise associated with the movement of the hand and body can be reduced, so that the sensory evaluation and the physiological response can be measured at the same time; like MRI. It is possible to express the intention when measuring the physiological response that requires a lot of restraint (except when it is not applicable, such as when the parts of the line-of-sight measurement means contain metal); There is a possibility of picking up brain activity that occurs only by the act of moving a hand such as activity, but if evaluation is performed by eye, it is possible to measure without causing such unnecessary brain activity; it can.

[Sensory evaluation method over time]
The temporal sensory evaluation method of the present invention is a presentation step of presenting two or more evaluation items related to a test object to a subject, and the subject temporally evaluates the test object based on two or more evaluation items. A sensory evaluation step in which a subject selects an evaluation item by directing his / her line of sight to one of two or more evaluation items, a line-of-sight measurement step in which a subject identifies an evaluation item to which his / her line of sight is directed. It also includes an association step of associating the line-of-sight retention time zone in which the subject is looking at the evaluation item with the evaluation item of the line-of-sight retention time zone.

With this configuration, the temporal sensory evaluation method of the present invention can be suitably used for sensory evaluation over time. In particular, the temporal sensory evaluation method of the present invention preferably has a high time resolution of sensory evaluation.

Hereinafter, preferred embodiments of the temporal sensory evaluation system of the present invention will be described. The preferred embodiment of the temporal sensory evaluation method of the present invention is basically the same as the preferred embodiment of the temporal sensory evaluation system of the present invention.

<Presentation process>
The temporal sensory evaluation method of the present invention includes a step of presenting a presentation means including two or more evaluation items to a subject. The presentation means and preferred embodiments of the respective elements are as described above.

In the presentation step, it is preferable to arrange the presentation means so that each evaluation item can be equally easily directed by the subject from the viewpoint of ensuring the accuracy of the sensory evaluation. Specifically, the positional relationship between the subject's viewpoint and each evaluation item (distance, height, angle, etc.), the brightness of the placement location of the presentation means, etc. are adjusted so that the ease of directing the line of sight is optimized. This is preferable from the viewpoint of ensuring the ease of directing the line of sight and making it easier for the subject to reflect what he / she felt from the test object in the sensory evaluation.

<Sensory evaluation process>
The temporal sensory evaluation method of the present invention is a sensory evaluation step in which a subject temporally evaluates a test object based on two or more evaluation items, and the subject has any of two or more evaluation items. It includes a sensory evaluation step of selecting evaluation items and performing sensory evaluation by looking at the crab. In the sensory evaluation step, it is preferable to have the subject select an evaluation item by directing his / her eyes to an evaluation item that applies to what he / she felt from the test object, such as sensation, emotion, and impression.

In the present invention, the subject is directed to the evaluation item that he / she felt most strongly about the test object, for example, the evaluation item that he / she felt most strongly when he smelled the scent or the evaluation item that he felt most strongly when he ate food or drink. By selecting, teach them to keep their eyes on the evaluation item while they can feel the evaluation item, and the time zone in which they keep looking at the evaluation item is the time when the evaluation item is selected. The band (that is, the line-of-sight residence time zone). If you do not feel anything or if you feel that there are no applicable evaluation items, you may instruct them to look at the gazing point.

Immediately after the subject is presented (such as immediately after eating or drinking in the case of food or drink), the subject can be made to perform a sensory evaluation on the test object at an arbitrary timing or period. The period of the sensory evaluation process (also referred to as the sensory evaluation period) is the period from the start point to the end point of the sensory evaluation. The start point and end point of the sensory evaluation step may be arbitrarily set according to the timing at which the test object is desired to be sensory evaluated.

For example, the starting point of the sensory evaluation process may be the time when the subject first looks at the evaluation item felt about the test object, or the time when the subject is presented with the test object. In the latter case, if nothing is felt from the test object at the time of presentation of the test object, look at the evaluation item that displays the evaluation item indicating that nothing is felt, or look at the above-mentioned gaze point. May be directed. Before the start point of the sensory evaluation, a specific position such as the above-mentioned gazing point may be watched. More specifically, the time when the test object is presented, the time when a desired time elapses from the presentation of the test object, the time when an unspecified or specific stimulus is felt, the time when an unspecified or specific emotion occurs, and the like can be mentioned. .. More specifically, for example, in the case of food and drink, it may be when the food or drink is put in the mouth or when a certain period of time has passed since then, and when the flavor detection threshold (when some flavor is felt although it cannot be specified) is exceeded. May be set as the starting point, and a time point when the cognitive threshold (a time point at which a specific flavor such as sweetness can be identified) is exceeded may be set as the starting point. In the case of foods and drinks that require chewing, the starting point can be immediately after being put in the mouth.

As the end point of the sensory evaluation process, as described above, the line of sight may be directed to the gaze point or the evaluation item indicating that nothing is felt may be posted, or the vocalization and raising of the hand may be performed. , Nodding, button pressing, etc. may be performed by any method. More specifically, the time when a specific action is completed, the time when an unspecified or specific stimulus is no longer felt, or the time when an unspecified or specific emotion is no longer felt can be mentioned. More specifically, for example, in the case of food and drink, it may be when a certain period of time has passed since the food or drink was put in the mouth, when the food or drink is swallowed, or when the food or drink disappears from the mouth, and the flavor detection threshold value (specification). The end point may be a time when the end point is below the time when a certain flavor is felt although it cannot be done, or the end point may be a time when the end point is below the cognitive threshold (the time when a specific flavor such as sweetness can be identified). In the case of foods and drinks, the afterglow of the flavor may continue even after the foods and drinks disappear from the mouth, and in such a case, the end point may be a point below the detection threshold value or the cognitive threshold value of the flavors. In the case of foods and drinks that require chewing, the end point may be the time of swallowing the entire amount of foods and drinks or a certain time after the swallowing.

The temporal sensory evaluation method of the present invention preferably has a high time resolution of sensory evaluation, and can be particularly preferably used when the subject repeats the selection of the evaluation item two or more times. In particular, when the test object is a food or drink and its flavor changes over time, the time-dependent sensory evaluation method of the present invention is preferably used.

However, even when the evaluation item is not specified twice or more, the temporal sensory evaluation method of the present invention can be used. For example, when the temporal sensory evaluation method of the present invention is used for testing a device that ejects a fragrance composition or a fragrance compound at a specific timing, the desired fragrance can be obtained by using the high time resolution of the sensory evaluation. It can be used to confirm whether the perceived timing matches a specific timing. Alternatively, even when the physiological response data is acquired during the sensory evaluation using the physiological response measuring device as described above, the influence of the operation such as clicking on the physiological response data can be reduced, so that the temporal sensory evaluation of the present invention can be performed. The method can be preferably used.

<Gaze measurement process>
The temporal sensory evaluation method of the present invention includes a line-of-sight measurement step of identifying an evaluation item to which the subject is looking. The line of sight of the subject is measured by using the above-mentioned line of sight measuring means or the like.

The line-of-sight measurement step is performed in parallel with the above-mentioned sensory evaluation step, but may be performed before, after, or both of the sensory evaluation steps.

It is preferable to calibrate the line-of-sight measuring means before starting the line-of-sight measurement process. After calibrating the line of sight, for example, when instructing the subject to look at the gazing point, it is preferable to confirm whether the line of sight measured by the line-of-sight measuring means is looking at the gazing point accurately.

In addition, when it is difficult to identify each evaluation item by image recognition, or when it is desired to improve the identification accuracy, the above-mentioned feature part is provided in the evaluation item, and what kind of feature part can identify each evaluation item with the highest accuracy. There may be a further step of examining.

In the line-of-sight measurement process, the sampling rate is not particularly limited. As described above, it can usually be carried out using a line-of-sight measuring device of about 25 to 2000 Hz, and the number of evaluation items, the characteristics of the viewpoint to be evaluated for the test object, and what humans can feel from the test object (test object). If is a food or drink, it may be appropriately set according to the characteristics of the expression (flavor, etc.). Generally, the higher the sampling rate, the faster the eye movements can be captured.

Since the sampling rate can be arbitrarily set according to the purpose, a step of adjusting the sampling rate to an optimum value may be further performed.

<Association process>
The temporal sensory evaluation method of the present invention includes a step of associating a line-of-sight retention time zone in which the subject is looking at the evaluation item with an evaluation item in the line-of-sight retention time zone. More specifically, when the subject is looking at a certain evaluation item, it is a step of associating the evaluation item with the line-of-sight residence time for the evaluation item. As mentioned above, this can be done using the software that accompanies the line-of-sight measuring means, or any other software or program that allows this association.

The criteria for determining that the subject is looking at a certain evaluation item are not particularly limited. For example, when a line of sight is directed to an evaluation item for a specific period (which can be arbitrarily set by time, number of frames, etc.) or longer, it may be determined that the line of sight is directed to the evaluation item. More specifically, for example, when the sampling rate is 30 Hz, when the line of sight stays in the same evaluation item continuously for 11 frames (0.37 seconds) or more, the time during which the line of sight is directed to the evaluation item. Can be a belt. A step of adjusting the optimum sampling rate may be further provided according to the moving speed of the line of sight of the subject.

This association result can be used for an output method and an analysis method described later.

<Output method>
The temporal sensory evaluation method of the present invention further has an output method for outputting the result of associating the line-of-sight retention time zone in which the subject is looking at the evaluation item with the evaluation item in the line-of-sight retention time zone. preferable.

The output means used in the output method is not particularly limited, and may be, for example, a means for outputting the association result in a format that is easy to see. The output format is arbitrary as described above, and examples thereof include, but are not limited to, a text format, a csv format, an xls or xlsx format, a doc format or a docx format, and a pdf format. As described above, the output means used in the output method is not particularly limited, and for example, a display, a printer, a projector, or the like can be used.

In the output method, the association result once stored in the recording means can be read and output to the output means, or the association result can be output to the above-mentioned output means in real time.

In the output method, the association result may be output in any expression. For example, a stacked bar graph, a numerical table, a circle or donut graph, a radar chart, a bubble graph, a line graph, etc. showing the relationship between each evaluation item and its line-of-sight residence time can be exemplified. In the expression, it may be expressed as the length of the line-of-sight residence time zone for each evaluation item, or may be expressed as the ratio of the line-of-sight residence time zone between the evaluation items, and a desired expression mode can be adopted.

When a blank portion is provided in the presenting means, the method of processing the time zone in which the line of sight is directed (selected) to the blank portion is arbitrary. For example, especially when the line-of-sight residence time zone of the blank portion is short, if there is a line-of-sight in the blank portion, it may be considered as a transition from the first evaluation item to the second evaluation item. Since it is considered that the subject moves his / her line of sight after judging that it corresponds to the evaluation item included in the second evaluation item, the time zone when the line of sight is in the blank part is the time when the subject gazes at the second evaluation item. Can be included and processed. However, the time zone in which the line of sight is moving the blank portion may be treated as a "no answer" or "not applicable" time zone, or the time zone may be removed.

<Analysis method>
The temporal sensory evaluation method of the present invention may further include a method for performing various analyzes based on the result of associating the evaluation item with the line-of-sight residence time.

For example, the analysis method may be a method of analyzing the number of times the evaluation item is switched over time in the line-of-sight retention time zone. For example, it is useful when it is desired to grasp the number of times the evaluation items are switched as an index of the changeability of the flavor of the food or drink (test object). The analysis of the number of times the evaluation item is switched over time in the line-of-sight retention time zone is determined by the time when the line of sight is directed to the evaluation item (line-of-sight retention time zone).

There are no particular restrictions on how to express the analysis results, and graphs, numerical tables, numerical lists listing numerical values, etc. may be used.

The number of times the evaluation items are switched over time in the line-of-sight retention time zone may be analyzed using software used for analysis. However, when the temporal sensory evaluation system outputs to a display, printer, etc. in an arbitrary format that the evaluation items in the line-of-sight retention time zone are switched over time by the above-mentioned output method, the analyst visually stays in the line of sight. The number of times the evaluation item changes over time in the time zone may be calculated.

An analysis for deriving yet another parameter may be performed using the analysis result of the number of times the evaluation item is switched over time in the line-of-sight retention time zone. Other parameters include the type of evaluation item and the speed at which the evaluation item is switched. The type of evaluation item can be analyzed as the number of evaluation items that the subject gazes at (selects). The speed of switching of evaluation items can be analyzed as the number of times of switching of evaluation items per unit time.

Further, the result analyzed by the analysis method may also be output in any format by the above-mentioned output method.

Note that each type of analysis may be performed using machine learning or AI (artificial intelligence). Machine learning captures certain trends from data containing two or more variables, but gives the computer the ability to learn and the relationships between variables without the person explicitly instructing their behavior. It is to be analyzed. Machine learning that can be used includes "support vector machine" and "neural network analysis". As the neural network analysis, a hierarchical network model or a deep learning model in which a large number of intermediate layers of the hierarchical network model are used can be used. In addition, machine learning may be performed by unsupervised analysis or supervised analysis.

The features of the present invention will be described in more detail with reference to Examples and Comparative Examples. The materials, amounts used, ratios, treatment contents, treatment procedures, etc. shown in the following examples can be appropriately changed as long as they do not deviate from the gist of the present invention. Therefore, the scope of the present invention should not be construed in a limited manner by the specific examples shown below.

[Example 1]: Selection method based on the line of sight <Sensory evaluation system over time>
Commercially available grape-flavored gummy A and gummy B were used as test objects.

The temporal sensory evaluation system of Example 1 having the following configuration was prepared.

(Presentation means)
A display (FlexScan M1700C-R manufactured by EIZO Corporation) was used as a presentation means, and a diagram showing the evaluation items was displayed on the screen of the display.

The figure showing the evaluation items (Fig. 1) shows all the evaluation items in which one flavor term related to the flavor of silverberry, that is, "gelatin odor", "sweetness", "grape" or "sourness" is surrounded by a broken line square. It consisted of four pieces, a gaze point (+ in FIG. 1) and a blank part (that is, an evaluation item or a part that is not the gaze point). Subjects were asked to keep their eyes on the relevant endpoint during times when they could feel any of the terms posted on these endpoints. In addition, the gazing point was placed in the center of the display. Regarding the gazing point, the subject did not feel any of the flavor terms from the start of the line-of-sight measurement by putting the gummy in his mouth until he could feel any of the flavor terms from the gummy or the gummy. After swallowing, the gummy candy was designed to indicate the flavor of the gummy candy at other times by asking them to keep their eyes on the gummy candy.

In order to ensure that all evaluation items are selected under the same conditions, each evaluation item has the same shortest distance from the gazing point to each evaluation item (that is, the above-mentioned dashed square with the flavor term). Was placed. When moving the line of sight from one evaluation item to another evaluation item, a blank portion is arranged so that the line of sight does not easily pass over the evaluation items that are not intended to be selected.

(Gaze measuring means)
A spectacle-type eye-gaze measuring device (TK2950 TalkEye Lite, manufactured by Takei Kikai Kogyo Co., Ltd.) was used and attached to the subject. The eye used for gaze measurement was the right eye. This line-of-sight measuring device includes a field-of-view camera that detects the field of view of the subject and a pupil camera that detects the movement of the pupil of the subject. These cameras are directly connected to the PC via USB, and the field image captured by the field camera and the viewpoint detected by the pupil camera can be recorded directly or once on the display attached to the PC and confirmed later. Based on the fact that the line of sight obtained by detecting the movement of the eyes of the subject by the line-of-sight measuring device is inside the evaluation item (that is, the quadrangle of the broken line), it is set to identify which evaluation item the line of sight is directed to. The software's arbitrary area analysis processing program is set to identify each evaluation item by image recognition based on the difference in flavor terms (characters) in the broken line square where the flavor terms are posted, and the evaluation that the subject is looking at. It was set to be automatically specified as an item.

An arbitrary area analysis processing program of the software attached to the line-of-sight measurement device was used as an associating means for associating the line-of-sight retention time zone in which the subject is looking within each evaluation item with the evaluation items in the line-of-sight retention time zone. A PC storage area was used as a recording means for recording the associated line-of-sight retention time zone and evaluation items in the line-of-sight retention time zone, and each type of data obtained in the PC storage area was set to be stored. The sampling rate for recording the line-of-sight residence time zone of the line-of-sight measuring device used was set to 30 Hz. 30 Hz means that the input is sensed 30 times per second. In addition, the line-of-sight residence time zone of each evaluation item is set to be continuously recorded on the PC by the arbitrary area analysis processing program of the software attached to the line-of-sight measurement device.

<Sensory evaluation process>
Subject No. 1 and subject No. Two of 2 were the subjects.

The temporal sensory evaluation method of Example 1 was carried out by the following method.

(Gaze means calibration process)
First, after the subject wore a spectacle-type eye-gaze measuring device, calibration was performed using the software attached to the eye-gaze measuring means. When the calibration is completed, the visual field image of the subject and the detected line of sight of the subject (where they are looking) are displayed in the visual field image on the display attached to the PC. Next, the subject was instructed to look at the gazing point of the presentation means, and it was confirmed that the subject's line of sight was displayed on this specific position on the display.

(Sensory evaluation process and line-of-sight measurement process)
Next, the subjects were asked to chew gummy candies A or B freely, and a single time-dependent sensory evaluation was performed. Free chewing means chewing as often as you like, such as the number of times and speed, and having them swallow at any time. The timing of swallowing is not related to the state of gummy candies (shape, taste, etc.) in the mouth.

The line-of-sight measurement process is started from the time when the calibration of the above-mentioned eyeglass-type line-of-sight measurement device is completed.

In the sensory evaluation, the subjects were asked to keep their eyes on the evaluation items on the screen of the presentation means, which posted the term closest to the flavor felt at that moment. The period of the sensory evaluation step started from the time when the subject put the gummy in his mouth, and ended from the time when he could not feel any of the flavor terms posted in the evaluation items or when he swallowed the gummy. As mentioned above, before and after the sensory evaluation period, the subjects were asked to keep their eyes on the gazing point.

The data of the sensory evaluation result, that is, the line-of-sight residence time zone in which the subject is looking into each evaluation item and the evaluation item in the line-of-sight retention time zone are determined by the arbitrary area analysis processing program of the software attached to the line-of-sight measurement device. It was associated and recorded (stored) in the recording means.

<Output of association result>
The association result was output in csv format, and a stacked bar graph of the association result was derived based on the csv data. The graph was displayed on the display using the display attached to the PC as an output means. There was a very short time when it was detected that the line of sight was directed to the blank part, but that time passed during the time to move to the next evaluation item, which occurred as a result of thinking that it did not correspond to the previous evaluation item. It was considered as "the part that was done", and while the line of sight was moving in the blank part, it was treated as "synonymous with selecting the next evaluation item".

FIG. 2 (A) and FIG. 2A and FIG. It is shown in FIG. 2 (B).

[Comparative Example 1]: Hand-pushing method Using the sensory evaluation software MagicSense manufactured by Taste Technology GK, evaluation items were selected by mouse-clicking (hand-pushing), and sensory evaluation was performed over time (in the present specification, the hand-pushing method). Also called). The sampling rate was set to the frequency of detecting the input at a pace of 10 times every 3 seconds. This sampling rate is generally adopted by the hand-push method. In Comparative Example 1, the evaluation item was selected by clicking the mouse without attaching the line-of-sight measuring device of Example 1. With mouse clicks, the subject is asked to click once on the evaluation item to be posted when the flavor of any of the above terms is felt, and to click once on the corresponding evaluation item each time the perceived flavor changes. The time zone between each click was set as the time zone in which the evaluation item was selected. Regarding the gazing point, the subject did not feel any of the flavor terms from the start of the line-of-sight measurement by putting the gummy in his mouth until he could feel any of the flavor terms from the gummy, or the gummy. When swallowed, the subject was asked to click on the gummy candy. Other than these, the same as in Example 1 was applied. Although the sampling rates of Example 1 and Comparative Example 1 are different in this way, it is considered that this difference in sampling rate cannot affect the sensory evaluation result, considering the speed of the movement of the human moving the line of sight. ..

The evaluation items and the time zones selected by clicking the mouse were associated with the MagicSense data using TDS-analyzer, and the association and the results were output in the same manner as in Example 1. The graphs expressing the results of the hand-pushing method of Comparative Example 1 as a stacked bar graph of the actual line-of-sight residence time are shown in FIGS. 3 (A) and 3 (B).

In these stacked bar graphs, time elapses from the left side to the right side of the page, the left end of the bar graph means the start time of the sensory evaluation, and the right end of the bar graph means the end time of the sensory evaluation. The white part of the bar graph, which is the initial stage of the sensory evaluation from the start point, represents the time from the start of the sensory evaluation to the time when the flavor terms described in the evaluation items can be felt. Means. The right end of the bar graph means that the subject lost his or her taste or swallowed a gummy candy and turned his or her gaze to the point of gaze. The same applies to FIGS. 5 to 8 described later.

[result]
<Time resolution of sensory evaluation over time>
The stacked bar graphs of FIGS. 2 (A), 2 (B), 3 (A) and 3 (B) were analyzed, and the number of times the evaluation items were switched was derived.

Subject No. In No. 1, the analysis result of the number of times the evaluation items were switched was as follows.

Gummy A evaluation: 16 times in Example 1 and 10 times in Comparative Example 1.

Gummy B evaluation: 12 times in Example 1 and 8 times in Comparative Example 1.

Subject No. In No. 2, the analysis result of the number of times the evaluation items were switched was as follows.

Gummy A evaluation: 18 times in Example 1 and 13 times in Comparative Example 1.

Gummy B evaluation: 18 times in Example 1 and 15 times in Comparative Example 1.

From these results, it was found that the temporal sensory evaluation system of the present invention can increase the frequency of switching the evaluation items selected in one sensory evaluation, and the time resolution of the sensory evaluation is high.

<Types of evaluation items>
Comparing FIGS. 2 and 3, it was shown that the line-of-sight selection method of the present invention is excellent. For example, subject No. 1 and subject No. In both cases, in the first half of the sensory evaluation period of gummy (A), "gelatin odor" could be selected by the line-of-sight selection method of Example 1, but "gelatin odor" could not be selected by the hand-pushing method of Comparative Example 1. I understood it. It was found that the selection method based on the line of sight of Example 1 can increase the types of evaluation items that can be selected as compared with the manual push method of Comparative Example 1.

From these results, it was found that according to the temporal sensory evaluation system of the present invention, the temporal sensory evaluation that reflects the subject's consciousness better and in real time can be performed. It is considered that one of the causes of the selection method based on the line of sight is that the work load of the subject is suppressed.

<Speed of switching evaluation items>
From the comparison of FIGS. 2 (A) and 3 (A) and the comparison of FIGS. 2 (B) and 3 (B), the selection method based on the line of sight of Example 1 is more "pushing method" than the manual method of Comparative Example 1. It was found that the "speed of switching of evaluation items" was excellent.

From this result, it was found that the temporal sensory evaluation system of the present invention also has an effect of excellent switching speed of evaluation items. It is considered that one of the causes of the selection method based on the line of sight is that the work load of the subject is suppressed.

[Example 2]: Selection method based on the line of sight <Sensory evaluation system over time>
As the test object, the commercially available gummy B used in Example 1 was used.

As the presentation means, a drawing paper on which the evaluation items were described was attached to the wall. As evaluation items, we used square evaluation items that post the terms "waxy," "fruity," "sweet," and "foxy" related to the flavor of silverberry. Foxy is a grape scent reminiscent of the Concord grape variety, which is characteristic of the grape variety. The figure which showed the evaluation item used in Example 2 is shown in FIG. FIG. 4 is composed of an evaluation item (a quadrangle on which flavor terms are posted), a gazing point (+ part), and a blank part (that is, a part that is not an evaluation item). The gazing point was placed in the center of the display. Each evaluation item was arranged so that the shortest distance from the gazing point to each evaluation item was the same. When moving the line of sight from one evaluation item to another, a blank portion was arranged so that the line of sight would not easily pass over the evaluation items that were not intended to be selected. As shown in FIG. 4, white squares and black squares are added at different positions as feature parts so that the design of each evaluation item is different.

As the line-of-sight measurement means, the same eyeglass-type line-of-sight measurement device as in Example 1 was used. However, the software's arbitrary area analysis processing program sets the image recognition of the difference in the design of each evaluation item of the quadrangle to identify each evaluation item, and automatically identifies it as the evaluation item that the subject is looking at. Set to.

Other than that, the temporal sensory evaluation system of Example 2 was prepared in the same manner as in Example 1.

<Sensory evaluation method over time>
Subject No. Four subjects, 1 to 4, were the subjects.

First, the subject wore the same eyeglass-type eye-gaze measuring device as that used in Example 1, and then calibrated in the same manner as in Example 1.

Next, the subject was asked to chew the test object freely, and the sensory evaluation over time was repeated twice.

Other than that, the temporal sensory evaluation method of Example 2 was carried out in the same manner as in Example 1.

<Analysis of association results>
The association result was output in the same manner as in Example 1. FIG. 5 shows a graph expressing the result of associating the selection method by the line of sight in the first sensory evaluation of Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 6 shows a graph expressing the result of associating the selection method by the line of sight in the second sensory evaluation of Example 2 as a stacked bar graph of the actual line-of-sight residence time zone.

[Comparative Example 2]: Hand-push method Using the sensory evaluation software MagicSense manufactured by Taste Technology GK, evaluation items were selected by mouse-clicking (hand-pushing), and sensory evaluation was performed over time. The sampling rate was 10/3 Hz. Comparative Example 2 was the same as in Example 2 except that the line-of-sight measuring device of Example 2 was not attached and the evaluation items were selected by mouse-clicking (hand-pressing).

The association result was output in the same manner as in Example 2 except that the MagicSense data was associated with the evaluation item and the time zone selected by clicking the mouse using TDS-analyzer. FIG. 7 shows a graph expressing the result of the hand-pushing method in the first sensory evaluation of Comparative Example 2 as a stacked bar graph of the actual line-of-sight residence time zone. FIG. 8 shows a graph expressing the result of the hand-pushing method in the second sensory evaluation of Comparative Example 2 as a stacked bar graph of the actual line-of-sight residence time zone.

[result]
<Overall tendency of sensory evaluation over time>
As shown in FIGS. 5 to 8, the sensory evaluation results (evaluation items) tended to change with the passage of time in the order of waxy, fruity, and foxy in both the hand-push method and the line-of-sight selection method.

When the evaluation items are identified by providing a unique feature portion for each evaluation item of the presenting means and recognizing the difference between the feature portions as in the second embodiment, the line of sight is better than when the feature portion is not provided. Reliability can be increased because the identification of the evaluation item to be directed can be more accurate.

<Time resolution of sensory evaluation>
Figures 5 to 8 were analyzed to determine the number of times the evaluation items were switched.

Subject No. In 1, the average is 3.5 times in the hand-push method and 7 times in the line-of-sight method.
Subject No. In 2, the average is 4.5 times in the hand-push method and 16 times in the line-of-sight method.
Subject No. In 3, the average is 4.5 times in the hand-push method and 6.5 times in the line-of-sight method.
Subject No. In 4, the average was 5.5 times in the hand-push method and 12 times in the line-of-sight method.

It was found that the time resolution of all four subjects was greatly improved.
<Types of evaluation items>
Subject Nos. The second half of 2 and the subject No. As particularly shown in the first half of 4, the percentage of people who could select evaluation items that could not be selected by hand (in a specific period) such as mouse clicks when using the line-of-sight measurement means tends to increase. I understood it. It is considered that one of the causes of the selection method based on the line of sight is that the work load of the subject is suppressed.
<Speed of switching evaluation items>
Visual analysis of the graphs of FIGS. 5 to 8 shows that the line-of-sight selection method of the present invention increases the number of times the evaluation items are switched and the "speed of switching of the evaluation items" is faster than the manual push method. It turned out that there is a tendency to become. The data in which the evaluation item is selected by the line-of-sight measurement means has a high frequency of switching of the evaluation item and a fast switching speed, so that the flavor change captured by the subject can be more dynamically (that is, the evaluation item that the subject wants to select can be selected in real time. It was found that it is easy to select and the subject's consciousness can be reflected in the sensory evaluation more directly). It is considered that one of the causes of the selection method based on the line of sight is that the work load of the subject is suppressed.
<Subject's workload>
The work load of the subjects in the case of continuous sensory evaluation by the hand-push method and the line-of-sight method was evaluated by conducting a subjective evaluation questionnaire.

The following Q1 to Q3 questionnaires were conducted by showing the subjects four types of graphs obtained from the results of their own evaluations in Example 2 and Comparative Example 2. The questionnaire showed to the subjects that A-1 and A-2 were the results of the first visit and B-1 and B-2 were the results of the second dose, but A-1 and A- Which of 2 is the result of the hand-push method or the result of the selection method by the line of sight is shown blindly (randomized and arranged side by side). B-1 and B-2 are also shown blinded in the same manner.
Q1. Does it reflect the change in flavor when you actually eat it?
Q2. How was the workload of the line-of-sight method compared to the hand-push method?
Q3. Do you feel that the gaze method is more immediate and more accurate than the hand-push method?
Using the scales shown in FIGS. 9 to 11 as the answer columns for Q1 to Q3, the subjects were asked to answer by selecting the part corresponding to the subject.

From the answers obtained in the subjective evaluation questionnaire of each subject, the selected answers were scored with 1 point on the left side of the paper and 9 points on the right side of the paper on the scale of FIGS. 9 to 11.

The answers to the subjective evaluation questionnaires of the four subjects were summarized and the results of the following subjective evaluation questionnaires were obtained.

The average value of the answers to Q1 was 5 points for the hand-push method and 6.8 points for the line-of-sight method. It was found that the subjects felt that the gaze method reflected the change in flavor when actually eaten compared to the hand-push method. It can be said that this result has a significant difference (p <0.05, paired t-test).

The average value of the answers to Q2 was 6.8 points. It was found that the subjects felt that the work load was reduced by the line-of-sight method compared to the hand-push method.

The average value of the answers to Q3 was 6.8 points. It was found that the subjects felt that the gaze method was more immediate and more accurate than the hand-push method.

Claims (12)

A temporal sensory evaluation system used for a temporal sensory evaluation in which a subject evaluates a test object in a temporal manner based on two or more evaluation items visually presented.
A specific means for identifying the evaluation item to which the subject is looking at by detecting a place where the subject is looking at the subject based on the measured information on the subject's line of sight .
Before Symbol the evaluation items specified by the specifying means, associating means said subject associate gaze dwell time zone which is directed toward the line of sight, and the evaluation items in the line of sight dwell time period, and
A temporal sensory evaluation system including an output means for outputting an association result between the line-of-sight residence time zone associated with the association means and the evaluation item in the line-of-sight residence time zone. The time-dependent sensory evaluation system according to claim 1, wherein the evaluation item is sensory information or impression information. The time-dependent sensory evaluation system according to claim 1 or 2, wherein the evaluation item is sensory information perceived by the sense of smell, taste, or both. The time-dependent sensory evaluation system according to claim 3, wherein the line of sight of the subject is measured by the line-of-sight measuring means. Each of the evaluation items, the have different features from each other can be distinguished by the image recognition of a particular unit, the specific means, the evaluation items on the basis of the type of the features detected by the image recognition the evaluation items The temporal sensory evaluation system according to any one of claims 1 to 4, wherein the sensory evaluation system is identified. The time-dependent sensory evaluation system according to any one of claims 1 to 5, further comprising a recording means for recording the line-of-sight residence time zone and the evaluation items in the line-of-sight residence time zone. And the output means, you output graphs or tables based on the association result, over time sensory evaluation system according to any one of claims 1 to 6. The temporal sensory evaluation system according to any one of claims 1 to 7, further comprising an analysis means for deriving the number of switchings or switching speeds of evaluation items based on the association result. A temporal sensory evaluation method used for a temporal sensory evaluation in which a subject evaluates a test object in a temporal manner based on two or more evaluation items visually presented .
By detecting the location where the subject is toward the line of sight on the basis of the total measured by said information related to the subject line of sight, and specifying step of specifying the evaluation items the subject is toward the line of sight,
An association step of associating the line-of-sight retention time zone in which the subject is looking at the identified evaluation item with the evaluation item in the line-of-sight retention time zone .
A time-dependent sensory evaluation method in which a computer executes an output step of outputting an association result between the associated line-of-sight residence time zone and the evaluation item in the line-of-sight residence time zone. The temporal sensory evaluation method according to claim 9, wherein the specification of the evaluation item is repeated twice or more. The time-dependent sensory evaluation method according to claim 9 or 10, wherein the test object is a food or drink, a cosmetic or a flavor. A time-lapse sensory evaluation program used for a time-lapse sensory evaluation in which a subject evaluates a test object over time based on two or more evaluation items visually presented.
A specific step of identifying the evaluation item to which the subject is looking at by detecting a place where the subject is looking at the subject based on the measured information on the subject's line of sight.
An association step of associating the line-of-sight retention time zone in which the subject is looking at the identified evaluation item with the evaluation item in the line-of-sight retention time zone.
A time-dependent sensory evaluation program that causes a computer to execute an output process that outputs an association result between the associated line-of-sight residence time zone and the evaluation item in the line-of-sight residence time zone.

Images