JP5402252B2 - Operation evaluation apparatus and program - Google Patents

Description

  The present invention relates to an operation evaluation apparatus and a program.

  In recent years, an apparatus has been proposed in which an LED is provided on a keyboard and the keyboard is illuminated to instruct key depression (see, for example, Patent Documents 1 and 2). In addition, a device for playing a game or training a moving visual acuity using a musical instrument having an LED provided on a keyboard has been proposed (see, for example, Patent Document 3). In recent years, an apparatus for presenting a graphic problem and measuring a brain function has been proposed (see, for example, Patent Documents 4 and 5).

Japanese Patent Application Laid-Open No. 06-066763 JP-A-10-222160 JP 2006-158955 A JP 2006-158421 A JP 2006-158944 A

By the way, in the conventional method for measuring brain function, a person remembers and presents a pattern, presents a subject to a subject, and the person judges the result, so the measurement result can be calculated numerically. could not. Also, the guide on the keyboard often prompts to play the keyboard at the same time as it is presented, and it was difficult for an unfamiliar person to keep up with the guide, so the user could not practice happily, In addition, the measurement result could not be calculated numerically.
The present invention has been made in view of the above-described background, and an object of the present invention is to provide a technique that can easily perform brain function measurement and brain function activation as compared with the related art.

In order to solve the above-described problems, the present invention provides a timing data storage means for storing timing data for notifying a user's operation timing, and a user's operation based on the timing data stored in the timing data storage means. An operation timing notifying means for informing operation timing, a plurality of operators that can be moved by being gripped or mounted by a user, and provided on the operator, detecting movement of the operator, and based on the detection result The operation detection means for detecting the user's action, and a plurality of actions detected by the action detection means in a predetermined period after the action timing is notified by the action timing notification means. with evaluating the operation of the user based on comparison with the reference data that is one of the operation detecting means detects If the comparison result of the operation and other operations predetermined condition is satisfied, it provides an operation evaluation apparatus characterized by comprising an evaluation means for notifying to that effect.

  According to the present invention, measurement of brain function and activation of brain function can be performed more easily than in the past.

It is a figure which shows an example of a structure of a subject presentation system. It is a figure which shows an example of the external appearance of an operating device. It is a block diagram which shows an example of the hardware constitutions of an operating device. It is a block diagram which shows an example of the hardware constitutions of a subject presentation apparatus. It is a figure which shows an example of the content of the data memorize | stored in the correspondence storage area. It is a block diagram which shows an example of a functional structure of a subject presentation apparatus. It is a flowchart which shows the flow of the process which an operation | movement evaluation part performs. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a figure which shows an example of the content of a scale name corresponding | compatible table.

<A: Configuration>
FIG. 1 is a diagram showing an example of the configuration of a problem presentation system according to an embodiment of the present invention. In the figure, a task presentation device 1 is a device that presents a task for measurement of brain function or activation of brain function to a user or evaluates a user's reaction. Each of the operation devices 2a, 2b, and 2c is a device that is mounted on a user and is movable, and is a device that detects a user's operation. The operation devices 2a, 2b, and 2c are used by different users. In the following description, when it is not necessary to distinguish the operation devices 2a, 2b, and 2c, these will be referred to as “operation device 2”.

  FIG. 2 is a diagram illustrating an example of the appearance of the controller device 2. As illustrated, the housing 2A of the controller device 2 has a substantially rectangular parallelepiped shape, and is used by being worn (or grasped) by a user. The internal configuration of the controller device 2 will be described with reference to FIG. In the controller device 2, the control unit 20, the sensor 21, and the transmission unit 22 are connected by a bus, and their configurations are housed in a housing 2 a illustrated in FIG. 2.

  The sensor 21 has an acceleration sensor and a gyro sensor. The acceleration sensor included in the sensor 21 is a triaxial acceleration sensor. That is, the sensor 21 includes three sensors (hereinafter referred to as Sx, Sy, and Sz) that detect accelerations in three axial directions orthogonal to each other, and the axes of the sensors are shown in FIG. It is provided so as to be in the x-, y-, and z-axis directions. In this embodiment, as shown in FIG. 2, the longitudinal direction of the operating device 2 is defined as the x axis, the vertical direction in the figure is defined as the z axis, and the direction perpendicular to the x axis and the z axis is defined as the y axis. Each sensor Sx, Sy, Sz detects the positive and negative accelerations (represented as ax, ay, az, respectively) about the x, y, z axes shown in FIG. Generate and output numerical data representing acceleration. Hereinafter, the numerical data indicating the acceleration will be referred to as “acceleration data”. In the following, when specifically indicating the contents of the data, the values of acceleration in the directions of the x, y, and z axes are used to indicate (ax , Ay, az). The gyro sensor included in the sensor 21 detects the roll, pitch, and yaw angle of the controller device 2 and outputs data indicating the detection result.

  The control unit 20 includes a central processing unit (CPU), a read only memory (ROM), and a random access memory (RAM). The CPU executes a control program stored in the ROM using the RAM as a working area. The transmitter 22 outputs the data generated by the sensor 21 to the task presentation device 1 as a radio signal such as a radio wave every predetermined time (5 milliseconds in the present embodiment).

  Next, the configuration of the problem presentation device 1 will be described with reference to the drawings. FIG. 4 is a diagram illustrating an example of a hardware configuration of the task presentation device 1. In the figure, the control unit 11 includes a CPU, a ROM, and a RAM, and controls each unit of the task presentation device 1 through a bus by reading and executing a computer program stored in the ROM or the storage unit 12. The storage unit 12 is a storage unit for storing a computer program executed by the control unit 11 and data used at the time of execution, and is, for example, a hard disk device. The display unit 13 includes a liquid crystal panel and the like, and displays various images under the control of the control unit 11. The operation unit 14 includes various operators that can be operated by the user of the task presentation device 1 and outputs a signal corresponding to the operation.

  The microphone 15 is a sound collection unit that collects a nearby sound and outputs an analog signal representing the collected sound. The sound processing unit 16 A / D converts the analog signal output from the microphone 15 to generate digital data. In addition, under the control of the control unit 11, the audio processing unit 16 D / A converts digital audio data to generate an analog signal, and outputs the generated audio signal to the speaker 17. The speaker 17 is a sound emitting unit that emits sound with an intensity corresponding to the analog signal supplied from the sound processing unit 16. The receiving unit 18 receives a radio signal transmitted from the controller device 2 and outputs data represented by the received radio signal to the control unit 11.

  In this embodiment, the case where the microphone 15 and the speaker 17 are included in the task presentation device 1 will be described. However, the audio processing unit 16 is provided with an input terminal and an output terminal, and the input terminal is connected via an audio cable. An external microphone may be connected, and similarly, an external speaker may be connected to the output terminal via an audio cable. In this embodiment, the case where the audio signal input from the microphone 15 to the audio processing unit 16 and the audio signal output from the audio processing unit 16 to the speaker 17 are analog audio signals will be described. You may make it input / output. In such a case, the audio processing unit 16 does not need to perform A / D conversion or D / A conversion. The same applies to the display unit 13 and the operation unit 14, and may be configured to be built in the problem presentation device 1 or may be configured to be externally attached.

  The storage unit 12 includes a presentation sound data storage area 121 and a correspondence relation storage area 122 as illustrated. The presentation sound data storage area 121 stores a plurality of sound data (hereinafter referred to as “presentation sound data”) representing a sound presenting the user's operation timing (hereinafter referred to as “presentation sound”). This presentation sound data may be data representing a single sound, or data representing a phrase composed of a plurality of sounds. The presentation sound data may be rhythm pattern data representing a sound rhythm pattern. This presentation sound data is used as timing data for notifying the operation timing of the user. A part of this presentation sound data has a set of first and second presentation sound data representing different sounds.

  The correspondence relationship storage area 122 stores the correspondence relationship between the presentation sound data and the operation mode of the user. FIG. 5 is a diagram illustrating an example of the content of data stored in the correspondence storage area 122. In the example shown in FIG. 5, the items “presentation sound” and “motion” are stored in association with each other in this storage area. Among these items, in the “presentation sound” item, a presentation sound ID (accompaniment sound identification information) for identifying presentation sound data stored in the presentation sound data storage area 121 is stored. In the “operation” item, data representing the content (operation mode) of the user's operation (hereinafter referred to as “reference data”) is stored. The correspondence relationship between the specific presentation sound data and the operation mode of the user is exemplified as follows. For example, in <B-1: Go / NoGo assignment> to be described later, in the “formation experiment assignment”, the operation corresponding to the presentation sound 1 is an action that swings the controller device 2, and in the “differentiation experiment assignment”, the presentation sound The operation corresponding to 2 is an operation that swings the controller device 2 and an operation that does not correspond to the presentation sound 3 (no operation). In the “reverse differentiation experiment task”, what is the operation that corresponds to the presentation sound 2? If there is no (no operation) and the operation corresponding to the presentation sound 3 is an operation of swinging the controller device 2. In <B-2: Branching task>, the operation corresponding to the presentation sound of the rhythm pattern P1 is an operation of engraving the rhythm similarly to the rhythm pattern P1, and the operation corresponding to the presentation sound of the rhythm pattern P2 is a rhythm. This is an operation for engraving the rhythm in the same manner as the pattern P2. Furthermore, in <B-3: Conflict task>, the action corresponding to the presentation sound of the rhythm pattern A is an action of hitting the rhythm pattern X, and the action corresponding to the presentation sound of the rhythm pattern B is an action of hitting the rhythm pattern Y. is there. As described above, the content of the presentation sound data, the content of the user's operation mode, and the corresponding relationship are arbitrarily set according to the task to be executed.

  Next, an example of a functional configuration of the task presentation device 1 will be described with reference to the drawings. FIG. 6 is a diagram illustrating an example of a functional configuration of the task presentation device 1. In the figure, a task presentation control unit 111, a presentation sound reproduction unit 112, a motion detection unit 113, and a motion evaluation unit 114 are realized by the control unit 11 reading and executing a computer program stored in the ROM or the storage unit 12. The The arrows in the figure schematically show the flow of data.

  In FIG. 6, the task presentation control unit 111 performs task presentation processing according to the operation content of the user. The presentation sound reproduction unit 112 reproduces the presentation sound based on the presentation sound data stored in the presentation sound data storage area 121. The presentation sound reproduction unit 112 functions as an operation timing unit that notifies the user of the operation timing based on the presentation sound data stored in the presentation sound data storage area 121.

  The motion detection unit 113 detects the user's motion based on the signal output from the controller device 2. In this embodiment, the motion detection unit 113 detects whether or not the user has swung the operating device 2 based on the acceleration data output from the sensor 21 of the operating device 2, and the user operates the operating device 2. When the is shaken, the length of time of the shake is detected. More specifically, in this embodiment, the motion detection unit 113 swings the controller device 2 when the acceleration data values αx, αy, and αz are all less than a predetermined threshold. On the other hand, in the other case, that is, when at least one of the values of the acceleration data αx, αy, αz is equal to or greater than a predetermined threshold value, the user shakes the controller device 2. It is determined that In addition, the motion detection unit 113 measures a time length in which at least one of αx, αy, and αz of the acceleration data is equal to or greater than a predetermined threshold value. The motion detection unit 113 outputs data indicating the detection result to the motion evaluation unit 114.

  Further, the motion detection unit 113 controls the voice processing unit 16 when the user's motion is detected (that is, when it is determined that the user is shaking the controller device 2), and is determined in advance. Sound (hereinafter referred to as “sensor sound”) is emitted from the speaker 17. In other words, in this embodiment, a sensor sound is output from the speaker 17 every time the controller device 2 is swung by the user.

  The motion evaluation unit 114 detects the motion detected by the motion detection unit 113 and predetermined reference data during a predetermined period after the presentation sound is reproduced by the presentation sound reproduction unit 112 (hereinafter referred to as “evaluation target period”). The user's action is evaluated based on the comparison with (reference data stored in the correspondence storage area 122), and evaluation data indicating the evaluation result is generated. In this embodiment, the action evaluating unit 114 specifies an action corresponding to the presentation sound presented by the presentation sound reproducing unit 112 with reference to the correspondence storage area 122, and compares the identified action with the detected action. Then, the user's action is evaluated according to the degree of matching between the two. The operation evaluation unit 114 displays the evaluation result on the display unit 13.

  In addition, when performing brain function measurement using a plurality of operation devices 2, the operation evaluation unit 114 compares signals output from the operation devices 2 and evaluates the user's operation according to the comparison result. . Specifically, for example, the task presentation device 1 performs a reaction 1 when a certain presentation sound 1 is presented (for example, performs a thrusting motion with the left hand after performing a thrusting motion with the right hand) When the presentation sound 2 is presented, the user is instructed to perform the reaction 2 (for example, perform the thrusting motion with the left hand after performing the thrusting motion with the left hand), and the task presentation device 1 performs these reactions. The accuracy of a series of operations of reaction 1 and reaction 2 may be determined.

  Here, an example of specific processing performed by the motion evaluation unit 114 will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of a flow of processing performed by the operation evaluation unit 114. The motion evaluation unit 114 receives a signal received from the controller device 2, and acquires the current posture (roll, pitch, yaw angle) of each controller device 2 based on the received signal (step Sa1). Next, the motion evaluation unit 114 compares the acquired sensor output value with the sensor output value of the other controller device 2 (step Sa2). The motion evaluation unit 114 evaluates the user's motion according to the comparison result, and when the comparison result satisfies a predetermined condition (for example, when the compared postures match or are symmetric) (step Sa3). ; YES), a process for notifying that effect is performed (step Sa4). On the other hand (step Sa3; NO), the process is terminated as it is.

  As an example of the determination process performed by the motion evaluation unit 114 in step Sa3, for example, the motion evaluation unit 114 determines whether or not the degree of coincidence of sensor output values from the plurality of operation devices 2 is equal to or greater than a predetermined threshold. You may make it determine, and you may make it determine whether the difference of the output timing of the sensor output value from the some operating device 2 is in the predetermined range. Moreover, you may make it determine whether the attitude | position to compare is symmetrical by determining whether the attitude | position of the some operating device 2 is symmetrical with respect to the orthogonal | vertical direction. Moreover, as an example of the specific content of the alerting | reporting process performed in step Sa4, for example, the operation | movement evaluation part 114 controls the audio | voice processing part 16 at the timing when the comparison result satisfy | filled the predetermined condition, The determined notification sound may be output from the speaker 17.

<B: Operation>
Next, the operation of this embodiment will be described. The user uses the operation unit 14 of the assignment presentation device 1 to perform an operation for performing assignment presentation processing. The operation unit 14 outputs an operation signal corresponding to the operated content. The control unit 11 starts the task presentation process in response to the signal output from the operation unit 14. The task presentation device 1 presents three types of tasks: <1: Go / NoGo task>, <2: Branching task>, and <3: Conflict task>. The control unit 11 of the assignment presentation device 1 selects one of these three kinds of assignments according to the content operated by the performer, and performs a process of presenting the selected assignment to the performer. .

<B-1: Go / NoGo assignment>
First, the Go / NoGo assignment presented by the assignment presentation apparatus 1 will be described. In this task, three tasks of “formation experiment task”, “differentiation experiment task”, and “reverse differentiation experiment task” are performed in order.
First, the “formation experiment subject” will be described with reference to FIG. FIG. 8 is a sequence diagram showing the flow of the operation of the formation experiment task. In this operation, first, the task presentation device 1 presents the presentation sound 1 (s1). That is, the control unit 11 of the task presentation device 1 reads predetermined presentation sound data from the presentation sound data storage area 121 and controls the voice processing unit 16 to output the sound from the speaker 17. When the user confirms that the presentation sound 1 has been presented before the experiment, the user is instructed to swing the operation device 2 to generate a sound. For this reason, when the user confirms that the presentation sound 1 is presented, the user shakes the operation device 2 to generate a sound (s2).

  When the controller device 2 is swung by the user, the sensor 21 sequentially generates acceleration data that represents the acceleration in each axial direction, and also sequentially generates data that represents the posture (roll, pitch, yaw angle) of the controller device 2. To do. The generated data is transmitted to the task presentation device 1 as a radio signal via the transmission unit 22. In this embodiment, the data output from the sensor 21 is written and transmitted at the current value every 5 milliseconds. The receiving unit 18 of the assignment presentation device 1 receives data from the controller device 2 and outputs the data to the control unit 11. The control unit 11 receives the data and detects the user's action based on the received data. The control unit 11 stores data indicating the detection result in the RAM. Further, when it is determined that the user has swung the controller device 2, the control unit 11 controls the voice processing unit 16 to reproduce a predetermined sensor sound. That is, every time the controller device 2 is moved by the user, a sensor sound is emitted according to the movement.

  In addition, the control unit 11 compares the signals output from each of the plurality of operation devices 2, evaluates the user's operation according to the comparison result, and when the comparison result satisfies a predetermined condition, A process for notifying that effect is performed. In this embodiment, the control part 11 detects the attitude | position (roll, pitch, yaw angle) of each operating device 2, and shows that when the difference of the detected attitude | position is in the predetermined range. A notification sound is output from the speaker 17.

  The task presentation device 1 repeats the presentation process of the presentation sound 1 five times (s3, s5, s7, s9). The user performs an operation of swinging the operation device 2 every time the presentation sound 1 is presented by the task presentation device 1. A user's operation | movement is detected by the sensor 21, and is sequentially transmitted to the task presentation apparatus 1 (s4, s6, s8, s10).

  Next, the “differentiation experiment task” will be described with reference to FIG. FIG. 9 is a sequence diagram showing a flow of operations of the differentiation experiment task. In this task, the task presentation device 1 presents two types of presentation sounds, presentation sound 2 and presentation sound 3 (s11, s13). That is, the control unit 11 of the task presentation device 1 reads out two types of different presentation sound data from the presentation sound data storage area 121, and controls the sound processing unit 16 to output as sound from the speaker 17. When the presentation sound 2 sounds, the user shakes the operating device 2 (s12, s15, s18, s22, s25). On the other hand, when the presentation sound 3 sounds, the user is instructed before starting the experiment so as not to perform anything.

  The task presentation device 1 repeats the presentation sound presentation process 10 times (s11, s13, s14, s16, s17, s19, s20, s21, s23, s24). That is, the control unit 11 of the task presentation device 1 reads two types of different presentation sound data (presentation sound data of the presentation sound 2 and presentation sound data of the presentation sound 3) from the presentation sound data storage area 121, and randomly reads them. The sound is output from the speaker 17 in order. The user determines whether to perform the operation while listening to the presentation sound to be emitted. The control unit 11 of the assignment presentation device 1 detects the user's action based on the data output from the controller device 2 and stores data indicating the detection result in the RAM. In addition, the control unit 11 compares the signals output from each of the plurality of operation devices 2, evaluates the user's operation according to the comparison result, and when the comparison result satisfies a predetermined condition, A notification sound indicating that is output from the speaker 17.

  Next, the “reverse differentiation experiment subject” will be described with reference to FIG. FIG. 10 is a sequence diagram showing a flow of operations of the reverse differentiation experiment task. In this task, the task presentation device 1 presents two types of presentation sounds presented in the “differentiation experiment task” (s31, s32). That is, the control unit 11 of the task presentation device 1 reads out two types of different presentation sound data from the presentation sound data storage area 121, and controls the sound processing unit 16 to output as sound from the speaker 17. On the other hand, the user performs an operation reverse to that in the differentiation experiment. That is, when the presentation sound 2 sounds, the user does nothing, but when the presentation sound 3 sounds, the user is instructed to start the experiment by swinging the operation device 2 to generate sound. (S33, s36, s39, s41, s44).

  The task presentation device 1 repeats the presentation sound presentation process 10 times (s31, s32, s34, s35, s37, s38, s40, s42, s43, s45). That is, the control unit 11 of the task presentation device 1 reads two types of different presentation sound data (presentation sound data of the presentation sound 2 and presentation sound data of the presentation sound 3) from the presentation sound data storage area 121, and randomly reads them. The sound is output from the speaker 17 in order. The user determines whether to perform the operation while listening to the presentation sound to be emitted. The control unit 11 of the assignment presentation device 1 detects the user's action based on the data output from the controller device 2 and stores data indicating the detection result in the RAM. In addition, the control unit 11 compares the signals output from each of the plurality of operation devices 2, evaluates the user's operation according to the comparison result, and when the comparison result satisfies a predetermined condition, A notification sound indicating that is output from the speaker 17.

  When the task presentation processing is finished, the control unit 11 of the task presentation device 1 refers to the data stored in the RAM, compares the detected motion with the motion stored in the correspondence storage area 122, and both User behavior is evaluated according to the degree of matching. As a specific example of the evaluation performed by the control unit 11, for example, the brain age of the user may be calculated numerically according to a predetermined algorithm according to the degree of matching between the two. Further, as another example, for example, the control unit 11 may perform a personality analysis (such as decoy, quick and dust) according to a predetermined algorithm. In this embodiment, the control part 11 determines the presence or absence of a user's reaction with respect to each of the presentation sounds emitted from the task presentation device 1. Moreover, the control part 11 measures the time after a presentation sound is output until a user reacts, and also evaluates with reference to this time length.

  Specific contents of the evaluation performed by the control unit 11 include, for example, evaluating the ratio of correct / incorrect response of the user's action, and correct / incorrect response contents (reaction time length, which side of each task) It is also possible to evaluate whether or not the reaction is correct / incorrect in the time period of (1) or (2), and to evaluate the relationship between the test time and time (am and afternoon, seasonal effects, etc.). Further, for example, a history of correct / false reactions (the correct answer is gradually increasing / decreasing, a tendency of improvement / deterioration) may be taken, and the evaluation may be performed according to this history. That is, the control unit 11 compares the detected action with the action stored in the correspondence storage area 122, and based on the comparison result, the correctness / incorrectness of the user's action, the contents of correct / incorrect, the correct / incorrect ratio, and the comparison You may make it identify at least any one of the log | history of a result, and perform evaluation according to a specific result. In addition, for example, the evaluation mode may be varied according to the relationship (difficulty level or the like) with the presentation sound.

  Further, the control unit 11 determines that the type of the user's motion determination is “inactive type”, “excited type”, “suppressed type”, “depressed type” based on the determination result of the differentiation experiment task and the determination result of the reverse differentiation experiment task. It is determined whether the type is “type” or “active type”. Specifically, the control unit 11 has an error in the Go task (when the operation device 2 must be swung) in the differentiation experiment, and the NoGo task (the operation to swing the operation device 2) in the differentiation experiment. If there are three or more mistakes (when you must not do), it is determined as “inactive type”. Further, the control unit 11 determines “excited” when there is no mistake in the Go problem in the differentiation experiment and there are three or more errors in the NoGo problem in the differentiation experiment. In addition, the control unit 11 determines “inhibition type” when there is an error in the Go problem in the differentiation experiment and the error in the NoGo problem is twice or less in the differentiation experiment. In addition, the control unit 11 has no mistakes in the Go problem in the differentiation experiment, the error in the NoGo problem is twice or less in the differentiation experiment, the Go problem in the reverse differentiation experiment, and the NoGo problem in the reverse differentiation experiment. If the mistake is less than 2 times, it is determined to be a “moist type”. In addition, the control unit 11 determines “active type” when there is no mistake in the Go problem in both the differentiation experiment and the reverse differentiation experiment, and the error in the NoGo problem is two or less in the differentiation experiment and the reverse differentiation experiment. To do.

  That is, in the differentiation experiment task, the control unit 11 reproduces the presentation sound (presentation sound 2, presentation sound 3) based on the plurality of presentation sound data, and any one of the plurality of presentation sound data. The presentation sound data (presentation sound data indicating the presentation sound 2) is used as timing data for notifying the user's operation timing. That is, in the differentiation experiment task, the control unit 11 evaluates the user's operation during a predetermined period after reproducing the presentation sound 2. In addition, in the reverse differentiation experiment task, the control unit 11 reproduces the same presentation sound (presentation sound 2, presentation sound 3) as the differentiation experiment task described above, and the presentation sound data used as timing data in the differentiation experiment task. Presentation sound data (presentation sound data 3) other than (presentation sound data indicating the presentation sound 2) is used as timing data for notifying the operation timing of the user. That is, in the reverse differentiation experiment task, the control unit 11 evaluates the user's operation in a predetermined period after reproducing the presentation sound 3. Next, the control unit 11 compares the evaluation result in the differentiation experiment task and the evaluation result in the reverse differentiation experiment task, and determines the type of user motion determination (“inactive type”, “excited type”) according to the difference between the two. , “Inhibition type”, “moist type”, “active type”).

  The control unit 11 notifies the evaluation result to the user, for example, by displaying the evaluation result (determination result) on the display unit 13. The user can grasp the measurement result of his / her brain function by referring to the screen displayed on the display unit 13.

<B-2: Branching issue>
Next, the branching assignment presentation process will be described with reference to FIG. This blanching task is aimed at evaluating and improving short-term memory. In this task, first, the task presentation device 1 creates a rhythm pattern P2 as a presentation sound and reproduces the pattern (s91). That is, the control unit 11 reads predetermined presentation sound data (rhythm pattern data) from the presentation sound data storage area 121 and controls the sound processing unit 16 to emit sound as sound from the speaker 17.

  The user is taught to memorize the rhythm pattern P2 presented by the task presentation device 1, swing the operation device 2, and react to engrave the rhythm in the same manner as the presented rhythm pattern P2. The controller device 2 outputs acceleration data to the task presentation device 1 in accordance with a user operation (s92). In this branching task, in order to encourage the user to memorize intensively, instead of a simple presentation sound such as a short sound, a rhythm pattern composed of a plurality of sounds is adopted, and short-term memory It used for evaluation and improvement.

  Next, the task presentation device 1 creates a rhythm pattern P1 as a presentation sound and continues to reproduce the pattern repeatedly. (S101, ..., s107). That is, the control unit 11 reads predetermined presentation sound data (rhythm pattern data) from the presentation sound data storage area 121 and controls the sound processing unit 16 to emit sound as sound from the speaker 17.

  The user is taught to memorize the rhythm pattern P1 presented by the task presentation device 1 and to make a reaction of engraving the rhythm in the same manner as the rhythm pattern P1 presented by swinging the operation device 2. The operation device 2 outputs data to the task presentation device 1 in accordance with a user operation (s102, s103, s104, s105, s106,..., S108, s109, s110, s111, s112). Each time the rhythm pattern P1 is presented once by the task presentation device 1, the user succeeds by repeating the same rhythm pattern P1 as the presented rhythm pattern P1 five times. Repeat this combination three times.

  In the example shown in FIG. 11, the user repeats the operation for one rhythm pattern P5 five times and the task presentation device 1 repeats the presentation of the rhythm pattern P1 three times. Although illustrated, the frequency | count of a user's operation | movement and the frequency | count of presentation of the rhythm pattern of the subject presentation apparatus 1 are not limited to this, It can change suitably according to the design of the subject presentation apparatus 1, etc. In short, the task presentation device 1 may repeat the presentation of the rhythm pattern a plurality of times, and the user may repeat the operation for the presented rhythm pattern a predetermined number of times.

  When the presentation of the third rhythm pattern P1 is completed, the task presentation device 1 instructs the user to reproduce another rhythm pattern P2 previously performed (s113). The user swings the operating device 2 according to the rhythm pattern P2 presented by the task presentation device 1, and engraves the rhythm in the same manner as the other rhythm pattern P2. The controller device 2 outputs data to the task presentation device 1 in accordance with a user operation (s114). As described above, the rhythm pattern P1 is presented a plurality of times (three times), and this presentation period is provided between the two presentation periods of the rhythm pattern P2, so that the short-term memory retention capability of the rhythm pattern P2 is achieved. Determined. In addition, the control unit 11 of the assignment presentation device 1 compares signals output from each of the plurality of operation devices 2, evaluates the user's action according to the comparison result, and the comparison result is a predetermined condition. When satisfy | filling, the notification sound which shows that is output from the speaker 17. FIG.

  The control unit 11 refers to the data stored in the RAM, compares the detected operation with the operation stored in the correspondence relationship storage area 122, and evaluates the user's operation according to the degree of matching between the detected operation and the operation. . The evaluation process performed by the control unit 11 is the same as the process shown in the Go / NoGo problem described above, and a detailed description thereof is omitted here.

<B-3: Conflict issues>
Next, the conflict problem presented by the problem presentation device 1 will be described. In this task presentation process, rhythm patterns A and B and rhythm patterns X and Y that match the rhythm patterns A and B are used. Rhythm patterns A and B are preferably connected musically. The rhythm patterns X and Y are preferably musically matched to the rhythm patterns A and B, respectively.

  The user is instructed by the task presentation device 1 to strike the rhythm pattern X when the rhythm pattern A flows, and to strike the rhythm pattern Y when the rhythm pattern B flows. As an aspect of this teaching, for example, while the control unit 11 actually emits the rhythm pattern A and the rhythm pattern X, “When this rhythm pattern (A) flows, this rhythm pattern (X) A message such as “Please respond by hitting” may be output in synchronization with the sound actually emitted. Note that the rhythm pattern X and the rhythm pattern Y may be presented to the user in advance on a musical score or the like.

The control unit 11 reproduces the rhythm pattern A and the rhythm pattern B in a random order.
This rhythm pattern may be a performance sound of a percussion instrument or a performance sound of another musical instrument. Moreover, when using the performance sound which has a pitch, you may use a phrase, a chord, an accompaniment, etc. In this case, it is preferable that it is the length of 1-2 measures.

  That is, the control unit 11 reads two types of different rhythm pattern data from the presentation sound data storage area 121 and outputs them as sounds from the speaker 17 in a random order. The user performs an operation corresponding to each rhythm pattern while listening to the rhythm pattern to be emitted. The controller device 2 outputs data according to the user's operation, and the control unit 11 detects the user's action based on the data output from the controller device 2 and stores data indicating the detection result in the RAM. . In addition, the control unit 11 of the assignment presentation device 1 compares signals output from each of the plurality of operation devices 2, evaluates the user's action according to the comparison result, and the comparison result is a predetermined condition. When satisfy | filling, the notification sound which shows that is output from the speaker 17. FIG.

  When the assignment is finished, the control unit 11 refers to the data stored in the RAM and compares the detected action with the action stored in the correspondence storage area 122 in association with the presented pattern data. The user's action is evaluated according to the degree of matching between the two. In this problem, the control unit 11 evaluates whether the user is responding to the rhythm pattern. More specifically, the control part 11 evaluates the presence or absence of a user's reaction. In addition, the control unit 11 evaluates and analyzes whether the rhythms / sounds and patterns of the phrases X and Y match. The control unit 11 may store the situation data and the determination result, and when the difficulty level is further selected, the length, time, and pattern difficulty level may be presented at random.

  As described above, according to the present embodiment, it is possible to perform Go / NoGo assignment, branching assignment, and conflict challenge musically by sound / music presentation, etc., and prevent dementia and prefrontal cortex. You can know judgment-oriented patterns, such as activation, prevention training of so-called “Kyrel” children. That is, according to the present embodiment, it is possible to perform brain function activation, personality analysis, and the like, using the operation device 2 that senses a response action to a user's sound. Further, according to the present embodiment, since the task is presented using sound / music, the task can be performed while the user is enjoying without imposing a mental burden on the user.

  Furthermore, according to the present embodiment, when a single user wears a plurality of operation devices 2 and uses the problem presentation device 1, or a plurality of users wear the operation devices 2 and use the problem presentation device 1. In the case of using, the user's motion is evaluated by comparing a plurality of detected motions, and when the postures of the plurality of operating devices 2 satisfy a predetermined condition (for example, the motion of the operating device 2 is When they match, or when the movement of the controller device 2 becomes symmetric, etc., the sound and music are emitted, so that the user can perform the task while having fun.

  Moreover, according to this embodiment, a reflex brain age etc. can be taken out numerically from a test subject's reaction time, and it can lead to the next motivation. In addition, by evaluating the user's actions based on the correct answer rate and the reaction time, it is possible to analyze the types of user's action judgments (such as decoy and quick dust).

<C: Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below. In addition, you may combine each following aspect suitably.
(1) In the above-described embodiment, the task presentation device 1 reproduces the presentation sound, thereby informing the performer of the timing for performing the operation or the timing for not performing the operation. The manner of notifying the operation timing is not limited to this, and for example, the operation timing may be notified by displaying an image on a display device and changing the image in time series. In addition, for example, the task presentation device 1 may include a mechanism that vibrates the device itself, and the operation timing may be notified by changing the vibration mode in time series. In short, the control unit 11 of the task presentation device 1 may notify the operation timing by changing at least one of sound, light, video, and vibration in time series.

(2) In the above-described embodiment, a case where one user performs motion measurement of a plurality of persons using one controller 2 is described. However, the present invention is not limited to this. ) May be grasped (attached) to both hands, for example, and the motion measurement of a plurality of parts may be performed. In this case, the control unit 11 detects the user's action based on the data output from the plurality of controller devices 2, and evaluates the user's action according to the detection result.

(3) In the above-described embodiment, different sounds may be emitted according to the axial direction and the direction in which the controller device 2 is moved. In this case, the storage unit 12 issues presentation device 1, as shown in FIG. 1 2, and configured to store the scale name correspondence table, the control unit 11 issues presentation device 1, by referring to this table The sound corresponding to the axis and the direction in which the operating device 2 is moved is emitted. In the example shown in FIG. 1 2, the scale name correspondence table, as shown, the axial and its orientation controller device 2 is moved, and the name of the scale are stored in association. As shown in the figure, in the scale name correspondence table, the scale of the scale corresponding to the combination of the axial direction (axis x, y, z) in which the operating device 2 is moved and the direction (positive or negative) of the axial direction is shown. One name is associated.

  When the operation device 2 is moved by the user, the sensor 21 sequentially generates acceleration data representing the acceleration in each axial direction and transmits the acceleration data to the task presentation device 1. The task presentation device 1 receives acceleration data from the operation device 2. The control unit 11 refers to the scale name correspondence table and specifies the scale corresponding to the received acceleration data. The control unit 11 emits the sound of the specified scale.

  In the above-described aspect, the axial direction and the direction in which the operating device 2 is moved are associated with the scale, but the axial direction and the direction in which the operating device 2 is moved are not limited to the scale. For example, it may be a timbre (tone for each musical instrument or its variation) or an effect (reverberation sound, localization (pan), etc.). The characteristics (including the scale, timbre, and effect) may be stored in association with each other.

(4) In the above-described embodiment, a device having a substantially rectangular parallelepiped shape is used as the operation device 2, but the shape of the operation device 2 is not limited to this, and for example, a shape of an orchestra command rod may be used. For example, it may be spherical. In short, the controller device 2 may be any device that can be gripped or mounted by a user and can be moved, and that has built-in sensors for detecting positive and negative motions about a plurality of axes.
In the above-described embodiment, the task presentation device 1 may be a dedicated device, and may be, for example, a mobile phone terminal, a portable game machine, or the like.

(5) In the above-described embodiment, the control unit 11 of the task presentation device 1 causes a predetermined sensor sound to be output from the speaker 17 every time a user action is detected by the sensor 21 of the controller device 2. I made it. Instead of this, the controller device 2 may have a built-in speaker, and the sensor sound may be output from the speaker of the controller device 2. In this case, the control unit 20 of the controller device 2 detects the presence / absence of the user's motion based on the data output from the sensor 21, and the user's motion is detected (that is, the user operates the controller device 2). If it is determined that the sensor is being shaken), a predetermined sensor sound may be emitted from the built-in speaker. In addition, the controller device 2 is not limited to a built-in speaker, and an external speaker may be connected to the controller device 2.

(6) In the above-described embodiment, the user's motion is detected using the triaxial acceleration sensor and the gyro sensor. However, the mode of detecting the user's motion is not limited to this. A sensor may be built in the controller device 2 and a user's motion may be detected by a geomagnetic sensor. A plurality of types of sensors may be used in combination. In short, what is necessary is just to provide in the operating device 2 and to detect the motion about a some axis | shaft.

DESCRIPTION OF SYMBOLS 1 ... Problem presentation apparatus, 2 ... Operation apparatus, 11, 20 ... Control part, 12 ... Memory | storage part, 13 ... Display part, 14 ... Operation part, 15 ... Microphone, 16 ... Sound processing part, 17 ... Speaker, 18 ... Reception Part, 21... Sensor, 22.

Claims (2)

Timing data storage means for storing timing data for notifying the operation timing of the user;
Operation timing notifying means for notifying the user's operation timing based on the timing data stored in the timing data storage means;
A plurality of operators that can be moved by being gripped or mounted by a user;
Motion detecting means provided on the operating element, detecting movement of the operating element, and detecting the operation of the user based on the detection result;
Based on a comparison between each of the plurality of operations detected by the operation detection unit and predetermined reference data in a predetermined period after the operation timing is notified by the operation timing notification unit. And an evaluation means for notifying that when a result of comparison between one action detected by the action detecting means and another action satisfies a predetermined condition, the action is evaluated. A characteristic operation evaluation apparatus. A computer having timing data storage means for storing timing data for notifying the operation timing of the user,
Informing the user's operation timing based on the timing data stored in the timing data storage means;
Detecting a movement of a manipulator that is held or attached to the user and is movable, and detecting an operation of the user based on a detection result;
In a predetermined period after the notification of the operation timing, the user's operation is evaluated based on a comparison between each of a plurality of detected operations and predetermined reference data, and the detected one When the result of the comparison between the operation and other operations satisfies a predetermined condition, a program for informing that is provided .

Images