JP4374010B2 - Motor motion evaluation system, motor motion evaluation method and program thereof - Google Patents

Description

  The present invention relates to an exercise system that gives instructions to an exerciser in accordance with music or a predetermined rhythm.

  Conventionally, a dance game is known as a kind of music game. In other words, it is a dance game in which an exerciser steps on a foot switch according to music. In such a dance game, the game device outputs a screen for instructing a dance step position to the monitor. The exerciser performs a stepping operation by stepping on a part of the plurality of foot switches according to the screen. The stepping motion of the exerciser is determined based on the on / off of each foot switch. As a result of the determination, the game apparatus calculates an evaluation point indicating whether or not the exerciser was able to dance as instructed, and displays this.

  For example, the evaluation is performed as follows. It calculates how much the timing at which the instructed foot switch is turned on deviates from the reference timing instructed on the screen. Points are given to each input of the exerciser according to the degree of deviation by one of three grades. Three-stage evaluation is performed for each input of the athletes in one music piece, and the total points of all inputs are set as evaluation points. Other evaluation methods have been proposed, but are the same in that the input timing of the foot switch and the reference timing are compared one by one.

In addition to the dance game, the general method for evaluating the exerciser's input is the same in general music games. That is, when the game device outputs an instruction in accordance with music and evaluates an input from a controller including a plurality of operation members, the operation timing of the operation member input by the controller and its reference timing are sequentially determined. Compare and evaluate.
JP 2000-037490 JP

  In a dance game using a foot switch, the position of the exerciser's foot is limited only on the foot switch. Therefore, there are few degrees of freedom of movement size and freedom of choreography. As a result, the movement of the exerciser is restricted, and it is difficult for the exerciser to enjoy a variety of movements that are relaxed in nature. In view of such a problem, in recent years, it has been attempted to attach a sensor to the body of an exerciser and detect the movement of the exerciser using the sensor. For example, it is conceivable to detect the movement of the athlete by wrapping a belt with a sensor attached around the waist of the athlete.

  With regard to this point, as a result of the inventor actually making a trial product and studying repeatedly, it has been found that the following problems exist. That is, it has been found that when an exerciser's motion is detected by a sensor attached to the exerciser's body, it is necessary to review the exerciser's motion evaluation method. Specifically, even if the exerciser is operating as instructed, the timing at which the sensor detects the exerciser's motion matches the timing at which the exerciser steps on the foot switch at the instructed reference timing. I do not. This is because a time lag occurs between the timing when the foot steps on the foot switch and the timing when the sensor detects an impact. This is because when the foot switch is stepped on with a foot, the impact is transmitted to the sensor via the knee and hip joints. Further, when the sensor is, for example, a belt-like one and is attached so as to be fastened to the body, if the tightening method is loose, the sensor will react with a delay with respect to the movement of the exerciser. In some cases. Furthermore, when the exerciser's body has a lot of fat, the shock is transmitted to the sensor attached to the skin surface or clothes through the fat, so that the fluctuation of the fat also contributes to the time lag. Therefore, as in the conventional evaluation method, it is not appropriate to compare the timing detected by the sensor with the reference timing for stepping on the foot switch indicated on the screen. This is because the two are not essentially the same.

  Furthermore, each movement of the athlete has a difference in stride and a body swing even if the movement is the same. Also, there are individual differences in how to attach the sensor to the body. Therefore, individual differences occur in the time lag from when the foot switch is pressed with the foot until the sensor detects the operation. From the above, in the conventional evaluation method that detects the deviation by comparing the movement timing of the exerciser detected by the sensor and the reference timing indicated on the screen, the movement of the exerciser can be correctly evaluated. difficult.

  In the present invention, when detecting the movement of an exerciser using a sensor attached to the body of the exerciser, the movement of the exerciser is considered in consideration of the time lag variation from when the exerciser actually moves until the sensor detects the movement. The purpose is to provide a technique for evaluating the operation of the system.

In order to solve the above-described problems, the present invention 1 provides an exercise motion evaluation system having the following means.
Reference motion data storage means for storing motion information of a derivative that guides an arbitrary exerciser to a predetermined motion and time information in association with each other as reference motion data;
First motion detection means that is mounted on the first exerciser and detects the movement of the first exerciser performed on the movement information of the derivative ;
Movement history data recording means for recording the first movement information detected by the first movement detection means and the time information as first movement history data in association with each other;
Shift data generating means for generating the first shift data by shifting the phase of the time information in the first motion history data by a predetermined time interval ΔT;
The first motion history data and the first shift data are temporally compared with the reference motion data using the time information of the reference motion data as a reference, and the data with the higher degree of coincidence with the reference motion data is Data selection means for determining first selection data;
An evaluation means for evaluating the first athlete based on the first selection data;
Informing means for informing the result of evaluation by the evaluating means.

The motion detection means outputs motion information indicating the motion of the exerciser. The movement information of the exerciser includes, for example, “0” and “1” indicating the presence / absence of movement, “front”, “back”, “left”, “right” indicating the direction of movement, the presence / absence of the rotational movement and the direction thereof. Can be mentioned.
As the motion detection means, a vibration sensor that detects the presence or absence of vibration, a three-dimensional acceleration sensor, a six-axis acceleration sensor, or the like can be used. These motion detection means can be attached to a belt that wraps around the waist of the exerciser, a band that the exerciser wraps around the ankle or wrist, headgear that the exerciser wears on the head, a ring that the exerciser wears on the finger, and the like.

  There is an individual difference in the difference between the timing at which the motion detection means detects the motion of the exerciser and the timing at which the exerciser actually moves. The exerciser moves with the derivative, but the movement is detected after the movement. Therefore, the phase of the motion history data indicating the detected motion is shifted by ΔT, for example, 0.1 second to generate shift data. Here, for example, if the total exercise time of the exerciser is 10 minutes, the shift data is obtained by shifting the entire movement history data acquired during the 10 minutes by 0.1 seconds along the time axis. Data is shown. Then, if the shifted case matches the reference motion data as compared to the non-shifted case, the movement of the exerciser is evaluated based on the shift data. Thereby, the time lag which arises when detecting an exercise | movement of an exerciser using a motion detection means is compensated by shift data, and an exerciser's operation | movement can be evaluated appropriately. The reason is that if a shift of 0.1 seconds has already occurred at the moment when the athlete moves while looking at the derivative, for example, due to the looseness of the belt, the shift of 0.1 seconds is the same as that moment. Not only that, it is possible to determine that there is always a similar shift during exercise. As a result, for example, even if an exerciser can perfectly follow the action of the derivative, the conventional judgment method has judged whether the same action as the derivative is being performed at the same time, so the evaluation result is low. However, according to the present invention, since the determination is made in a manner that compensates for the deviation, an appropriate evaluation can be obtained.

  It should be noted that the creation of shift data does not cause a situation in which the evaluation of an exerciser who cannot adjust the timing well (for example, a beginner) gets an unreasonably high evaluation. This is because there is almost no possibility that a beginner's exerciser will be uniformly delayed over the entire exercise time with respect to the ideal movement, and even if the shift data is applied, the evaluation will remain low if the beginner is applied. A good senior will get a high evaluation.

  In the reference motion data, motion information of a derivative that differs for each of a plurality of predetermined motion types may be associated with time information. The motion information corresponds to information that can be obtained from the motion detection means and the number thereof. For example, when only one motion detection means capable of detecting acceleration in two directions is attached to an exerciser, the motion information includes “front”, “back”, “left”, “right” “0” and “1” indicating the presence or absence of movement. When the motion detection unit detects a rotational motion in addition to the forward / backward / left / right motion, the motion information further includes the presence / absence of the rotational direction.

The present invention can be applied to exercise systems and music games. For example, the present invention is suitably applied to an exercise system in which an instructor performs an example operation on a screen, and a music game in which a foot panel, guitar, piano, drum-shaped controller, etc. are operated according to notes or a score displayed on the screen. can do.
The second aspect of the present invention relates to the exercise operation according to the first aspect of the present invention, further comprising a second motion detection unit that is attached to the second exerciser and detects the movement of the second exerciser performed on the movement information of the derivative. Provide an evaluation system. In this system, the movement history data recording means further records second movement history data in which the movement information of the second exerciser detected by the second movement detection means is associated with time information. The shift data generation means further generates second shift data in which the time information in the second motion history data is shifted in phase by a predetermined time interval ΔT. The data selection means temporally compares the second motion history data and the second shift data with the reference motion data based on time information of the reference motion data, and the degree of coincidence with the reference motion data is The higher data is further determined as the second selection data. The evaluation means further evaluates the second exerciser based on the second selection data. The notification means further notifies the result of evaluation by the evaluation means.

  For example, the first shift data shifted by ΔT is closer to the reference motion data for the first exerciser, but the second motion history data may be closer to the reference motion data for the second exerciser. This is because the time lag from when each exerciser moves until the movement is detected by the movement detection means is different for each exerciser. Therefore, the data selection means changes depending on the exerciser whether shift data or movement history data is to be selected data. Thereby, the individual difference of a time lag can be compensated appropriately, and the evaluation result of each athlete's movement can be made more appropriate.

  According to a third aspect of the present invention, in the first aspect of the present invention, the shift data generating unit further provides a movement motion evaluation system that further generates double shift data shifted by a time interval Δ2T based on the first motion history data. In this system, the data selection unit determines, as the first selection data, data having a high degree of coincidence with the reference operation data among the motion history data, the first shift data, and the double shift data. .

For example, it is conceivable to generate time-shifted data in the motion history data that is 1-times shifted data that is shifted forward by ΔT and double-shifted data that is shifted forward by Δ2T. By evaluating the motion of the exerciser based on the one of the 1 × shift data and the 2 × shift data that matches the reference motion data, the motion of the exerciser can be more accurately evaluated.
Similarly, three-time shift data in which the time information in the movement history data is shifted forward by Δ3T or four-time shift data in which the time information is shifted forward by Δ4T is generated, and the data that most closely matches the reference motion data is It can also be motion data.

A fourth aspect of the present invention provides the motor motion evaluation system according to the first to third aspects, further comprising instruction output means for displaying the derivative based on the reference motion data.
The instruction output means includes a monitor and a drawing processing means for generating an image to be displayed on the monitor. The drawing processing means generates a frame image showing the change of the derivative corresponding to the time information, and writes it in the frame memory every 1/60 sec. By displaying the movement of the derivative according to the time information one after another, an instruction of a predetermined reference operation that changes with the elapsed time is displayed on the monitor.

  As a specific example of the movement of the derivative, for example, an instructor showing a reference action can be cited. Another example of the movement of the derivative is an arrow mark that moves toward the timing line. By using four types of arrows, front, rear, left, and right as the arrow marks and relatively moving each arrow mark and the timing line, it is possible to instruct the timing of stepping in any arrow direction.

The present invention 5 provides an exercise motion evaluation method including the following steps.
A reference motion data storage step for storing, as reference motion data, movement information of a derivative that guides an arbitrary exerciser to a predetermined motion and time information;
A first motion detection step of receiving, from a sensor attached to the first exerciser, first motion information indicating the motion of the first exerciser performed on the motion information of the derivative ;
A movement history data recording step of recording the first movement information received in the first movement detection step and the time information as first movement history data in association with each other;
A shift data generation step of generating the first shift data by shifting the phase of the time information in the first motion history data by a predetermined time interval ΔT;
The first motion history data and the first shift data are temporally compared with the reference motion data using the time information of the reference motion data as a reference, and the data having the higher degree of coincidence with the reference motion data A data selection step to determine the first selection data;
An evaluation step for evaluating the first exerciser based on the first selection data;
A notification step for notifying a result of the evaluation in the evaluation step.

The present invention has the same effects as the first aspect.
The present invention provides an exercise motion evaluation program characterized by causing a computer terminal to function as the following means.
Reference motion data storage means for storing motion information of a derivative that guides an arbitrary exerciser to a predetermined motion and time information in association with each other as reference motion data;
First movement detection means for receiving movement information indicating movement of the first athlete performed on movement information of the derivative from a sensor attached to the first athlete;
A movement history data recording unit that records the first movement information received by the first movement detection unit and the time information as first movement history data in association with each other;
Shift data generating means for generating the first shift data by shifting the phase of the time information in the first motion history data by a predetermined time interval ΔT;
The first motion history data and the first shift data are temporally compared with the reference motion data using the time information of the reference motion data as a reference, and the data with the higher degree of coincidence with the reference motion data is Data selection means for determining first selection data;
Evaluation means for evaluating the first exerciser based on the first selection data; and notification means for notifying a result of evaluation by the evaluation means.

  The present invention has the same effects as the first aspect.

  Using the present invention, when detecting the movement of the athlete by a sensor attached to the body of the athlete, taking into account the variation in the time lag from when the athlete actually moves until the sensor detects the action, The movement of the exerciser can be evaluated.

<First Embodiment>
〔System configuration〕
FIG. 1 is a schematic perspective view of a training system to which an exercise motion evaluation system according to the present invention is applied. The training system 1 is constructed in a room in a certain hall. The training system 1 executes a training program for performing predetermined training, and controls the progress of the training.

The training system 1 includes a projection screen 20, a projector 21, a speaker 22, a control device 30, a transceiver 40, a terminal device 50, and a battery station 60 provided in a training room.
The projection screen 20 is provided on the front wall of the training room so as to face backward. For example, a liquid crystal projector 21 is attached to the rear ceiling of the training room. The projector 21 projects an image on the screen of the projection screen 20. An exerciser performs an operation along the instruction content of the guide while viewing the guide image displayed on the projection screen 20.

The audio output speakers 22 are arranged on the left and right upper portions of the front wall surface of the training room.
The control device 30 is disposed along the left wall surface in the drawing, in a position that does not interfere with the exerciser in the training room. Note that the control device 30 is not necessarily arranged in the training room.

  At least one, in this case, two transceivers 40 are arranged near the control device 30. The transmitter / receiver 40 receives a radio signal from the terminal device 50 simulating a belt worn on the waist of the athlete, converts the received radio signal into data, and outputs the data to the control device 30. The transceiver 40 may convert the data from the control device 30 into a radio signal and transmit it. The transceiver 40 may have a function for identifying which terminal device 50 the received signal and the transmitted signal are from.

  For example, a time division slot is allocated to each terminal device 50, and each terminal device 50 performs transmission / reception in synchronization with the slot, whereby the transceiver 40 can identify the terminal device 50. In addition, it is conceivable to identify each terminal device 50 by changing the encoding method of the transmission signal for each terminal device 50 or by making the carrier frequency different from each other. In addition, it is conceivable to identify a signal from each terminal device 50 by sequentially sending transmission requests from the transceiver 40 to each terminal device 50 and receiving a response to the request. Further, each terminal device 50 transmits data with individual identification added, and the transceiver 40 can be considered to identify each terminal device 50 based on an identifier included in the received data. In this embodiment, a time division slot is assigned to each terminal device 50, and an identifier of each terminal device 50 is added to data, and two transceivers 40 having different encoding methods are provided. By distributing half of the terminal device 50 to each transceiver 40, interference prevention is further achieved.

Here, the battery station 60 is disposed at an appropriate place in the training room, for example, in the vicinity of the entrance / exit. The battery station 60 is a charging device that also serves as a storage for the terminal device 50.
[Terminal device and battery station]
(1) Terminal Device FIG. 2 is an example of the configuration of the terminal device 50 worn by the exerciser. The terminal device 50 includes a belt unit 51, a buckle unit 52, a sensor 53, a light emitting element 54, and a wireless communication interface 55.

  The belt portion 51 has a required width and a length that can be wound around the waist of the exerciser. The buckle portion 52 is connected to the base end side of the belt portion 51. When the front end of the belt portion 51 is inserted into the buckle portion 52, the belt portion 51 is annular, that is, in a use state. The buckle portion 52 is formed with a charging connector (not shown) to be inserted into the battery station 60, and power can be supplied to the battery in the sensor 53 via the charging connector.

  The sensor 53 is built in the buckle portion 52. The sensor 53 can detect, for example, acceleration in a direction perpendicular to the floor surface of the training room, for example, with an athlete wearing the belt portion 51 on the waist. The sensor 53 detects movement at predetermined time intervals, for example, every 0.06 seconds, and sends the detection result to the wireless communication interface 55. The sensor 53 is configured using, for example, an acceleration sensor. The acceleration sensor includes a piezoelectric element that can detect a predetermined axial component. When acceleration occurs, the acceleration sensor outputs a level voltage of an axial component corresponding to the acceleration. In the present embodiment, the sensor 53 detects at least the acceleration of the vertical axis and outputs either “0” or “1”. An acceleration sensor that can detect axial components in the front-rear direction and the left-right direction may be employed according to needs. Furthermore, a 6-axis acceleration sensor capable of detecting rotation can also be used. In addition, as the sensor 53, a configuration according to need can be appropriately employed.

The plurality of light emitting elements 54 are provided on the buckle portion 52. The number of the light emitting elements 54 to be turned on and the light emitting elements to be lighted are switched according to the voltage level of the battery built in the sensor 53. Thereby, the exerciser can visually recognize the remaining capacity of the built-in battery.
The wireless communication interface 55 converts detection data detected by the sensor 53 at predetermined time intervals into a detection signal that is a radio wave signal and transmits the detection signal to the transceiver 40. In this example, the detection signal is transmitted at a predetermined time interval in synchronization with the time division slot assigned to each terminal device 50. This transmission time interval is set longer than the detection interval of the sensor 53, and is, for example, an interval of 0.1 seconds. Therefore, the detection results for a plurality of times are transmitted simultaneously at 0.1 second intervals.

Although not shown, the terminal device 50 incorporates a chargeable / dischargeable battery. The battery supplies power to the sensor 53, the light emitting element 54, and the wireless communication interface 55. With this electric power, motion detection by the sensor 53, lighting and light emission by the light emitting element 54, conversion to a radio wave signal and transmission of radio waves by the wireless communication interface 55 are performed.
(2) Battery Station FIG. 3 is an external view of the battery station 60. The battery station 60 includes a holding unit 61 that holds the terminal device 50 in an unused state, and a support unit 62 that supports the holding unit at a certain height. The holding portion 61 includes a predetermined number, 24 in this case, connector connecting portions 63 in the longitudinal direction. The connector connection part 63 is electrically connected to the charging connector of the buckle part 52 of the terminal device 50 in an unused state. FIG. 3 shows a plurality of terminal devices 50 connected to the connector connecting portion 63. The battery in the terminal device 50 connected to the connector connection unit 63 is charged by a charge control circuit built in the battery station 60.

(3) Entry signal transmission An entry signal indicating the start of use of the terminal device 50 can be transmitted from the terminal device 50 to the control device 30 via the transceiver 40 as follows, for example. The identifier of the terminal device 50 may be transmitted together with the entry signal.
(A) The terminal device 50 is provided with detection means for detecting disconnection between the connector connection portion 63 of the battery station 60 and the charging connector of the terminal device 50, and an entry signal is transmitted in response to detection of disconnection.
(B) The terminal device 50 is provided with detection means for detecting that the tip of the belt portion 51 is inserted into the buckle portion 52, and an entry signal is transmitted in response to the detection of insertion.
(C) The control device 30 sets a predetermined period for accepting an entry, and regards a detection signal based on the detection of the sensor 53 within the period as an entry signal.
(D) An entry button (not shown) is provided in the terminal device 50, and an entry signal is transmitted in response to pressing of the entry button.

[Hardware configuration of control device]
FIG. 4 is a block diagram illustrating a hardware configuration of the control device 30. The control device 30 includes a CPU 31, a ROM 32, a RAM 33, a drawing processing processor 34, and a sound processing processor 35. In addition, the control device 30 is wired to the transceiver 40 and receives motion information from the sensor 53 via the transceiver 40.

The CPU 31 is connected to the ROM 32 and RAM 33 via a bus. The CPU 31 executes a predetermined control program stored in the ROM 32 and controls the progress of the lesson.
The ROM 32 stores image information and various data necessary for a predetermined control program. In the present invention, the data stored in the ROM 32 includes reference operation data generated for each piece of music information. Details of the reference operation data will be described later. Further, the ROM 32 stores a plurality of pieces of music information. Thereby, the derivative | guide_body which shows an exerciser's reference | standard motion is output synchronizing with a music based on reference | standard motion data. The control program includes a training program, a demonstration program, an exerciser evaluation program, and the like.

The RAM 33 temporarily stores processing data associated with execution of each control program.
The drawing processor 34 reads necessary image data from the ROM 32 based on a drawing command issued by the CPU 31, and performs drawing processing on the display area of the RAM 33. Thereby, image data is output to the projector 21 in a predetermined cycle, for example, 1/60 second.
The sound processor 35 reads out ADPCM data of the music from the ROM 32, performs processing such as pitch conversion, noise addition, envelope setting, level setting, reverb addition and the like, and outputs the music from the speaker 22 as sound.

[Functional configuration of control device]
FIG. 5 is a block diagram illustrating a functional configuration of the control device 30. The control device 30 includes a training control unit 30a, a motion history data generation unit 30b, a shift data generation unit 30c, a data selection unit 30d, an evaluation unit 30e, and a notification unit 30f.
(1) Data Stored in ROM and RAM ROM 32 stores a reference operation data table, and RAM 33 stores a motion history data table and a shift data table. These data will be described first, and then each functional unit will be described.

(1-1) Reference Operation Data FIG. 6 is a conceptual explanatory diagram of reference operation data. The reference motion data is created for each song according to the length, rhythm, melody, etc. of the song. Therefore, although not shown, the reference motion data is stored in association with music. The reference motion data associates the motion information of the derivative that guides an arbitrary exerciser with a predetermined motion with the time information. In this example, the motion information includes a motion flag and a direction flag. “Motion flag” values “0” and “1” indicate the presence or absence of motion. That is, a value of “1” indicates that the sensor 53 should output “1” at a predetermined time. Conversely, if the value of the motion information is “0”, this indicates that the output of the sensor 53 should be “0”. The “direction flag” indicates the type of derivative displayed on the guide image. In this example, the derivatives include four types of arrow-shaped derivatives indicating the left and right front-rear directions. “Time information” indicates a relative elapsed time from the beginning of the music. The time interval of the time information, that is, the difference between the time information t _i and t _{i + 1} is the same as the detection time interval of the sensor 53.

(1-2) Motion History Data FIG. 7 is a conceptual explanatory diagram of motion history data. The motion history data associates time information with the first motion flag, the second motion flag,... The Nth motion flag (N is a natural number). Here, “time information” indicates a relative elapsed time from the beginning of the music. The time information t _i and t _{i + 1,} has a sensor 53 the same time interval as to detect the presence or absence of a signal, for example, 0.06 seconds. The “jth motion flag” (j is a natural number equal to or less than N) is a value of a detection signal from the jth terminal device 50 worn by the jth exerciser. In this way, the value of the detection signal from the first to Nth terminal devices 50 worn by the first to Nth athletes is stored in association with the time information.

Hereinafter, “exerciser motion history data” and “movement history data of the jth terminal device 50 worn by the exerciser” refer to a combination of the jth motion flag and time information.
(1-3) Shift Data FIG. 8 is a conceptual explanatory diagram of 1 × shift data. The 1 × shift data associates 1 × shift time information with the first motion flag, the second motion flag,... The Nth motion flag. Here, “1 time shift time information” is a value obtained by shifting each time information in the motion history data by ΔT, that is, “t _i −ΔT”. The values of “first motion flag”, “second motion flag”... “Nth motion flag” are the same as the values in the motion history data in the time information “t _i ”. Here, the value of ΔT is set to be longer than the time interval at which the sensor 53 detects the movement. As will be described later, in this example, of the motion history data or the 1 × shift data, the one closer to the reference motion data is selected as selection data and used for the calculation of the overall evaluation result of the exerciser.

Hereinafter, “executor's 1 × shift data” and “j × terminal device 50's 1 × shift data worn by the athlete” are the j th motion flag of the j th terminal device 50 and 1 ×. A combination with shift time information.
(2) Training control unit The training control unit 30 a controls the training process based on the control program 32 a stored in the ROM 32. That is, guide images necessary for execution of training are displayed one after another, and the reaction of the exerciser is evaluated. Furthermore, the training control unit 30a may display a demonstration screen prior to training.

(2-1) Guide image display The guide image is displayed with reference to the reference motion data table 32b. The reference operation data table 32b of the ROM 32 stores reference operation data for each music piece. The training control unit 30a generates a guide image indicating the derivative based on the reference motion data and outputs the guide image to the drawing processor 34.

  FIG. 9 shows an example of a guide image displayed based on the reference motion data. Four types of arrows indicating front and rear, left and right directions, that is, four types of derivatives GMa, scroll from the lower side to the upper side in the figure. Each arrow-like derivative GMa overlaps the timing bar TB at the instruction timing indicated by the time information in the reference motion data of FIG. In this example, an instructor-shaped derivative GMb is also displayed together with the arrow-shaped derivative GMa. The movement of the instructor-like derivative GMb indicates the action when the instructor-like derivative GMb moves as instructed by the arrow-like derivative GM. Although not shown, the reference motion data for displaying the instructor-like derivative GMb is created separately from the reference motion data of the arrow-like derivative GMa. The reference motion data of the instructor-like derivative GMb indicates the movement and timing of an exerciser exercising based on the arrow-like derivative GMa. Instead of displaying the arrow-like derivative GMa, only the instructor-like derivative GMb may be displayed as a derivative.

In this example, since the sensor 53 detects only the acceleration in the vertical direction, four types of arrow-like derivatives GMa are output on the assumption that the direction in which the exerciser moves is not evaluated.
(2-2) Temporary Evaluation Result The training control unit 30a calculates the temporary evaluation result of each exerciser based on the movement history data of each exerciser, and outputs an image indicating the result to the drawing processor 34. . The temporary evaluation result is an evaluation result with respect to an exerciser's reaction at each instruction timing. This evaluation result is calculated based on the motion history data and the reference motion data. In addition, evaluation here is evaluation with respect to the real-time operation | movement during exercise to the last. As will be described later, the feature of the present invention includes the step of shifting the entire motion history data acquired by the exercise for a predetermined time, and this is used to make the final evaluation for the entire exercise for the predetermined time accurate. In the point.

  Refer to FIG. 9 again. The image in FIG. 9 also shows the temporary evaluation results of each exerciser during training. In the figure, a plurality of rectangular areas indicated by numbers “1” to “24” are individual areas UA of the athletes wearing the first to Nth terminal devices 50. In this figure, the case of N = 24 is shown. If the output of the sensor 53 coincides with the operation flag of the reference operation data at the instruction timing, the exerciser's personal area UA is displayed in “blue”. It is preferable to allow a certain amount of deviation in the determination of timing coincidence / mismatch. The greater the difference in timing at which the output of the sensor 53 matches the action flag of the reference action data, the more the color of the exerciser's personal area UA changes in the order of “yellow” and “red”. This determination is made based on the motion history data.

  FIG. 10 is a graph showing changes in the values of the motion flags of the reference motion data and motion history data. A solid line indicates a change in the value of the motion flag of the reference motion data. A broken line indicates a change in the value of the motion flag of the motion history data. At time t3, the reference motion data changes from “1” to “0”, but the motion history data changes with a delay of Δt seconds. At time t5, the reference motion data changes from “0” to “1”, but the motion history data changes with a delay of Δ2 t seconds.

  FIG. 11 is an explanatory diagram of a temporary evaluation table created in the RAM 33 by the training control unit 30a. This table shows a case where a change in the value of the motion flag of the reference motion data and the motion history data shown in FIG. 10 occurs. In the temporary evaluation table, time information, an operation flag in the reference operation data, an operation flag in the motion history data, and an evaluation result are written in association with each other. For example, the training control unit 30a displays “blue” if the time information deviation at which the value of the motion flag changes is Δt or less, “yellow” if it exceeds Δt and is Δ2t or less, and “red” if it exceeds Δ2t. ". In this example, the change from “1” to “0” is evaluated as “blue” because it is a shift of Δt. The change from “0” to “1” is evaluated as “blue” because of a shift of Δt at time t6, but is evaluated as “yellow” because of a shift of Δ2t at time t7.

  That is, if the number of entries in which the motion flag values are continuously different between the reference motion data and the motion history data is Nb or less, the training control unit 30a writes “blue” in the evaluation result of the entry. In this example, “Nb = 1”. In addition, the training control unit 30a evaluates the entry having different motion flag values if the number of entries in which the motion flag values continuously differ between the reference motion data and the motion history data is Ny or less and exceeds Nb. Write "Yellow" in In this example, “Ny = 2”. Furthermore, if the number of entries in which the motion flag values are continuously different between the reference motion data and the motion history data is greater than or equal to Nr, the training control unit 30a displays “red” as the evaluation result of the entries having different motion flag values. Write. In this example, “Nr = 3”.

Note that the method for evaluating the timing shift at which the output of the sensor 53 matches the operation flag of the reference operation data is not necessarily limited to this example.
(3) Motion History Data Generation Unit The motion history data generation unit 30b receives a detection signal from the sensor unit 53 of the terminal device 50 via the transceiver 40. In this example, the plurality of transceivers 40 and the terminal device 50 perform time division multiplex communication, and the motion history data generation unit 30b identifies the terminal device 50 by the time division slot assigned to each terminal device 50. The motion history data generation unit 30 b writes the motion history data in the motion history data table 33 a of the RAM 33 based on the received detection signal.

(4) Shift data generation unit The shift data generation unit 30c generates 1 × shift data by shifting the time information of the motion history data by a predetermined time interval ΔT. The generated 1 × shift data is written in the shift data table 33b of the RAM 33.
The shift data generation unit 30c may further generate double shift data, triple shift data, and so on. The double shift data is associated with the double shift time information and the first motion flag, the second motion flag,... The Nth motion flag. Here, “double shift time information” is a value obtained by shifting each time information in the motion history data by Δ2T, that is, “t _i −Δ2T”. The triple shift data is associated with the triple shift time information and the first motion flag, the second motion flag,... The Nth motion flag. Here, “three times shift time information” is a value obtained by shifting each time information in the motion history data by Δ3T, that is, “t _i −Δ3T”. The values of “first motion flag”, “second motion flag”... “Nth motion flag” are the same as the values in the motion history data in the time information “t _i ”.

(5) Data Selection Unit The data selection unit 30d determines selection data for a certain exerciser when training is performed in accordance with a certain music piece. The data selection unit 30d compares the exerciser's movement history data and the 1 × shift data with the reference movement data, respectively. As a result of the comparison, data having a higher degree of coincidence with the reference motion data is determined as selection data for the exerciser.

  FIG. 12 is a conceptual diagram of a comparison work table created by the data selection unit 30d. This figure shows a comparative work table for a first athlete wearing a certain first terminal device 50, but the data selection unit 30d creates a similar table for each of all the terminal devices 50. The data selection unit 30d compares the value of the motion flag corresponding to the time information ti between the motion history data and the reference motion data, and determines a match / mismatch. Further, the value of the motion flag corresponding to the 1 × shift time information (ti−ΔT) of the 1 × shift data is compared with the value of the motion flag corresponding to the time information ti of the reference motion data, and a match / mismatch is determined. To do. The data selection unit 30d determines the selected one of the motion history data and the 1 × shift data that has the larger number of values that match the reference motion data. This determination is made for each exerciser. In FIG. 12, the number of times that the 1-times shifted data is determined to be “match” is larger. Accordingly, the 1 × shift data becomes the selection data. In this way, the data selection unit 30d determines the first selection data to the Nth selection data for each of the first exerciser to the Nth exerciser.

Which of the movement history data and the 1 × shift data becomes the selection data differs depending on the exerciser. This is because the time lag from when the exerciser actually moves to when it is detected differs depending on how the exerciser wears the terminal device 50 and how the exerciser moves.
When not only the 1 × shift data but also the 2 × shift data is generated as the shift data, any one of the motion history data, the 1 × shift data, and the 2 × shift data is selected data for each athlete. To decide. The method for determining which matches the reference operation data is the same as described above. The smaller the value of the phase shift width ΔT of the time information of the reference motion data and the more shift data is generated, the more accurately the movement of the exerciser can be evaluated.

As described above, when the motion of the athlete is detected using the sensor 53 attached to the body of the athlete, the time lag from the actual movement of the athlete to the detection thereof is compensated by the shift data. Can do.
(6) Evaluation part The evaluation part 30e calculates a comprehensive evaluation result. The comprehensive evaluation result is represented by an evaluation point for the reaction of the exerciser through the entire music, which is calculated after the end of one music. This evaluation point is calculated based on the reference motion data of the music and the selection data of each athlete.

First, the evaluation unit 30e creates a work table similar to the above-described temporary evaluation table for the reference operation data and the selection data, and writes either blue, yellow, or red evaluation for each entry. However, the value of the jth motion flag in the selection data is used instead of the motion flag in the motion history data of the temporary evaluation table. If the selected data is 1-fold shift data, the value of the j-motion flag of selection data corresponding to the time information t _i is the value of the j-motion flag corresponding to the time information t _i -.DELTA.T. Next, the evaluation unit 30e calculates the exerciser's evaluation point P based on the following formula, for example, with a maximum of 100 points. In this manner, the temporary evaluation table is created and the evaluation points P are calculated for each athlete at the end of each music piece.

P = N _blue × 100 / N _ref −N _yellow × α-N _red × β
N _blue : number of entries of evaluation result “blue” in the current temporary evaluation table N _ref : maximum number of entries of evaluation result “blue” N _yellow : entry of evaluation result “yellow” in the current temporary evaluation table Number N _red : Number of entries of the evaluation result “red” in the current temporary evaluation table α, β: Weighting (6) Notification unit The notification unit 30 f visually indicates the comprehensive evaluation result by the evaluation unit 30 e to the athlete. Notice. FIG. 13 is an example of a screen that displays the comprehensive evaluation result. Evaluation points out of 100 points are written for each athlete. Further, a printer may be connected to the control device 30 (not shown), and the comprehensive evaluation result may be output to the printer. The result may be recorded on a server by a computer network and stored as personal information.

[Process flow]
(1) Main Routine FIG. 14 is a flowchart showing an example of the flow of the main routine executed by the CPU 31 of the control device 30. This process is executed when the control device 30 is activated.
Step S1: The CPU 31 waits for a training start time, and when the start time is reached, the CPU 31 proceeds to step S2. Here, it is assumed that a predetermined training start time is set in the ROM 32 of the control device 30.

Step S2: The CPU 31 notifies the exerciser that the entry is accepted. This notification is performed, for example, by displaying an entry screen.
Steps S3 to S5: The CPU 31 receives an entry signal via the transceiver 40 (S3), and increments the total number of entries every time an entry signal is received. The CPU 31 proceeds to step S6 after the total number of entries reaches a predetermined number of entries within a predetermined entry period (S4) or after the entry period elapses (S5).

Step S6: The CPU 31 accepts selection of music or selects music stored at random to determine music.
Steps S7 to S9: The CPU 31 outputs a demonstration image. In the demonstration image, for example, basic steps are shown (S7). During the output period of the demonstration image, the CPU 31 confirms whether or not the detection signals from all the terminal devices 50 that have entered can be received (S8). If there is a terminal device 50 that has not received the detection signal, the process returns to step S8 again within the demo period (S9). When detection signals from all the terminal devices 50 that have entered during the demonstration period are received or when the demonstration period elapses, the process proceeds to step S10 (S9).

  Steps S <b> 10 to S <b> 11: The CPU 31 starts reproduction of music and displays guide images including the derivative GMa and the derivative GMb one after another based on reference motion data associated with the music. Further, the CPU 31 evaluates the instruction timing and the movement deviation of each exerciser one by one, and displays the evaluation result, that is, the temporary evaluation result together with the guide image. Further, the CPU 31 sequentially writes detection signals from the terminal devices 50 in association with time information into the RAM 33 to generate a motion history data table. The CPU 31 displays a guide image, displays a temporary evaluation result, and writes movement history data until the music ends (S11). When the music ends, the process proceeds to step S12.

Step S12: The CPU 31 executes a shift evaluation processing subroutine. In this subroutine, the evaluation points of each exerciser are calculated.
Step S13: The CPU 31 displays the evaluation points of each exerciser calculated in step S12 in association with the identifier indicating each terminal device 50.
(2) Shift Evaluation Processing Subroutine FIG. 15 is a flowchart showing an example of the flow of processing of the shift evaluation processing subroutine executed in step S11 of the main routine. In this subroutine, selection data is determined, and evaluation points for each exerciser are calculated based on the selection data.

Step S <b> 111: The CPU 31 specifies one terminal device 50 that is an evaluation point calculation target among the terminal devices 50 in the entry. For example, assume that the j-th terminal device 50 is specified as an evaluation target.
Step S112: The CPU 31 generates 1 × shift data based on the operation history data of the jth terminal device 50.

  Steps S113 to S115: The CPU 31 creates the comparison work table illustrated in FIG. 12 for the j-th terminal device 50, and determines either the motion history data or the 1 × shift data as selection data. That is, it is determined whether or not the motion flag and the j-th motion flag match between the motion history data and the reference motion data (S113). Also, it is determined whether or not the values of the j-th motion flag of the 1-times shift data of the j-th terminal device 50 and the motion flag of the reference motion data match (S114). The CPU 31 determines the one with more matching values as selection data (S115).

Step S116: The CPU 31 generates a work table based on the selection data and the reference operation data.
Step S117: The CPU 31 calculates the evaluation point of the j-th terminal device 50 based on the work table generated in step S116, and temporarily writes it in the RAM 33 or the like in association with the identifier of the j-th terminal device 50.

Step S118: The CPU 31 determines whether or not evaluation points have been calculated for all the terminal devices 50 that have entered, and when the calculation for all the terminal devices 50 is completed, the CPU 31 returns to the main routine.
In this example, an exerciser's evaluation point is calculated and displayed every time the music ends. However, the evaluation points may be displayed at the end of the training time including a plurality of music pieces.

With the above process, when detecting the movement of the athlete using a sensor attached to the body of the athlete, taking into account the variation in the time lag from when the athlete actually moves until the sensor detects the movement, Person's actions can be evaluated.
<Other embodiments>
(A) Terminal device The terminal device 50 does not necessarily have a belt shape. Depending on the type of exercise, the number and shape of the terminal device 50 and the attachment position to the exerciser can be changed as appropriate. For example, in a boxing exercise, a glove worn by an athlete on both hands may be used as the terminal device 50, and the sensor 53 may be incorporated in the glove-shaped terminal device. Further, in aerobics or dance exercise, a band-shaped terminal device 50 wound around both wrists and both ankles of an exerciser may be used.

(B) Sensor As the sensor 53, a sensor capable of detecting multi-directional acceleration and rotational movement, such as a 3-axis acceleration sensor or a 6-axis acceleration sensor, may be used. In that case, the reference operation data is stored in the ROM 32 for each direction. Further, the motion history data and the shift data are also generated for each direction, and are compared with the reference motion data for each direction. At this time, the delay when the sensor detects the movement of the exerciser is not only different for each exerciser, but may be different depending on the direction even for the same exerciser. That is, when evaluating a certain exerciser, the 1 × shift data shifted by ΔT in the first direction is closer to the reference motion data, but the 2 × shift data shifted by Δ2T in the second direction is the reference motion data. It can be closer.

  The sensor output may be a multi-stage analog output instead of a digital output. For example, it is conceivable to use a sensor capable of 128-stage output or 256-stage output, and to evaluate the speed of movement, the intensity of movement, and the magnitude of swing. In this case, the value of the motion information of the reference motion data is also a value corresponding to the output of the sensor, for example, “0” to “127” or “0” to “255”. The same applies to the values of motion information of motion history data and shift data. When such a multi-stage output sensor is used, it is preferable to set a tolerance for deviation when comparing the reference motion data with the motion history data or the shift data.

Thus, by attaching the sensor to the body of the exerciser and devising the data collected from the sensor, it becomes possible to evaluate the movement of the exerciser in detail.
(C) A program for executing the above-described method on a computer and a computer-readable recording medium recording the program are included in the present invention. Here, the program may be downloadable. Examples of the recording medium include a computer readable / writable flexible disk, hard disk, semiconductor memory, CD-ROM, DVD, magneto-optical disk (MO), and others.

  The present invention is applicable to a training system, a game, and a simulation system in which a sensor is attached to an exerciser to detect the movement of the exerciser and the movement is evaluated.

Schematic perspective view of training system to which exercise motion evaluation system is applied An example of the configuration of a terminal device worn by an athlete Example of external view of battery station in FIG. The block diagram which shows the hardware constitutions of the control apparatus of FIG. The block diagram which shows the function structure of the control apparatus of FIG. Conceptual diagram of reference motion data Conceptual diagram of motion history data Conceptual diagram of 1x shift data An example of a guide image displayed based on the reference motion data The graph which shows the change of the value of the motion flag of standard motion data and motion history data Explanatory drawing of temporary evaluation table Conceptual diagram of work table for comparison Sample screen displaying the comprehensive evaluation results The flowchart which shows an example of the flow of the process of the main routine which the control apparatus of FIG. 1 performs Flowchart showing an example of the processing flow of the shift evaluation processing subroutine

Explanation of symbols

1: Training system 30: Control device 31: CPU
40: Transceiver 50: Terminal device 53: Sensor 55: Wireless communication interface 60: Battery station

Claims (6)

Reference motion data storage means for storing motion information of a derivative that guides an arbitrary exerciser to a predetermined motion and time information as reference motion data in association with each other,
A first motion detecting means that is mounted on the first exerciser and detects the movement of the first exerciser performed on the movement information of the derivative ;
Movement history data recording means for recording the first movement information detected by the first movement detection means and the time information in association with each other as time movement data;
Shift data generating means for shifting the phase of the time information in the first motion history data by a predetermined time interval ΔT and generating first shift data;
The first motion history data and the first shift data are temporally compared with the reference motion data on the basis of the time information of the reference motion data, and the data with the higher degree of coincidence with the reference motion data is Data selection means for determining one selection data;
Evaluation means for evaluating the first exerciser based on the first selection data;
Informing means for informing the result of evaluation by the evaluating means;
A motor motion evaluation system comprising: A second motion detecting means mounted on the second exerciser for detecting the movement of the second exerciser performed on the motion information of the derivative ;
The movement history data recording means further records second movement history data in which the movement information of the second exerciser detected by the second movement detection means is associated with time information,
The shift data generation means further generates second shift data in which the time information in the second motion history data is shifted in phase by a predetermined time interval ΔT,
The data selection means temporally compares the second motion history data and the second shift data with the reference motion data based on time information of the reference motion data, and the degree of coincidence with the reference motion data is The higher data is further determined as the second selection data,
The evaluation means further performs evaluation of the second exerciser based on the second selection data,
The notification means further notifies the result of evaluation by the evaluation means;
The motor motion evaluation system according to claim 1, wherein: The shift data generation means further generates double shift data shifted by a time interval Δ2T based on the first motion history data,
The data selection means determines, as the first selection data, data having a high degree of coincidence with the reference operation data among the motion history data, the first shift data, and the double shift data. The exercise motion evaluation system according to claim 1.   The exercise motion evaluation system according to claim 1, further comprising instruction output means for displaying the derivative based on the reference motion data. Reference motion data storage step for storing the motion information of the derivative that guides an arbitrary exerciser to a predetermined motion and the time information as reference motion data in association with each other,
A first motion detection step of receiving first motion information indicating the motion of the first exerciser performed on the motion information of the derivative from a sensor attached to the first exerciser;
A movement history data recording step of recording the first movement information received in the first movement detection step and the time information as first movement history data in association with each other;
A shift data generation step for generating time information in the first motion history data by shifting the phase by a predetermined time interval ΔT to generate first shift data;
The first motion history data and the first shift data are temporally compared with the reference motion data on the basis of the time information of the reference motion data, and the data with the higher degree of coincidence with the reference motion data is A data selection step to determine one selection data;
An evaluation step for evaluating the first exerciser based on the first selection data;
A notification step for notifying a result of the evaluation in the evaluation step;
A method for evaluating motion movement, comprising: Reference motion data storage means for storing motion information of a derivative that guides an arbitrary exerciser to a predetermined motion and time information as reference motion data in association with each other,
First movement detecting means for receiving movement information indicating movement of the first athlete performed on movement information of the derivative from a sensor attached to the first athlete;
Movement history data recording means for recording movement information of the first athlete received by the first movement detection means and time information in association with each other as time movement data;
Shift data generating means for generating the first shift data by shifting the phase of the time information in the first motion history data by a predetermined time interval ΔT;
The first motion history data and the first shift data are temporally compared with the reference motion data on the basis of the time information of the reference motion data, and the data with the higher degree of coincidence with the reference motion data is Data selection means for determining one selection data;
Evaluation means for evaluating the first athlete based on the first selection data; and notification means for notifying a result of evaluation by the evaluation means;
An exercise motion evaluation program characterized by causing a computer terminal to function.

Images