JP3783592B2 - Operation determination system, operation determination method, operation determination program, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a state determination system, a state determination method, a state determination program, and a recording medium that make it possible to evaluate a user's physical state against a numerical standard.
[0002]
[Prior art]
Music therapy is a treatment technique that uses musical sounds intentionally and systematically for recovery of physical and mental disabilities and functional improvement. In recent years, this music therapy has been implemented in a wide range of scenes such as hospitals, welfare facilities, elderly facilities, and educational sites, and is also used for rehabilitation and stress management.
[0003]
Music therapy is performed by a user (hereinafter referred to as a therapist) selecting a musical sound that best suits various symptoms, and using the response of the user (hereinafter referred to as a client) to the musical sound. Some music therapies use reactions involving physical movements such as singing, playing, and dancing, and various instruments such as castanets and maracas are used for the progression. Therapists need to fully participate, focus on and observe the responses of clients operating with these instruments in music therapy settings (hereinafter referred to as sessions).
[0004]
Through a session that is usually repeated multiple times, the therapist records the client's response to the musical sound in detail and determines how the client's state has changed. This determination is based on various scales depending on the purpose of the session such as rehabilitation and the target client such as a child with developmental disability and the elderly, but is common in that an objective determination criterion is required.
[0005]
[Problems to be solved by the invention]
However, in the past, the above-described determination, that is, the evaluation of the session is based on a subjective scale using a questionnaire or the like, and numerical data is collected directly based on the operation of the client. There was no way to determine the session.
[0006]
In view of the above-described problems, an object of the present invention is to provide a state determination system and a state determination method that make it possible to evaluate a body state of a client against a numerical standard.
[0007]
[Means for Solving the Problems]
  In order to solve the above problems, in the state determination system of the present invention, a computer device that reproduces a musical sound based on a musical sound signal,An operation determination system comprising a signal transmission device operated by a user according to the musical sound,,The signal transmission device includes operation detection means for detecting an operation of the signal transmission device and outputting an operation signal indicating the operation, and transmission means for transmitting the operation signal to the computer device,The computer device includes:Sent by the sending meansSaidActionReceive to receive signalmeansAnd the above musicAccordingUser'sActionReference signal indicating target value ofMeans for storingWhen, The receiving meansReceived saidActionSignal andThe reference signal stored in the storage means;Based on said musical soundDeviation from the target value of user's action according toIndex signal generation to generate an index signal indicatingmeansIt is characterized by providing.
[0008]
  TakeActionThe discrimination system can acquire numerical data indicating the operation of the client corresponding to the musical sound while reproducing the musical sound. Further, by using the reference signal, the actual operation of the client can be obtained as numerical data indicating a deviation from a certain reference.
[0009]
  In addition, the computer device may include the indicator signal.IssueRememberIndicator signalMemorymeansIt is preferable to provide. By doing so, various musical sounds can be used in the session.
  In another preferred aspect, the computer device controls the parameters of the musical sound based on the operation signal received by the receiving means.
[0010]
  In addition, the index signal generationmeansSaidActionThe index signal is preferably generated based on a difference signal indicating a level difference between a signal and the reference signal. By doing so, it becomes possible to grasp the difference between the action to be reacted by the client and the actual reaction by the client as the level difference of the electric signal.
[0011]
  In addition, the index signal generationmeansPreferably, the indicator signal is generated by integrating the absolute value of the difference signal over a predetermined period. The client's action for a certain musical tone may be faster, slower, or more varied than the target action. In the present invention, even if the client action precedes the target action, Even in the case of delay, the deviation from the target value can be obtained as numerical data that can be compared with other data.
[0012]
  Also, the aboveComputerThe apparatus includes a display unit and generates the index signalmeansPreferably, the index signal is shaped into a predetermined graph format, and a graph as a shaping result is displayed on the display unit. By doing so, it is possible to clearly show the transition of the client's response to the musical tone.
[0013]
  Also, the memorymeansStores a plurality of reference signals, and selects one of the plurality of reference signals to generate the indicator signalmeansSupply to choosemeansIt is preferable to provide. By doing so, it becomes possible to flexibly change the value indicating the target of the client's reaction.
[0014]
  Also, the aboveComputerPreferably, the apparatus is connected to a communication terminal via a communication network and transmits the index signal to the communication terminal. By doing so, it is possible to acquire numerical data indicating the operation of the client even in a session where the therapist and the client are remote.
[0015]
The communication terminal preferably includes a shaping unit that shapes the index signal into a predetermined graph format, and a terminal display unit that displays a graph. By doing so, it is possible to easily display numerical data indicating the operation of the client even in a session where the therapist and the client are remote.
[0016]
  The operation determining method of the present invention reproduces a musical tone based on a musical tone signal,Depending onuserAn operation signal that is detected and output by the signal transmission device operated by the signal transmission device, the operation of the signal transmission deviceAnd an index signal indicating a deviation from the target value of the user's action based on the reference signal indicating the target value of the user's action responding to the musical sound.
[0017]
  TakeActionAccording to the determination method, it is possible to acquire numerical data indicating the operation of the client corresponding to the musical sound while reproducing the musical sound. Further, by using the reference signal, the actual operation of the client can be obtained as numerical data indicating a deviation from a certain reference.
[0018]
  An operation determination program according to the present invention includes a step of reproducing a musical tone based on a musical tone signal using a computer device,Depending onuserAn operation signal that is detected and output by the signal transmission device operated by the signal transmission device, the operation of the signal transmission deviceAnd a reference signal indicating a target value of the user's action that reacts to the musical sound, and an index signal indicating a deviation from the target value of the user's action based on the comparison result Discriminating program for executing the step to performIsIt is characterized by that.
[0019]
  TakeActionThe discrimination program can acquire numerical data indicating the operation of the client corresponding to the musical sound while reproducing the musical sound. Further, by using the reference signal, the actual operation of the client can be obtained as numerical data indicating a deviation from a certain reference.
[0020]
  Further, the computer-readable storage medium of the present invention is the above-described storage medium.ActionIt is preferable to store a discrimination program. By doing so, even with other computer devices used for general purposes, it is possible to acquire numerical data indicating the operation of the client corresponding to the musical sound while reproducing the musical sound.
[0021]
DETAILED DESCRIPTION OF THE INVENTION
[1. First Embodiment]
[1-1. Configuration of First Embodiment]
FIG. 1 is an overall view showing a configuration of a state determination system SYS of the first embodiment. As shown in FIG. 1, the state determination system SYS of the first embodiment includes a plurality of signal transmitters 1Tn (n = natural number), a recording performance device 1M, a terminal device 2, and a speaker system 3. .
[0022]
<A. Signal transmitter 1T>
FIG. 2 is a perspective view showing an external configuration of the signal transmitter 1Tk (k = 1 to n). As shown in FIG. 2, the signal transmitter 1T includes a transmitter main body SH and a sensor unit SS that can be attached to and detached from the transmitter main body SH. Hereinafter, when it is not necessary to distinguish individual devices, the signal transmitter will be described with a 1T symbol.
[0023]
The transmitter main body SH and the sensor part SS are configured to be able to be fixed via the connector part CN.
FIG. 3 is an enlarged perspective view showing the shape of the connector portion CN. As shown in FIG. 3, the sensor unit SS includes a pin jack PJ, while the transmitter body includes a plug PG. When the pin jack PJ is inserted into the plug PG, a signal can be transmitted from the sensor unit SS to the transmitter body SH.
[0024]
A screw thread is formed on the outer peripheral wall of the end of the sensor unit SS, while a screw groove is formed on the inner peripheral wall of the end of the transmitter body SH. By rotating the sensor unit SS in the direction of arrow a in FIG. 3 and the transmitter body SH in the direction of arrow b in FIG. 3, the sensor unit SS and the transmitter body SH are fixed. Therefore, for example, even when the user takes an action such as swinging the signal transmitter 1T violently, the sensor unit SS and the transmitter main body SH are not separated.
[0025]
Further, by rotating the sensor unit SS in the direction of the arrow b shown in FIG. 3 and the transmitter body SH in the direction of the arrow a shown in FIG. 3, the connector unit CN is loosened, and the sensor unit SS is moved to the transmitter body. Can be removed from SH.
[0026]
Since the sensor unit SS and the transmitter main body SH are detachable, any sensor unit SS can be attached to the transmitter main body SH as long as the sensor unit SS has an engageable connector unit CN. Can do. Therefore, it is possible to select and use various sensor units SS according to the case classification, for example, a session for an infant with Down syndrome or a session for an elderly person with Alzheimer's disease. is there.
[0027]
When the sensor unit SS is selected in accordance with the session, it is necessary for the transmitter body SH to be able to identify what sensor is selected. For this purpose, the transmitter body SH is provided with a switch 14. With this switch 14, it is possible to specify what kind of sensor is attached to the transmitter main body SH. The switch 14 is provided with a plurality of buttons (not shown) with numbers such as “2” and “3”, and each button has data obtained by converting the display number into a binary number. It is associated. The transmitter main body SH can change the processing of the electrical signal detected by the sensor unit SS in accordance with the selection state of the switch 14.
[0028]
FIG. 4 is a block diagram illustrating an electrical configuration of the transmitter main body SH in a state where the sensor unit SS is mounted. As shown in FIG. 4, the transmitter main body SH includes a measurement circuit 30, an A / D converter 31, a data processing circuit 32, and a transmission circuit 33.
[0029]
In the example of FIG. 4, the strain gauge 10 is used as the sensor unit SS. The strain gauge 10 has a property that when its shape changes, the resistance value changes according to the amount of change. Therefore, when the client grasps the signal transmitter 1T and takes some action, the resistance value of the strain gauge 10 changes.
[0030]
The measurement circuit 30 measures changes in the resistance value of the strain gauge 10. The measurement circuit 30 includes a resistor 100, and measures the voltage value at the point p from the value of the resistor 100, the value of the resistor 10 of the sensor unit SS, and the voltage power supply Vcc. Here, assuming that the value of the resistor 10 is r and the value of the resistor 100 is R, the voltage value at the point p is given by Equation (1).
Vcc × r / (r + R) (1)
The voltage value at this point p is the operation signal MS. That is, the operation signal MS is a signal output as a result of measuring the operation of the client by the sensor unit SS. The measurement circuit 30 outputs the operation signal MS to the A / D converter 31.
[0031]
The A / D converter 31 is a circuit that converts an analog signal into a digital signal. The A / D converter 31 digitally converts the operation signal MS to create a data bit DB. Then, the A / D converter 31 outputs the data bit DB to the data processing circuit 32.
[0032]
A signal indicating the state of the switch 14 is constantly supplied to the data processing circuit 32. Based on this signal, the data processing circuit 32 creates a switch bit SWB. Further, the data processing circuit 32 stores a value uniquely assigned to the transmitter main body SH, and creates an identification bit IB based on this value. The data processing circuit 32 combines the switch bit SWB, the identification bit IB, and the data bit DB supplied from the A / D converter 31 to create sensor data SD.
[0033]
The sensor data SD created by the data processing circuit 32 has a format as shown in FIG. 5, for example. In this example, the bit width of the sensor data SD is m, the switch bit SW is stored in a 3-bit width from the MSB, the identification bit IB is stored in the 4th to 6th bits from the MSB, and from the MSB The data bit DB is stored after the seventh bit.
[0034]
As described above, the switch bit SWB is based on the selection state of the switch 14, and the switch bit SWB can identify the number of axes representing the operation of the data bit DB. become. For example, in the example of FIG. 4, the single strain gauge 10 is selected as the sensor unit SS. Therefore, the operation signal MS generated based on the electrical change of the sensor unit SS is data indicating the movement of one axis. In this case, the value “001” is stored as the switch bit SWB.
[0035]
In the signal transmitter 1T of the present embodiment, the sensor unit SS is detachable, and the sensor unit SS can be freely changed according to the purpose of the session. It is also possible to mount a sensor for detecting movement or further movement of the shaft. In that case, the data bit DB stores data indicating movements of a plurality of axes.
[0036]
For example, when the sensor unit SS that detects the biaxial movement is mounted, the therapist may operate the switch 14 and select the button “2”. Then, the value of the switch bit SWB becomes “010”. As a result, it is possible to indicate in the sensor data SD that the value of the data bit DB indicates a biaxial movement. This is the same even when a sensor unit SS having three or more axes is mounted. Based on the number stored in the switch bit SWB, the data bit DB is equally divided, and for each group of the divided bits, it can be interpreted as expressing movement in each axial direction.
[0037]
Furthermore, even if a plurality of sensor data SD are transmitted simultaneously by the identification bit IB, it is possible to identify which sensor transmitter SD is data transmitted by each sensor data SD. The identification bit IB corresponds to a number uniquely assigned to each transmitter body SH and is generated by the data processing circuit 32. In this embodiment, since data having a 3-bit width is used as the identification bit IB, up to eight signal transmitters 1T can be identified.
[0038]
The sensor data SD output by the data processing circuit 32 is output to the transmission circuit 33. The transmission circuit 33 modulates the carrier based on the sensor data SD, and transmits the modulation signal MOD to the recording performance device 1M via a transmission antenna (not shown).
[0039]
<B. Recording performance device 1M>
Next, the recording performance device 1M will be described. The recording performance device 1M is a so-called computer device that includes a CPU and a RAM and can input and output data.
FIG. 6 is a block diagram showing an electrical configuration of the recording performance device 1M.
The recording performance apparatus 1M includes a receiving unit 20, a control unit 21, an input unit 22, a storage unit 23, a sound source unit 24, an effector 25, a D / A converter 26, a display unit 27, and an external device interface. 28.
[0040]
The receiving unit 20 performs wireless communication with the signal transmitter 1T via a receiving antenna (not shown) and receives the modulated signal MOD. When receiving the modulation signal MOD, the receiving unit 20 demodulates the signal and reproduces and outputs the sensor data SD.
[0041]
The control unit 21 centrally controls each unit provided in the recording performance device 1M to enable sound generation based on the sensor data SD output from the reception unit 20, and to indicate the transition of the user's physical condition. An index data ID is generated.
[0042]
As shown in FIG. 6, the control unit 21 includes a ROM 210, a CPU 211, a RAM 212, and a subtracter 213.
The ROM 210 is a rewritable nonvolatile memory. The ROM 210 stores various control programs and data necessary for operating the state determination system SYS. The CPU 211 functions as a control center of each unit provided in the performance device 1M. Further, the CPU 211 refers to various data stored in the ROM 210, analyzes the sensor data SD, and calculates a sound effect to be added to the musical sound. The result of this calculation is the effect parameter PM. A volatile memory RAM 212 is used as a temporary work area of the CPU 211. The subtractor 213 compares the reference data ST stored in the storage unit 23 with the sensor data SD, and outputs difference data DF indicating the difference.
[0043]
The reference data ST is data indicating an ideal value to be stored in the data bit DB when the client operates in accordance with the musical sound. Then, by comparing the reference data ST with the value of the data bit DB included in the sensor data SD and taking the difference, a numerical value indicating how far the operation of the client is from the ideal operation can be obtained. . This value is the above-described difference data DF.
[0044]
  FIG. 7 is an example of a graph showing temporal changes in the reference data ST and the data bit DB. In the example of FIG. 7, the value indicated by the reference data ST is slightly higher.LateAs a result, the value of the data bit DB is changed. Therefore, it can be seen that the client is operating slightly behind the music tempo. A graph showing the change of the difference data DF at this time is as shown in FIG.
[0045]
Suppose that the value of the data bit DB becomes exactly the same as the reference data ST as a result of ideal operation of the client. Then, since the difference between the reference data ST and the data bit DB is always 0, the graph is drawn as a line on the x-axis in the example shown in FIG. On the contrary, when the client takes an action far from the ideal action, the value of the difference data DF takes a large value regardless of a positive value or a negative value. Therefore, by calculating the area surrounded by the graph drawn by the difference data DF (the shaded area in FIG. 8) and determining how close this calculated area is to 0, the operation of the client is numerically shown. You will be able to get indicators. This index is the index data ID.
[0046]
In other words, the index data ID is equal to the integral of the absolute value of the difference data DF in an arbitrary period. A program for performing this calculation is stored in the ROM 210 of the control unit 21, and the CPU 211 executes the calculation.
[0047]
  The reference data ST, the difference data DF, and the index data ID are stored in the storage unit 23Is remembered. Storage unit 23For example, hard disk drive (HDD), compact disk read only memory (CD-ROM) drive, floppy (registered trademark) disk drive (FDD), magneto-optical (MO) disk drive, digital multipurpose disk It consists of a storage device such as a (DVD) drive. Further, the difference data DF is stored in the storage unit 2.3Are stored as separate files based on the identification bit IB. Therefore, even when sensor data SD is received simultaneously from a plurality of signal transmitters 1T, it is possible to refer to the index data ID corresponding to any signal transmitter 1T after the session ends. At this time, the index data ID is displayed in a predetermined graph format according to the control program stored in the ROM 210.
[0048]
The storage unit 23 also stores MIDI data MD that is data necessary for musical performance. The MIDI data MD is supplied to the sound source unit 24 during musical performance. The sound source unit 24 stores sound source data OD corresponding to various timbres in advance. The sound source data OD is a signal waveform indicating the tone color of a musical tone desired to be generated. The sound source unit 24 arranges the sound source data OD based on the MIDI data MD supplied from the storage unit 23 and generates musical sound data MC.
[0049]
Then, the effector 25 gives a predetermined effect to the musical sound data MC supplied from the sound source unit 24 based on the effect parameter PM supplied from the control unit 21. Specifically, the provision of the predetermined effect is, for example, changing a value indicating the volume, tempo, timing, tone color, effect, or pitch of a musical sound. The musical sound data MC provided with the acoustic effect by the effector 25 is converted into an analog signal by the D / A converter 26 and supplied to the speaker system 3. The speaker system 3 amplifies the analog signal that is the output of the D / A converter 26 and emits the sound.
[0050]
The musical tone performance and its settings as described above can be operated via the input unit 22. The input unit 22 includes a “start performance” button BT1 (not shown), a “data display” button BT2 (not shown), a “setting change” button BT3 (not shown), and a numeric keypad TK (not shown). Is provided. The “start performance” button BT1 is associated with a signal for instructing the recording performance device 1M to generate a musical tone. The “data display” button BT2 has an index data ID in a predetermined format on the display unit 27. A signal instructing display is associated. Further, a “setting change” button BT3 is associated with a signal for instructing execution of a predetermined control program stored in the ROM 210, and when this button is pressed, a program for changing the reference data ST is started. Is done.
[0051]
Accordingly, when the “start performance” button BT1 is pressed, a signal for instructing the start of performance is sent to the system bus SB of the recording performance device 1M, and the musical performance can be started. If the “data display” button BT2 is pressed, a signal requesting display of the index data ID on the display unit 27 is sent to the system bus SB, and a graph based on the index data ID is displayed on the display unit 27. Further, when the “setting change” button BT3 is pressed, a program for changing the reference data ST is started and an operation screen of the program is displayed on the display unit 27.
[0052]
The display unit 27 can display the index data ID shaped in a predetermined format, or can display a screen when changing the reference data ST by a predetermined control program stored in the ROM 210. When the user activates the program by pressing the “change setting” button BT3, the user can change the reference data ST by operating the numeric keypad TK in accordance with the screen displayed on the display unit 27.
[0053]
The external device interface 28 is a physical interface for connecting an external device that conforms to a standard compatible with the recording performance device 1M. Therefore, by connecting the cable of the external device to the external device interface 28, the recording performance device 1M and the external device can be used together. That is, it is possible to connect an external device to the external device interface 28 and use the MIDI data MD stored in the device.
[0054]
It should be noted that a program necessary for various processes such as musical tone reproduction control based on the MIDI data MD can be stored in the storage unit 23. In this case, those programs are loaded into the RAM 212 via the system bus SB, and the CPU 211 is operated.
[0055]
[1-2. Operation of First Embodiment]
FIG. 9 is an explanatory diagram showing an operation concept of the state determination system SYS. In this example, it is assumed that a uniaxial sensor unit SS composed of one strain gauge 10 is mounted on the signal transmitter 1T.
[0056]
First, when starting a session, the therapist must select some musical tone and reproduce the musical tone. Therefore, the therapist selects a desired musical sound via the input unit 22 and presses the “start performance” button BT1. Then, based on the control signal associated with the “start performance” button BT1, the CPU 211 of the control unit 21 supplies the MIDI data MD corresponding to the musical sound to be played from the storage unit 23 to the sound source unit 24, and Reference data ST corresponding to the MIDI data MD is loaded into the RAM 212.
[0057]
The tone generator 24 generates musical sound data MC based on the supplied MIDI data MD, converts the musical sound data MC into an analog signal by the D / A converter 26, and supplies it to the speaker system 3. Then, a musical sound is emitted from the speaker system 3. Here, since the modulation signal MOD has not yet been received from the control signal transmitter 1T, no effect is given to the musical sound to be emitted.
[0058]
Next, when the music used for the session becomes audible to the therapist and the client, the client and the therapist know that the music therapy session has started. The client takes various actions based on the session plan of the therapist in advance according to the musical tone. For example, it is assumed that the body movement such as dancing or taking a conducting action in accordance with the musical tone played by the client is started. Then, the movement of the client is detected by the signal transmitter 1T held by the client.
[0059]
The operation of the client is first generated as an operation signal MS by the measurement circuit 30 according to a change in the resistance value r of the strain gauge 10 built in the sensor unit SS. The operation signal MS is digitally converted by the A / D converter 31 to become a data bit DB. The data bit DB is combined with the identification bit IB corresponding to the signal transmitter 1T held by the client and the switch bit SWB based on the state of the switch 14 by the data processing circuit 32, and becomes sensor data SD. The transmission circuit 33 modulates a carrier having a predetermined frequency based on the sensor data SD, and transmits it to the recording performance device 1M via a transmission antenna (not shown). The above operation is repeated while the state determination system SYS is operating.
[0060]
As described above, the operation of the client is sequentially converted into data and transmitted to the recording performance device 1M as the modulation signal MOD. Therefore, all the movements of the client continue to be transmitted to the recording performance device 1M, and the movement of the client in response to the musical sound is not missed. Even when a plurality of clients are participating in the session, each of the signal transmitters 1T held by each client transmits the modulated signal MOD to the recording performance device 1M. Therefore, it is possible to capture the operations of all the clients.
[0061]
Now, on the recording performance device 1M side, the modulation signal MOD is received by the reception unit 20 via a reception antenna (not shown). The receiving unit 20 demodulates the modulation signal MOD, reproduces the sensor data SD, and sends it to the system bus SB. Then, the CPU 211 of the control unit 21 detects reception of the sensor data SD and starts analyzing the sensor data SD.
[0062]
The CPU 211 acquires the data bit DB after identifying how many axes of movement data are stored in the data bit DB based on the switch bit SWB. At this time, based on the identification bit IB, the CPU 211 identifies from which signal transmitter 1T the signal currently being processed is transmitted. Then, the CPU 211 supplies the reproduced data bit DB to the subtractor 213, calculates the effect parameter PM based on the data bit DB, and sequentially supplies the effect parameter PM toward the effector 25.
[0063]
Here, when the CPU 211 receives a plurality of sensor data SD from the signal transmitter 1T, the CPU 211 selects the sensor data SD including data that is closest to the reference data ST, and calculates the effect parameter PM according to the data.
[0064]
When the effect parameter PM is supplied from the CPU 211, the effector 25 changes the value of the musical sound data MC supplied from the sound source unit 24 based on the contents of the data, and gives an acoustic effect. Specifically, values indicating the tempo, pitch, sound quality, etc. of the musical sound data MC are changed. The effector 25 supplies the musical sound data MC to which the acoustic effect is given to the D / A converter 26, and the D / A converter 26 converts the musical sound data MC into an analog signal and outputs it to the speaker system 3.
[0065]
By performing the processing as described above, the speaker system 3 emits a musical sound to which an acoustic effect based on the movement of the client is given, and the change in the sound is identified by both the therapist and the client. become. Therefore, in the state determination system SYS of the present embodiment, the client and therapist can sensibly identify how much the player's tempo and dynamics are aligned and how much the pitch is shifted.
[0066]
Furthermore, by changing a predetermined control program in the ROM 210, it is possible to proceed with the performance by determining whether the above player's tempo and dynamics coincide with each other or whether a certain pitch is within a certain threshold. It is also possible to control the musical tone effectively according to the object and purpose of the music therapy session.
[0067]
Now, the subtractor 213 supplied with the data bit DB from the CPU 211 in the above subtracts the value of the data bit DB from the value of the reference data ST loaded in the RAM 212 to generate difference data DF. Then, the CPU 211 generates an index data ID based on the difference data DF. The CPU 211 stores the index data ID in the storage unit 23. At this time, the index data ID is stored in the storage unit 23 as a separate file for each identification bit IB corresponding to each index data ID.
[0068]
Then, the CPU 211 can convert the index data ID into a graph format according to a predetermined control program and display it on the display unit 27. Therefore, the therapist can check the operation of each client numerically and visually by the graph displayed on the display unit 27. In this case, the therapist may press the “data display” button BT 2 provided in the input unit 22. Then, a predetermined control program is activated by a control signal associated with the “data display” button BT 2, and a graph is displayed on the display unit 27 by the CPU 211.
[0069]
In addition, the display unit 27 displays a graph indicating the current movement of the client during the musical sound emission, and displays the graph based on the file storing the index data ID in the storage unit 27 during the musical sound stop. Is done. Therefore, the therapist can see a graph showing the behavior of clients participating in an ongoing session during a music therapy session, and after the session ends, during the session where the desired client ended. A graph showing the operation can be confirmed.
[0070]
Therefore, according to the state determination system SYS of the present embodiment, the therapist can check the operation of the client with a graph at any time, such as during the session and after the session ends, and the movement of the client can be more specifically and objectively determined. , Can be grasped numerically. In other words, the therapist can introduce a numerical standard superior to the conventional session determination method.
[0071]
[1-3. Effect of First Embodiment]
As described above, in the state determination system SYS of the first embodiment, any sensor unit SS can be used as long as the shape of the connector unit CN is engaged. The signal transmitter 1T can be customized so that the body expression of the client to the musical sound used for the measurement can be measured most easily. As a result, it is possible to collect numerical information of body expressions tailored to the target client, and it is possible to provide effective judgment criteria for the therapist.
[0072]
Further, in the state determination system SYS of the first embodiment, the therapist can freely input the reference for determining the body expression of the client via the input unit 22 of the recording performance device 1M. Thus, the therapist can determine the client's physical expression according to the criteria deemed most desirable in his session.
[0073]
Furthermore, in the state discrimination system SYS of the first embodiment, a certain numerical standard is introduced to the effect of music therapy that had to be observed and described only by subjective judgment of the therapist in the past, recording reference and diagnosis, It is possible to provide an effective reference standard, for example, when creating a subsequent treatment program. Since all system settings can be set before the session starts, the therapist's concentration on the client is not hindered during the actual session.
[0074]
In addition, in the state determination system SYS of the first embodiment, all settings necessary for the therapist can be performed before the actual session, and the record of the body expression of the client is stored in the storage unit 23. It is possible to confirm after completion. Therefore, the therapist can commit the body expression to the client throughout the session and confirm the experience numerically after the session ends. That is, the state determination system SYS of the first embodiment also has an educational effect for the therapist.
[0075]
[2. Second Embodiment]
[2-1. Configuration of Second Embodiment]
FIG. 10 is an overall view showing the configuration of the state determination system SYS ′ of the second embodiment. As shown in FIG. 10, the state determination system SYS ′ of the second embodiment includes a recording performance device 1M ′ instead of the recording performance device 1M, and the recording performance device 1M ′ and the terminal device 2 have a network NET. Connected through. The recording performance device 1M ′ and the terminal device 2 can perform data communication via the network NET.
[0076]
  The network NET may be a LAN (Local Area Network) laid in a facility such as a hospital or a nursing home, or a wide area communication network such as the Internet. Further, the terminal device 2 of the second embodiment includes the storage unit 2 of the state determination system SYS ′.3The MIDI data MD is stored in the same format as that stored in.
[0077]
  Next, a detailed configuration of the recording performance device 1M ′ of the second embodiment will be described. FIG. 11 is a block diagram showing an electrical configuration of the recording performance device 1M ′ of the second embodiment. FIG.1As shown in FIG. 2, the recording performance device 1M ′ of the second embodiment includes a communication interface 29.exceptThis is the same as the recording performance device 1M of the first embodiment.
[0078]
The communication interface 29 is used as a data input / output port for communication via the network NET, and performs data communication according to a predetermined protocol such as TCP / IP.
[0079]
In the control unit 21 of the recording performance device 1M ′ of the second embodiment, the ROM 210 stores a difference calculation program DP indicating a difference calculation procedure between the sensor data SD and the reference data ST. In accordance with the difference calculation program DP, the CPU 211 compares the sensor data SD and the reference data ST stored in the ROM 210 to generate difference data DF.
[0080]
[2-2. Operation of Second Embodiment]
FIG. 12 is a sequence diagram showing operations of the recording performance device 1M ′ and the terminal device 2 according to the second embodiment.
First, when measuring the operation of the client, as in the first embodiment, the client operates in accordance with music while holding the signal transmitter 1T, and sends the sensor data SD to the recording performance device 1M ′. . Then, the recording performance device 1M ′ generates the difference data DF by analyzing the sensor data SD, and creates the index data ID based on the difference data DF, and stores the index data ID in the storage unit 23 (step S101). To S103).
[0081]
Thereafter, when the music therapy session ends, the recorded performance device 1M ′ transmits the stored difference data DF to the terminal device 2 via the network NET (step S104). On the terminal device 2, the transferred index data ID is displayed in a predetermined format on a display device (not shown), and the therapist can know the result at a glance.
[0082]
Here, it is assumed that it is necessary to determine the operation of the client based on a more appropriate reference, and the reference data ST recorded in the recording performance device 1M ′ is changed (No in step S105). In this case, the therapist sets the reference data ST from the terminal device 2 and transmits it to the recording performance device 1M ′ (step S107).
[0083]
  Then, the recording performance device 1M ′ includes the storage unit 23Is changed to the received reference data ST (step S108). After changing the reference data ST, the recording performance device 1M ′ transmits a signal indicating the end of the change to the terminal device 2 (step S109). It can be seen from the terminal device 2 side that the reference data ST stored in the recording performance device 1M ′ has been changed by the signal indicating the end of the change.
[0084]
  Further, when it is desired to add or change the MIDI data MD recorded in the recording performance device 1M ′, the terminal device 2 transmits a signal requesting confirmation of the presence or absence of the desired MIDI data MD (step S111). Upon receiving this request signal, the recording performance device 1M ′ first stores the requested MIDI data MD in the storage unit 2.3Whether the requested MIDI data MD is stored in the storage unit 2 or not.3If it does not exist (No in step S112), a signal requesting transfer of the MIDI data MD is transmitted to the terminal device 2 (step S113). Receiving this transfer request, the terminal device 2 transmits the MIDI data MD and the reference data ST corresponding to the MIDI data MD to the recording performance device 1M ′ (step S114).
[0085]
  When the recording performance device 1M ′ receives the MIDI data MD and the reference data ST from the terminal device 2, the recording performance device 1M ′ stores the MIDI data MD and the reference data ST in the storage unit 2.3Is stored in a predetermined area. Then, the control program data stored in the ROM 210 of the control unit 21 is changed so that the musical sound based on the received MIDI data MD is reproduced in the music therapy session (step S115). When the change of the program data is completed, the recording performance device 1M ′ transmits a signal indicating the end of the change to the terminal device 2 (step S116). By receiving the signal indicating the end of the change, it is possible to identify that the setting of the recording performance device 1M ′ is completed from the terminal device 2 side.
[0086]
Through the above operation, the setting of the recording performance device 1M ′ is changed. Thereafter, when a new music therapy session is started, the process returns to step S102. If no session is performed, the process ends.
[0087]
The measurement conditions after step S106 can be changed whenever the therapist finds it necessary to change the data collection conditions of the recording performance device 1M ′. Similarly, when it is desired to transmit MIDI data MD not previously stored in the recording performance device 1M ′ to the recording performance device 1M ′, the MIDI data MD can be transmitted from the terminal device 2 at any time.
[0088]
In the recording performance device 1M ′, when the reference data ST is changed, both the data before the change and the data after the change are stored. Therefore, even if the reference data ST is changed, it can be restored to the original data contents. In addition, when the reference data ST is changed a plurality of times, the data storing the changes is stored in the recording performance device 1M ′. Therefore, it is possible to make a plurality of changes based on a certain reference data ST and select the reference data ST considered to be most suitable for an arbitrary session.
[0089]
[2-3. Effect of Second Embodiment]
As described above, the state determination system SYS ′ of the present embodiment can be changed in settings such as the content of pronunciation or stored in the state determination system SYS ′ even when set in a remote place. MIDI data MD that has not been transmitted can be transmitted. Therefore, if the state determination system SYS ′ of the second embodiment is used, the therapist can immediately acquire the data even for a session performed by a client in a remote location, for example. Even when there is a need to change the settings and music to suit the needs, it is possible to respond quickly.
[0090]
Music therapy is also used in, for example, terminal care situations (nursing centered on the dignity of a patient who has been sentenced to 6 months of life from a doctor). Such patients may receive nursing care at home, and it may be difficult to set up various facilities and information necessary for nursing. However, according to the state determination system SYS ′ of the second embodiment, setting and data transfer can be performed from the terminal device 2 via the network NET, which is effective.
[0091]
<Modification>
The present invention is not limited to the above-described aspects of the first and second embodiments. For example, the following various modifications are possible.
[0092]
(1) In the first and second embodiments, the sensor unit SS attached to the signal transmitter 1T has been described as being detachable. However, for example, only a musical tone having a very similar tempo and rhythm used by the therapist is used. If it is known in advance that the signal transmitter 1T is used, the signal transmitter 1T may be one in which the sensor unit SS that best matches the effect intended by the therapist is fixed to the transmitter body SH.
[0093]
(2) In the first and second embodiments, the therapist or the client cannot confirm the setting of the switch 14 provided in the transmitter main body SH, but the transmitter main body SH is configured with, for example, an LED. It is also possible to install the display panel so that the setting mode can be easily confirmed.
[0094]
(3) In the first and second embodiments, the measurement circuit 30 and the A / D converter 31 may be installed on the sensor unit SS side. In this case, since it is necessary to supply the power supply voltage and the operation clock in order to operate the measurement circuit 30 and the A / D converter 31, the cable for supplying the power supply voltage and the operation clock is connected from the transmitter body SH to the sensor unit SS. Need to connect to.
[0095]
(4) In the first and second embodiments, the identification bit width in the sensor data SD is 3 bits, and description has been made in a mode in which up to eight signal transmitters 1T can be used simultaneously. By setting 4 to 4 bits or more, a larger number of signal transmitters 1T may be used simultaneously. For example, when the identification bit IB is 4 bits, there are 16 signal transmitters 1T that can be used simultaneously in the first and second embodiments.
[0096]
(5) In the first and second embodiments, the generation of the effect parameter PM has been described by taking the form performed by the CPU 211 in accordance with a predetermined control program stored in the ROM 210, but is stored in the ROM 210. The generation method of the effect parameter PM may be changed by changing the control program. For example, the effect parameter PM may be created based only on the sensor data SD including the arbitrary identification bit IB, and the musical sound may be controlled according to the effect parameter PM, or a plurality of values may be set based on the value of the identification bit IB. The signal transmitters 1T may be grouped, the average value of the effect parameters PM may be calculated for each group, and a sound effect may be imparted to the musical sound data MC based on the result.
[0097]
(6) In the first and second embodiments, when a plurality of sensor data SD are received, the recording performance systems 1M and 1M ′ select the sensor data SD that is closest to the reference data ST, and according to the data Although the description has been given of the case where the effect parameter PM is generated and the tone control is performed, the method of generating the effect parameter PM may be a method of calculating an average value of all the received sensor data SD and following the average value.
[0098]
(7) In the first and second embodiments, the description has been given by taking the aspect in which the operation of the client is numerically determined based on the index data ID. However, the difference data DF stored in the storage unit 23 is arbitrary. By analyzing according to the statistical method, it is possible to take an aspect of grasping the client operation tendency and the client state transition in each session arranged in time series. This result can be used as an effective judgment criterion for the session progress policy.
[0099]
(8) Further, in the first and second embodiments, the description has been made in the mode in which the index data IB is generated using the reference data ST. However, instead of the reference data ST, the operation of the therapist or the like was measured. An aspect in which the data bit DB included in the sensor data SD is used may be employed. In this case, the difference data DF may be generated by calculating the difference between the reference data bit DB and the data bit DB based on the operation of the client, and the index data ID may be generated based on the difference data DF.
[0100]
(9) In the first and second embodiments, the sensor unit SS has been described as using the motion sensor that detects the human motion and measures the client motion, but is attached to the signal transmitter 1T. The sensor unit SS is a so-called biological information sensor that outputs a state signal obtained by measuring a client's brain wave, pulse (pulse wave), GSR (galvanic skin response), respiration, pupil movement, and the like. It may be. In this case, the client listens to the music produced by the recording / playing device 1M as well as the so-called “active music therapy” in which the client dances or conducts the music in accordance with the music. The state determination system SYS and SYS ′ of this embodiment can also be used for so-called “passive music therapy” that performs relaxation induction.
[0101]
【The invention's effect】
As described above, according to the state determination system of the present invention, it is possible to effectively quantify and collect non-linguistic expressions of the target client. Therefore, it is possible to provide an effective standard when the therapist judges the effect of the session.
[0102]
In the state determination system of the present invention, various sensors can be used according to the target client and its state, and the signal transmitter 1T can be customized so that the musical sound used for the session is most easily quantified. it can. As a result, it is possible to effectively digitize and collect the non-linguistic expressions of the client, and to provide effective judgment criteria for the therapist.
[0103]
In the state determination system of the present invention, the reference for determining the body expression of the client can be freely changed from the input unit of the recording performance device. Thus, the therapist can make measurements according to criteria that are considered most desirable in his session.
[0104]
Furthermore, since the measurement result can be stored in the storage unit, this data can be freely referred to after the session. As a result, the therapist can perform all necessary settings prior to the actual session, so the therapist can fully engage the client during the session and does not degrade the quality of the conventional session.
[0105]
In addition, since the measurement result is stored, the digitized physical condition of the client can be analyzed based on a specific method, and the change of the client due to the session can be clearly understood. Being able to see changes in the client's physical condition after the session means that changes that the therapist couldn't notice during the session can be referenced according to the criteria, so this change in the number can be seen during the session. Compared with the experience, the educational effect for therapists with little session experience is produced.
[0106]
Furthermore, since the state determination system according to the present embodiment can freely change settings via a communication network, for example, a session is also attempted for a client residing in a remote place or a client receiving nursing care at home. Even in situations where the therapist cannot engage with the client, it is possible to determine the effect of the session itself.
[Brief description of the drawings]
FIG. 1 is an overall view showing a system configuration of a state determination system SYS.
FIG. 2 is a perspective view showing an external configuration of a signal transmitter 1T.
FIG. 3 is a perspective view showing an enlarged shape of a connector part CN.
FIG. 4 is a block diagram showing an electrical configuration of a transmitter main body SH.
FIG. 5 is a conceptual diagram showing a format of sensor data SD.
FIG. 6 is a block diagram showing an electrical configuration of the recording performance device 1M.
FIG. 7 is an example of a graph showing temporal changes in reference data ST and data bits DB.
FIG. 8 is a graph showing changes in differential data DF.
FIG. 9 is an explanatory diagram showing an operation concept of the state determination system SYS.
FIG. 10 is an overall view showing a configuration of a state determination system SYS ′.
FIG. 11 is a block diagram showing an electrical configuration of the recording performance device 1M ′.
FIG. 12 is a sequence diagram showing operations of the recording performance device 1M ′ and the terminal device 2.
[Explanation of symbols]
SYS, SYS '... status determination system, 1T ... signal transmitter, 1M, 1M' ... recording performance device, 2 ... communication terminal, 20 ... receiving unit, 21 ... control unit, 23 ... storage unit, 27 ... display unit, ST ... reference data, DB ... data bit, DF ... difference data, ID ... index data, NET ... network.

Claims (12)

An operation determination system comprising a computer device that reproduces a musical sound based on a musical sound signal, and a signal transmission device that is operated by a user according to the musical sound,
The signal transmission device detects an operation of the signal transmission device and outputs an operation signal indicating the operation;
Transmission means for transmitting the operation signal to the computer device,
The computer device includes:
Receiving means for receiving the operation signal transmitted by the transmitting means;
Storage means for storing a reference signal indicating a target value of the user's action according to the musical sound;
Index signal generating means for generating an index signal indicating a deviation from a target value of the user's action corresponding to the musical sound based on the action signal received by the receiving means and the reference signal stored in the storage means An operation discrimination system comprising: The operation determination system according to claim 1, wherein the computer device includes an index signal storage unit that stores the index signal. The operation determination system according to claim 1, wherein the computer device controls a parameter of the musical sound based on the operation signal received by the receiving unit. The operation determination system according to claim 1, wherein the index signal generation unit generates the index signal based on a difference signal indicating a level difference between the operation signal and the reference signal. The operation determination system according to claim 4, wherein the index signal generation unit integrates an absolute value of the difference signal over a predetermined period to generate the index signal. The computer device includes a display unit,
The operation determination system according to claim 1, wherein the index signal generation unit shapes the index signal into a predetermined graph format and displays a graph as a shaping result on the display unit. The storage means stores a plurality of the reference signals,
The operation determination system according to claim 1, further comprising selection means for selecting one of the plurality of reference signals and supplying the selected reference signal to the index signal generation means. The operation determination system according to claim 1, wherein the computer device is connected to a communication terminal via a communication network and transmits the index signal to the communication terminal. The communication terminal is
The operation determination system according to claim 8, further comprising: a shaping unit that shapes the index signal into a predetermined graph format; and a terminal display unit that displays a graph. Play music based on the music signal,
A signal transmission device operated by a user according to the musical sound is an operation signal that is detected and output by the operation of the signal transmission device, and is used to react to the operation signal indicating the operation of the signal transmission device and the musical sound. An operation determination method comprising: outputting an index signal indicating a deviation from a target value of a user's action based on a reference signal indicating a target value of the user's action. Playing a musical sound based on a musical sound signal using a computer device;
A signal transmission device operated by a user in response to the musical sound is an operation signal that is output by detecting the operation of the signal transmission device, and an operation signal indicating the operation of the signal transmission device and a use that reacts to the musical sound Comparing a reference signal indicating a target value of the person's movement;
And a step of outputting an index signal indicating a deviation from the target value of the user's action based on the comparison result. A computer-readable recording medium comprising the operation determination program according to claim 11 recorded thereon.

Images