JP5673371B2 - Playback speed synchronization apparatus and program - Google Patents

Description

  The present invention relates to a content reproduction technology, and more particularly to a technology for synchronizing content with the breathing of a viewer.

  In Patent Document 1, a target breathing state is set at a sample point of content such as music, and the playback speed of the content is set so that the breathing state of the content viewer matches the target breathing state as much as possible. A technique for changing the above is disclosed. Non-Patent Document 1 discloses that the respiratory state is affected by emotion and activity.

JP2011-059419

Patrick Gomez and Brigitta Danuser, "Affective and physiological responses to environmental noises and music," International Journal of Psychophysiology, vol. 53, pp.91-103, 2004.

When the target breathing state set in the content and the breathing state affected by the viewer's emotion and activity level are significantly different from each other, the technique disclosed in Patent Document 1 appropriately sets the content playback speed in accordance with the viewer's breathing. There is a problem that it is difficult to control.
The present invention has been made in view of these points, and provides a technique capable of appropriately controlling the playback speed of content in conjunction with breathing that is affected by the emotion and activity of the viewer. Objective.

  In order to solve the above-mentioned problem, the present invention uses the respiratory information of the viewer, extracts emotional respiratory cycles corresponding to a plurality of respiratory cycles corresponding to a plurality of breaths performed by the viewer, and the emotional respiratory cycle The longer the basic sample update interval, the longer the basic sample update interval is calculated, and the content to be played back included in the content information corresponding to each of multiple playback positions along the time axis at the sample update interval corresponding to the basic sample update interval The information is updated, and reproduction information representing the content information to be reproduced is output.

  In the present invention, the longer the emotional respiratory cycle corresponding to a plurality of respiratory cycles corresponding to a plurality of breaths performed by the viewer, the longer the sample update interval is associated with the longer basic sample update interval, the content is set in the content. Even when the target breathing state and the viewer's breathing state are significantly different from each other, the playback speed of the content can be appropriately controlled in accordance with the viewer's breathing.

FIG. 1 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus according to the first and second embodiments. FIG. 2 is a graph illustrating the respiration level V (t) output from the respiration measurement unit. FIG. 3 is a graph for illustrating the respiratory cycle. FIG. 4 is a diagram illustrating a specific example of content with a set respiratory cycle. FIG. 5 is a flowchart for illustrating the playback speed synchronization method of the first embodiment. FIG. 6 is a flowchart for illustrating the playback speed synchronization method of the second embodiment. FIG. 7 is a block diagram for illustrating the functional configuration of the playback speed synchronization apparatus according to the third and fourth embodiments. FIG. 8 is a diagram for explaining an example of the predicted value of the expiration start time. FIG. 9 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the third embodiment. FIG. 10 is a flowchart for illustrating the playback speed synchronization method of the third embodiment. FIG. 11 is a diagram for illustrating the processing function of the reproduction speed calculation unit according to the fourth embodiment. FIG. 12A is a diagram for describing an example of a respiratory index calculated by the respiratory index extraction unit of the fourth embodiment. FIG. 12B is a diagram exemplifying a relationship among the respiratory index φ (t1), the respiratory target information Φ (p (t1)), and L (t1). 13A-13C are diagrams for explaining a specific example of the function D [L].

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Definition of terms]
Terms are defined as follows:
Content: means audio information or video information for viewing purposes, such as music, audio or reading, or theater, movie or TV program or other moving images.
Content information: Information that constitutes content and is sequentially played back along the time axis.
Reproduction position: means the reproduction position of each piece of content information that is sequentially reproduced along the time axis, that is, the progress position on the time axis in content reproduction. More specifically, for example, the frame position, sample point, time code, song position pointer, etc. correspond to the playback position.
Respiratory target setting position: It means a progress position on the time axis corresponding to at least a part of the reproduction positions. An example of the breathing target setting position is at least a part of the reproduction position.

Respiratory state: Means each state during a breathing exercise performed periodically. More specifically, for example, an exhalation start state that is a state at the time of starting an exhalation exercise, an exhalation state at each time point during the exhalation exercise, an expiration end state that is a state at the time of ending the exhalation exercise, an inspiration An inhalation start state, which is a state at the time of starting, an inhalation state at each point in time during the inspiratory motion, an inhalation end state, which is a state at the end of the inspiratory motion, and the like correspond to the respiratory state.
Reference state: means a predetermined respiratory state. For example, an exhalation start state, an exhalation end state, an inspiration start state, an inspiration end state, and the like correspond to the reference state.
Respiratory reference position: means a position on the time axis where the respiratory state becomes a specific reference state.

Respiration information: Information obtained by measuring the breathing state of a viewer who appreciates content or a performer who plays or performs content. More specifically, it means, for example, the length around the chest or the abdomen, the respiratory airflow, the temperature difference between exhaled air and inhaled air.
Reproduction speed: means the reciprocal of the time required from reproducing the content information at a certain reproduction position A to reproducing the content information at the next reproduction position B. This is a concept that can be read as the playback tempo or clock interval.

Set breathing cycle: This represents the breathing cycle of the viewer that is considered suitable for viewing the content set for the content. In this embodiment, it is assumed that one set respiratory cycle is set for one content. An arbitrary constant value may be set as the set breathing cycle, or a multiple or divisor of the reciprocal of the content tempo may be set as the set breathing cycle.
Content with set respiratory cycle: Means content including a set respiratory cycle and content information. A specific example of content with a set respiratory cycle will be described later.
Respiratory target content with set respiratory cycle: Means content with a set respiratory cycle in which the target respiratory state is set at the respiratory target setting position. A specific example of the respiration target content with the set respiration cycle will be described later.

[First Embodiment]
The first embodiment of the present invention will be described below.
<Configuration>
As illustrated in FIG. 1, the playback speed synchronization apparatus 1 of the first embodiment includes an input unit 11, a storage unit 12 that stores content 12 a with a set respiratory cycle, a respiratory measurement unit 13, and a respiratory emotion component extraction unit. 14, a basic playback speed calculation unit 15, a content playback speed control unit 16, a playback unit 17, and a control unit 18.

[Input unit 11]
The input unit 11 is a functional unit that receives input of content 12a with a set breathing cycle, and examples of the input unit 11 include an input port, an input interface, a reading device, and a receiving device.

[Contents 12a with set respiratory cycle]
The content with the set breathing cycle 12a of this embodiment is data having a data structure including the set breathing cycle and content information corresponding to each reproduction position along the time axis. For example, the content 12a with a set respiration cycle illustrated in FIG. 4 is set respiration with content information d (τ) which is MIDI data indicating the pitch and sound intensity corresponding to each sample point τ along the time axis. Including the period sBf. The sample point τ in this example is an integer greater than or equal to 0, and a larger value corresponds to a later time. In the content 12a with a set respiratory cycle illustrated in FIG. 4, the content information corresponding to each sample point τ to be reproduced is sequentially reproduced while the sample points τ to be reproduced are sequentially updated along the time axis. The update cycle of the sample point τ to be reproduced is called a sample update interval, and the standard set value of the sample update interval that is predetermined at the time of content creation or the like is S0. p (t) represents a sample point τ corresponding to the content information d (τ) reproduced at the time t, and the content information reproduced at the current time t = t1 is represented as d (p (t1)). Represent. t is an integer index corresponding to a discrete time, and “time t” means a time corresponding to the integer index t. For simplicity, it is assumed that t increases by 1 with a period T1.

[Storage unit 12]
The storage unit 12 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory.

[Respiration measurement unit 13]
The respiration measurement unit 13 is a well-known device that measures the respiration state of the content viewer 100 and outputs respiration information obtained thereby. In the example of this embodiment, information (respiration level) corresponding to the length around the chest and the abdomen is used as respiration information, and a device that detects respiration from a resistance change of a rubber tube wound around the chest or abdomen (for example, Nihon Kohden) TR-753T manufactured by AD and MLT1132 manufactured by ADInstruments are used as the respiratory measurement unit 13. The respiration measuring unit 13 in this example measures and outputs a respiration level V (t) at a certain set cycle T1. V (t) represents the respiratory level at time t.
FIG. 2 is a graph illustrating the respiration level V (t) output from the respiration measurement unit.
In the example of FIG. 2, the respiration level V (t) becomes maximum at the exhalation start time (bpe (n-1), etc.) that is the time when exhalation starts, and the respiration level V (t) decreases as the exhalation state progresses The breathing level V (t) becomes minimal at the inhalation start time (bpi (n), etc.), which is the time when inspiration starts, and the breathing level V (t) increases as the inspiratory state progresses, and the next exhalation starts A state in which the respiration level V (t) is maximized again at time (bpe (n), etc.) is repeated periodically.

[Respiratory emotion component extraction unit 14]
The respiratory emotion component extraction unit 14 includes, for example, a CPU (central processing unit), a memory, and the like, and is a processing unit configured by reading a predetermined program into the CPU. The respiratory emotion component extraction unit 14 uses the viewer's 100 respiratory level V (t) (respiration information) output from the respiratory measurement unit 13 and uses a plurality of breaths corresponding to a plurality of breaths performed by the viewer 100. The emotional respiratory cycle corresponding to the respiratory cycle is extracted and output. The emotional respiratory cycle is a cycle obtained by measuring the breathing level of the viewer 100 in the medium and long term, and reflects the affect of the emotion and activity of the viewer 100.

The respiratory emotion component extraction unit 14 in this example receives the respiratory level V (t) output from the respiratory measurement unit 13, and uses the value of t when the respiratory level V (t) is a maximum value as the expiration start time: bpe (n) is temporarily stored in a memory (not shown) in the respiratory emotion component extraction unit 14. n is an integer given for convenience in representing each breath, and increases by 1 for each breath. First, the respiratory emotion component extraction unit 14 calculates a respiratory cycle Btot (n) according to the following equation using, for example, the expiration start time bpe (n) temporarily stored in the memory (see FIG. 3).
Btot (n) = bpe (n) -bpe (n-1)… (1)
In the example of FIG. 3, the exhalation start time immediately before the current time t = t1 is bpe (n), but this is not a limitation of the present invention, and an exhalation start time earlier than that is bpe (n). Good.

Next, the respiratory emotion component extraction unit 14 of this example sets the value corresponding to the average value of the obtained plurality of respiratory cycles Btot (n) as the emotional respiratory cycle Bf. For example, the respiratory emotion component extraction unit 14 calculates and outputs the average respiratory cycle obtained according to the following formula as the emotional respiratory cycle Bf.
Bf = (Btot (n) + Btot (n-1) +… + Btot (nN)) ÷ (N + 1)… (2)
However, N is a predetermined positive integer, and n is larger than N. The example of N is an integer greater than or equal to 4 (refer nonpatent literature 1). In this case, the emotional respiratory cycle Bf corresponds to five or more respiratory cycles corresponding to five or more breaths. In addition, a monotonically increasing function value of the average value of a plurality of respiratory cycles Btot (n) or a representative value in the plurality of respiratory cycles Btot (n) closest to the average value of a plurality of respiratory cycles Btot (n) Or the like may be used as the emotional respiratory cycle Bf.

[Basic playback speed calculation unit 15]
The basic playback speed calculation unit 15 is configured by, for example, a CPU, a memory, and the like, and is a processing unit configured by reading a predetermined program into the CPU. The basic playback speed calculation unit 15 uses the set respiratory cycle sBf included in the content 12a with the set respiratory cycle stored in the storage unit 12 and the emotional respiratory cycle Bf output from the respiratory emotion component extraction unit 14, and uses sBf ÷ S0 The basic sample update interval mS0 is calculated and output so that the value of Bf ÷ mS0 approaches. Since the set respiratory cycle sBf and the standard setting value S0 of the sample update interval are constants, the basic reproduction speed calculation unit 15 calculates the basic sample update interval mS0 that is longer as the emotional respiratory cycle Bf is longer. For example, the basic reproduction speed calculation unit 15 sets the linear function value for the emotional respiratory cycle Bf as the basic sample update interval mS0. In other words, the basic reproduction speed calculation unit 15 sets, for example, a basic sample update interval mS0 as a result of applying a monotonically increasing linear function to the emotional respiratory cycle Bf. For example, the basic sample update interval mS0 is obtained according to the following equation.
mS0 = S0 × (a × (Bf ÷ sBf-1) +1) (3)
However, a is an adjustment amount indicating the degree to which the difference between the emotional respiratory cycle Bf and the set respiratory cycle sBf is reflected in the basic sample update interval mS0, and is an arbitrary constant greater than 0 and less than or equal to 1, for example.

[Content playback speed control unit 16]
The content playback speed control unit 16 is configured by, for example, a CPU, a memory, and the like, and is a processing unit configured by reading a predetermined program into the CPU. The content playback speed control unit 16 includes the basic sample update interval mS0 output from the basic playback speed calculation unit 15 and the content information d (τ) included in the content with the set breathing cycle 12a stored in the storage unit 12. Entered. The content playback speed control unit 16 sets the content information d (τ) corresponding to each of a plurality of sample points τ (playback position) along the time axis at a sample update interval that is a time interval corresponding to the basic sample update interval mS0. The content information d (τ) to be reproduced included is updated, and reproduction information r (τ) representing the content information d (τ) to be reproduced is sequentially output. The sample update interval of this embodiment is the basic sample update interval mS0 itself.

[Playback unit 17]
The reproduction unit 17 is a known presentation device that includes, for example, an amplifier, a speaker, and an image display device. The playback unit 17 receives the playback information r (τ) output from the content playback speed control unit 16 and outputs content such as acoustic information specified by the playback information r (τ).

[Control unit 18]
The control unit 18 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 18 controls the entire processing of the reproduction speed synchronization apparatus 1.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.
As illustrated in FIG. 5, content 12a with a set breathing cycle is input to the input unit 11 (step S101) and stored in the storage unit 12 (step S102).

  The breathing measurement unit 13 attached to the viewer 100 measures the breathing state of the viewer 100 at a cycle T1, and the breathing levels V (t1), V (t1-1), V ( t1-2),... are output (step S103). The respiratory levels V (t1), V (t1-1), V (t1-2),... Are input to the respiratory emotion component extraction unit 14, and the respiratory emotion component extraction unit 14 sets a new emotional respiratory cycle Bf. It is determined whether the respiration levels V (t1), V (t1-1), V (t1-2),... Necessary for generation have been input (step S104). In this embodiment, since only one emotional respiratory cycle Bf is generated in order to reproduce one content 12a with a set respiratory cycle, the respiratory emotion component extraction unit 14 is necessary to generate one emotional respiratory cycle Bf. It is determined whether respiration levels V (t1), V (t1-1), V (t1-2), ... are input. If the necessary respiration levels V (t1), V (t1-1), V (t1-2),... Are not input to the respiration emotion component extraction unit 14, the process returns to step S103. When necessary respiratory levels V (t1), V (t1-1), V (t1-2), ... are input to the respiratory emotion component extraction unit 14, the respiratory emotion component extraction unit 14 For example, the emotional respiratory cycle Bf is extracted and output according to the equations (1) and (2) (step S105).

  The basic reproduction speed calculation unit 15 receives the set respiratory cycle sBf included in the content 12a with the set respiratory cycle and the emotional respiratory cycle Bf output from the respiratory emotion component extraction unit 14. The basic playback speed calculation unit 15 calculates and outputs the basic sample update interval mS0 according to, for example, equation (3) (step S106).

  The basic sample update interval mS0 output from the basic playback speed calculation unit 15 and the content information d (τ) included in the content 12a with the set respiratory cycle stored in the storage unit 12 are input to the content playback speed control unit 16. Is done. The content playback speed control unit 16 sets the basic sample update interval mS0 as the sample update interval, and the content to be played back included in the content information d (τ) corresponding to each of a plurality of sample points τ (playback position) along the time axis Information d (τ) is updated, and reproduction information r (τ) representing content information d (τ) to be reproduced is sequentially output. This is continued until reproduction information r (τ) corresponding to the last sample point τ included in the content 12a with the set breathing cycle is output (step S107). The reproduction unit 17 sequentially outputs contents such as acoustic information specified by the reproduction information r (τ) (step S108).

[Second Embodiment]
The second embodiment of the present invention will be described below. In the first embodiment, one basic sample update interval mS0 is calculated before the reproduction of the content 12a with the set respiratory cycle is started, and the content information d (τ) to be reproduced is updated with the basic sample update interval mS0 as the update interval. While being done, the content 12a with the set respiratory cycle was reproduced. In the second embodiment, after starting the reproduction of the content 12a with the set respiration cycle, the basic sample update is performed by repeating the processing in the respiration measurement unit 13, the processing in the respiratory emotion component extraction unit, and the processing in the basic reproduction speed calculation unit. The interval mS0 is updated, and the content information d (τ) to be reproduced is updated with the updated basic sample update interval mS0 as the sample update interval. Below, it demonstrates centering around difference with 1st Embodiment, and abbreviate | omits description about the matter which is common in 1st Embodiment. For items common to the first embodiment, the same reference numerals as those of the first embodiment are used.

<Configuration>
As illustrated in FIG. 1, the playback speed synchronization apparatus 2 of the second embodiment includes an input unit 11, a storage unit 12 that stores content 12 a with a set respiratory cycle, a respiratory measurement unit 13, and a respiratory emotion component extraction unit. 24, a basic playback speed calculation unit 25, a content playback speed control unit 26, a playback unit 17, and a control unit 28.

[Input unit 11, storage unit 12, content 12a with a set respiratory cycle, respiratory measurement unit 13, reproduction unit 17]
Since it is the same as that of 1st Embodiment, description is abbreviate | omitted.

[Respiratory emotion component extraction unit 24]
The respiratory emotion component extraction unit 24 is configured by, for example, a CPU, a memory, and the like, and is a processing unit configured by reading a predetermined program into the CPU. The respiratory emotion component extraction unit 24 of the present embodiment extracts and outputs emotional respiratory cycles Bf (i) corresponding to a plurality of respiratory cycles corresponding to a plurality of breaths immediately before the current time t = t1. i is an integer given for convenience in order to represent the number of times of calculation of the emotional respiratory cycle Bf (i). Assume that i increases by 1 each time the emotional respiratory cycle Bf (i) is updated.

  The respiratory emotion component extraction unit 24 in this example receives the respiratory level V (t) output from the respiratory measurement unit 13, and uses the value of t when the respiratory level V (t) is a maximum value as the expiration start time: bpe (n) is temporarily stored in a memory (not shown) in the respiratory emotion component extraction unit 24. First, the respiratory emotion component extraction unit 24 calculates a respiratory cycle Btot (n) according to Equation (1) using, for example, the expiration start time bpe (n) temporarily stored in the memory. In this embodiment, the exhalation start time immediately before the current time t = t1 is bpe (n), but this is not a limitation of the present invention, and the exhalation start time earlier than that may be bpe (n).

Next, the respiratory emotion component extraction unit 24 in this example sets the value corresponding to the average value of the obtained plurality of respiratory cycles Btot (n) as the emotional respiratory cycle Bf (i). For example, the respiratory emotion component extraction unit 24 calculates an emotional respiratory cycle Bf (i) from N + 1 respiratory cycles Btot (n) corresponding to N + 1 breaths immediately before the current time t = t1 according to the following equation. Is calculated and output.
Bf (i) = (Btot (n) + Btot (n-1) +… + Btot (nN)) ÷ (N + 1)… (4)

[Basic playback speed calculation unit 25]
The basic playback speed calculation unit 25 is a processing unit configured by, for example, a CPU, a memory, and the like, and a predetermined program read into the CPU. The basic playback speed calculation unit 25 uses the set respiratory cycle sBf included in the content 12a with the set respiratory cycle stored in the storage unit 12 and the emotional respiratory cycle Bf (i) output from the respiratory emotion component extraction unit 24 to obtain sBf The basic sample update interval mS (i) is calculated and output so that the values of ÷ S0 and Bf (i) ÷ mS (i) are close to each other. Since the set respiratory cycle sBf and the standard setting value S0 of the sample update interval are constants, the basic reproduction speed calculation unit 25 calculates a longer basic sample update interval mS (i) as the emotional respiratory cycle Bf (i) is longer. For example, the basic reproduction speed calculation unit 25 sets the linear function value for the emotional respiratory cycle Bf (i) as the basic sample update interval mS (i). In other words, the basic reproduction speed calculation unit 25 sets, for example, a result obtained by applying a monotonically increasing linear function to the emotional respiratory cycle Bf (i) as the basic sample update interval mS (i). For example, the basic sample update interval mS (i) is obtained according to the following equation.
mS (i) = S0 × (a × (Bf (i) ÷ sBf-1) +1)… (5)

[Content playback speed control unit 26]
The content playback speed control unit 26 is configured by, for example, a CPU, a memory, and the like, and is a processing unit configured by reading a predetermined program into the CPU. The latest basic sample update interval mS (i) output from the basic playback speed calculation unit 25 and the content information d (τ) included in the content 12a with the set breathing cycle stored in the storage unit 12 are the content playback speed. Input to the control unit 26. The content reproduction speed control unit 26 is content information d () corresponding to each of a plurality of sample points τ (reproduction position) along the time axis at a sample update interval that is a time interval corresponding to the basic sample update interval mS (i). The content information d (τ) to be reproduced included in τ) is updated, and reproduction information r (τ) representing the content information d (τ) to be reproduced is sequentially output. The sample update interval in this embodiment is the basic sample update interval mS (i) itself.

[Control unit 28]
The control unit 28 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 28 controls the entire processing of the reproduction speed synchronization apparatus 2.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.
As illustrated in FIG. 6, after the processing of steps S <b> 101 to S <b> 105 described in the first embodiment is performed, the basic playback speed calculation unit 25 sets the set respiratory cycle sBf included in the content 12 a with the set respiratory cycle and the respiratory emotion. The emotional respiratory cycle Bf (i) output from the component extraction unit 24 is input. The basic playback speed calculation unit 25 calculates and outputs the basic sample update interval mS (i) according to, for example, Expression (5) (step S206).

  The basic sample update interval mS (i) output from the basic playback speed calculation unit 25 and the content information d (τ) included in the content 12a with the set breathing cycle stored in the storage unit 12 are the content playback speed control unit. 26. The content playback speed control unit 26 uses the basic sample update interval mS (i) as the sample update interval, and plays back the content information d (τ) included in the content information d (τ) respectively corresponding to a plurality of sample points τ (playback position) along the time axis. The target content information d (τ) is updated, and playback information r (τ) representing the playback target content information d (τ) is output (step S207). The playback unit 17 outputs content such as acoustic information specified by the playback information r (τ) (step S208).

  The control unit 28 determines whether or not the reproduction of all the content information d (τ) included in the content 12a with the set breathing cycle is finished (step S209). Here, when it is determined that the reproduction of all the content information d (τ) is finished, the processing is finished. On the other hand, if it is determined that the reproduction of all the content information d (τ) has not been completed, it is time for the control unit 28 to measure the respiration level V (t) by the respiration measurement unit 13 (the previous time). Whether the time T1 has elapsed from the measurement of the respiration level V (t) is determined (step S210). When it is determined that the time for measuring the respiration level V (t) is not reached by the respiration measurement unit 13, the process returns to step S207. On the other hand, if it is determined by the respiration measurement unit 13 that it is time to measure the respiration level V (t), the process returns to step S103.

[Third Embodiment]
The third embodiment is a modification of the first embodiment. In the third embodiment, respiration target content including content information and respiration target information for specifying a respiration state determined with respect to a respiration target setting position that is an advance position on the time axis corresponding to at least a part of the reproduction positions Play back. The content sample update interval is controlled so that the respiration state determined with respect to the respiration target setting position approaches the respiration state of the viewer at the time when the content information corresponding to the respiration target setting position is reproduced. The feature of this embodiment is that the sample update interval is controlled based on the “basic sample update interval that is longer as the emotional respiratory cycle is longer” described in the first embodiment. Below, it demonstrates centering on difference with 1st Embodiment.

<Configuration>
As illustrated in FIG. 7, the reproduction speed synchronization device 3 of the third embodiment includes an input unit 11, a storage unit 32 that stores a respiration target content 32 a with a set respiration cycle, a respiration measurement unit 13, and a respiration emotion component. The extraction unit 14, the respiratory index extraction unit 34, the basic playback speed calculation unit 15, the playback speed calculation unit 39, the content playback speed control unit 36, the playback unit 17, and the control unit 38 are included.

[Input unit 11, respiratory measurement unit 13, respiratory emotion component extraction unit 14, basic playback speed calculation unit 15, playback unit 17]
Since it is the same as that of 1st Embodiment, description is abbreviate | omitted.

[Respiration target content 32a with set respiratory cycle]
The respiration target content 32a with the set respiration cycle of the present embodiment is a position on the time axis corresponding to the set respiration cycle, content information corresponding to each reproduction position along the time axis, and at least a part of the reproduction positions. This is data having a data structure including respiration target information for specifying a respiration state determined with respect to the respiration target setting position and synchronization importance that is a coefficient corresponding to each reproduction position. The synchronization importance indicates the importance of the respiratory target information corresponding to the reproduction position corresponding to the synchronization importance. That is, the greater the importance of synchronization, the greater the importance of synchronizing the breathing target information corresponding to the reproduction position corresponding to the respiration of the viewer 100 when the content information corresponding to the reproduction position is reproduced. Takes a value. It is desirable that the synchronization importance of this embodiment be set to a value between 0 and 1.

In this example, the sample point is the playback position, the MIDI data indicating the pitch and the intensity of the sound is the content information, and the sample point (respiration target sample point) that is desirable as the time to start exhalation exercise is the respiration target setting position. The exhalation start state is set as a predetermined respiration state at the respiration target sample point, and information for specifying the exhalation start state at the respiration target sample point is used as the respiration target information.
For example, the respiration target content 32a with a set respiration cycle illustrated in FIG. 8 includes MIDI data indicating the set respiration cycle sBf and the pitch and sound intensity respectively corresponding to each sample point τ (playback position) along the time axis. Content information d (τ), and respiratory target information Bpe (μ) for specifying the expiration start state determined for each respiratory target sample point, which is a desirable sample point as the time to start exhalation exercise, This is data having a data structure including a synchronization importance α (τ) that is a coefficient corresponding to each sample point τ.

  The respiration target information Bpe (μ) in this example indicates a sample point τ (respiration target sample point) corresponding thereto. For example, the value of the respiration target information Bpe (μ) determined for the respiration target sample point τ = 100 is 100. μ is an index given for convenience of explanation, and is a continuous integer of 0 or more for identifying each respiration target information Bpe (μ). A larger value μ corresponds to later respiratory target information in time.

[Storage unit 32]
The storage unit 32 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory.

[Respiration index extraction unit 34]
The respiratory index extraction unit 34 is a processing unit configured by, for example, a predetermined program being read into the CPU. The respiratory index extraction unit 34 extracts a respiratory index corresponding to the viewer's respiratory state from the respiratory information obtained by measuring the viewer, and outputs the respiratory index. The respiratory index extraction unit 34 of the example of the present embodiment receives the respiratory level V (t) output from the respiratory measurement unit 13 as an input, and the most recent future expiration start time of the viewer 100 to be measured from the time t. The predicted value pbpe (n) is output as a respiratory index.

FIG. 8 is a diagram for explaining an example of the predicted value of the expiration start time.
The predicted exhalation start time pbpe (n) can be obtained, for example, by estimating the latest past respiratory cycle viewed from the current time t = t1 as the latest future respiratory cycle viewed from the time t = t1. . That is, the predicted value pbpe (n) of the expiration start time can be calculated as follows, for example.
pbpe (n) = bpe (n-1) + (bpe (n-1) -bpe (n-2))
= 2 ・ bpe (n-1) -bpe (n-2)… (6)
Where bpe (n-1) is the most recent past from time t = t1 calculated using respiration levels V (t1), V (t1-1), V (t1-2), ... Expresses the exhalation start time, bpe (n-2) is the exhalation start time bpe (n calculated using the respiration levels V (t1), V (t1-1), V (t1-2), ... -1) Shows the latest past expiration start time. More specifically, for example, let bpe (n-1) be the time corresponding to the maximum value of the most recent respiratory level seen from time t = t1, and the most recent respiratory level seen from the expiration start time bpe (n-1). The time corresponding to the maximum value is bpe (n-2) (see FIG. 8).

[Reproduction speed calculation unit 39]
The reproduction speed calculation unit 39 is a processing unit configured, for example, by reading a predetermined program into the CPU. The reproduction speed calculation unit 39 is configured so that the respiration state specified by the respiration target information corresponding to one of the respiration target setting positions is the viewer's respiration state at the time when the content information corresponding to the respiration target setting position is reproduced. Is set to a sample update interval for sequentially reproducing each piece of content information corresponding to each reproduction position along the time axis. In other words, the playback speed calculation unit 39 is the viewer at the time when the breathing state specified by the breathing target information corresponding to one of the breathing target setting positions and the content information corresponding to the breathing target setting position are played back. The sample update interval of the content is set so that the correlation with the breathing state becomes higher.

  For example, at time t = t1, the playback speed calculation unit 39 sends the basic sample update interval mS0 output from the basic playback speed calculation unit 15 and the predicted value pbpe of the expiration start time which is the respiratory index output from the respiratory index extraction unit 34 (n), the respiratory target sample point Bpe (m) extracted from the respiratory target content 32a with the set respiratory cycle stored in the storage unit 32, the synchronization importance α (p (t1)), and the sample point τ = p (t1 ) Is entered. However, as illustrated in FIG. 9, the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1, and at this time the set breath From the sample point τ = p (t1) included in the periodic respiratory target content 32a, the most recent future respiratory target sample point is Bpe (m) (μ = m), and the respiratory index is extracted at time t = t1. Assume that the predicted value (respiration index) of the expiration start time output from the unit 34 is pbpe (n).

The reproduction speed calculation unit 39 considers the synchronization importance α (p (t1)) of the sample point τ = p (t1) and sets the breath target sample point Bpe (m) to the predicted value pbpe (n) of the expiration start time. ), The basic sample update interval mS0 is corrected and the sample update interval S (t1) is calculated and output so that the reproduction time of the content information d (τ) corresponding to) approaches. The correction value at this time (the amount of change in the sample update interval with respect to the basic sample update interval mS0) is the prediction period pbpe (n from the current time t = t1 to the time t = pbpe (n) at which the breathing state corresponding to the respiratory index is reached. ) -t1 corresponds to the respiration target sample point (respiration target setting position) Bpe (m) from the reproduction position p (t1) corresponding to the content information d (p (t1)) to be reproduced at the current time t = t1 (Pbpe (n) -t1) / (value obtained by dividing by the number of playback positions Bpe (m) -p (t1) existing until the sampling point (playback position) τ = Bpe (m) Corresponding to the difference {(pbpe (n) -t1) / (Bpe (m) -p (t1))-mS0} between Bpe (m) -p (t1)) and the basic sample update interval mS0 Value. That is, for example, the playback speed calculation unit 39 calculates the sample update interval S (t1) according to the following equation.
S (t1) = α (p (t1)) {(((pbpe (n) -t1) / (Bpe (m) -p (t1)))-mS0} + mS0… (7)
In this example, α (p (t1)) {((pbpe (n) −t1) / (Bpe (m) −p (t1))) − mS0} is the correction value. When the synchronization importance α (p (t1)) is 1, sample update is performed so that the sample point to be played is updated from p (t1) to Bpe (m) between time t1 and time pbpe (n) The interval S (t1) is calculated. When the synchronization importance α (p (t1)) is 0 or more and less than 1, the sample update interval S (t1) having a smaller correction value than that when the synchronization importance α (p (t1)) is 1 is calculated. The When the synchronization importance α (p (t1)) is 0, S (t1) = mS0 as in the first embodiment, and when the synchronization importance α (p (t1)) is greater than 0, S (t1) ≠ mS0.

[Content playback speed control unit 36]
The content playback speed control unit 36 is, for example, a processing unit configured by reading a predetermined program into the CPU. The content playback speed control unit 36 includes the sample update interval S (t1) output from the playback speed calculation unit 39 and the content information d (τ included in the respiration target content 32a with the set respiratory cycle stored in the storage unit 32. ) Is entered. The content playback speed control unit 36 updates the playback target content information d (τ) at the sample update interval S (t1), and sequentially outputs playback information r (τ) representing the playback target content information d (τ). .

[Control unit 38]
The control unit 38 is, for example, a processing unit configured by reading a predetermined program into the CPU. The control unit 38 controls the entire processing of the reproduction speed synchronization device 3.

<Method>
Next, the playback speed synchronization method of this embodiment will be exemplified.
As illustrated in FIG. 10, after the processing of steps S <b> 101 to S <b> 106 described in the first embodiment is performed, the respiratory index extraction unit 34 calculates and outputs a respiratory index pbpe (n) according to, for example, the equation (6). To do. Further, the playback speed calculation unit 39 sets the basic sample update interval mS0 output from the basic playback speed calculation unit 15, the respiratory index pbpe (n) output from the respiratory index extraction unit 34, and the setting stored in the storage unit 32. The respiration target sample point Bpe (m) extracted from the respiration target content 32a with a respiration cycle, the synchronization importance α (p (t1)), and the sample point τ = p (t1) are input. The playback speed calculation unit 39 calculates and outputs the sample update interval S (t1) according to, for example, equation (7) (step S306).

  The sample update interval S (t1) output from the playback speed calculation unit 39 and the content information d (τ) included in the content 12a with the set breathing cycle stored in the storage unit 12 are sent to the content playback speed control unit 36. Entered. The content playback speed control unit 36 updates the sample point corresponding to the content information d (τ) to be played back at the sample update interval S (t1), and plays back the playback information r (τ) representing the content information d (τ) to be played back. ) Is output (step S307). The playback unit 17 outputs content such as acoustic information specified by the playback information r (τ) (step S208).

  The control unit 28 determines whether or not the reproduction of all the content information d (τ) included in the respiration target content 32a with the set respiration cycle has ended (step S309). Here, when it is determined that the reproduction of all the content information d (τ) is finished, the processing is finished. On the other hand, when it is determined that the reproduction of all the content information d (τ) has not been completed, the control unit 28 determines whether it is time to measure the respiration level V (t) by the respiration measurement unit 13. (Step S210). When it is determined that the time for measuring the respiration level V (t) is not reached by the respiration measurement unit 13, the process returns to step S306. On the other hand, if it is determined by the respiration measurement unit 13 that it is time to measure the respiration level V (t), the process returns to step S103.

[Modification of Third Embodiment]
In the third embodiment, the sample update interval is controlled based on the basic sample update interval mS0 described in the first embodiment. However, the sample is updated based on the basic sample update interval mS (i) described in the second embodiment. Control of the update interval may be performed. Below, it demonstrates centering on difference with 3rd Embodiment.

<Configuration>
As illustrated in FIG. 7, in the reproduction speed synchronization device 3 ′ according to the modification of the third embodiment, the basic reproduction speed calculation unit 15 of the reproduction speed synchronization device 3 is replaced with a basic reproduction speed calculation unit 25, and the reproduction speed calculation is performed. The unit 39 is replaced with a reproduction speed calculation unit 39 ′.
[Reproduction speed calculation unit 39 ']
The playback speed calculation unit 39 ′ uses the basic sample update interval mS (i) output from the basic playback speed calculation unit 25 in place of the basic sample update interval mS0 used in the playback speed calculation unit 39, and uses the sample update interval mS0. S (t1) is calculated. For example, the playback speed calculation unit 39 calculates the sample update interval S (t1) according to the following equation.
S (t1) = α (p (t1)) {(((pbpe (n) -t1) / (Bpe (m) -p (t1)))-mS (i)} + mS (i)… (8)

<Method>
As illustrated in FIG. 10, in the reproduction speed synchronization method according to the modification of the third embodiment, the process of step S206 is executed instead of step S106. Further, instead of step S306, the basic sample update interval mS (i) output from the basic playback speed calculator 25 to the playback speed calculator 39 ′ and the expiration start which is the respiratory index output from the respiratory index extractor 34. The predicted time value pbpe (n), the respiratory target sample point Bpe (m) extracted from the respiratory target content 32a with the set respiratory cycle stored in the storage unit 32, the synchronization importance α (p (t1)), and the sample point τ = p (t1) is input. The reproduction speed calculation unit 39 ′ calculates and outputs the sample update interval S (t1) according to, for example, the equation (8) (step S306 ′). Others are the same as in the third embodiment.

[Fourth Embodiment]
The fourth embodiment is a modification of the third embodiment. The respiratory target information and the respiratory index of the fourth embodiment are information for specifying the phase of the periodic respiratory motion, respectively, and the reproduction speed calculation unit of the fourth embodiment is at any respiratory target setting position. The sample update interval is controlled so that the difference between the phase specified by the corresponding respiratory target information and the phase specified by the respiratory index at the time when the content information corresponding to the respiratory target setting position is reproduced is reduced. . The feature of this embodiment is that the sample update interval is controlled based on the “basic sample update interval that is longer as the emotional respiratory cycle is longer” described in the first embodiment. Below, it demonstrates centering around difference with 3rd Embodiment.

<Configuration>
As illustrated in FIG. 7, the reproduction speed synchronization device 4 of the fourth embodiment includes an input unit 11, a storage unit 42 that stores a respiration target content 42 a with a set respiration cycle, a respiration measurement unit 13, and a respiration emotion component. The extraction unit 14, the respiratory index extraction unit 44, the basic playback speed calculation unit 15, the playback speed calculation unit 49, the content playback speed control unit 36, the playback unit 17, and the control unit 48 are included.

[Input unit 11, respiratory measurement unit 13, respiratory emotion component extraction unit 14, basic playback speed calculation unit 15, playback unit 17]
Since it is the same as that of 1st Embodiment, description is abbreviate | omitted.

[Respiratory target content 42a with set respiratory cycle]
A set breathing cycle, content information corresponding to each playback position along the time axis, and a breathing state determined with respect to a breathing target setting position that is a position on the time axis corresponding to at least a part of the playback positions. This is data having a data structure including the respiratory target information to be identified and the synchronization importance that is a coefficient corresponding to each reproduction position. The difference from the respiration target content 32a with the set respiration cycle is that the respiration target information is information for specifying the phase of the periodic respiratory motion.

  For example, the respiration target content 42a with a set respiration cycle illustrated in FIG. 11 includes MIDI data indicating the set respiration cycle sBf and the pitch and sound intensity respectively corresponding to each sample point τ (playback position) along the time axis. Content information d (τ), and information Φ for specifying a desirable “period of respiratory motion” at each sample point τ, which is defined for all sample points τ (respiration target setting position) This is data having a data structure including (τ) (respiration target information) and synchronization importance α (τ). A specific example of the respiratory target information Φ (τ) of this embodiment will be described later.

[Storage unit 42]
The storage unit 42 is an information storage device such as a magnetic recording device, an optical disc, a magneto-optical recording medium, or a semiconductor memory.

[Respiration index extraction unit 44]
The breathing index extraction unit 44 is a processing unit configured by, for example, a predetermined program being read into the CPU. The breathing index extraction unit 44 extracts information for identifying the phase of the periodic breathing motion of the viewer from the breathing information obtained by measuring the viewer 100 as a breathing index, and outputs the breathing index It is.
FIG. 12A is a diagram for describing an example of a respiratory index calculated by the respiratory index extraction unit 44 of the fourth embodiment.

There is no particular limitation on what value is used as “information for specifying the phase of the viewer's periodic respiratory motion”. In the following, the polar coordinate declination in the space (phase space) of the Cartesian coordinate system with the respiratory level V (t) as the value of the first dimension and the delay value V (t-γ) as the value of the second dimension. Used as “information for identifying the phase of the viewer's periodic respiratory movement (respiration index φ (t))”. The process corresponding to the time t of the respiratory index extraction unit 44 in this case is as follows, for example.
1. The respiration level V (t) at time t output from the respiration measurement unit 13 is set as the first dimension value of the phase space.
2. Let the respiration level V (t-γ) obtained by passing the respiration level V (t) through the time delay filter be the second-dimensional value of the phase space. Here, γ is the delay width of the time delay filter, and in the case of breathing, about 200 ms to 800 ms is desirable.
3. The deviation angle when the points (V (t), V (t−γ)) in the orthogonal coordinate system of the phase space are displayed in polar coordinates is obtained and output as a respiratory index φ (t) (see FIG. 12A).
When such a value is used as the respiratory index φ (t), the desired respiratory index φ (t) at each predetermined sample point τ is the respiratory target information Φ (τ) corresponding to the sample point τ (FIG. 11). Reference) is set in the respiration target content 42a with a set respiration cycle.

[Reproduction speed calculation unit 49]
The reproduction speed calculation unit 49 is a processing unit configured, for example, by reading a predetermined program into the CPU. The reproduction speed calculation unit 49 is specified by the phase specified by the respiration target information corresponding to one of the respiration target setting positions and the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced. The sample update interval S (t1) is calculated and output so that the difference from the phase becomes small.

The reproduction speed calculation unit 49 of this embodiment calculates and outputs a sample update interval S (t) every time the respiration measurement unit 13 obtains a respiration level V (t), that is, at a cycle T1. As illustrated in FIG. 11, it is assumed that the reproduction up to the content information d (p (t1)) corresponding to the sample point τ = p (t1) is completed at the time t = t1. At this time, the respiration target information corresponding to the sample point τ = p (t1) included in the respiration target content 42a with the set respiration cycle is Φ (p (t1)), and the respiration index extraction unit 44 at the time t = t1. Suppose that the respiratory index (information for specifying the phase of the periodic respiratory motion of the viewer) output from is φ (t1). The reproduction speed calculation unit 49 receives the respiration index φ (t1) and the respiration target information Φ (p (t1)) as input, and the angle formed on the phase space of FIG. Ask.
R (t1) = φ (t1) -Φ (p (t1))… (9)
If | R (t1) |> π then L (t1) = R (t1) -Sgn (R (t1)) ・ 2π else L (t1) = R (t1)… (10)
However, Sgn (δ) is a sign function, and the function value is Sgn (δ) =-1 when δ <0, Sgn (δ) = 0 when δ = 0, and δ> 0. Sometimes Sgn (δ) = 1. When L (t1)> 0, the viewer 100's breathing is more advanced than the breath indicated by the breathing target information at time t = t1, and when L (t1) <0, the viewer at time t = t1. 100 breaths are delayed from the breath indicated by the breath target information. FIG. 12B illustrates the relationship between the respiratory index φ (t1), the respiratory target information Φ (p (t1)), and L (t1). FIG. 12B is an example of L (t1) <0.

The reproduction speed calculation unit 49 further outputs the basic sample update interval mS0 output from the basic reproduction speed calculation unit 15 and the synchronization importance α (p) included in the respiration target content 42a with the set respiration cycle read from the storage unit 42. (t1)) and the sample update interval S (t1) at time t = t1 is obtained by correcting the basic sample update interval mS0 with the correction value. The correction value of this embodiment is the phase difference between the respiratory state φ (t1) corresponding to the respiratory index at the current time t = t1 and the respiratory state Φ (p (t1)) defined for the respiratory target setting position. Is a value corresponding to. For example, the playback speed calculator 49 calculates and outputs the sample update interval S (t1) at time t = t1 according to the following equation.
S (t1) = mS0 / {α (p (t1)) ・ C ・ L (t1) +1} (11)
C is an arbitrary constant that satisfies C> 0. For example, if the constant C is determined so that α (p (t)) · C · L (t) +1> 0 for all possible α (τ) and L (t), the playback speed The calculation unit 49 calculates a sample update interval S (t1) larger than mS0 when the viewer's breathing is ahead of the breathing indicated by the breathing target information (L (t1)> 0), and the viewer's breathing Is synchronized with the breath indicated by the respiratory target information (L (t1) = 0), the sample update interval S (t1) equal to mS0 is calculated, and the viewer's breath is delayed from the breath indicated by the respiratory target information If (L (t1) <0), a sample update interval S (t1) smaller than mS0 is calculated.

<Method>
The playback speed synchronization method of this embodiment will be illustrated with reference to FIG.
As illustrated in FIG. 10, after the processing of steps S <b> 101 to S <b> 106 described in the first embodiment is executed, the respiratory index extraction unit 44 calculates and outputs the respiratory index φ (t) described above. Further, the playback speed calculation unit 49 stores the basic sample update interval mS0 output from the basic playback speed calculation unit 15, the respiratory index φ (t) output from the respiratory index extraction unit 44, and the setting stored in the storage unit 42. Respiration target information Φ (τ), synchronization importance α (p (t1)) and sample point τ = p (t1) extracted from the respiration target content 42a with a respiratory cycle are input. The playback speed calculator 49 calculates and outputs the sample update interval S (t1) according to, for example, equation (11) (step S406). The subsequent processing is the same as in the third embodiment.

[Modification 1 of Fourth Embodiment]
Instead of the equation (11), the sample update interval S (t1) may be calculated according to the following equation.
S (t1) = mS0 / {α (p (t1)) ・ D [L (t1)] + 1}… (12)
However, D [L (t)] is a function value obtained by applying the function D [L] to L (t). In accordance with the function D [L], it is possible to change the manner in which the playback speed of the content follows the breathing of the viewer 100.

13A-13C are diagrams for explaining a specific example of the function D [L].
FIG. 13A is a diagram illustrating a function represented by the following equation.
D [L] = C ・ L… (13)
The function value D [L (t)] in this case is proportional to L (t). The processing in this example is the same as that in the third embodiment.

FIG. 13B is a diagram illustrating a function represented by the following equation.
D [L] = C1 * L (L <0)… (14)
D [L] = C2 * L (L> = 0)… (15)
However, C1 and C2 are arbitrary constants that satisfy the condition of C1>C2> 0. In the case of this function D [L], the change amount of the function value D [L (t)] relative to the change amount of L (t) when L (t)> 0 is L (t) <0 Is smaller than the change amount of the function value D [L (t)] with respect to the change amount of L (t). In this case, the playback speed calculation unit adjusts the sample update interval when the viewer's breathing phase is ahead of the breathing phase indicated by the breathing target information (L (t1)> 0). ) Is more emphasizing the adjustment of the sample update interval (adjustment to slow down the playback speed) when the viewer's breathing phase is behind the breathing phase indicated by the breathing target information (L (t1) <0) Will do. That is, for L (t1) with the same absolute value, the amount of change in S (t1) with respect to S0 when L (t1) <0 is the change in S (t1) with respect to S0 when L (t1)> 0. Greater than the amount.

FIG. 13C is a diagram illustrating a function represented by the following equation.
D [L] = SIN (L)… (16)
In the case of this function D [L], the playback speed calculation section samples even if the phase difference between the viewer's breath and the breath indicated by the breathing target information becomes larger than when using the function D [L] in FIG. 13A. The change amount of the update interval is not increased so much. That is, when the function value D [L (t)] is not proportional to L (t) as shown in FIGS. 13B and 13C, the phase specified by the respiration target information corresponding to any respiration target setting position. And the amount of change in the reproduction speed (the amount of change in the sample update interval) with respect to the amount of change in the difference from the phase specified by the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced. The relative value (L (t)) of the phase specified by the respiration index at the time when the content information corresponding to the respiration target setting position is reproduced with respect to the phase specified by the respiration target information corresponding to the target setting position Will depend.

[Modification 2 of the fourth embodiment]
In the fourth embodiment and its modification 1, the sample update interval is controlled based on the basic sample update interval mS0 described in the first embodiment, but the basic sample update interval mS (i described in the second embodiment is used. ) May be used to control the sample update interval. Below, it demonstrates centering on difference with 4th Embodiment and its modification 1. FIG.

<Configuration>
As illustrated in FIG. 7, in the playback speed synchronization device 4 ′ of Modification 2 of the fourth embodiment, the basic playback speed calculation unit 15 of the playback speed synchronization device 4 is replaced with a basic playback speed calculation unit 25, and the playback speed is increased. The calculation unit 49 is replaced with a reproduction speed calculation unit 49 ′.

[Reproduction speed calculation unit 49 ']
The playback speed calculation unit 49 ′ uses the basic sample update interval mS (i) output from the basic playback speed calculation unit 25 instead of the basic sample update interval mS0 used in the playback speed calculation unit 49, and uses the sample update interval mS0. S (t1) is calculated. For example, the playback speed calculation unit 49 calculates the sample update interval S (t1) according to the following equation.
S (t1) = mS (i) / {α (p (t1)) ・ C ・ L (t1) +1}… (17)
Alternatively, the sample update interval S (t1) may be calculated according to the following equation.
S (t1) = mS (i) / {α (p (t1)) · D [L (t1)] + 1}… (18)

<Method>
As illustrated in FIG. 10, in the reproduction speed synchronization method according to the second modification of the fourth embodiment, the process of step S206 is executed instead of step S106. Also, instead of step S406, the basic sample update interval mS (i) output from the basic playback speed calculator 25 to the playback speed calculator 49 ′ and the respiratory index φ (t) output from the respiratory index extractor 44. And respiration target information Φ (τ), synchronization importance α (p (t1)) and sample point τ = p (t1) extracted from the respiration target content 42a with set respiration cycle stored in the storage unit 42 Is done. The reproduction speed calculation unit 49 ′ calculates and outputs the sample update interval S (t1) according to, for example, the equation (17) or (18) (step S406 ′). Others are the same as in the fourth embodiment.

[Features of each embodiment]
In all the embodiments, content information to be played back is updated at a sample update interval corresponding to a basic sample update interval that is longer as an emotional respiratory cycle corresponding to a plurality of respiratory cycles corresponding to a plurality of breaths performed by the viewer. Decided to update. The emotional respiratory cycle reflects the viewer's mid- to long-term emotion and activity. Therefore, in all the embodiments, it is possible to appropriately control the playback speed of content in conjunction with breathing that is affected by the emotion and activity level of the viewer.

  According to the second embodiment, since the emotional respiratory cycle is also sequentially updated during the playback of the content, the content playback speed is appropriately adjusted according to the change in the physical condition of the viewer during the playback of the content and the emotional change caused by the viewing itself. Can be controlled.

  According to the third embodiment, on the basis of the emotional respiratory cycle reflecting the viewer's medium- to long-term emotion and activity state, the target respiratory state set at the content playback position and the viewer's respiratory state Control the playback speed so that Therefore, even when the target breathing state set in the content and the breathing state affected by the viewer's emotion and activity level are significantly different, the playback speed of the content can be appropriately controlled.

[Other variations]
The present invention is not limited to the above-described embodiment.
For example, in each of the above-described embodiments and the modifications thereof, the content in which the breathing target information and the synchronization importance are associated with the sample points is illustrated. However, if the breathing target information and the synchronization importance are associated with any reproduction position, the breathing target information and the synchronization importance are not necessarily associated with the sample point. For example, the respiratory target information and the synchronization importance may be distributed and recorded in the content at the same frequency as the content sampling frequency or (1 / natural number) times, or may be recorded at arbitrary intervals. . When recording at arbitrary intervals, for example, the start point information for specifying the start point of the content information and the information for specifying the relative position of the respiratory target information and the synchronization importance for the start point information may be stored in the content. Good. Further, the respiratory target information and the synchronization importance need not be discrete data, and may be recorded in an analog manner. Further, the breathing target information and the synchronization importance need not be defined for the entire content, but may be defined for only a part thereof.

In each of the above-described embodiments and modifications thereof, the respiratory level is exemplified as a specific example of the respiratory information output from the respiratory measurement unit. However, for example, the differential value of the respiratory level may be used as the respiratory information. The differential value of the respiratory level is obtained, for example, by detecting the respiratory airflow.
Further, in each of the above-described embodiments and modifications thereof, MIDI data indicating the pitch and the intensity of sound is shown as a specific example of the content information. However, content data may be other data that specifies audio information or video information for viewing purposes, such as music, audio, movies such as movies and television programs. In addition, the content playback speed control unit does not change the pitch or sound quality if sound, even if the playback speed changes, and playback time control processing that includes processing such as suppressing video disturbance due to frame advance or fast forward if video. It is desirable to do.

  In the third embodiment, it has been shown that a synchronization importance level of 0 or more and 1 or less is preferable. However, this does not limit the present invention, and the synchronization importance may be less than 0 or greater than 1. Thereby, the variation of the reproduction | regeneration method of a content can be increased, and the choice of how to enjoy can be increased. For example, by setting the synchronization importance level to less than 0, it is possible to reproduce content that is uncomfortable for the viewer, and the range of artistic expression is expanded. Further, in all the embodiments and modifications thereof, a value obtained by inverting the sign of the above-described synchronization importance may be used instead of the synchronization importance by the reproduction speed calculation unit.

Each block in each block diagram is a conceptually divided processing section, and each block does not have to exist as an independent device. Moreover, each block does not need to be configured as one device, and may be distributed in a plurality of devices.
In addition, the various processes described above are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Needless to say, other modifications are possible without departing from the spirit of the present invention.

Further, when the above-described configuration is realized by a computer, processing contents of functions that each device should have are described by a program. The processing functions are realized on the computer by executing the program on the computer.
The program describing the processing contents can be recorded on a computer-readable recording medium. An example of a computer-readable recording medium is a non-transitory recording medium. Examples of such a recording medium are a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, and the like.

  This program is distributed, for example, by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, this computer reads the program stored in its own recording device and executes the process according to the read program. As another execution form of the program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and the program is transferred from the server computer to the computer. Each time, the processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It is good. Note that the program in this embodiment includes information that is used for processing by an electronic computer and that conforms to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer).

  In this embodiment, the present apparatus is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

1-4, 3 ', 4' Playback speed synchronization device

Claims (7)

A respiratory emotion component extraction unit that extracts emotional respiratory cycles corresponding to a plurality of respiratory cycles corresponding to a plurality of breaths performed by the viewer, using the respiratory information of the viewers;
A basic playback speed calculation unit that calculates a basic sample update interval that is longer as the emotional respiratory cycle is longer;
The content information to be played back included in the content information corresponding to each of a plurality of playback positions along the time axis is updated at a sample update interval that is a time interval corresponding to the basic sample update interval, and the content information to be played back A content playback speed control unit that outputs playback information representing
I have a,
Stores respiratory target content including the content information and respiratory target information for specifying a respiratory state determined with respect to a respiratory target setting position that is a position on a time axis corresponding to at least a part of the reproduction position. A storage unit
A respiratory index extraction unit that extracts a respiratory index corresponding to the viewer's respiratory state from the respiratory information,
The sample update interval is obtained by correcting the basic sample update interval with a correction value,
The correction value corresponds to a predicted period from a current time to a time when a breathing state corresponding to the breathing index is reached, from the playback position corresponding to the content information to be played back at the current time to the breathing target setting position. A value obtained by dividing the value obtained by dividing by the number of the playback positions existing up to the playback position and the basic sample update interval, and a value obtained by multiplying the synchronization importance at the current time by the difference Is,
A reproduction speed synchronization apparatus characterized by the above.   The playback speed synchronization device of claim 1,
  The reproduction speed synchronization apparatus, wherein the synchronization importance is greater than 0 and less than 1. The playback speed synchronization device according to claim 1 or 2 ,
The basic sample update interval is a linear function value for the emotional respiratory cycle.
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to any one of claims 1 to 3 ,
The sample update interval is updated by repeating the processing in the respiratory emotion component extraction unit and the processing in the basic playback speed calculation unit,
The content playback speed control unit updates the content information to be played back at the updated sample update interval.
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to any one of claims 1 to 4 ,
The emotional respiratory cycle corresponds to five or more respiratory cycles corresponding to five or more breaths;
A reproduction speed synchronization apparatus characterized by the above. The playback speed synchronization device according to any one of claims 1 to 5 ,
The emotional respiratory cycle is a value corresponding to an average value of the plurality of respiratory cycles,
A reproduction speed synchronization apparatus characterized by the above. The program for functioning a computer as each part of the reproduction speed synchronizer in any one of Claim 1 to 6 .

Images