JP4191348B2 - Audio waveform playback device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an audio waveform reproduction device capable of reproducing an audio waveform such as a phrase while time stretching.
[0002]
Various waveform reproduction apparatuses that reproduce audio waveform signals stored in a memory in advance while time-stretching using a time-axis compression / expansion technique have been proposed. Specifically, as disclosed in, for example, Japanese Patent Application Laid-Open No. 11-52954, a series of audio waveform signals such as phrases are stored, and the playback speed is increased without changing the pitch (time axis compression). ) Or a waveform reproducing apparatus that can be reproduced at a later time (expanded time axis), stopped, or reproduced in the reverse direction has been proposed. Usually, this playback speed is set by the user inputting a numerical value with an operator.
[0003]
[Problems to be solved by the invention]
However, as in the waveform playback apparatus described above, it is difficult for the user to intuitively understand how to control the playback of the stored audio waveform by setting the playback speed by numerical input or the like. It was not a way to say.
[0004]
The present invention has been made in view of such problems, and allows a user to directly specify the playback position of a stored audio waveform so that the audio waveform signal can be played back while being time-stretched in a desired manner. The purpose is to do.
It is another object of the present invention to enable switching between a waveform playback mode at a set playback speed and a waveform playback mode in which a user directly designates a playback position according to a predetermined desired characteristic. .
[0005]
[Means and Actions for Solving the Problems]
In order to solve the above-described problem, an audio waveform reproduction device according to the present invention includes, as one form, a storage unit that stores waveform data of an audio waveform, and a position on the time axis of the audio waveform designated as a reproduction position. A reproduction means for reproducing waveform data corresponding to the reproduction data, a reproduction speed input means for inputting a reproduction speed that is an amount to advance the reproduction position, a movement amount input means for inputting a movement amount of a movement manually operated by the user, The mode switching means for switching the playback mode of the playback means between the first mode and the second mode, and when the mode switching means switches to the first mode, the playback means performs waveform playback while updating the playback position based on the playback speed. When the control is switched to the second mode, the update of the playback position based on the playback speed is stopped and input by the motion amount input means instead. And control means for controlling so as to waveform reproduced while updating the playback position on the basis of the amount can, the updating of the reproduction position based on the reproduction speed when switching from the first mode by the mode switching means to the second mode, When the playback position arrives at a predetermined position There is provided stop characteristic control means for controlling to stop with a predetermined change characteristic that changes with time rather than instantaneous change. As the above movement amount input means, the movement distance when the user rubs a finger or the like on the plate is input as the movement amount, and the movement distance when the knob of the linear slide operator is moved back and forth is moved. It is possible to use one that inputs as a quantity or one that inputs the amount of rotation of a wheel or lever as a movement amount. As the mode switching means, it is possible to use a mode switching unit that detects that the user touches the plate with a finger or the like, or a mode switching unit that uses a switch or the like. As the change characteristic of the stop characteristic control means, for example, a change characteristic such that the reproduction speed converges to 0 with a predetermined exponential curve or a linear function characteristic can be used. Similarly, as the change characteristic of the return characteristic control means, for example, a change characteristic such as a predetermined exponential function curve or a linear function characteristic that causes the reproduction speed to converge to the original state can be used. In this audio waveform reproduction device, when the mode switching means is switched to the first mode, the reproduction means sets the reproduction position for the audio waveform stored in the storage means based on the reproduction speed input by the reproduction speed input means. While updating, the waveform data corresponding to the reproduction position is reproduced. On the other hand, when the mode switching means switches from the first mode to the second mode, the control means stops updating the playback position based on the playback speed, and instead plays back based on the motion amount input by the motion amount input means. Controls waveform reproduction while updating the position. At that time, the stop characteristic control means controls the updating of the reproduction position based on the reproduction speed so as to stop with a predetermined change characteristic that changes with time rather than an instantaneous change. Thereby, switching of the reproduction mode of waveform reproduction can be performed smoothly based on the predetermined characteristics.
[0006]
The above-described audio waveform reproduction device updates the reproduction position when the mode switching unit switches from the second mode to the first mode with the above-described stop characteristic control unit or instead of the instantaneous change with time. You may comprise so that the return characteristic control means which controls to return to the original update mode based on reproduction speed with the predetermined change characteristic to change may be provided.
When the mode switching unit switches from the second mode to the first mode, the control unit switches from updating the playback position based on the amount of motion input by the motion amount input unit to updating the playback position based on the playback speed. At this time, the return characteristic control means controls the update of the reproduction position so as to return to the original update mode based on the reproduction speed with a predetermined change characteristic that changes with time rather than an instantaneous change.
Thereby, switching of the reproduction mode of waveform reproduction can be performed smoothly based on the predetermined characteristics.
[0007]
Further, the above-described audio waveform reproduction apparatus sets one or more stop positions in advance at arbitrary locations on the time axis of the audio waveform, and reproduces when the mode switching means switches from the first mode to the second mode. Based on speed Update The stop may be configured to be performed based on the stop position (for example, when the reproduction position reaches the stop position). As the stop position, for example, when the audio waveform is played back according to the amount of movement, there is no place where it can be expected that a special effect can be produced, or when the playback position is stopped, there is no unnaturalness. Such a location may be selected and set in advance. As a result, switching to update the playback position based on the amount of motion from the playback speed can be performed at a position on the audio waveform that is considered to have a high effect, or at a position that does not feel unnatural in terms of hearing. It becomes possible.
[0008]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 shows a hardware configuration of an audio waveform reproducing apparatus as an embodiment of the present invention. In FIG. 1, a CPU 1 is a central processing unit that controls the entire apparatus, and operates according to a program stored in the ROM 2 to detect an operation state of each operator in the operator group 4 and to / from a DSP 7. To exchange and control various information.
[0009]
The ROM 2 is a read-only memory and stores processing programs for the CPU 1 and the DSP 7. The DSP 7 program is transferred to the DSP 7 via the CPU 1. The RAM 3 is a random access memory and is used as a work memory for work used for the processing of the CPU 1.
[0010]
The waveform memory 8 is a memory that stores waveform data of an audio waveform signal to be reproduced by the apparatus of this embodiment, and supplies this waveform data to the DSP 7. The data structure of this waveform data is shown in FIG. As shown in the figure, the waveform data of the audio waveform signal is composed of PCM (pulse code modulation) waveform data which is the main body of the waveform data, and waveform related data indicating an address range in which the PCM waveform data is stored. ing.
[0011]
For example, as shown in FIG. 4, the PCM waveform data is amplitude value data (PCM data) obtained by periodically sampling a series of audio waveform signals (for example, audio waveform signals for one phrase) at a predetermined sampling frequency Fs. The time series of these amplitude value data is stored in sequential address areas of the waveform memory with sequential addresses.
[0012]
As the waveform-related data, the amplitude value data at the beginning of the audio waveform is stored as information for indicating the range of the address area in which the PCM waveform data for one batch (for example, one phrase) is stored. The start address wavestart and the last address waveend where the last amplitude value data is stored. Also, as other related information, the original pitch of the sampled audio waveform (original pitch), stop mark mark ( i) There is.
[0013]
Although the stop mark mark (i) will be described in detail later, when the playback position of the audio waveform is stopped according to the present invention, a portion where a higher production effect can be obtained on the audio waveform (for example, a portion of an interesting sound when time stretching is performed). , Or sound breaks) are specified in advance by address values, and stop marks mark (i) are set at a plurality of positions along the time axis of the audio waveform. Specified. This parameter i is 0 ≦ i ≦ n, and n is the total number of stop marks set in the audio waveform.
[0014]
The operating element group 4 is an operating element group including an operating element for setting a time expansion amount. This time companding amount setting operator is a manipulator for setting a time compression / expansion amount (hereinafter referred to as a time companding amount) on the time axis when reproducing an audio waveform signal. The reproduction speed tcomp as a time companding amount is set according to the operation amount of the operation element.
[0015]
This playback speed tcomp is a step value for advancing the value of the playback position (playback position sphase) in the audio waveform data, and the playback position sphase is represented by an address value. tcomp is the number of addresses at which the value of the playback position sphase is updated.
[0016]
Depending on the value of the reproduction speed tcomp, the audio waveform is reproduced in the following manner.
(1) When the reproduction speed tcomp> l, the time series of the PCM waveform data is generated by time compression, so that the audio waveform signal is reproduced at a faster speed than the original waveform.
When the reproduction speed tcomp <l, the time series of the PCM waveform data is generated by time expansion, so that the audio waveform signal is reproduced at a speed slower than that of the original waveform.
When the reproduction speed tcomp = 1, the original audio waveform is reproduced at the original speed without being compressed and expanded on the time axis.
Note that the playback speed tcomp is 1 at the initial setting, and tcomp> 0 is always established.
[0017]
The keyboard 5 is used as a normal musical tone input keyboard when the apparatus of this embodiment is caused to function as an electronic musical instrument. At the same time, in the present invention, the start / end of reproduction of the audio waveform signal is instructed by key depression / release, and the pitch of the audio waveform (musical sound) to be reproduced is instructed by the depressed key. Specifically, the pitch information is a pitch shift amount pitch based on a pitch from a predetermined reference pitch (for example, C4) to the pitch of the pressed key. When a plurality of keys are pressed, the pitch shift amount pitch is set based on the highest pitch among the plurality of keys pressed.
[0018]
The ribbon controller 6 is an operator for inputting information on a position for reproducing an audio waveform in a reproduction mode in which a reproduction position is directly specified by position information according to the present invention, and is composed of a device having an elongated plate. By rubbing the plate left and right with the finger, position information (movement amount shift) corresponding to the amount of movement moved by touching is generated. This movement amount shift is one-dimensional information (that is, position information only in the X-axis direction), and when the ribbon controller 6 plate (hereinafter simply referred to as the ribbon controller 6) is touched with a finger, the touch “ON” is turned on by the touch sensor. If the finger is removed from the ribbon controller 6, the touch “OFF” is detected. The movement amount shift is a negative value corresponding to the distance moved when the point where the above touch is “ON” is set to the origin (0 point) and moved toward the left side, and the amount moved can be moved toward the right side. For example, it becomes a positive value according to the distance moved.
[0019]
The DSP 7 is a digital signal processor that performs arithmetic processing for reproducing the waveform data stored in the waveform memory 8. FIG. 3 shows a schematic configuration in the form of a functional block diagram. As shown in the figure, the DSP register group 71 for storing various signals from the CPU 1 side, the position information calculating means 72 for calculating the position information based on each information of those registers, and the position information calculating means 72 are used for calculation. It includes a reproduction waveform calculation means 73 that performs waveform data reproduction calculation based on position information (reproduction position sphase) and reproduces the waveform. Here, various information input to the DSP register group 71 includes a pitch shift amount pitch, a shift amount shift, a reproduction speed tcomp, a sound generation flag gate, a touch flag r.touch, and the like, which will be described in detail later. .
[0020]
The D / A converter 9 is a circuit that converts the reproduction waveform data of the disc value calculated by the DSP 7 into an analog signal. The reproduced analog audio waveform signal is amplified by an amplifier (not shown) and then emitted from the speaker 10.
[0021]
The operation of this embodiment apparatus will be described below.
First, the operation of the apparatus of this embodiment will be schematically described. FIG. 4 shows the relationship between audio waveform data (PCM waveform data stored in the waveform memory 8) to be reproduced by the apparatus of this embodiment and the reproduction position sphase. In the figure, the amplitude value is taken in the vertical direction, and the time axis of the audio waveform data is taken in the horizontal direction. This time axis is represented by a waveform reproduction position sphase, and this reproduction position sphase is represented by an address for storing amplitude value data. Accordingly, the reproduction position sphase corresponding to the head of the audio waveform is the start address wavestart, and the reproduction position sphase corresponding to the end is the final address waveend.
[0022]
In this embodiment apparatus, the waveform section corresponding to the current reproduction position sphase is reproduced while being repeated as appropriate. This waveform section consists of a section of a waveform of about 1 to 2 cycles in a series of audio waveforms. If the current playback position moves sequentially toward the right side in the figure, the audio waveform will be played back in normal time order. Conversely, if this playback position is moved sequentially toward the left side, the audio waveform will be played back. The waveform is reproduced while reversing the time. However, in each waveform section being reproduced, the reproduction direction is always the forward direction of the time axis. If the playback speed is slower than that of the original waveform, the above-mentioned waveform section will be repeated as appropriate, and if the playback speed is made faster than that of the original waveform, the waveform section will be skipped appropriately. become. Further, when the current playback position is stopped at one place, the same waveform section corresponding to the current playback position is repeatedly played back, and the state does not advance or return in time.
[0023]
According to such a reproduction method, waveform reproduction can be performed by changing the reproduction speed (time compression / decompression amount) without changing the pitch.
[0024]
FIG. 5 is a diagram showing, by way of example, a change in reproduction speed due to a touch ON / OFF operation of the ribbon controller 6 and a change in position information (reproduction position sphase) of waveform data currently being reproduced according to the change. . In this example, the user touches the ribbon controller 6 with a finger, and then stops without rubbing the finger left and right, and then releases the finger after a while.
[0025]
(1) in FIG. 5 shows the relationship between the waveform data playback position sphase and time, and (2) shows the current playback speed (current playback speed w.tcomp) and the time at which the waveform data is played back. Showing the relationship. Here, the reproduction speed tcomp is a value of the reproduction speed set by the time companding amount setting operator. The reproduction speed tcomp is the reproduction speed tcomp = 1 in the original waveform that is not time-stretched, and the reproduction speed is shown as tcomp = 1 in the original waveform in the example of FIG. The current playback speed w.tcomp is
Current playback speed w.tcomp = playback speed tcomp
However, when waveform reproduction is performed by position designation according to the present invention, as will be described later, the current reproduction speed w.tcomp changes toward “0” and does not coincide with the reproduction speed tcomp.
[0026]
In FIG. 5, when the user touches the ribbon controller 6 with a finger, the touch “ON” is detected by the touch sensor. From the playback position sphase of the audio waveform when this touch is “ON” to the position of the first stop mark mark (i) that is temporally behind the playback position sphase, normal waveform playback (this example Then, the waveform reproduction at the current reproduction speed w.tcomp = 1 is performed.
[0027]
When the playback position sphase reaches the position of the stop mark mark (i), the current playback speed w.tcomp starts to attenuate toward “0” at the playback position sphase of the stop mark mark (i). The attenuation characteristic at this time does not change from “1” to “0” instantaneously, but is a characteristic curve that attenuates exponentially. After the current playback speed w.tcomp is attenuated to “0”, the playback position sphase is not updated and does not change, and the playback position versus time characteristic becomes a horizontal line as shown in FIG. In this horizontal line section, an audio waveform is repeatedly reproduced at a certain point (one same waveform section), and does not advance or return in time.
[0028]
When the user lifts his / her finger from the ribbon controller 6, the touch “OFF” is detected by the touch sensor, so that the current playback speed w.tcomp is exponentially curved as usual (original) as shown in FIG. The playback speed tcomp is restored to “1”. At this time, as shown in FIG. 5 (1), the reproduction position sphase also draws a characteristic [solid line in FIG. 5 (1)] that changes toward the reproduction speed tcompa over time. After returning to the normal state, the current playback speed w.tcomp becomes the playback speed tcomp.
[0029]
Next, as in FIG. 5, FIG. 6 is a diagram showing an example of a change in the current playback speed w.tcomp due to the operation of the ribbon controller 6 and a change in the playback position sphase according to the change. In the example 6, the user touches the ribbon controller 6 with a finger, and after a short time, the user rubs the finger to the right side, then folds and rubs it to the left side, and moves the finger before returning to the initial touch position. This is when the release operation is performed.
[0030]
When the user touches the ribbon controller 6 with his / her finger, the touch is turned “ON”, and the playback speed tcomp is attenuated to “0” from the position of the first stop mark mark (i) thereafter with an exponential curve-like attenuation characteristic. Thus, it is the same as FIG. 5 described above that a certain point in the audio waveform is repeatedly reproduced. Here, when the user rubs his / her finger to the right on the ribbon controller 6, the reproduction position sphase increases by the amount corresponding to the rubbed distance. The waveform section of the reproduction position sphase corresponding to the position of the movement is reproduced. When the finger is rubbed toward the left side, the waveform section at the reproduction position sphase corresponding to the position on the ribbon controller 6 that is rubbed is reproduced. In this case, the time of the audio waveform is reproduced. Each waveform section is extracted and reproduced while reversing on the axis. Thereby, an audio waveform can be reproduced while producing a special effect. In each waveform section, the waveform is reproduced only in the forward direction on the time axis.
[0031]
When the user lifts his / her finger from the ribbon controller 6, the touch “OFF” is detected as in the example of FIG. 5 described above, and the current playback speed w.tcomp is an exponential curve as shown in FIG. 6 (2). With a characteristic curve, the playback speed tcomp (in this example, the playback speed tcomp = 1 corresponding to the original waveform) is restored.
[0032]
Details of the operation of the embodiment apparatus for realizing the above-described operation mode will be described below with reference to the flowcharts shown in FIGS.
[0033]
FIG. 7 is a flowchart showing the main processing of the CPU 1. When the power of the embodiment apparatus is turned on, this CPU main process is started and the RAM 3 and DSP 7 are initialized (step A), and thereafter, steps B, C and D are looped during the power-on period. This CPU main process is repeated. Note that, as the above initial setting, processing for resetting the register group 71 in the DSP 7 shown in FIG. 3 and resetting other various flags and registers is performed.
[0034]
When the initial setting is completed, first, an operation detection process (see FIG. 8) of the operator group 4 is performed (step B), and then an operation detection process of the keyboard 5 (see FIG. 9) is performed (step C). 6 operation detection processing (see FIG. 10) is performed (step E), and this is repeated in a loop.
[0035]
FIG. 8 is a flowchart showing the operation detection processing routine of the above-mentioned operator group 4. In this operation detection process, only the process for detecting the operation of the time companding amount setting operation element is shown, and the other operation elements are not directly related to the present invention and are omitted.
[0036]
When the operation detection processing routine of the operator group 6 is started in the CPU main process, it is determined whether or not there is any operation on the operator group 6 (step B1). When there is no operation in the operator group 4, the process returns to the CPU main process. When it is detected that any of the controls has been operated, it is determined whether or not the operator that has performed the operation is a time companding amount setting manipulator, that is, whether or not the time companding amount has been changed ( Step B2). If it is determined by the time companding amount setting operator that the time companding amount has been changed, the value of the regeneration speed tcomp is changed based on the manipulated value of the time companding amount setting operator (step B3). The reproduction mode based on the value of the reproduction speed tcomp is as described above. Thereafter, the process returns to the CPU main process.
[0037]
FIG. 9 is a flowchart showing the operation detection processing routine of the keyboard 5 described above. In this embodiment apparatus, the reproduction of the audio waveform signal is started at the timing when one of the keys on the keyboard 5 is first depressed, and the reproduction of the audio waveform signal is terminated when all the depressed keys are released. To do. In response to this, a sound generation flag gate indicating whether or not the sound waveform state is being reproduced during audio waveform signal reproduction is provided. If the sound generation flag gate is “0”, the sound waveform signal is not sounded. If “1”, the audio waveform signal is being sounded.
[0038]
When the operation detection processing routine of the keyboard 5 is started in the CPU main process, it is determined whether any key operation (key pressing or key release operation) has been performed on any key on the keyboard 5 (step C1). If there is no key operation, the process immediately returns to the CPU main process. If there is a key operation, it is determined whether or not the key operation is a key pressing operation (step C2).
[0039]
If it is a key pressing operation, the following key pressing process is performed. First, it is determined whether or not the key press is a new key press operation, that is, whether or not the key is pressed for the first time from a state in which all keys on the keyboard 5 are not pressed (step C5). If the key is a new key press, as described above, the reproduction of the audio waveform signal is started at the timing of the first key press, so that “1” indicating the sounding state is set in the sound generation flag gate (step C6). ).
[0040]
Then, pitch information based on the pitch of the depressed key is set in the register as the pitch shift amount pitch (step C7), and the process returns to the CPU main process. As described above, the pitch information set in the pitch shift amount pitch is specifically the pitch shift amount based on the pitch from a predetermined reference pitch (for example, C4) to the pitch of the pressed key. It is. When setting the pitch information, if there is only one key being pressed, the pitch information based on the pitch of the key being pressed is set as the pitch shift amount pitch. When there are a plurality of keys, pitch information is set based on the highest treble of them. This is because the apparatus according to the present embodiment can only generate one voice, and therefore, when a plurality of keys are pressed, it is determined that the voice is generated with a higher sound priority.
[0041]
On the other hand, if the key operation is not a key pressing operation (step C2), the key operation is determined as a key release operation, and in this case, all keys that have been pressed are released. Is determined (step C3). If all the keys have been released, the audio waveform signal playback is stopped, so the sound generation flag gate is set to “0” indicating that no sound is generated (step C4). Return to the CPU main process. If all keys are not released (step C3), no special process is performed, and the process returns to the CPU main process without doing anything.
[0042]
FIG. 10 is a flowchart showing the operation detection processing routine of the ribbon controller 6 described above. As described above, in the apparatus of this embodiment, when the user touches the ribbon controller 6, the touch sensor of the ribbon controller 6 is turned on "ON" and is based on the reproduction speed tcomp of the reproduction position of the audio waveform signal. The change (progress) is stopped according to the predetermined attenuation characteristic. When the finger is released from the ribbon controller 6, the touch sensor of the ribbon controller 6 is turned “OFF”, and the change (progress) based on the playback speed tcomp of the playback position of the audio waveform signal that has been stopped is determined according to a predetermined return characteristic. Return to and play the waveform. In order to perform this control, a touch flag r.touch is prepared, and “0” is set to the touch flag r.touch when the touch sensor is “OFF”, and “1” is set when the touch is “ON”. ing.
The playback mode when the touch flag r.touch is “0” corresponds to the first mode of the present invention, and the playback mode when the touch flag r.touch is “1” corresponds to the second mode of the present invention.
[0043]
When the above-described operation detection processing routine of the ribbon controller 6 is started in the CPU main process, it is first determined whether or not there has been an operation (ON / OFF operation) of touching the ribbon controller 6 with a finger (step D1). If there is no touch operation, this routine is ended as it is, and the process returns to the CPU main process. If there is a touch operation, it is determined whether the touch operation is an operation with the finger touching the ribbon controller 6 (touch ON operation) or an operation with the finger released (touch OFF operation) (step OFF) D2).
[0044]
In the case of touch-on operation in which the ribbon controller 6 is touched with a finger, “1” is set to the touch flag r.touch (step D3), and then the operation amount of the ribbon controller 6 (the movement amount by rubbing the finger) ) Is set in the register as the shift amount shift. As described above, this shift amount shift is a positive value corresponding to the distance (distance from the origin) if the position where the plate is first touched is the origin (0 point) and is slid to the right from this origin. If it is rubbed to the left from the origin, it becomes a negative value corresponding to the distance (distance from the origin). The position where the audio waveform data is reproduced is controlled according to the shift amount shift.
[0045]
If the touch operation is a touch OFF operation in which the finger is released from the ribbon controller 6 (step D2), “0” indicating that the ribbon controller 6 is not touched is set in the touch flag r.touch. (Step D5). Further, in the case of this touch “OFF”, the movement amount shift of the ribbon controller 6 is meaningless, so the movement amount shift is reset to “0” (step D6), and this routine is terminated and the CPU main process is started. Return.
[0046]
FIG. 11 is a flowchart showing the main processing of the DSP 7. As shown in FIG. 3, the DSP 7 receives various pieces of information (pitch shift amount pitch, movement amount shift, reproduction speed tcomp, sound generation flag gate, touch flag r.touch, etc.) from the CPU 1, and these information is stored in the DSP register. The reproduction position sphase of the audio waveform signal is calculated by the position information calculation unit 72 based on the information stored in the group 71, and the reproduction waveform calculation unit 73 is calculated based on the calculated reproduction position sphase and pitch shift amount pitch. Then, while reading the audio waveform data from the waveform memory 8, the reproduction position, pitch, time companding amount (reproduction speed) and the like are controlled to reproduce the waveform. The DSP main process is periodically started and executed by an interrupt that occurs every sampling period to perform waveform reproduction.
[0047]
When an interrupt is applied at the sampling period, the DSP main process of FIG. 11 is started, and first, a position information generation process routine is executed (step E). This position information generation processing routine corresponds to the position information calculation means 72 having the functional block configuration shown in FIG. 3, and the position information on the time axis to be reproduced with respect to the waveform data stored in the waveform memory 8 ( This is a process for sequentially generating the reproduction position (sphase). The detailed operation will be described later.
[0048]
Next, a reproduction waveform calculation processing routine is executed based on the reproduction position sphase reproduced in this position information generation processing routine (step F). This reproduction waveform calculation processing routine corresponds to the reproduction waveform calculation means 73 having the functional block configuration of FIG. 3, and the waveform section at the position indicated by the reproduction position sphase on the time axis of the audio waveform data is instructed from the outside. This is a process of generating reproduced waveform data reproduced based on the sounding start / end information (sounding flag gate) and pitch information (pitch shift amount pitch). Since such a waveform reproducing method is a general known technique as disclosed in, for example, Japanese Patent Laid-Open No. 11-52954, detailed description thereof is omitted here.
[0049]
12 to 14 are flowcharts showing the processing procedure of the position information generation processing routine 0 described above.
[0050]
When this position information generation process routine is started in the DSP main process, the state of the sound generation flag gate is first determined (step E1). The sound generation flag gate is a flag indicating the sound generation / no sound generation state. If it is “0”, the sound generation is not performed. In this case, this routine is immediately terminated and the process returns to the DSP main process.
[0051]
On the other hand, if the sound generation flag gate is “1”, the sound generation of the audio waveform signal is currently being performed. Therefore, next, the sound generation flag gate rises at the present time, that is, the sound generation of the audio waveform signal is started. Is detected (step E2). If it is the start time, initial preparation for reproducing the audio waveform signal is performed (steps E3 and E4). That is, the reproduction position sphase representing the position (address) on the time axis for reproducing the waveform data (PCM amplitude value data) stored in the waveform memory 8 is initialized to the start address wavestart that is the start position of the waveform ( Step E3). Next, the current reproduction speed (that is, the current reproduction speed w.tcomp) used in the calculation of the DSP 7 is initialized to the reproduction speed tcomp set by the time companding amount setting operator (step E4).
[0052]
After this processing is completed or when the audio waveform signal is already being reproduced (step E2), the state of the touch flag r.touch is determined (step E5). If the touch flag r.touch is “1”, that is, the ribbon controller 6 is being touched, the reproduction position sphase representing the position of the waveform data to be reproduced on the time axis is from the reproduction position sphase. It is determined whether or not the first stop mark mark (i) is reached later in time (step E8).
[0053]
The determination result is “Yes”, that is,
Playback position sphase ≥ Stop mark mark (i)
If so, the attenuation flag tts is set to "1" (step E9). This change of the attenuation flag tts to “1” causes the current reproduction speed w.tcomp to attenuate toward the target value offset (in this embodiment, “0” is set at the time of attenuation or “1” is set at the time of return). Is instructed. Therefore, on the condition that the attenuation flag tts is “1” indicating the attenuation of the current reproduction speed w.tcomp (step E10), the target value offset is set to “0”. As a result, after the stop mark mark (i), the current playback speed w.tcomp attenuates toward “0”, whereby the playback position sphase based on the value (playback speed tcomp) set by the time compensator setting operator. Change (progress) stops.
In this case, the waveform section of the audio waveform signal corresponding to the reproduction position sphase is sequentially reproduced based on the reproduction position sphase that is changed by the operation of the ribbon controller 6.
[0054]
The determination result in step E8 is “No”, that is,
Playback position sphase <stop mark mark (i)
If this is the case, the current playback position sphase has not yet reached the first stop mark mark (i) in the direction of travel, so waveform playback will continue as usual. In this case, the attenuation flag tts is set. Absent.
[0055]
On the other hand, when the determination result in step E5 indicates that the touch flag r.touch is “0”, that is, the operation of releasing the finger from the ribbon controller 6 (touch OFF), the attenuation flag tts is set to “0”. Set (step E6). The change of the attenuation flag tts to “0” is an instruction to restore the attenuated current reproduction speed w.tcomp to the original value (the reproduction speed tcomp set by the time companding amount setting operator). The reproduction speed tcomp, which is the reproduction speed set by the time expansion / compression setting operator, is set to the target value offset which is the return destination value (step E7). As a result, after that, the current playback speed w.tcomp returns to the playback speed tcomp in an exponential curve every sampling period, and normal waveform playback is performed after reaching the playback speed tcomp. It becomes like this.
[0056]
In the next step E12, the calculation of the current playback speed w.tcomp is performed to determine the attenuation characteristics of the current playback speed w.tcomp by the touch “ON” and the return characteristics of the current playback speed w.tcomp by the touch OFF operation. The formula of
w.tcomp ← w.tcomp + k × (offset−w.tcomp)
(Where k is an arbitrary coefficient)
The current current playback speed w.tcomp is updated at every sampling period by calculating according to. As shown in FIG. 5 and FIG. 6, this update formula is such that the current playback speed w.tcomp is reduced from the time position of the stop mark mark (i) to 0 with an exponential curve, or the ribbon controller 6 In this way, the current playback speed w.tcomp is returned to a predetermined value (playback speed tcomp) with an exponential curve by the touch-off operation.
[0057]
In this update formula, when the current playback speed is attenuated by a touch-on operation, the target value offset is “0”, so that the current current playback speed w.tcomp is k × w. The attenuation characteristic (that is, an exponential curve characteristic) that decreases by tcomp is drawn. Further, when the current playback speed is restored by the touch-off operation, the target value offset is the playback speed tcomp (eg, “1”), so that the current current playback speed w.tcomp is k × A recovery characteristic (that is, an exponential curve characteristic) increasing by (1-w.tcomp) is drawn.
[0058]
In step E13 following the update step E12 of the current playback speed w.tcomp, it is determined whether the current playback speed w.tcomp matches the playback speed tcomp, that is, “w.tcomp = tcomp”. If they do not match, the current playback speed w.tcomp is currently “0” or changing, and if they match, the current value before the decay start (that is, before the stop mark mark (i)) or the original value. It has been returned to.
[0059]
If the former does not match, it is determined whether the touch flag r.touch is “1” and the current playback speed w.tcomp is near “0” (w.tcomp≈0), and the determination result is “Yes”. If so, the attenuation of the current playback speed w.tcomp is sufficiently close to “0”, so it is regarded as “0”, and the current playback speed w.tcomp is forcibly set to “0” (step E15).
[0060]
After the current playback speed w.tcomp becomes “0”, the waveform playback mode at the playback speed set by the operator is switched to the waveform playback mode in which the user directly designates the playback position by the ribbon controller 6. As a result, waveform reproduction is not performed based on the value (reproduction speed tcomp) set by the time companding amount setting operator, but instead, waveform reproduction is performed based on the amount of movement that the ribbon controller 6 is rubbed left and right with a finger. It will be done while determining the position.
[0061]
That is, the current playback position sphase is updated according to the following update formula (step E16).
sphase = sphase + a × shift
(Where a is an arbitrary coefficient)
That is, a value obtained by multiplying the movement amount shift based on the operation amount of the ribbon controller 6 by a predetermined coefficient a is added to the reproduction position sphase representing the position on the time axis of the currently reproduced waveform data. The playback position is sphase. Therefore, the waveform reproduction position can be controlled in accordance with the value of the shift amount changed by the ribbon controller 6. As can be seen from the above update formula, the coefficient a corresponds to the operation sensitivity of the ribbon controller 6.
[0062]
If the determination result in step E14 is “No”, then it is determined whether the touch flag r.touch is “0” and the current current playback speed w.tcomp is a value near the playback position sphase. (Step E17). This is to determine whether or not the current playback speed w.tcomp has returned from “0” to a value near the playback speed tcomp due to the touch “OFF” operation, and if the determination result is “Yes” The current playback speed w.tcomp is forcibly set to the value of the playback speed tcomp set by the time companding amount setting operator (step E18), and is completely restored from the state of the playback speed “0”. Return to the restored state.
[0063]
Next, the playback position sphase is updated according to the following update formula.
sphase ← sphase + w.tcomp
This update formula adds the current current playback speed w.tcomp to the playback position sphase that represents the position on the time axis of the waveform data that is currently being played back, resulting in a new playback position sphase. Waveform reproduction is performed based on the updated reproduction position sphase.
[0064]
Then, it is determined whether or not the newly updated playback position sphase has exceeded the position of the current stop mark mark (i), and if so, the current stop mark mark (i) is further followed by the stop mark In order to update to a new stop mark by replacing with mark (i + 1)
i ← i + 1
(However, 0 ≦ i ≦ n, n is the total number of stop marks, and the initial value of i is 0)
Follow the update process.
[0065]
After this, the playback position sphase is set in the following steps E22 to E25 so that the playback position sphase does not return before the start address wavestart at the beginning of the audio waveform or advance further than the end address waveend at the end of the audio waveform. Then, processing is performed to limit the audio waveform data within the address range.
[0066]
That is, it is determined whether or not the reproduction position sphase representing the position on the time axis of the currently reproduced waveform data is smaller than the head address wavestart (step E22). The start address wavestart is set (step E23), and the reproduction position sphase is fixed to the start address wavestart so as not to be smaller than that.
[0067]
Also, it is determined whether or not the reproduction position sphase representing the position on the time axis of the waveform data currently being reproduced has become larger than the final address waveend (step E24). Is set to the final address waveend (step E25), and the reproduction position sphase is fixed to the final address waveend so as not to be larger than that.
[0068]
When the above limit processing is performed, or when the current playback position sphase is within the address range of the audio waveform data, this position information generation processing routine is terminated and the process returns to the DSP main processing routine.
[0069]
In carrying out the present invention, various modifications are possible. For example, in the above-described embodiment, the playback speed is increased by turning the ribbon controller ON / OFF.
Current playback speed w.tcomp ← Current current playback speed w.tcomp
10k × [Target playback speed Offset-Current current playback speed w.tcomp]
However, the characteristics are not limited to this. For example, a linear function curve that changes to the target playback speed (Offset) may be used. Instead, it may be anything that does not give the user a sense of incompatibility when switching the playback mode by changing with a change characteristic that changes with time.
[0070]
In the above-described embodiment, the ribbon controller is cited as an operation element that directly designates the waveform position to be reproduced by position information. However, the present invention is not limited to this, and for example, a disk or a circular operation element. The waveform position to be reproduced may be designated based on the rotation amount by rotating the. For example, a turntable provided with a sensor for detecting a rotational position, a rotary encoder, or the like can be considered. Alternatively, a waveform position to be reproduced may be designated according to the amount of movement by a linear slide resistance operator or a so-called wheel operator. Or you may designate the waveform position to reproduce | regenerate by operating the operation element arrange | positioned on a concentric circle. In short, any operator may be used as long as it can generate, as position information, the amount of movement manually operated by the user.
[0071]
In the above-described embodiment, the touch mode of the ribbon controller detects the touch “ON” and the touch “OFF” and switches the playback mode. However, the present invention is not limited to this, and for example, a ribbon Instead of the touch sensor of the controller, the playback mode may be switched by a pedal ON / OFF operation or the like. Alternatively, an operator such as a joystick may be used, and position information can be input by the amount of movement of the joystick.
[0072]
In the above description of the embodiment, the case where the present invention is realized by applying the present invention to a hardware device having a single purpose, such as an audio waveform reproduction device, has been described. However, the present invention is not limited to this. It can also be realized by installing a program such as an electronic musical instrument including the processing routines described above. In this case, such a program is stored in various recording media such as a CD-ROM and a floppy disk (a computer-readable recording medium recording a program for causing a computer to function as each of the function realizing means) and distributed to the market. Can do.
[0073]
【The invention's effect】
As described above, according to the present invention, the audio waveform signal can be reproduced while being time-stretched in a desired manner by directly specifying the reproduction position of the stored audio waveform by the user. Since switching can be performed according to the predetermined desired characteristics, switching between the waveform playback mode at the playback speed set by the operator and the waveform playback mode in which the user directly designates the playback position can be performed smoothly.
[Brief description of the drawings]
FIG. 1 is a diagram showing a block configuration of an audio waveform reproduction device as one embodiment according to the present invention.
FIG. 2 is a diagram showing a data configuration of waveform data stored in a waveform memory in the embodiment apparatus.
FIG. 3 is a diagram representing a schematic configuration of a DSP in the embodiment apparatus in the form of a functional block diagram;
FIG. 4 shows an example of waveform data reproduced by a reproduction waveform calculation process in the embodiment apparatus.
FIG. 5 is a diagram showing an example (part 1) of a change in position information of waveform data in the embodiment apparatus;
FIG. 6 is a diagram showing an example (part 2) of a change in position information of waveform data in the embodiment apparatus;
FIG. 7 is a flowchart showing a procedure of CPU main processing executed by the CPU in the embodiment apparatus;
FIG. 8 is a flowchart showing the procedure of an operation detection processing routine for a control group in the CPU main processing of the embodiment apparatus;
FIG. 9 is a flowchart showing the procedure of a keyboard operation detection processing routine in the CPU main processing of the embodiment apparatus;
FIG. 10 is a flowchart showing a procedure of a ribbon controller operation detection processing routine in the CPU main processing of the embodiment apparatus;
FIG. 11 is a flowchart showing a procedure of a DSP main process executed by the DSP in the embodiment apparatus.
FIG. 12 is a flowchart (1/3) illustrating a procedure of a position information generation process routine in the DSP main process of the embodiment apparatus;
FIG. 13 is a flowchart (2/3) illustrating a procedure of a position information generation process routine in the DSP main process of the embodiment apparatus;
FIG. 14 is a flowchart (3/3) illustrating a procedure of a position information generation processing routine in the DSP main processing of the embodiment apparatus;
[Explanation of symbols]
1 CPU (Central Processing Unit)
2 ROM (Read Only Memory)
3 RAM (Random Access Memory)
4 controls
5 keyboard
6 Ribbon controller
7 DSP (Digital Signal Processor)
8 Waveform memory
9 D / A (digital / analog) converter
10 Speaker

Claims (3)

Storage means for storing waveform data of the audio waveform;
Reproduction means for reproducing waveform data corresponding to a position on the time axis of the audio waveform designated as a reproduction position;
Playback speed input means for inputting a playback speed that is an amount to advance the playback position;
A movement amount input means for inputting a movement amount of a movement manually operated by the user;
Mode switching means for switching the reproduction mode of the reproduction means between the first mode and the second mode;
When switched to the first mode by the mode switching means, the playback means controls to reproduce the waveform while updating the playback position based on the playback speed, and when switched to the second mode, Control means for controlling the reproduction of the waveform while stopping the update of the reproduction position based on the reproduction speed and updating the reproduction position based on the amount of movement input by the movement amount input means instead.
The playback position is updated based on the playback speed when the mode switching means switches from the first mode to the second mode. When the playback position arrives at a predetermined position , the update does not change instantaneously but changes with time. An audio waveform reproduction device comprising stop characteristic control means for controlling to stop at a change characteristic of Storage means for storing waveform data of the audio waveform;
Reproduction means for reproducing waveform data corresponding to a position on the time axis of the audio waveform designated as a reproduction position;
Playback speed input means for inputting a playback speed that is an amount to advance the playback position;
A movement amount input means for inputting a movement amount of a movement manually operated by the user;
Mode switching means for switching the reproduction mode of the reproduction means between the first mode and the second mode;
When switched to the first mode by the mode switching means, the playback means controls to reproduce the waveform while updating the playback position based on the playback speed, and when switched to the second mode, Control means for controlling the reproduction of the waveform while stopping the update of the reproduction position based on the reproduction speed and updating the reproduction position based on the amount of movement input by the movement amount input means instead.
The update of the playback position when the mode switching means switches from the second mode to the first mode is changed to the original update mode based on the playback speed with a predetermined change characteristic that changes with time rather than an instantaneous change. An audio waveform reproducing device comprising return characteristic control means for controlling to return. One or more stop positions are set in advance at an arbitrary position on the time axis of the audio waveform, and the reproduction based on the reproduction speed when the mode switching unit switches from the first mode to the second mode. The audio waveform reproduction apparatus according to claim 1, wherein the position update is stopped based on the stop position.

Images