JP5282563B2 - Musical sound reproducing apparatus and program for realizing the method - Google Patents

Description

  The present invention relates to a musical sound reproducing apparatus capable of reproducing musical sounds with a scratch effect based on waveform data, and a program for realizing a control method thereof.

  2. Description of the Related Art Musical sound reproducing apparatuses that can reproduce musical sounds with a scratch effect based on waveform data have been known.

  As such a musical sound playback device, a start point indicating the first position (point) when waveform data is read out from the waveform memory and played back, a loop start point indicating the first position of the repeated portion during repeated playback, and a repeated portion A loop end point that indicates the last position of the signal and a scratch point that indicates the start point for applying the scratch effect are set in advance, and the reading is performed according to the operation of the pitch bend operator for instructing the reading speed and reading direction of the waveform data. When it is detected that the direction has changed, waveform data is read out at a speed and direction (forward direction or reverse direction) instructed from a set scratch point (for example, Patent Document 1). reference).

There is also a musical sound reproducing apparatus that includes a ribbon controller and starts reproducing waveform data when the ribbon controller is touched and moves the position touching the ribbon controller to scratch the reproduced sound (for example, , See Patent Document 2). In this musical tone reproducing apparatus, a scratch area is set at a predetermined position in the waveform data, and a predetermined address on the scratch area is set as a scratch start address in the scratch pointer, and the ribbon controller starts operating. Regardless of the position, scratch reproduction is started from the position indicated by the scratch pointer.
JP-A-8-76761 JP-A-9-90958

  However, in any of the above conventional music sound reproducing apparatuses, at least the scratch start position must be set in advance in order to perform scratch reproduction, so the scratch start position can be freely selected and set during normal reproduction. There wasn't.

  In the former of the conventional musical sound reproducing apparatuses, scratch reproduction is performed using a pitch bend operator, and in the latter of the conventional musical sound reproducing apparatuses, a ribbon controller is used. When the waveform data is displayed on the display device, the user needs to operate an operator at a position different from the display device while viewing the displayed waveform. Operation is difficult.

  The present invention has been made paying attention to this point, and provides a musical sound reproducing apparatus that can perform scratch reproduction from a desired position with a simple operation and a program for realizing the control method thereof. With the goal.

In order to achieve the above object, a musical tone reproducing apparatus according to claim 1 is a multipoint touch panel, waveform readout control means for controlling readout of supplied waveform data, and waveforms controlled to be read out by the waveform readout control means. A musical sound reproducing apparatus comprising a reproducing means for reproducing a musical sound based on data, the display means for displaying at least one or more reproduction control operators and the supplied waveform data on the multipoint touch panel; an accepting means for a user receives a touch input more than one point was performed with respect to the multi-point touch panel, and detecting means for detecting a predetermined user operation from the touch input received by the receiving with means, users said multipoint in response to performing the operation of rubbing after touching the waveform data displayed on the touch panel, the detection means the predetermined user Upon detecting a scratch operation for instructing scratch play as work, the a accepted touch input, of rubbing after the touch operation, to extract the scratch reproduction start position from the touch position, reproduction direction and the operation thereafter a rubbing Scratch reproduction control information extracting means for extracting the waveform data reading speed and extracting scratch reproduction control information including the scratch reproduction start position, reproduction direction and reading speed , and transmitting various information to the waveform reading control means. Transmitting means, and when the scratch reproduction control information extracting means extracts the scratch reproduction control information, the transmitting means transmits the scratch reproduction control information to the waveform reading control means, and the waveform reading control means comprises: When the scratch reproduction control information transmitted by the transmission means is received, the scratch reproduction control information is received. Based on the latch reproduction control information, as the scratch reproduction start position the scratch reproduction in the reproduction direction in the reading speed from the is carried out, and controls the reading of the supplied waveform data.

  According to a second aspect of the present invention, there is provided a musical sound reproducing apparatus according to the first aspect, wherein when the detection unit detects an operation on the reproduction control operator as the predetermined user operation, the received sound input is detected. Furthermore, it further includes reproduction control information extraction means for extracting reproduction control information including a control type and a control amount of the reproduction control, and the waveform reading control means controls reading of the waveform data based on the scratch reproduction control information. When the reproduction control information extraction means extracts reproduction control information during the execution, the reproduction means obtains the waveform data obtained from the waveform read control means by the read control and the reproduction control information extraction means. The musical sound is reproduced based on the reproduced reproduction control information.

According to a third aspect of the present invention, there is provided a musical sound reproducing apparatus according to the first aspect, wherein when the detecting means detects an operation for instructing a loop reproduction section as the predetermined user operation, the received sound input is detected. Furthermore, it further has a loop section extracting means for extracting the start position and end position of loop playback that is the loop section, and the transmitting means, when the loop section extracting means extracts the loop section, When the detection means detects an operation for instructing the end of scratch reproduction as the predetermined user operation, the end of the scratch reproduction is transmitted to the waveform readout control means, and the waveform readout control means is transmitted by the transmission means. Upon receiving the loop section, the loop section to set, when the loop section is set, the transmission means transmits And upon receiving the scratch reproduction control information, starts the pre-SL read control of the waveform data based on the scratch reproduction control information, then, when the transmission unit receives the end instruction scratch reproduction that has sent to the scratch reproduction control information It is characterized in that the reading control of the waveform data based thereon is stopped.

  In order to achieve the above object, the program according to claim 4 can be realized by the same technical idea as claim 1.

According to the first or fourth aspect of the present invention, an operation of rubbing after touch, which is one or more touch inputs performed on the waveform data displayed on the multipoint touch panel by the user, is accepted and accepted. When a predetermined user operation is detected from the touch input and a scratch operation instructing scratch reproduction is detected as the predetermined user operation, from the touch position of the received touch input , the post-touch rubbing operation The scratch playback start position is extracted , the playback direction and the readout speed of the waveform data are extracted from the subsequent rubbing operation , and the scratch playback control information including the scratch playback start position, the playback direction and the readout speed is extracted, and the waveform readout is performed. Is transmitted to the control means, and the waveform readout control means is based on the scratch reproduction control information. Te, As the scratch reproduction in the reproduction direction to the reading speed from the scratch reproduction start position are carried out, it controls the reading of the supplied waveform data, the reproducing means, based on the read control waveform data tone Therefore, scratch reproduction can be performed from a desired position with a simple operation.

  According to the second aspect of the present invention, while the waveform readout control means performs the readout control of the waveform data based on the scratch playback control information, the playback control information is further received from the accepted touch input. When the sound is extracted, the reproducing means reproduces a musical sound based on the waveform data obtained from the waveform reading control means and the extracted reproduction control information by the reading control, so that an operation for obtaining a scratch effect is performed. And the playback control operator can be performed simultaneously and easily.

According to the invention described in claim 3, in the waveform readout control means, upon receiving a loop section, the loop section to set, when the loop section is set, receiving the scratch reproduction control information then, to start the read control of the waveform data based on the previous SL scratch reproduction control information, then, upon receiving the instruction to end the scratch reproduction, so to stop the read control of the waveform data based on the scratch reproduction control information, loop The section can be set easily and in real time, and a variety of reproductions can be performed.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a musical sound reproducing apparatus according to an embodiment of the present invention.

  As shown in the figure, the musical tone playback apparatus according to the present embodiment includes a panel operation element 1 including a plurality of switches for inputting various types of information, and waveform data and various musical tone parameters to be played back. A touch panel 2 for inputting various kinds of information by touching the displayed waveforms and controls, a detection circuit 3 for detecting the operation state of the panel controls 1, and a touch panel 2 by the user. A detection circuit 4 that detects a pressing operation such as an operation position and an operation pressure, a display circuit 5 that displays a GUI (graphical user interface) for inputting various information related to musical tone reproduction on the touch panel 2, and control of the entire apparatus. The CPU 6 that controls the ROM 7, the ROM 7 that stores the control program executed by the CPU 6, various table data, and the like, the waveform data, various input information, and the calculation A RAM 8 that temporarily stores results, a storage device 9 that stores various application programs including the control program, various waveform data, and various data, and an external device 100 are connected, and data is transmitted to and received from the external device 100. A communication interface (I / F) 10 for performing the above, a tone generator circuit 11 for converting waveform samples obtained by reproducing the waveform data stored in the RAM 8 into a tone signal, and various tone signals from the tone generator circuit 11 An effect circuit 12 for providing an effect, and a sound system 13 such as a DAC (digital-to-analog converter), an amplifier, or a speaker that converts a musical sound signal from the effect circuit 12 into sound. Yes.

  The components 3 to 12 are connected to each other via the bus 14, the external device 100 is connected to the communication I / F 10, the effect circuit 12 is connected to the sound source circuit 11, and the sound system is connected to the effect circuit 12. 13 is connected.

  The touch panel 2 is a panel (hereinafter referred to as “multi-point touch panel”) having a multi-point recognition function for recognizing user touch operations on a plurality of positions.

  The storage device 9 is, for example, a storage medium such as a flexible disk (FD), a hard disk (HD), a CD-ROM, a DVD (digital versatile disc), a magneto-optical disk (MO), and a semiconductor memory, and a driving device thereof. The storage medium may be detachable from the drive device, or the storage device 9 itself may be detachable from the musical sound reproducing device of the present embodiment. Alternatively, neither the storage medium nor the storage device 9 may be detachable. As described above, the storage device 9 (the storage medium) can also store the control program executed by the CPU 6. If the control program is not stored in the ROM 7, the control program is stored in the storage device 9. By reading it into the RAM 7, it is possible to cause the CPU 6 to perform the same operation as when the control program is stored in the ROM 7. In this way, control programs can be easily added and upgraded.

  In the illustrated example, the external device 100 is connected to the communication I / F 10, but the present invention is not limited to this. For example, a server computer is connected via a communication network such as a LAN (local area network), the Internet, or a telephone line. You may be made to do. In this case, if the above programs and various parameters are not stored in the storage device 9, the communication I / F 10 is used to download the programs and parameters from the server computer. The musical tone reproducing apparatus as a client transmits a command for requesting downloading of a program and parameters to the server computer via the communication I / F 10 and the communication network. Upon receiving this command, the server computer distributes the requested program and parameters to the musical sound reproducing device via the communication network, and the musical sound reproducing device receives these programs and parameters via the communication I / F 10. Downloading is completed by accumulating in the storage device 9.

  As the communication I / F 10, for example, a music-dedicated wired I / F that exclusively transmits and receives a music signal such as a MIDI signal, a general-purpose short-distance wired I / F such as USB (universal serial bus) and IEEE 1394 (eye triple E 1394). And general-purpose network I / F such as Ethernet (registered trademark), and general-purpose short-range wireless I / F such as wireless LAN and Bluetooth (registered trademark). In this embodiment, the USB is adopted as the communication I / F 10, but other types of I / Fs may be used instead, and other types of I / Fs are added thereto. You may do it.

  FIG. 2 is a diagram showing a part of a waveform data reproduction screen displayed on the multipoint touch panel 2. As shown in the figure, in a partial area of the multipoint touch panel 2, a waveform display area 21 for displaying the shape of waveform data to be reproduced, and a vertical channel fader 22L, which is an example of a reproduction control operator, are shown. A vertical fader 22R and a cross fader 23 for the right channel are displayed. The reason why such a volume fader is exemplified as the playback control operator is that a representative type of operator that is simultaneously operated while performing scratch reproduction is a volume fader. As this type of operation element other than the volume fader, there is an operation element for instructing mute or filter. Of course, these operators may be added to the waveform data reproduction screen.

  The control process executed by the musical tone reproducing apparatus configured as described above will be described first with reference to FIGS. 2 to 4, and then with reference to FIGS. 5 and 6 in detail.

  When the reproduction mode for reproducing the waveform data is selected, the waveform display area 21, the left and right channel vertical faders 22L and 22R, and the cross fader 23 are displayed on the multipoint touch panel 2 as shown in FIG. The waveform data playback screen including is displayed. When normal (normal) reproduction of waveform data is instructed, the reproduction pointer P indicating the reproduction point (current reproduction position) advances in the forward direction (rightward in the drawing) as the reproduction proceeds. During normal playback, if the user performs an operation such as rubbing the waveform display area 21 to the left or right with the index finger of the right hand (hereinafter referred to as “drawing operation”), input information corresponding to the drawing operation (multiple points) Input information) is detected via the detection circuit 4, and the scratch reproduction start position, the reproduction direction and the waveform data reading speed are extracted based on the input information, and the scratch reproduction is performed based on the extracted information. Be started. As shown in FIG. 3, when the user touches the knob of the crossfader 23 with, for example, the left index finger and moves the knob to the left or right during the scratch reproduction, the crossfade value corresponding to the movement amount is obtained. It is calculated and reflected in scratch reproduction.

  When the user stops the drawing operation with the index finger of the right hand and releases the finger from the waveform display area 21, the scratch playback ends, and the playback pointer P moves to the position where the index finger of the right hand is released, and from that position Playback resumes.

  Next, when the user touches two points on the waveform display area 21 with the thumb and forefinger of the right hand, for example, as shown in FIG. 4, the point (loop start point) designated by the thumb (point designated by the index finger) The section up to (loop end point) becomes a loop section, and the display mode changes (in the example shown, it is shaded, but this is for convenience and other display modes such as color change and reverse display) May be). When the playback pointer P reaches the loop end point, the playback pointer P then returns to the loop start point, and thereafter, loop playback from the loop start point to the loop end point is repeatedly executed. When a point outside the loop section is touched during loop playback, the loop playback ends. When a point inside the loop section is touched, the playback point of loop playback moves to that point.

  As described above, in this embodiment, the start position of scratch reproduction can be freely selected and set during normal reproduction. Further, since it is possible to instruct the scratch reproduction on the display of the waveform data to be reproduced, it is possible to easily obtain the scratch effect with a simple and intuitive operation. Furthermore, since a multipoint touch panel is used as the operation input means, an operation for obtaining a scratch effect and an operation for the playback control operator can be performed simultaneously and easily. In addition, on the display of the waveform data to be reproduced, loop reproduction can be set or canceled easily and in real time, and reproduction rich in change can be performed.

  Next, this control process will be described in detail.

  FIG. 5 and FIG. 6 are flowcharts showing the procedure of the playback process executed by the musical tone playback apparatus of this embodiment, particularly the CPU 6.

This playback process is mainly
(1) Initial screen display process (step S1)
(2) Normal reproduction request processing (steps S3 to S8)
(3) Reproduction end request processing (step S10)
(4) Loop section designation request processing (step S13)
(5) Playback point change request processing (step S16)
(6) Loop section release request processing (step S17)
(7) Scratch regeneration request processing (steps S19 to S22)
(8) Scratch regeneration release request processing (steps S26 to S28)
(9) Reproduction control operator process (step S24)
It is constituted by. Note that the term “request” is used in the processes (2) to (8) above, but this is actually performed by a “waveform readout control unit” described later. This is because in (2) to (8), a request for the processing is made to the “waveform readout control unit”.

  When the user operates, for example, a mode switch (not shown) included in the panel operation element 1 to switch the operation mode to the reproduction mode, the reproduction process is started. When the reproduction process is started, first, the CPU 6 advances the process to the initial screen display process (1). In this (1) initial screen display process, the CPU 6 displays a waveform data reproduction screen on the multipoint touch panel 2. FIG. 2 shows a part of the waveform data reproduction screen. The waveform data reproduction screen includes at least a waveform display area 21, vertical faders 22L and 22R for left and right channels, and a cross fader 23. The waveform data displayed in the waveform display area 21, that is, the waveform data currently being reproduced, is stored in a waveform data reproduction buffer (not shown) provided at a predetermined position in the RAM 7 as it is. Used. Accordingly, it is assumed that the waveform data reproduction buffer stores, for example, one selected by the user from a plurality of waveform data stored in the storage device 9 or the like before the reproduction process is started. . The waveform data is not limited to the data stored in the music sound reproducing device of the present embodiment, but may be read from the data stored outside the music sound reproducing device of the present embodiment, or via the communication I / F 10. It is also possible to input what is output in real time from another device such as an externally connected instrument.

  Next, the CPU 6 waits until the user operates, for example, a playback switch (not shown) included in the panel operation element 1 to instruct the start of playback (step S2). The process proceeds to the normal reproduction request process (2). In this (2) normal reproduction request process, first, the CPU 6 determines whether or not the user has designated a reproduction point (step S3). Since the musical sound reproducing apparatus of the present embodiment is configured so that normal reproduction can be started from the middle of the waveform data, in this step S3, the position to start reproduction, that is, the reproduction point is designated. It is determined whether or not. If the result of this determination is that the user has not designated a playback point, the CPU 6 sets the beginning of the waveform data as the playback point (step S4). On the other hand, when the user designates a playback point, the CPU 6 sets the designated position as the playback point. (Step S5). The playback points are stored in a playback point storage buffer (not shown) provided at a predetermined position in the RAM 7. Next, the CPU 6 clears the loop start point and the loop end point (step S6). Here, the loop start point is the start point of the loop section during loop playback, and the loop end point is the end point of the loop section. The loop start point and loop end point are stored in a loop start point storage buffer and a loop end point storage buffer (both not shown) provided at predetermined positions in the RAM 7, respectively. Note that “clear” in step S6 is, for example, that “FF” (when expressed by 1 byte) is set for each of the loop start point and the loop end point (hereinafter, the same applies to other steps). Further, the CPU 6 turns off (“0”) a scratch flag provided at a predetermined position in the RAM 7 (step S7). The scratch flag is a flag that is set to ON (“1”) during scratch reproduction and is set to OFF when scratch reproduction is not being performed.

  Next, the CPU 6 requests the waveform readout control unit to start normal reproduction by transmitting the reproduction point to the waveform readout control unit (step S8). In the present embodiment, the waveform readout control unit is configured by appropriately changing a known technique (for example, the readout control unit 10 shown in FIG. 5 of Patent Document 1) for the present invention in order to simplify the description. We adopt what we did. Therefore, the waveform reading control unit is supplied (transmitted) with predetermined information from the outside (CPU 6), specifically, all or part of the playback point, loop start point, loop end point, scratch start point, and scratch flag. Then, the processing result corresponding to that (the contents will be described below) shall be automatically output, and how the waveform readout control unit uses the supplied information to obtain the corresponding processing result. The detailed description of is omitted. The waveform readout control unit is realized by using the CPU 6, the RAM 8, the tone generator circuit 11, and a control program (executed by the CPU 6). When the playback point is supplied with the loop start point, the loop end point, the scratch start point, and the scratch flag all reset (the processing state in step S8), the waveform readout control unit performs normal playback from the playback point. Start. That is, the waveform readout control unit reads out one sample of the waveform data stored in the waveform data reproduction buffer one by one at a predetermined timing, and generates a musical tone signal based on the sample one at a predetermined timing. . The generated musical sound signal is supplied to the effect circuit 12. Since the scratch start point is necessary only during scratch reproduction, it does not need to be transmitted here. In the case of scratch reproduction, values corresponding to the waveform data read speed and reproduction direction must be input. Further, since the loop start point and the loop end point are always compared with the playback point, the loop start point and loop end point cleared in step S6 are transmitted here. That is, in step S8, only the “reproduction point” is transmitted to the waveform readout control unit. However, as described above, information other than the “reproduction point” is actually transmitted to the waveform readout control unit.

  Next, when the user instructs the end of the reproduction process by operating the mode switch or the like, the CPU 6 advances the process to the reproduction end request process of (3). In this (3) reproduction end request process, the CPU 6 requests the waveform read control unit to end reproduction. Specifically, the CPU 6 clears all of the playback point, loop start point, loop end point, scratch start point, and scratch flag, and transmits the cleared parameter value to the waveform read control unit. In response to this, the waveform reading control unit stops reading if the waveform data is being read, and does nothing particularly if the waveform data is not being read. Note that “clear” of the playback point and scratch start point is “FF” (when expressed in 1 byte) at the playback point and scratch start point, respectively, similarly to “clear” of the loop end point and scratch start point. “Clear” of the scratch flag means that the scratch flag is turned off (“0”). That is, the waveform readout control unit is in a reproduction stop state when the reproduction point is cleared.

  On the other hand, when the user does not instruct the end of the reproduction process, the CPU 6 checks the output of the detection circuit 4 to determine whether or not the user has made a touch input to the multipoint touch panel 2, and the touch input is If there is, input information such as the input position, pressure and speed is received and acquired (step S11). Then, the CPU 6 analyzes the received input information and performs a process according to the analysis result.

  If two or more point designations are detected simultaneously on the waveform display area 21 as a result of the analysis, the process proceeds to the loop section designation request process (4). In this (4) loop section designation request processing, first, the CPU 6 extracts a loop start point and a loop end point based on the detected point designation, and sets (saves them in the loop start point storage buffer and the loop end point storage buffer, respectively. ) And transmitted to the waveform readout control unit (step S13). Here, when there are two point designations, the point designation position (address) that is earlier on the time axis of the waveform display area 21 is set as the loop start point, while the position (address) that is later point designation is the loop end. Set to point. If there are three or more point designations, the outer two points may be adopted, but in addition to this, two points from the earlier on the time axis, two points from the later, or the current point Two points close to the playback point may be used. Furthermore, it goes without saying that “at the same time” includes a time difference within a predetermined range. When the loop start point and the loop end point are supplied, the waveform readout control unit does not change whether the current readout position (position of the playback pointer P) of the waveform data is within the designated loop section. When playback is continued and the read position reaches the loop end point, the read position is returned to the loop start point and loop playback is started. At this time, the loop section may be specified before the reading position. In this case, only the loop section is specified, and the loop reproduction is not started. Thereafter, the reading position is set, for example, in step S16 described later. It is only necessary to start loop playback when moving into the loop section by the above process. Alternatively, simultaneously with the designation of the loop section, the readout position may be moved to the loop start point, and loop playback may be started.

  As a result of the analysis, when one point designation is detected on the waveform display area 21, the loop section is designated and the point designation is not outside the loop section. That is, the point designation is the loop section designation. If it is made in a state where it is not performed, or if the point designation is made in a state where the loop section is designated and is within the loop section, the CPU 6 performs the processing (5). On the other hand, if the loop section is designated and the point designation is outside the loop section, the CPU 6 performs the process (6). The process proceeds (steps S14 → S15 → S17). (5) In the playback point change request process, the CPU 6 moves the playback point to the designated point, and then transmits the playback point to the waveform readout control unit (step S16). As a result, the waveform readout control unit moves the waveform data readout position from the current readout position to the designated point, and continues reproduction. On the other hand, in the (6) loop section release request process, the CPU 6 clears the loop start point and the loop end point (loop release) (step S17). As a result, the waveform readout control unit ends the loop reproduction if loop reproduction is in progress, and returns to normal reproduction. However, in this case, the read position of the waveform data is maintained as it is. That is, only the designation of the loop section is canceled. As described above, since the loop section is not released until the user touches outside the loop section, even if the user releases his / her finger from the multipoint touch panel 2 after the loop playback is started, the loop playback continues as it is. .

Thus, in this embodiment,
(A) State & point designation with loop section specified is outside loop section: cancellation of loop section designation (b) State & point designation with loop section designated is within loop section: loop playback is in progress While maintaining the playback, the waveform data read position is moved to the specified position in the loop section while the waveform data read position is moved to the specified position in the loop section if loop playback is not in progress. Thereafter, loop playback is started from that position. (C) When the loop section is not designated: The waveform data reading position is controlled to move to the designated position. Therefore, in the present embodiment, when a loop section is designated, it is impossible to move only the waveform data read position outside the loop section without canceling the designation of the loop section. To make this possible, when one point on the waveform display area 21 is specified a plurality of times (for example, twice) in a short time, such as double-clicking the mouse, the loop section is not specified. The reading position may be moved when it is performed a single time.

  Further, when the drawing operation is detected on the waveform display area 21 as a result of the analysis, the CPU 6 advances the process to the scratch reproduction request process (7). In this (7) scratch reproduction request process, the CPU 6 first turns on the scratch flag (step S19 in FIG. 6) and transmits it to the waveform readout control section (step S20). As a result, if the current playback state is during loop playback, the waveform readout control unit cancels the loop playback without changing the values of the loop start point and loop end point, and the current playback state is during normal playback. Do nothing in particular. Next, the CPU 6 extracts the scratch reproduction start position, the reproduction direction and the waveform data readout speed from the acquired input information (step S21), and transmits the extracted information to the waveform readout controller (step S22). ). In the process of step S21, information to be transmitted to the waveform readout control unit is extracted from the input information. Among the information to be transmitted to the waveform readout control unit, in particular, the readout speed of the waveform data is directly extracted from the input information. However, in some cases, the waveform readout control unit cannot be used. In this case, the extracted speed (finger moving speed in the drawing operation) is subjected to a predetermined conversion and then transmitted to the waveform readout control unit. To. That is, the “extraction” in step S21 includes not only simple extraction but also a predetermined operation on the result obtained by simple extraction. Here, specific examples of the “predetermined calculation” include the following. That is, when the user performs the drawing operation as shown in FIG. 3, the position of the finger is detected at a predetermined period T (for example, 0.1 second), and the position of the finger is detected during this period T. When moving from the start point A to the end point B, the CPU 6 first obtains the waveform data addresses corresponding to the start point A and the end point B, and then the number of waveform data (number of samples) between A and B from both addresses. N is acquired, and the calculation of the following equation is further performed to acquire the reproduction pitch P, that is, the waveform data reading speed.

P = N / Fs / T
However, Fs is the sampling frequency of waveform data (the number of waveform data per second). Then, the CPU 6 transmits this reproduction pitch P to the waveform readout control unit. The above processing is repeatedly executed while the user performs the drawing operation.

  Of the information transmitted in step S22, the scratch start position is transmitted as it is to the waveform readout control unit. However, with regard to the reading speed and playback direction of the waveform data, when the playback direction is the forward direction, the speed (absolute value) is used as it is in the waveform read control unit, and when the playback direction is the reverse direction, the speed (absolute value) is minus. Value is used. Thereby, the waveform readout control unit starts scratch reproduction.

  In addition, the drawing operation basically assumes a drawing operation in the horizontal axis direction. However, even when the “line” of the drawing operation is in another direction, the finger is operated in the same manner as in the horizontal axis direction. What is necessary is just to extract the movement distance and speed of this, and to reflect it on scratch reproduction. The forward direction or the reverse direction may be determined based on whether the movement is in the plus direction or the minus direction with respect to the horizontal axis.

  Further, in the present embodiment, the scratch reproduction is performed during the normal reproduction. However, in addition to this, the scratch reproduction may be performed in response to a user operation input while the reproduction is stopped.

  When the user stops the drawing operation on the waveform display area 21 and releases his / her finger from the waveform display area 21, the operation is an operation for ending the scratch reproduction in the present embodiment. Is advanced to the scratch reproduction release request processing of (8). In this (8) scratch reproduction release request processing, the CPU 6 first moves the reproduction point to the position where the finger is released (step S26), then turns off the scratch flag (step S27), and further reproduces the reproduction point and scratch flag. Is transmitted to the waveform readout control unit (step S28). As a result, the waveform readout control unit resumes normal playback from the position of the playback point, that is, the position where the user removed the finger that was performing the scratch operation after returning to the original (normal playback) speed and direction during scratch playback. To do. However, at this time, if the loop section is valid (that is, valid values are set for the loop start point and the loop end point, respectively) and the playback point is within the loop section, the waveform readout control unit performs loop playback. I do.

  While normal playback, loop playback, or scratch playback is being performed, the user can control playback controls on the multipoint touch panel 2 (in this embodiment, the vertical faders 22L and 22R and the crossfader for the left and right channels in FIG. 2). When the operation information input is detected by operating 23), the CPU 6 advances the process to the reproduction control operator process of (9). In this (9) reproduction control operator processing, the CPU 6 extracts the control type and the control amount based on the detected operation input information, and transmits it to the sound source circuit 11 (step S24). For example, as shown in FIG. 3, when the user moves the knob of the crossfader 23 to the left or right during the scratch reproduction and instructs the change of the current value, the CPU 6 detects the operation input, and the amount of movement of the knob. Then, the crossfade value after the change is calculated and set in a corresponding register (not shown) of the tone generator circuit 11. Thereby, the effect according to the changed cross-fade value is reflected in the musical sound to which the scratch effect is given generated from the sound system 13.

  In the present embodiment, no consideration is given to a case where a loop section is specified while a loop section is specified. That is, in the flowchart of FIG. 5, since the process of step S13 is executed many times as long as the condition of step S12 is satisfied, a loop section is set for each execution. However, since such a case is a peculiar case, it is not mentioned in the above description of the process in step S13. There are several possible ways to handle such cases. For example, if a loop section is specified again when it is specified, the previously specified loop section is canceled, the newly specified loop section is enabled, and the loop section is always specified by the latest one section. To be. Alternatively, in the state where the loop section is designated, re-designation is not accepted, and the outside of the currently set loop section is touched to cancel the designation of the loop section, and then the loop section is newly designated. Alternatively, the designation of the loop section is repeated every time a new loop section is designated without canceling the designation of the loop section. In this case, information about each loop section (loop start point and loop end point) is stored and managed in a list format, for example, and touch input for canceling the loop section (in this embodiment, outside the loop section) If there is a touch input), the loop section closest to the position of the touch input may be searched based on the information about each loop section, and the loop section may be canceled. It should be noted that the rule for which loop section is canceled for touch input is not limited to the “closest”, and any rule may be adopted.

  In this embodiment, only the volume fader is used as an operator that can be operated simultaneously with the scratch reproduction. However, an operator for instructing the mute or filter may be added thereto.

  Furthermore, in the present embodiment, the loop section is displayed by changing the display mode in the waveform display area 21, but the present invention is not limited to this, and the loop section is displayed in another area on the multipoint touch panel 2. A dedicated display area may be provided. In this case, if the loop section is set on the dedicated display area, a plurality of loop sections can be set or canceled even during scratch reproduction.

  In addition, in this embodiment, the mode switching and the reproduction instruction are performed using a mechanical switch. However, the present invention is not limited to this, and is performed using a switch displayed on the multipoint touch panel 2. May be.

  A program in which a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus is stored in the storage medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the code.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the program code and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic A tape, a non-volatile memory card, a ROM, or the like can be used. Further, the program code may be supplied from a server computer via a communication network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instruction of the program code performs the actual processing. It goes without saying that a case where the functions of the above-described embodiment are realized by performing part or all of the above and the processing thereof is included.

  Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows schematic structure of the musical tone reproduction apparatus which concerns on one embodiment of this invention. It is a figure which shows a part of waveform data reproduction | regeneration screen displayed on the touch panel of FIG. It is a figure which shows a mode that the drawing operation with respect to the waveform display area displayed on a part of waveform data reproduction | regeneration screen of FIG. 2 and the operation with respect to a cross fader were made simultaneously. It is a figure which shows a mode that the setting operation of the loop area with respect to the waveform display area displayed on a part of waveform data reproduction | regeneration screen of FIG. 2 was made. 2 is a flowchart showing a procedure of a reproduction process executed by the musical sound reproduction apparatus of FIG. 1, particularly a CPU. FIG. 6 is a flowchart showing a procedure subsequent to the reproduction process of FIG. 5. FIG.

Explanation of symbols

2 ... multi-point touch panel, 4 ... detection circuit (accepting means), 5 ... display circuit (display means), 6 ... CPU (reproducing means, display means, accepting means, detecting means, scratch reproduction control information extracting means, transmitting means, Reproduction control information extraction means, loop section extraction means) 8... RAM (reproduction means, detection means, scratch reproduction control information extraction means, reproduction control information extraction means, loop section extraction means), 11... Sound source circuit (reproduction means)

Claims (4)

A musical sound reproducing apparatus comprising a multipoint touch panel, waveform readout control means for controlling readout of supplied waveform data, and reproduction means for reproducing musical sounds based on waveform data read and controlled by the waveform readout control means There,
Display means for displaying at least one reproduction control operator and the supplied waveform data on the multipoint touch panel;
Receiving means for receiving one or more touch inputs made by the user on the multi-point touch panel;
Detecting means for detecting a predetermined user operation from the touch input received by the receiving means;
When the detection unit detects a scratch operation for instructing scratch reproduction as the predetermined user operation in response to the user performing a rubbing operation after touching the waveform data displayed on the multipoint touch panel. The scratch reproduction start position is extracted from the touch position, and the playback direction and the reading speed of the waveform data are extracted from the subsequent rubbing operation , and the scratch reproduction is performed. Scratch reproduction control information extracting means for extracting scratch reproduction control information including a start position, a reproduction direction, and a reading speed ;
Transmission means for transmitting various information to the waveform readout control means,
The transmission means transmits the scratch reproduction control information to the waveform readout control means when the scratch reproduction control information extraction means extracts the scratch reproduction control information,
When the waveform readout control means receives the scratch reproduction control information transmitted by the transmission means, the waveform reproduction control means performs scratch reproduction at the readout speed from the scratch reproduction start position to the reproduction direction based on the scratch reproduction control information. Further, the musical sound reproducing apparatus is characterized by controlling reading of the supplied waveform data. Reproduction that further extracts reproduction control information including a control type and a control amount of the reproduction control from the accepted touch input when the detection unit detects an operation on the reproduction control operator as the predetermined user operation. A control information extracting unit;
While the waveform readout control means performs readout control of the waveform data based on the scratch playback control information, when the playback control information extraction means extracts playback control information, the playback means performs the readout control. 2. The musical sound reproducing apparatus according to claim 1, wherein the musical sound is reproduced based on the waveform data obtained from the waveform reading control means and the reproduction control information obtained from the reproduction control information extracting means. When the detection means detects an operation for designating a loop playback section as the predetermined user operation, a loop section for further extracting a loop playback start position and end position, which is the loop section, from the accepted touch input Further having an extraction means;
The transmitting means indicates the loop section when the loop section extracting means extracts a loop section, and when the detecting means detects an operation to instruct the end of scratch reproduction as the predetermined user operation, To the waveform readout control means,
The waveform readout control means receives the loop section of said transmission means has transmitted, the loop section to set, when the loop section is set, receives a scratch reproduction control information which the transmitting means has transmitted then, to start the pre-SL read control of the waveform data based on the scratch reproduction control information, then, when the transmission unit receives the end instruction scratch reproduction that has sent the read control of the waveform data based on the scratch reproduction control information tone reproducing apparatus according to claim 1, characterized in that to stop. A musical sound reproducing apparatus comprising a multipoint touch panel, waveform readout control means for controlling readout of supplied waveform data, and reproduction means for reproducing musical sounds based on waveform data read and controlled by the waveform readout control means A program for causing a computer to execute a control method for controlling,
The control method is:
A display step of displaying at least one reproduction control operator and the supplied waveform data on the multi-point touch panel;
An accepting step of accepting one or more touch inputs made by the user on the multipoint touch panel;
A detection step of detecting a predetermined user operation from the touch input received by the reception step;
When a scratch operation instructing scratch reproduction is detected as the predetermined user operation in the detection step in response to a user performing a post-touch rubbing operation on the waveform data displayed on the multipoint touch panel. The scratch reproduction start position is extracted from the touch position, and the playback direction and the reading speed of the waveform data are extracted from the subsequent rubbing operation , and the scratch reproduction is performed. A scratch reproduction control information extraction step for extracting scratch reproduction control information including a start position, a reproduction direction, and a reading speed ;
A transmission step of transmitting various information to the waveform readout control means,
In the transmission step, when the scratch reproduction control information is extracted in the scratch reproduction control information extraction step, the scratch reproduction control information is transmitted to the waveform readout control means,
When receiving the scratch reproduction control information transmitted in the transmission step, the waveform readout control means performs scratch reproduction at the readout speed from the scratch reproduction start position to the reproduction direction based on the scratch reproduction control information. , the program characterized by controlling the reading of the supplied waveform data.

Images