JP3876262B2 - Sound image localization changing reproduction apparatus and method - Google Patents

Description

  The present invention relates to a sound effect changing device, and more particularly, to a sound effect changing method.

  Patent Document 1 discloses a ringtone melody service method in which a desired portion can be set as a ringtone.

JP 2002-204789 A

  However, in the above incoming melody service method, it was only possible to extract a certain part, and it was not possible to generate a song with a free idea. On the other hand, it is difficult to generate a song that can be listened to without any restrictions. Such a problem becomes a problem not only when the user's favorite music is created, but also when the mobile phone's incoming melody is created.

  An object of the present invention is to provide a sound effect changing device that can solve the above-described problems and create music data to which a desired sound effect is added.

  1) The sound image localization changing playback method according to the present invention is as follows. 1) While playing the music to be edited, the cursor is moved on the screen in parallel with the playback, and when the cursor is positioned on the judgment line, When performing key input, the localization change instruction step for storing the elapsed time specifying information for specifying the elapsed time after the start of reproduction and the type of the input key as localization change instruction data, and the localization change instruction step are the edit target While a song is being played, a repeat step that is repeated a plurality of times, each key is associated with localization information, and when an edited data reproduction command is given, the sound image of the song to be edited is converted to the localization information and localization According to the change instruction data, there is provided a reproduction step of changing according to the elapsed time and reproducing. Therefore, the music whose sound image localization is changed is reproduced based on the operator's key input performed when the cursor is positioned on the determination line in accordance with the elapsed time specifying information. Thereby, music data to which various acoustic effects are added can be obtained.

  2) A sound image localization changing / playback device according to the present invention includes 1) song data storage means for storing edit target song data, 2) playback means for playing back the edit target song data, and 3) progress of playback of the edit target song data. Cursor movement control means for moving the cursor so that it repeatedly passes through the judgment line provided on the display means, 4) Input means for the operator to perform key input, 5) The cursor is on the judgment line When the key input is performed when positioned, localization change instruction data storage means for storing the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of the input key as localization change instruction data; 6) It includes a localization information storage means for storing localization information associated with each key, and 7) the reproduction means receives the edited data reproduction instruction and receives the localization change instruction data Based on preliminary the localization data localization information stored in the storage means, to change the sound image localization in accordance with the elapsed time specifying information, to play. Therefore, the music whose sound image localization is changed is reproduced based on the operator's key input performed when the cursor is positioned on the determination line according to the elapsed time. Thereby, music data to which various acoustic effects are added can be obtained.

3) the sound image localization changes reproducing apparatus according to the present invention, 1) reproducing means for reproducing the edited music data, 2) in the display means in accordance with the progress of playback of the edited tune, the first mark and the second mark to overlap repeated regularly or irregularly in the first mark and the second relative moving means for relatively moving the position of the mark, 3) input means for an operator to perform an operation input, 4) If the operation input is performed when the first mark and the second mark overlap, the elapsed time specifying information for specifying the elapsed time after the start of reproduction and the type of the operation input are localized. Localization change instruction data storage means for storing as change instruction data, 5) Localization information storage means for storing localization information associated with each operation input, 6) The reproduction means is provided by an edited data reproduction instruction Before Based on the localization change instruction data and the localization data localization information stored in the storage means, to change the sound image localization in accordance with the elapsed time specifying information, to play. Therefore, the music whose sound image localization is changed is reproduced based on the operation input performed when the first mark and the second mark overlap each other according to the elapsed time. Thereby, music data to which various acoustic effects are added can be obtained.

4) sound effect changing apparatus according to the present invention, 1) reproducing means for reproducing the edited music data, 2) in the edited music playback display means in accordance with the progress of the first mark and the second mark to overlap repeated regularly or irregularly, the first mark and the second relative moving means for relatively moving the position of the mark, 3) input means for an operator to perform an operation input, 4 ) If the operation input is performed when the first mark and the second mark overlap, the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of the operation input Sound effect change instruction data storage means for storing as sound effect change instruction data, 5) Sound effect definition data storage means for storing sound effect definition data associated with each operation input, 6) The reproduction means, Edited data A sound reproduction command is given, the sound effect of the edit target song is determined according to the elapsed time specifying information based on the sound effect change instruction data and the sound effect definition data stored in the sound effect definition data storage means. Change and play. Therefore, the music with the changed sound effect is reproduced based on the operation input performed when the first mark and the second mark overlap according to the elapsed time. Thereby, music data to which various acoustic effects are added can be obtained.

5) The sound effect changing apparatus according to the present invention is as follows: 1) The first mark and the second mark are repeatedly overlapped regularly or irregularly on the display means in accordance with the progress of the reproduction of the edit target music relative movement means for relatively moving the position of the second mark and the first mark, 2) input means for an operator to perform an operation input, 3) the first mark and the second mark When the operation input is performed when they overlap, the sound effect change instruction data for storing the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of operation input as the sound effect change instruction data Storage means, 4) acoustic effect definition data storage means for storing acoustic effect definition data associated with each operation input, 5) stored in the acoustic effect change instruction data and the acoustic effect definition data storage means Based on the sound effect definition data, there is provided sound effect change data creating means for creating sound effect change data obtained by changing the sound effect of the music to be edited according to the elapsed time specifying information. Therefore, according to the elapsed time, it is possible to create a song with a changed acoustic effect based on an operation input performed when the first mark and the second mark overlap each other. Thereby, music data to which various acoustic effects are added can be obtained.

6) A program according to the present invention is a program that 1) causes a computer to function as a sound image localization changing / playback device, and 2) the computer stores sound image localization data in association with each key, A program for causing the computer to execute the following processing. a1) in the display means in accordance with the progress of the playback of the edited music, as the first and second marks overlap repeated regularly or irregularly, the second mark and the first mark A2) When the operation input performed by the operator is when the first mark and the second mark overlap, the elapsed time from the start of reproduction is specified. The elapsed time specifying information and the type of operation input are stored as sound effect change instruction data. A3) Based on the localization change instruction data and the stored sound image localization data, the edit target song is stored in accordance with the elapsed time specifying information. Sound localization change data is created by changing the sound localization of.

  In the present specification, “edited music” refers to music that the operator desires to change the acoustic effect.

“Elapsed time specifying information” refers to information that can specify elapsed time directly or with reference to other data. In the embodiment, the example in which the elapsed time after the start of reproduction is directly stored has been described. In the embodiment, the “localization change instruction data” corresponds to a localization number corresponding to elapsed time specifying information for specifying the elapsed time, as shown in FIG. In the embodiment, the “localization information” corresponds to data for specifying the localization corresponding to the numeric keys as shown in FIG. In the embodiment, “overlapping periodically or irregularly repeatedly” corresponds to the case where the cursors shown in FIG. 5 sequentially move in the direction of the arrow 57 and the determination lines overlap. In the embodiment, “relatively move the positions of the first mark and the second mark” means that the determination line (second mark) shown in FIG. 5 is fixed and the cursor (first mark ) Is moved to relatively move both, but it is a concept including moving either one or both.

  In the embodiment, “acoustic effect change instruction data” corresponds to a localization number corresponding to elapsed time specifying information for specifying an elapsed time, as shown in FIG. In the embodiment, “acoustic effect definition data” corresponds to data specifying a localization corresponding to a numeric key as shown in FIG.

1. Outline and Description of Functional Blocks An embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram of a sound image localization changing / playback apparatus 1 according to the present invention.

  The sound image localization changing / playback apparatus 1 includes music data storage means 3, playback means 5, cursor movement control means 7, display means 9, input means 11, localization change instruction data storage means 13, and localization information storage means 15. .

  The song data storage means 3 stores edit target song data. The reproduction means 5 reproduces the editing object music data. The cursor movement control means 7 moves the cursor so that it repeatedly passes on the determination line provided in the display means 9 as the reproduction of the music to be edited progresses. The input means 11 is used by the operator to input keys at a desired timing. When the key is input when the cursor is positioned on the determination line, the localization change instruction data storage means 13 includes the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the input key Is stored as localization change instruction data. The localization information storage means 15 stores localization information associated with each key. When the edited data reproduction command is given, the reproducing means 5 changes the sound image localization according to the elapsed time specifying information based on the localization change instruction data and the localization information stored in the localization information storage means 15. ,Reproduce.

2. Hardware Configuration of Sound Image Localization Changing Device 1 The hardware configuration of the mobile phone 100 that functions as the sound image localization changing device 1 will be described with reference to FIG. FIG. 2 is an example of a hardware configuration in which the mobile phone 100 is configured using a CPU.

  The mobile phone 100 includes a CPU 23, a memory 27, a flash memory 26, an input device 28, a display 30, a communication unit 21, a sound source unit 31, a speaker 32, and a bus line 29.

  The CPU 23 controls each unit via the bus line 29 in accordance with a program stored in the memory 27. Note that this program may be downloaded via the communication unit 21 instead of being stored in the memory 27. The flash memory 26 stores original song data, created song data, and the like.

  In this embodiment, NEC Electronics μPD9970 is adopted as the sound source unit 31. This LSI is an LSI in which a three-dimensional (3D) acoustic engine is packaged in a general synthesizer. When C-MIDI data including MIDI data and ADPCM such as MFi is given as input, 2-channel audio data (voice waveform data) is output. Further, when the sound image localization information is given, the 3D acoustic engine converts the audio data given from the synthesizer into sound of the specified localization based on the sound image localization information, as will be described later. That is, the LSI outputs audio data of a specified localization when given MIDI data and sound image localization information.

The flash memory 26 stores MFi format music data (MIDI data). The MFi format is a kind of MIDI data, which is a format used for ringing melody made by NTT DoCoMo. By supplying such music data to the sound source unit 31, audio data is reproduced from the speaker 32. The music data includes screen display data described later and data for performing cursor movement control on the screen. Specifically, for example, data for performing cursor movement control (hereinafter referred to as timing determination information) such as the appearance time and movement speed of the cursor may be stored and displayed on the screen.
The flash memory 26 stores 3D localization information as shown in FIG. The localization changing process using the 3D localization information will be described later.

  The flash memory 26 stores a program named “3D sound application” which will be described later.

  The communication unit 21 performs packet communication processing for telephone data and network connection with the base station.

4). Flowchart The program stored in the flash memory 26 will be described with reference to FIG. First, the operator selects a song to be edited. Specifically, the CPU 23 may display a list of songs on the display 30 (step S1 in FIG. 4) and allow the operator to select one (step S2).

  When any one is selected, the CPU 23 gives the selected music piece to the sound source unit 31 and reproduces it (step S5). If the played music is acceptable, the operator presses a start button (not shown). When determining that the start button has been pressed (step S7), the CPU 23 displays a 3D mixing screen as shown in FIG. 5 (step S9). On the 3D mixing screen, a numeric keypad display area 51 from 1 to 9 and a moving cursor display area 53 are displayed. In the moving cursor display area 53, a cursor 54 and a determination line 55 are displayed.

  Next, the CPU 23 starts playing and starts the screen (step S11). The performance is executed by giving the music data of the selected music to the sound source unit 31 as before. On the display, the cursor 53 moves from the right to the left of the screen (in the direction of the arrow 57) based on the timing determination information added to the selected music data.

  When the cursor moves and is positioned on the determination line 55, the operator presses one of the numeric keys 1 to 9 of the mobile phone.

  The CPU 23 initializes the process number i (step S13), and determines whether the numeric key has been pressed when the i-th moving cursor is present on the determination line 55 (step S15). If the ten-key is pressed while the i-th moving cursor is present on the determination line 55, the pressed ten-key is stored in the memory 27 as the localization information of the i-th data together with the elapsed time from the start of the music ( Step S17). If the tenth key is not pressed when the i-th moving cursor is present on the determination line 55, null is stored as localization information for the i-th data (step S18).

  The CPU 23 determines whether or not the reproduction of the music has ended (step S19). If the music has not ended, the CPU 23 increments the processing number i (step S27) and repeats the processing from step S15. By repeating such processing, the localization change information as shown in FIG. 6 is stored in the memory 27.

  If CPU23 judges that reproduction | regeneration of a music was complete | finished in step S19, it will reproduce | regenerate, changing the sound image localization of an edit object music using the obtained localization change information (step S21). Such reproduction processing will be described with reference to FIG.

  The CPU 23 displays a screen for asking the operator whether to listen to the edited music (not shown). When an edited data reproduction command is given from the input device in response to the inquiry, the CPU 23 displays the screen as shown in FIG. The 3D localization information and the localization change information shown in FIG. 7 are read (step S31 in FIG. 8). The CPU 23 gives a reproduction command to the sound source unit 31 so as to perform reproduction with the initial localization information (step S33).

  The CPU 23 determines whether or not the elapsed time from the start of reproduction of the music matches the elapsed time shown in FIG. 7 (step S35). If they match, it is determined whether or not the corresponding designated localization number is “null”. (Step S37). In this case, since the designated localization number is “7” at the elapsed time t1, it is determined that the corresponding designated localization number is not “null”, and reproduction is performed with the read localization number “7”. The sound source unit 31 is instructed. Specifically, the localization number 7 is “distance 0.8 meter, azimuth angle −45 degrees, elevation angle −45 degrees” with reference to the 3D localization information shown in FIG. To give. Thereby, from the elapsed time t1, the music is reproduced with such localization.

  A screen during playback is shown in FIG. A sphere 55 is displayed in the display area 58 so that the localization change can be visually recognized. Points 55a to 55i are defined in the sphere 55. The point 55a corresponds to the numeric key “1”, the point 55b corresponds to the numeric key “2”,... The point 55i corresponds to the numeric key “9”, and whether or not the area 59 matches the timing when the key is pressed. This is the area where the evaluation is displayed. In this case, since the reproduction is performed with the localization number “7” from the elapsed time t1, the CPU 23 performs display control so that the point 55g blinks. In addition, since the pressed timing is correct, “that's cool” indicating high evaluation is displayed in the area 59.

  The CPU 23 determines whether or not the music has ended (step S41), and since it has not ended in this case, the CPU 23 returns to step S35 and determines whether or not the elapsed times match (step S35).

  In this case, since the next elapsed time is the elapsed time t2, when the elapsed time reaches t2, the CPU 23 determines whether or not the corresponding designated localization number is “null” (step S37). In this case, since the specified localization number is “null” at the elapsed time t2, the CPU 23 instructs the sound source unit 31 to perform reproduction with the previous localization number. In this case, since the previous localization number is “7”, referring to the 3D localization information shown in FIG. 3, “distance 0.8 meters, azimuth angle −45 degrees, elevation angle −45 degrees”. Therefore, the localization information is given to the sound source unit 31. Further, the CPU 23 controls the display so that the point 55g blinks. In this case, since the timing is not correct in this case, “TRY AGAIN” or the like indicating a low evaluation is displayed.

  The CPU 23 determines whether or not the song is finished (step S41). In this case, since the process has not been completed, the process returns to step S35 to determine whether or not the elapsed times match (step S35).

  In this case, since the next elapsed time is the elapsed time t3, when the elapsed time reaches t3, the CPU 23 determines whether or not the corresponding designated localization number is “null” (step S37). In this case, since the designated localization number is “3” at the elapsed time t3, the CPU 23 determines that the corresponding designated localization number is not “null” and plays back with the read localization number “3”. The sound source unit 31 is instructed to perform Specifically, since the localization number 3 is “distance 0.8 meter, azimuth angle 45 degrees, elevation angle 45 degrees” with reference to the 3D localization information shown in FIG. 3, the localization information 3 is given to the sound source unit 31. . Thereby, from the elapsed time t3, the music is reproduced with such localization. In this case, since the reproduction is performed with the localization number “3”, the CPU 23 performs display control so that the point 55c blinks. In addition, since that timing is correct, “that's cool” is displayed in the area 59.

  Thereafter, this process is repeated until the end of the song. When it is determined that the song has ended (step S41), the CPU 23 displays a message screen (not shown) as to whether or not to save it (step S43), and a save button (not shown) displayed on the display is displayed. If selected, it is stored in the flash memory 26 (step S47), and the process is terminated. If the save button is not pressed, the process ends.

  By performing the processing shown in FIG. 8 at the next and subsequent playbacks, similar playback is possible.

  Note that although control information for moving the cursor on the screen is added to the music data, such control information may be ignored when sound image localization instruction data is present.

In the present embodiment, the case has been described in which the elapsed time from the creation time is directly stored as the elapsed time specifying information. However, the elapsed time can also be specified with reference to other data. For example, the cursor control information stored originally may be used to calculate from the timing when the cursor matches the determination line.

  As described above, when the cellular phone numeric keys 1 to 9 are pressed when positioned on the determination line 55, the data in which the localization of the editing target song is changed at the localization corresponding to the pressed key. Can be generated. In addition, when the numeric keypads 1 to 9 of the mobile phone are pressed without locating the timing on the determination line 55, the localization of the song to be edited is performed at the localization corresponding to the previously set key. Changed data can be obtained. In this way, the sound image localization is not changed at all preset timings, but the sound image localization is changed by an operation that clears a certain condition among the operations of the operator, thereby improving the game performance and various editing operations. You can get a song. In addition, the operator can obtain a song that changes in a desired sound image localization by changing the type of key.

5). Other Embodiments In the present embodiment, when the timing located on the determination line 55 is missed and the numeric keys 1 to 9 of the mobile phone are pressed, “null” data is stored and the previous one is stored. Although the localization data corresponding to the key set to is edited, a default localization number (for example, “5” or the like) may be adopted when the timing is shifted.

  Moreover, although the case where it mounted in the mobile phone was demonstrated in the said embodiment, it is applicable also to portable terminals and personal computers, such as PDA.

  In the above embodiment, the numeric keypad is used as a key for changing the localization, but the present invention is not limited to this, and another key may be used. Further, since it is a numeric keypad, nine types of localization are adopted, but such localization information can be changed according to the number of types of keys.

  In addition, although the control information for moving the cursor on the screen has been described in the case where it is stored in the song data, it may be stored separately from the song data. As a result, a more varied acoustic effect can be obtained.

In the above embodiment, the determination line is fixed, and the cursor is moved so as to pass over the determination line. However, the first mark and the second mark are repeatedly overlapped with each other. The position of the second mark may be moved relatively. In this case, the movement may be repeated regularly or irregularly.

  In the above embodiment, the case where the editing target song has already been stored in the flash memory 26 has been described, but it may be downloaded from a predetermined server by the communication unit 21.

  In the above-described embodiment, the same processing as that at the time of confirmation is performed once created, but it may be stored as data including a number corresponding to a portion corresponding to “null”. For example, “7” is stored at the elapsed time t2 in FIG. 6, and “3” is stored at t4.

  In this embodiment, when the elapsed times coincide with each other in step S35 in FIG. 8, the processes of step S37, step S39, and step S43 are executed. These steps are executed in advance before step S35. Alternatively, when the elapsed times coincide with each other, the process of step S39 or step S43 may be executed.

  In the above embodiment, the present invention has been described as an apparatus that edits and reproduces a song to be edited, but it can also be understood as an apparatus that creates data after editing.

  In the above embodiment, the sound effect is changed in the middle of the music by changing the sound image localization corresponding to the assigned key. However, the same applies to the stereo sound effects other than the sound image localization. Can be applied to. As a three-dimensional sound effect, the reverberation time (the most basic concept for evaluating the sound field in a room, an amount that represents the length of the sound. After the sound radiated into the room reaches an equilibrium state, the sound is suddenly stopped, The time until the subsequent reverberation energy density becomes 1 / 1,000,000 (-60 dB) compared to the energy density immediately before the sound source is stopped). Moreover, even if it is not a stereophonic sound effect, as a sound effect, you may change sound quality, for example by changing a frequency characteristic.

  In the present embodiment, the case where the MIDI data is in the MFi format has been described. However, other types of MIDI data of the ringing melody may be used, and music data other than the ringing melody can be similarly applied.

  In this embodiment, in order to realize the function shown in FIG. 1, a CPU is used and a dedicated chip is added to realize this. However, all may be realized by software, or all may be realized by hardware such as a logic circuit, and the software, hardware, and configuration ratio are arbitrary.

  In addition, you may make it make an operating system (OS) process a part of said program.

1 is a functional block diagram of a sound image localization change / playback apparatus 1 according to the present invention. It is a figure which shows an example of the hardware constitution which implement | achieved the sound image localization change reproducing | regenerating apparatus 1 using CPU. 3D localization information is shown. It is a creation flowchart. The display screen at the time of creation is shown. The data structure of the creation result is shown. The display screen during playback is shown. It is a flowchart at the time of reproduction | regeneration.

Explanation of symbols

100 ・ ・ Mobile phone 23 ・ ・ ・ CPU
26... Flash memory 27... Memory 28... Input device 31.

Claims (6)

While playing the song to be edited, move the cursor on the screen in parallel with the playback, and when the cursor is positioned on the judgment line, if the operator inputs a key, the elapsed time after the start of playback is specified A localization change instruction step for storing the elapsed time specifying information and the type of the input key as localization change instruction data;
Repeating the localization changing instruction step a plurality of times while the edit target song is being played back,
Localization information is associated with each key, and when an edited data reproduction command is given, the sound image of the song to be edited is changed according to the elapsed time by the localization information and localization change instruction data. , Playback step to play,
A sound image localization change reproduction method characterized by comprising: Song data storage means for storing edit target song data;
Playback means for playing back the music data to be edited;
Cursor movement control means for moving the cursor so that the cursor repeatedly passes on a determination line provided in the display means as the reproduction of the edit target song progresses,
Input means for the operator to enter keys,
When the key is input when the cursor is positioned on the determination line, the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of the input key are stored as localization change instruction data. A localization change instruction data storage means,
Localization information storage means for storing localization information associated with each key;
With
When the edited data reproduction command is given, the reproduction means changes the sound image localization according to the elapsed time specifying information based on the localization change instruction data and the localization information stored in the localization information storage means. Playing,
A sound image localization changing reproduction device characterized by the above. Playback means for playing the song data to be edited,
By the display means in accordance with the progress of playback of the edited tune, the first mark and the second mark to overlap repeated regularly or irregularly, the first mark and the second mark Relative movement means for relatively moving the position;
An input means for an operator to input an operation,
If the operation input is performed when the first mark and the second mark overlap, the elapsed time specifying information for specifying the elapsed time after the start of reproduction and the type of operation input are specified. Localization change instruction data storage means for storing as data,
Localization information storage means for storing localization information associated with each operation input;
With
When the edited data reproduction command is given, the reproduction means changes the sound image localization according to the elapsed time specifying information based on the localization change instruction data and the localization information stored in the localization information storage means. Playing,
A sound image localization changing reproduction device characterized by the above. Playback means for playing the song data to be edited,
By the display means in accordance with the progress of playback of the edited tune, the first mark and the second mark to overlap repeated regularly or irregularly, the first mark and the second mark Relative movement means for relatively moving the position;
An input means for an operator to input an operation,
If the operation input is performed when the first mark and the second mark overlap, the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of the operation input are sounded. Acoustic effect change instruction data storage means for storing the effect change instruction data;
Sound effect definition data storage means for storing sound effect definition data associated with each operation input;
With
When the edited data playback command is given, the playback means uses the sound effect change instruction data and the sound effect definition data stored in the sound effect definition data storage means to specify the elapsed time specifying information for specifying the above. In response to changing the sound effect of the song to be edited and playing it,
A sound effect changing device characterized by the above. By the display means in accordance with the progress of the playback of the edited music, as the first and second marks overlap repeated regularly or irregularly, the position of the second mark and the first mark Relative movement means for relatively moving,
An input means for an operator to input an operation,
If the operation input is performed when the first mark and the second mark overlap, the elapsed time specifying information for specifying the elapsed time from the start of reproduction and the type of the operation input are sounded. Acoustic effect change instruction data storage means for storing the effect change instruction data;
Sound effect definition data storage means for storing sound effect definition data associated with each operation input;
Based on the sound effect change instruction data and the sound effect definition data stored in the sound effect definition data storage means, create sound effect change data in which the sound effect of the song to be edited is changed according to the elapsed time specifying information Sound effect change data creating means,
A sound effect changing device comprising: A program for causing a computer to function as a sound image localization change / playback device, wherein the computer stores sound image localization data in association with each key, and causes the computer to execute the following processing.
1) in the display means in accordance with the progress of the playback of the edited music, as the first and second marks overlap repeated regularly or irregularly, the second mark and the first mark Relatively move
2) When the operation input performed by the operator is when the first mark and the second mark overlap, the elapsed time specifying information and the operation input for specifying the elapsed time from the start of reproduction Is stored as sound effect change instruction data,
3) Based on the localization change instruction data and the stored sound image localization data, acoustic localization change data is generated by changing the acoustic localization of the song to be edited according to the elapsed time specifying information.

Images