JP5051838B2 - Sound data generating apparatus and program - Google Patents

Description

  The present invention relates to a sound data generation device and a program.

In recent years, techniques for skillfully reproducing sounds associated with natural phenomena such as “river sound of a river” and “breeze sound” on a computer have been proposed. For example, Patent Document 1 proposes a technique for reproducing sound of a natural phenomenon by repeatedly converting waveform data imitating the characteristics of the sound in the natural phenomenon into speech.
Japanese Patent Application Laid-Open No. 07-140973

  By the way, it is clear from the example that the sound of the above-mentioned river breeze is caused by the movement of a large number of water molecules, and the sound of the breeze is caused by the flow and vibration of a large number of gas molecules existing in the air. As described above, most of the sounds generated in nature are generated by the frequent interaction of many particles when viewed on a small scale. Therefore, it is considered that the resulting sound has “randomness” and “non-reproducibility”, which give the sound “naturalness”.

  However, since the sound generated by the conventional computer including the above-mentioned Patent Document 1 is a sound in which predetermined waveform data is repeatedly read out, the above-mentioned “randomness” and “non-reproduction” are included in the sound. There is a problem that the so-called “naturalness” cannot be felt due to lack of “sexuality”.

  The present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide a technique capable of generating a sound having no regularity when a sound is generated by a computer.

  The sound data generation device according to a preferred aspect of the present invention includes a virtual space setting unit that sets a virtual space and a part or all of the virtual space set by the virtual space setting unit as a specific region. Specific region specifying means for specifying a plurality of virtual particles, virtual particle emitting means for performing a calculation for continuously releasing a plurality of virtual particles to the virtual space, and trajectories of the virtual particles emitted by the calculation of the virtual particle emitting means And calculating a waveform according to the virtual particles in the specific area specified by the specific area specifying means according to the calculation result by the trajectory calculating means. Waveform calculating means, sound data generating means for generating sound data corresponding to the waveform calculated by the waveform calculating means, and sound data generated by the sound data generating means Characterized by comprising an output means for outputting.

In the above-described aspect, the waveform calculating means calculates a waveform expressed by an arrangement aspect of the virtual particles included in the specific area specified by the specific area specifying means according to the calculation result by the trajectory calculating means. Also good.
In the above aspect, the waveform calculation means may calculate a waveform that appears by connecting virtual particles that are close to each other in the predetermined axial direction within the specific region.

  In the above-described aspect, the sound data generation unit may generate sound data by repeating the waveform calculation unit by repeating the waveform calculation unit a plurality of times.

  Moreover, in the above-mentioned aspect, it includes a pitch data acquisition unit that acquires pitch data indicating a pitch, and the sound data generation unit includes a pitch indicated by the pitch data acquired by the pitch data acquisition unit. Sound data may be generated based on the above.

  Further, in the above-described aspect, the specific area specifying unit specifies a plurality of partial or entire areas in the virtual space as specific areas, and the waveform calculating unit includes a part or all of the plurality of specific areas. When overlapping, the overlapping area may be shared and the waveform may be calculated for each specific area.

  Further, in the above-described aspect, the virtual particle is identified by the correspondence storage means for storing the correspondence between the position in the axial direction predetermined in the specific region and the pitch, and the calculation result by the trajectory calculation means. Based on the correspondence relationship stored in the storage means based on the position calculation means for calculating the predetermined axial position of the virtual particles in the specific area when passing through the area, the position calculation means A pitch specifying means for specifying a pitch corresponding to the calculated position, and the sound data generating means may generate sound data of the pitch specified by the pitch specifying means.

  Further, in the above-described aspect, the apparatus includes waveform arranging means for arranging a waveform having a predetermined shape in the specific area specified by the specific area specifying means, and the sound data generating means is based on the trajectory calculating means. According to the calculation result, sound data corresponding to the waveform when the waveform is read from the collision position between the virtual particle released by the calculation of the virtual particle emitting means and the waveform may be generated.

  Further, in the above-described aspect, the virtual particle arrangement means for arranging a plurality of second virtual particles movable in the specific area in the specific area specified by the specific area specifying means, and the trajectory calculation means According to the calculation result, the arrangement of the second virtual particles in the specific region is continuously performed based on the interaction between the second virtual particles in the specific region and the virtual particles emitted by the calculation of the virtual particle emitting unit. Position changing means for changing the waveform, and the waveform calculating means may calculate a waveform expressed by an arrangement mode of the second virtual particles in the specific region.

  According to the present invention, when a sound is generated by a computer, a sound having no regularity can be generated.

(Outline of the present invention)
The sound data generation apparatus according to the present invention emits a large number of virtual particles into a virtual space formed by computer computation. And the waveform expressed with the arrangement | positioning aspect of the virtual particle in the specific area | region provided in virtual space is calculated, and sound data are produced | generated based on the waveform.

  FIG. 1 is an example of a monitor display in the sound data generation process. The virtual particles 200 are emitted into the virtual space 100 from the tip portion of the sprinkler 150. Then, the virtual particles 200 “drop” toward the lower side of the screen according to the gravity set in the virtual space 100, bounce off the wall surface of the virtual space 100, or collide with each other. As a result, a large number of virtual particles 200 move randomly in the virtual space 100. The specific area 300 is provided in the virtual space 100 in which a large number of virtual particles 200 are flying. When the virtual particle 200 enters the specific region 300, sound data is generated based on the waveform W expressed by connecting the virtual particles 200 in the specific region 300 with a line.

(A: Configuration)
The best mode for carrying out the present invention will be described below with reference to the drawings.
(A-1: Overall configuration)
FIG. 2 is a diagram showing the overall configuration of the sound data generation system 1 according to the present invention. The sound data generation system 1 includes a sound data generation device 10 as a program execution device, a mouse 20, a monitor 30, and a multipoint controller 40.

(A-2: Configuration of each device)
First, the hardware configuration of the sound data generation device 10 will be described with reference to FIG.
The sound data generation device 10 includes a control unit 101, an optical disc playback unit 102, a ROM (Read Only Memory) 103, a RAM (Random Access Memory) 104, and an I / O unit 105. These units are connected to each other via a bus 109. A control unit 101 shown in the figure is, for example, a CPU (Central Processing Unit), and executes various control programs read from the ROM 103 to perform sound and video signal processing and control of each unit. The optical disc playback unit 102 reads data from an optical disc such as a CD-ROM / DVD-ROM. The ROM 103 stores various control programs executed by the control unit 101. The RAM 104 is used as a work area by the control unit 101. The I / O unit 105 mediates transmission / reception of signals with the device connected to the sound data generation device 10. Specifically, signals indicating operation signals from the mouse 20 and the multipoint controller 40 are received and output to the control unit 101, and sound data and video data received from the control unit 101 are output to the monitor 30.

  Next, the configuration of the mouse 20 will be described with reference to FIG. The mouse 20 has a button 22 on the upper surface (see (a) in the figure) of the main body 21 and a movement detection means 24 on the lower surface (see (b) in the figure). In addition, the mouse 20 is connected to the sound data generation device 10 via the communication cable 23, and data indicating the operation content is transmitted to the sound data generation device 10 via the communication cable 23.

In the mouse 20, when the main body 21 is moved, the movement detection unit 24 generates an operation signal indicating the movement direction and the movement amount, and outputs the operation signal via the communication cable 23. The control unit 101 that has received the signal performs a process of moving the cursor on the screen of the monitor 30 based on the operation signal.
When the button 22 is pressed (hereinafter referred to as “click”), the mouse 20 generates an operation signal indicating that the button is clicked and outputs the operation signal via the communication cable 23. When the control unit 101 receives the operation signal, the control unit 101 recognizes the coordinate where the cursor is located at the time of clicking according to the received operation signal, and the selection process is performed on the icon or the like displayed at the coordinate. recognize.
Further, when the main body 21 is moved in a state where the button 22 is pressed and an operation for releasing the pressing of the button 22 (hereinafter referred to as “drag”) is performed, the moving direction of the main body 21 while the button 22 is being pressed. Then, an operation signal indicating that the movement amount and the drag operation have been performed is generated and output via the communication cable 23. Upon receiving the operation signal, the control unit 101 recognizes that the selection process has been performed on the area on the screen selected by dragging, the icon included in the area, or the like according to the received operation signal.

  Next, the configuration of the monitor 30 will be described with reference to FIG. The monitor 30 displays a video based on the video data received from the sound data generation device 10. Each point on the monitor screen is set with coordinates having coordinates (0, 0) at the upper left of the screen and coordinates (756, 1024) at the lower right as shown in FIG. Further, as shown in FIG. 5, a sound data reproducing unit 30a is provided below the monitor screen. The sound data reproducing unit 30a emits sound based on the sound data received from the sound data generating device 10.

  Next, the configuration of the multipoint controller 40 will be described with reference to FIG. As illustrated in FIG. 6A, the multipoint controller 40 includes a touch panel 42. As shown in the figure, the touch panel 42 is set with coordinates having the upper left corner of the screen as coordinates (0, 0) and the lower right corner as coordinates (756, 1024). The touch panel 42 has sensing means for sensing that a specific point on the touch panel is pressed. When the sensing means senses that a specific point on the panel is pressed, the position of the pressed point is displayed. The pressed position information including the indicated coordinates is output to the sound data generation device 10 via the communication cable 41. When a plurality of points are pressed at the same time, the pressed position information is generated and output in parallel for each of the plurality of pressed points.

  When the control unit 101 of the sound data generating apparatus 10 receives the pressed position information from the multipoint controller 40, the control unit 101 reads the coordinates included in the pressed position information, and selects a point corresponding to the coordinates on the screen of the monitor 30. to decide. FIG. 6B is a diagram showing a screen display of the monitor 30. For example, when the hand A and the hand B press the touch panel 42 as shown in FIG. 6A, the pressed position information indicating the position pressed by the hand A and the position pressed by the hand B are shown. The pressed position information indicating the indicated coordinates is output to the control unit 101. Upon receiving the pressed position information, the control unit 101 determines that the points A and B on the monitor screen shown in FIG. 6B have been selected.

(A-3: Functional configuration of the sound data generation device 10)
Next, an example of a functional configuration of the sound data generation device 10 will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of a functional configuration of the sound data generation device 10. In FIG. 7, the spatial characteristic control unit 11, the object control unit 12, the particle motion control unit 13, the specific region control unit 14, the waveform calculation unit 15, the video control unit 16, and the sound data generation unit 17 are controlled by the control unit 101 in the ROM 103. This is realized by executing a stored program. The arrows in the figure schematically show the flow of data.

  The space characteristic control unit 11 sets the virtual space 100 by controlling various characteristics that are set in the virtual space 100 and that affect the motion of the virtual particles 200. Here, the contents of the space control processing performed by the space characteristic control unit 11 will be described with reference to FIG. FIG. 8 is a diagram illustrating an example of the screen of the monitor 30. On the screen, the framework of the virtual space 100 is displayed. A control panel 400 is displayed on the right side of the virtual space 100 in the figure. The space characteristic control unit 11 sets the virtual space 100 as follows based on an operation on the control panel 400 by the user.

  In the virtual space 100, “space characteristics” as exemplified below are set. When the space characteristic icon 404 at the bottom of the control panel 400 in the figure is clicked, the space characteristic control unit 11 displays a predetermined option on the screen of the monitor 30. FIG. 9 is a diagram illustrating an example of a display screen. In the example illustrated in FIG. 9, a screen for setting various spatial characteristics such as “(gravity) direction”, “gravity acceleration”, and “(resistance force) proportional constant” is displayed. The user operates the mouse 20 to select an option related to the direction of gravity displayed on the screen, and writes the magnitude of gravity acceleration. In addition, the user assumes that the resistance acting when moving the virtual particle 200 is proportional to the speed of the virtual particle 200, and operates the mouse 20 to write a proportionality constant for determining the resistance according to the speed. The spatial characteristic control unit 11 writes data indicating the input content in a predetermined storage area of the RAM 104 in accordance with an operation signal supplied from the mouse 20.

  These settings related to the virtual space 100 may be written in advance as a template in a control program or the like. For example, in a certain template, the gravitational field is set at the lower part of the screen, and a resistance force proportional to the speed acts on the virtual particle 200 moving in the virtual space 100, contrary to the direction of movement, and the proportionality constant is “ If a large value corresponding to “underwater” is set, the user simply selects the template, and the virtual space 100 is a container filled with water installed in a space with gravity. Such a setting can be easily performed.

  Next, the object control unit 12 illustrated in FIG. 7 controls the arrangement and the like of the object (sprinkler 150) that causes the virtual particles 200 to appear in the virtual space 100. In the virtual space 100 according to the present embodiment, a sprinkler 150 is used as an object for generating the virtual particles 200 in the virtual space 100.

  Here, the contents of the processing performed by the object control unit 12 will be described with reference to FIG. FIG. 10 is a diagram illustrating an example of a screen displayed on the monitor 30. The user sets the initial speed 402 and frequency 403 values of the control panel 400 using the mouse 20 while referring to the screen illustrated in FIG. 10, and performs an operation of dragging the sprinkler icon 401 into the virtual space 100. . The object control unit 12 sets the initial speed and frequency of the sprinkler 150 according to the operation signal supplied from the mouse 20 and causes the set sprinkler 150 to appear in the virtual space 100. The arrangement of the sprinkler 150 can be freely changed by the user performing a drag operation using the mouse 20. When a drag operation is performed by the user, the object control unit 12 moves the sprinkler 150 in the virtual space 100 in accordance with an operation signal from the mouse 20.

The object control unit 12 performs an operation of continuously discharging a plurality of virtual particles 200 from the discharge port 150a of the sprinkler 150 to the virtual space 100 at a set initial velocity and frequency. More specifically, the object control unit 12 continuously releases the virtual particles 200 from the sprinkler 150 so that the time averaged frequency is set per unit time.
Further, the object control unit 12 supplies data indicating the coordinates of the sprinkler 150 to the video control unit 16.

Next, the particle motion control unit 13 illustrated in FIG. 7 calculates the trajectory of the virtual particles emitted from the sprinkler 150 in the virtual space 100. More specifically, the particle motion control unit 13 controls the motion of the virtual particle 200 in the virtual space 100 according to the rules (a) to (c) described below. The following rules imitate the mechanical properties and laws of objects on the earth.
(A) The virtual particle 200 has a predetermined volume (v) and mass (m).
(B) There is a relationship of F = ma between the force F acting on the virtual particle 200, the mass m of the virtual particle 200, and the acceleration a. For example, in this embodiment, since gravity is applied downward in the virtual space 100, a force having a magnitude of mg (g is gravitational acceleration) always acts downward on the virtual particle 200.
(C) When the virtual particles 200 collide with each other and the framework of the virtual particles 200 and the virtual space 100 collide, a complete elastic collision is performed with a rebound coefficient of 1.

Further, the particle motion control unit 13 causes the virtual particles 200 that have reached the bottom of the virtual space 100 in the figure to disappear.
Further, the particle motion control unit 13 supplies data indicating the coordinates of each virtual particle to the video control unit 16.

Next, the specific area control unit 14 illustrated in FIG. 7 specifies one or a plurality of areas of the virtual space 100 as a specific area. In the example illustrated in FIG. 10, the specific area control unit 14 provides a rectangular specific area 300 at a predetermined position in the virtual space 100.
Further, the specific area control unit 14 supplies data indicating the coordinates of the specific area to the video control unit 16.

  Next, the waveform calculation unit 15 illustrated in FIG. 7 calculates a waveform expressed by the arrangement mode of the virtual particles 200 included in the specific region 300 according to the calculation result by the particle motion control unit 13. Here, the waveform calculation unit 15 acquires the coordinates of each virtual particle 200 included in the specific region 300, and sets the virtual particles 200 in a predetermined axial direction (in the example shown in FIG. Hereinafter, the waveform that appears by connecting the virtual particles 200 close to each other in the “x-axis direction”))) is calculated. At this time, the waveform calculation unit 15 uses the center position p1 in the vertical direction (hereinafter referred to as “y-axis direction”) of the left end portion of the specific region 300 in the drawing as the start point of the waveform, and The center position p2 in the y-axis direction is the end point of the waveform. The positions of the start point and end point are fixed. In the example illustrated in FIG. 10, the waveform calculation unit 15 employs virtual particles 200a, 200b, 200c,... As virtual particles constituting the waveform in order from the smallest x coordinate value starting from the point p1.

  At this time, when there are a plurality of virtual particles 200 having the same x-coordinate value, the waveform calculation unit 15 uses the virtual particles 200 that form the waveform as the virtual particles 200 having the smallest distance from the adjacent virtual particles 200. Adopt as. Specifically, for example, in the example illustrated in FIG. 10, when the x-coordinate values of the virtual particle 200f and the virtual particle 200g are the same, the control unit 101 determines the virtual particle having the smaller distance from the virtual particle 200e. 200f is adopted as a virtual particle constituting the waveform.

  Since the virtual particles 200 each move due to vibration or collision caused by gravity as time passes, the waveform formed in the specific region 300 by the virtual particles 200 changes every moment. Further, when the virtual particles 200 newly enter the specific region 300, these virtual particles 200 also move in the same manner as described above, so that the waveform change becomes more complicated and diversified.

  In the example illustrated in FIG. 10, the waveform W that appears in the specific region 300 is expressed with the x-axis direction as a time axis and the y-axis direction as an amplitude. The amplitude of the waveform W is equal to or smaller than the width of the specific region 300 in the y-axis direction, and the amplitude does not become larger than necessary.

  Next, the video control unit 16 illustrated in FIG. 7 determines the position of the sprinkler 150 in the virtual space 100 and the virtual particles based on data supplied from the object control unit 12, the particle motion control unit 13, and the specific region control unit 14. Video data indicating 200 motions and the like is generated and supplied to the monitor 30. The monitor 30 displays an image indicating the movement of the virtual particles 200 in the virtual space 100 based on the supplied image data.

  Next, the sound data generation unit 17 generates sound data corresponding to the waveform calculated by the waveform calculation unit 15. Here, the sound data generation unit 17 generates sound data obtained by repeating the waveform a plurality of times at a predetermined frequency, with the waveform calculated by the waveform calculation unit 15 as one cycle. Specifically, for example, when the predetermined frequency is 440 Hz, the sound data generation unit 17 generates sound data in which a waveform appearing in the specific region 300 is repeated 440 times per second.

  At this time, the sound data generation unit 17 generates sound data using MAX / MSP. MAX / MSP includes a music programming language MAXs and an extension MSP for acoustic signal processing. According to MAX / MSP, various modules can be connected to create a synthesizer, effector, sequencer, etc., as well as automatic generation of music by patching. Intuitive programming and operation through a visual programming environment Can do.

  The sound data generation unit 17 outputs the generated sound data to the sound data reproduction unit 30a. The sound data reproduction unit 30 a emits sound based on the sound data supplied from the sound data generation unit 17.

(B: Operation)
Next, an operation in which the sound data generation device 10 generates sound data will be described. First, when the sound data generating apparatus 10 is turned on, the control unit 101 reads various control programs from the ROM 103 and loads them into the RAM 104.

(B-1: Initial setting process)
First, the control unit 101 performs an initial setting process. FIG. 11 is a flowchart showing the flow of the initial setting process. First, the user of the sound data generation system 1 clicks the space characteristic icon 404 (see FIG. 8) on the control panel 400. The control unit 101 outputs data indicating a parameter setting screen (see FIG. 9) to the monitor 30 in response to an operation signal from the mouse. The monitor 30 corresponds to the data supplied from the control unit 101. Display the screen. The user performs an operation for setting the space characteristics of the virtual space 100 while referring to the screen displayed on the monitor 30. The control unit 101 sets the space characteristics of the virtual space 100, that is, gravity, resistance force, etc. in the virtual space 100 in accordance with the signal supplied from the mouse 20 (step SA100).

  For example, in the gravity setting, when the downward direction of the drawing is selected as the direction of gravity and the value of the gravitational acceleration is written, the virtual particle 200 is set so that the gravity of the value set in the downward direction of the screen works. . In addition, when the value of the proportionality constant is written in the setting of the resistance force, the resistance force proportional to the moving speed of the virtual particle 200 works in the direction opposite to the movement. The environment is set as if the virtual space 100 is filled with air and water corresponding to the proportionality constant.

  Next, the control unit 101 sets the sprinkler 150 (means for causing the virtual particles 200 to appear in the virtual space 100) (step SA110). After the parameters are written in the control panel 400 by the user operating the mouse 20, when the sprinkler icon 401 is clicked and an area in the virtual space 100 is set, the control unit 101 is supplied from the mouse 20. In accordance with the operation signal, the sprinkler 150 is set. The arrangement of the sprinkler 150 can be freely changed by the user using the mouse 20.

(B-2: Sound data generation process)
When the initial setting process is performed, the control unit 101 starts the sound data generation process. FIG. 12 is a flowchart showing the flow of sound data generation processing. First, the control unit 101 releases the virtual particles 200 from the sprinkler 150 into the virtual space 100 (step SB110). Next, the control unit 101 performs the processing from step SB120 onward for each of the emitted virtual particles 200 in parallel.

  First, the control unit 101 calculates the motion (behavior) of the virtual particle 200 after a minute unit time (step SB120). More specifically, when the virtual particle 200 collides with the wall of the virtual space 100 or another virtual particle 200, it rebounds with a complete elastic collision, and the control unit 101 sets a new velocity for the virtual particle 200. . On the other hand, when no collision occurs, the control unit 101 moves the virtual particle 200 to a new position by multiplying the speed of the virtual particle 200 by a minute time. At this time, in step SB120, the trajectory is calculated simultaneously for all of the virtual particles 200 that appear in the virtual space 100 in step SB110, so that a large number of randomly appearing virtual particles 200 frequently interact with each other. Will be repeated. Therefore, even if various settings of the virtual space 100 are the same, different behaviors of the virtual particles 200 are caused each time.

  Next, the control unit 101 determines whether or not the virtual particles 200 reach the bottom surface of the virtual space 100 and disappear (step SB130). When it is determined that the virtual particle 200 has reached the bottom surface of the virtual space 100 (step SB130; YES), the control unit 101 deletes the virtual particle 200 from the screen and ends the processing related to the virtual particle 200. To do. On the other hand, when it is determined that the virtual particle 200 has not reached the bottom surface of the virtual space 100 (step SB130; NO), the control unit 101 performs the processing after step SB140.

  The control unit 101 calculates a waveform from the position of each virtual particle 200 present in the specific region 300 (step SB140), and generates sound data based on the calculated waveform (step SB150). The control unit 101 supplies the generated sound data to the sound data reproduction unit 30a of the monitor 30. The sound data reproducing unit 30a emits sound based on the sound data supplied from the control unit 101.

  As described above, the virtual particles 200 are randomly emitted from the sprinkler 150, and since the large number of virtual particles 200 repeatedly interact with each other, the waveform changes in a complicated and diverse manner as described above. Thus, the generated sound data has randomness and non-reproducibility.

  When the process of step SB150 is completed, the control unit 101 returns to the process of step SB120 and continues the particle behavior calculation process.

  Further, the control unit 101 generates image data indicating an image such as the position of the virtual particle 200 in the virtual space 100 based on the coordinates of each virtual particle 200 obtained by the calculation, and outputs the image data to the monitor 30. The monitor 30 displays a screen corresponding to the data supplied from the control unit 101. Thereby, the motion state of the virtual particles 200 in the virtual space 100 is displayed on the monitor 30. In addition, since the sound data generated by the control unit 101 corresponds to the screen displayed on the monitor 30, the user can see the screen display corresponding to the emitted sound as it is.

  The control unit 101 outputs the sound data generated in step SB150 to the sound data reproduction unit 30a. The sound data reproducing unit 30a reproduces the sound data supplied from the control unit 101. In addition, the control unit 101 writes information on various parameters relating to sound data generation (hereinafter referred to as “setting information”) such as the arrangement mode of the sprinkler 150 and the spatial characteristics set in the virtual space 100 to the RAM 104 for each trial. . By reading the setting information written in the RAM 104, the control unit 101 can perform sound data generation processing again under the same conditions. Even if sound data is generated again under the same condition setting as described above, the behavior of each virtual particle 200 is different every time, and therefore sound data having a different waveform microscopically is generated.

  As described above, according to the present embodiment, the waveform appearing in the specific region 300 is deformed by the movement of the particles, and the timbre changes when the waveform shape changes. Further, the virtual particles are continuously emitted from the sprinkler 150, and the trajectory of each virtual particle including the collision between the emitted virtual particles is calculated, so that a sound whose tone color changes irregularly can be obtained. Can be output.

  Further, in this embodiment, since the specific area 300 is defined and a waveform appearing in the area is used, the maximum amplitude of the waveform is the vertical width of the specific area 300, and in this way, the sound volume is more than necessary. It can be prevented from becoming large.

(C: Modification)
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below. In addition, you may combine each following aspect suitably.
(1) In the above-described embodiment, the control unit 101 is configured to provide a rectangular specific region. However, the shape of the specific region is not limited to a rectangle, and may be an ellipse, a trapezoid, a pentagon, Further, for example, an area shaped by an ADSR (Attack Decay Sustain Release) parameter as shown in FIGS. 13A and 13B may be used. In short, any shape may be used as long as a part or all of the area in the virtual space 100 is specified. Even if the specific region has a shape other than a rectangle, the control unit 101 may specify the waveform represented by the virtual particles 200 in the specific region, as in the above-described embodiment.
In the above-described embodiment, one or more reflectors that reflect the virtual particles 200 may be provided in the virtual space 100. The reflector is installed in order for the user to control the waveform of the specific region by reflecting the virtual particles 200. When the user performs an operation of moving the reflector in the virtual space 100 using the mouse 20, the control unit 101 moves the reflector to a position corresponding to the operated content in accordance with a signal from the mouse 20. .

(2) In the above-described embodiment, the control unit 101 calculates the waveform that appears for the virtual particles 200 located in the specific region 300 by connecting the virtual particles 200 that are close to each other in the x-axis direction. The aspect is not limited to this, and for example, for the virtual particles 200 located in the specific region 300, a waveform that appears by connecting the particles close to each other in the y-axis direction may be calculated. Any waveform may be used as long as the waveform expressed by the arrangement of the virtual particles 200 is calculated according to a predetermined algorithm.

(3) In the above-described embodiment, as illustrated in FIG. 10, one specific area 300 is provided in the virtual space 100, but the number of specific areas is not limited to 1, and the control unit 101 may be included in the virtual space 100. A plurality of areas may be specified as a specific area. An operation example in this case will be described with reference to FIG. FIG. 14 is a diagram illustrating an example of a screen displayed on the monitor 30. In the example illustrated in FIG. 14, the control unit 101 sets two specific areas 300 a and 300 b in the virtual space 100. In this case, when part or all of these specific areas 300a and 300b overlap, the control unit 101 shares the overlapping area and calculates a waveform for each specific area.

  In this case, since the overlapping portions are shared when a plurality of specific regions overlap, it is possible to have a common portion in a plurality of waveforms in the overlapping regions, and thereby, the waveforms are generated from the waveforms of the plurality of specific regions. It is possible to correlate the timbre of the sound represented by the sound data. That is, according to this aspect, a plurality of different sounds having similar timbres can be played simultaneously.

(4) In the above-described embodiment, the control unit 101 generates the waveform data using the waveform W appearing in the specific area 300 as a waveform for one period, but the waveform W appearing in the specific area 300 is one period. It may be used as a waveform having a shorter time, or may be a waveform having a long time such as a half cycle.

(5) In the above-described embodiment, the control unit 101 is configured to provide the specific area 300 at a predetermined position in the virtual space 100. However, the control unit 101 causes the specific area 300 to be located in the virtual space 100. You may enable it to move or rotate. In this case, for example, the user performs an operation for moving / rotating the specific area 300 using the mouse 20, and the control unit 101 determines the position of the specific area 300 in the virtual space according to the operation signal from the mouse 20. What is necessary is just to move and rotate within 100.

  Further, the control unit 101 may change the shape of the specific region 300. In this case, for example, the user performs an operation for changing the shape of the specific area 300 using the mouse 20, and the control unit 101 changes the shape of the specific area 300 according to the operation signal supplied from the mouse 20. Change it. Also in this case, the control unit 101 may generate sound data based on the waveform expressed by the virtual particles 200 in the specific region 300. The readout cycle may be changed according to the shape of the specific region 300, such that the frequency is lowered as the length of the specific region 300 in the x-axis direction is longer.

  Further, the user can designate a MIDI tone by operating an operation means such as a keyboard provided on the keyboard instrument, the mouse 20 of the above embodiment, or the keyboard, and the control unit 101 has a waveform corresponding to the designated tone. An area where the envelope of the above is shaped by the ADSR parameter may be specified as the specific area. In this case, sound data having a timbre close to the designated timbre is generated by the sound data generating device.

  In addition, the user can operate the operation means such as a keyboard, a mouse, and a keyboard to specify the velocity, and the control unit 101 specifies the ADSR parameter according to the specified velocity, and is shaped by the specified parameter. An area may be specified as a specific area. In this case, more specifically, the velocity and the ADSR parameter are associated with each other and stored in a predetermined storage area in advance, and when the velocity is designated by the user, the control unit 101 corresponds to the designated velocity. The ADSR parameter to be specified may be specified based on the stored correspondence relationship, and the area shaped by the specified parameter may be specified as the specific area.

(6) In the above-described embodiment, sound data having a waveform repeated at a predetermined frequency is generated. However, the frequency (pitch) may be changed. Specifically, for example, the user can operate the operation means such as the mouse 20 or the keyboard to designate the pitch, and the control unit 101 can specify the pitch data according to the operation signal from the operation means. , And the sound data having a frequency corresponding to the pitch indicated by the acquired pitch data may be generated with the waveform appearing in the specific region 300 as one cycle.

  Further, the pitch may be designated by the user operating a keyboard (keyboard) provided on the keyboard instrument. In this case, the sound data generating device may be provided with a keyboard having a plurality of keys for designating the pitch, and the pitch specifying device having the keyboard may be connected to the sound data generating device. . In this case, when the user presses any key included in the keyboard, a signal corresponding to the operation of the keyboard is output, and the sound data generation device applies the pressed key according to the signal from the keyboard. The pitch data indicating the corresponding pitch is acquired, and the pitch data indicated by the acquired pitch data is generated.

  The manner in which the control unit 101 obtains the pitch data is not limited to the above-described one. For example, the pitch data may be received via a communication network. Anything can be acquired.

(7) In the above-described embodiment, the control unit 101 generates sound data corresponding to the waveform represented by the arrangement mode of the virtual particles 200 in the specific region 300. Instead, the correspondence between the predetermined axial position of the specific region 300 and the pitch is stored in advance in a storage unit such as a ROM, and the control unit 101 causes the virtual particle 200 to store the specific region 300. You may make it produce | generate the sound data of the pitch corresponding to the position when passing. A specific example in this case will be described below.

  In this aspect, a function indicating a correspondence relationship between a position (coordinates) in a predetermined axial direction (for example, the x-axis direction) and a pitch (or frequency) in the specific region 300 in the storage unit of the sound data generation device 10. Is stored in advance. In this example, the function indicating the correspondence relationship is stored in the storage unit. However, the present invention is not limited to this, and a table or the like indicating the correspondence relationship may be stored. It may be something like this.

  In this case, similarly to the above-described embodiment, the control unit 101 calculates the trajectory of each virtual particle 200 emitted from the sprinkler 150 including the collision between the virtual particles 200, and according to the calculation result, the virtual particle 200 Calculates the position in the x-axis direction when passing through the specific region 300. Next, the control unit 101 specifies a pitch corresponding to the calculated position based on the correspondence stored in the storage unit, and generates sound data of the specified pitch. Note that the shape of the specific region 300 may be a polygonal shape such as a rectangle as shown in the above-described embodiment, or may be a straight line as shown in FIG. 15 or a linear shape such as a curve. There may be.

  In this case, since the trajectory of the virtual particles 200 is calculated including the collision between the virtual particles 200 as in the above-described embodiment, the positions of the virtual particles 200 passing through the specific region 300 are irregular. . Thereby, the pitch of the sound data generated by the control unit 101 changes irregularly with the passage of time.

  Moreover, you may combine the above-mentioned embodiment and this modification. A specific example will be described with reference to FIG. FIG. 16 is a diagram showing an example of a screen displayed on the monitor 30 in this modification. In FIG. 16, a pitch sprinkler icon 413 is an icon for placing in the virtual space 100 a pitch sprinkler 160 that emits virtual particles 210 for changing the pitch. The user performs an operation of dragging the pitch sprinkler icon 413 into the virtual space using the mouse 20 while referring to the screen. As illustrated in FIG. 16, the control unit 101 provides a sprinkler 160 in the virtual space 100 in addition to the sprinkler 150 according to a signal from the mouse 20, and a virtual for changing the pitch from the sprinkler 160. Particles 210 are released. At this time, the control unit 101 is sound data of the waveform W represented by the arrangement mode of the virtual particles 200 in the specific area 300 and has a pitch corresponding to the position when the virtual particles 210 pass through the specific area 300. Generate sound data.

(8) In the above-described embodiment, the control unit 101 generates sound data corresponding to the waveform expressed by the arrangement mode of the virtual particles 200 located in the specific region 300. A predetermined waveform may be arranged in the inside. FIG. 17 is a diagram illustrating an example of a screen displayed on the monitor 30 in this aspect. In the example illustrated in FIG. 17, the control unit 101 arranges a predetermined waveform W <b> 2 in the specific area 300. The waveform W2 may be a waveform corresponding to a sound waveform generated by, for example, a MIDI (Musical Instrument Digital Interface) sound source, or may be a waveform of sound collected by a microphone or the like, for example. The control unit 101 calculates the trajectory of the virtual particles 200 emitted from the sprinkler 150 including the collision between the virtual particles 200, and calculates the timing at which the virtual particles 200 and the waveform W2 collide according to the calculation result. Next, the control unit 101 outputs sound data of the sound represented by the waveform W2 to the sound data reproduction unit 30a at the timing when the virtual particle 200 and the waveform W2 collide.

  At this time, the control unit 101 calculates the collision position (coordinates) between the virtual particle 200 and the waveform W2 in accordance with the calculation result of the trajectory of the virtual particle 200, and the sound representing the sound when the waveform is read from the calculated collision position Data may be generated. In this way, sounds of different timbres are emitted irregularly depending on the collision position between the virtual particle 200 and the waveform W2.

  When reading the waveform from the collision position, when two virtual particles 200 collide simultaneously with the waveform W2, the control unit 101 outputs sound data representing the sound read from each collision position at the same time. Also good.

  In this aspect, the control unit 101 releases the virtual particles 200 having particle characteristics such as mass and moving speed from the sprinkler 150, and the particle characteristics (mass and moving speed) of the virtual particles 200 colliding with the waveform W2. Depending on the waveform, the phase, amplitude, period (pitch), etc. of the waveform may be changed. Specifically, for example, the control unit 101 increases the amplitude of the waveform as the mass of the virtual particle 200 colliding with the waveform W2 increases, or increases the frequency as the moving speed of the impacted virtual particle 200 increases. May be.

  In this aspect, the control unit 101 may deform the waveform W2 every time the virtual particle 200 and the waveform W2 collide. Specifically, for example, in the example shown in FIG. 17, when the virtual particle 200 falling from the upper part in the figure to the lower part in the figure collides with the waveform W2, the control unit 101, as shown in FIG. The waveform W2 may be deformed so as to have a concave shape in the lower part of the figure. In this case, the control unit 101 may change the deformation amount of the waveform W2 according to the particle characteristics (mass, moving speed) of the virtual particle 200 that has collided.

  Further, in this modification, the control unit 101 may limit the amplitude of the waveform W2 with the line connecting the virtual particles 200 in the x-axis direction within the specific region 300 as an envelope. Specifically, for example, when the waveform W2 illustrated in FIG. 17 is arranged in the specific region 300, the control unit 101 performs a waveform according to the virtual particles 200 in the specific region 300 as illustrated in FIG. The amplitude of W2 may be limited.

(9) In the above-described embodiment, the control unit 101 moves the position of the sprinkler 150 according to the user's operation so that the user can appropriately set the position of the sprinkler 150. However, the present invention is not limited to this. The position of the sprinkler 150 may be fixed at a predetermined position.
In the above-described embodiment, the control unit 101 may cause the virtual particles 200 to be released in a different release manner for each sprinkler 150. For example, the control unit 101 may emit virtual particles at different emission frequencies for each of the plurality of sprinklers 150 arranged. Further, the virtual particles 200 having different properties (mass, size, etc.) for each sprinkler 150 may be emitted.

(10) In the above-described embodiment, the case where the spatial characteristics such as gravity and resistance force are not changed during the sound data generation process has been described. However, the control unit 101 changes the sound characteristics during the sound data generation process. You may be able to do that. For example, if it is programmed in advance so that the direction of gravity acceleration changes periodically, the movement of the virtual particles 200 changes periodically due to the periodic change of gravity acceleration.

(11) In the above-described embodiment, the case where the appearance pattern of the virtual particles 200 appearing from the sprinkler 150 is random has been described. Instead, the control unit 101 may periodically change the appearance pattern frequency and appearance location of the virtual particles 200. In the above-described embodiment, the case where the initial velocity of the virtual particles 200 is uniform has been described. Instead, the control unit 101 changes the initial velocity of the virtual particles 200 for each virtual particle 200. May be.

(12) In the above-described embodiment, the control unit 101 may emit the virtual particles 200 having different characteristics such as speed, size, and mass from the sprinkler 150. Further, for example, the control unit 101 may emit the virtual particles 200 from the sprinkler 150 while changing the emission mode such as the spread of the radiation angle and the emission frequency.

  In addition, as shown in the above-described modification (6), the above-described modifications (10) to (12) have frequencies corresponding to the pitch (the same frequency or a predetermined number of frequencies may be used). ) (Gravity, resistance, gravitational acceleration, appearance frequency, initial speed, mass, etc.) etc. may be vibrated.

(13) A program executed by the control unit 101 of the sound data generation device 10 in the above-described embodiment is read by a computer such as a magnetic tape, a magnetic disk, a flexible disk, an optical recording medium, a magneto-optical recording medium, a RAM, and a ROM. It can be provided in a state of being recorded on a possible recording medium. Also, the sound data generation device 10 can be downloaded via a network such as the Internet.

(14) In the above-described embodiment, when the virtual particles 200 collide with each other or when the virtual particles 200 collide with the framework of the virtual space 100, the control unit 101 performs a complete elastic collision with a rebound coefficient of 1. However, the rebound coefficient may be a value other than 1. For example, an inelastic collision with a rebound coefficient of 0 to 1 may be performed. Although it is contrary to the laws of nature, when calculating the speed of each object after the collision, a value exceeding 1 may be used as the rebound coefficient.

(15) Further, in the above-described embodiment, the control unit 101 calculates the trajectory of each virtual particle emitted from the sprinkler 150 including the collision between the virtual particles, whereby the virtual particle in the specific region 300 is calculated. The arrangement of 200 changed irregularly, and accordingly, the waveform appearing in the specific region 300 changed irregularly. The mode in which the waveform appearing in the specific region 300 is irregularly changed is not limited to this. For example, the control unit 101 may irregularly discharge the plurality of virtual particles 200 from the sprinkler 150. In this case, since the arrangement of the virtual particles 200 in the specific region 300 changes irregularly by being irregularly emitted, the shape of the waveform appearing in the specific region 300 also becomes irregular as time passes. Changes.
In short, the control unit 101 may perform control so that the waveform appearing in the specific region 300 changes irregularly.

(16) In the above-described embodiment, the control unit 101 calculates a waveform expressed by the arrangement mode of the virtual particles 200 located in the specific region 300 and generates sound data of the calculated waveform. For example, the control unit 101 arranges a plurality of virtual particles that can move in the specific area 300 in the specific area 300, and the arrangement mode of the virtual particles arranged in the specific area 300 is not limited thereto. The represented waveform may be calculated and sound data of the calculated waveform may be generated. A specific example will be described with reference to FIG.

  FIG. 20 is a diagram illustrating an example of a screen displayed on the monitor 30 in this aspect. In the example illustrated in FIG. 20, the control unit 101 arranges a plurality of virtual particles 220 that can move in the specific region 300 in the specific region 300. As a mode of this arrangement, the control unit 101 may be arranged in a predetermined mode, or the user designates the position of each virtual particle 220 using the mouse 20, and the control unit 101 uses the mouse. The virtual particles 220 may be arranged at a position designated based on the operation signal from 20. Further, the virtual particle 220 arranged in the specific region 300 may be moved only when it collides with the virtual particle 200, for example, and the control unit 101 controls so as to always move at a constant speed, for example. You may do it.

  The control unit 101 calculates the trajectory of the virtual particle 200 (and the virtual particle 220) including the collision between the virtual particles (including the collision between the virtual particle 200 and the virtual particle 220), and the virtual particle 200 according to the calculation result. And the position of the virtual particle 220 is changed. That is, the control unit 101 changes the position of the virtual particle 220 in the specific region 300 based on the interaction between the virtual particle 200 and the virtual particle 220. In addition, the control unit 101 calculates the waveform W3 expressed by the arrangement mode of the virtual particles 220 in the specific region 300, and generates sound data of the calculated waveform.

  Also in this aspect, since the trajectories of the virtual particles 200 and the virtual particles 220 are calculated including collisions between the virtual particles, the waveform W3 appearing in the specific region 300 changes irregularly, thereby causing irregularities. It is possible to generate sound data whose tone color changes.

  Thus, the waveform for generating sound data is not limited to that shown in the above-described embodiment, and may be a waveform expressed by the arrangement of the virtual particles 220 in the specific region 300. A predetermined waveform as exemplified in the above-described modification (8) may be used by being deformed along with the movement of the virtual particle 200. In short, the control unit 101 may calculate a waveform according to the virtual particles 200 in the specific region 300.

It is a figure which shows an example of the screen of the monitor 30 in a sound data generation process. It is a figure which shows an example of the whole structure of the sound data generation system. 1 is a diagram illustrating an example of a configuration of a sound data generation device 10. FIG. 2 is a diagram illustrating an example of an appearance of a mouse 20. FIG. It is a figure which shows an example of the screen of the monitor. 4 is a diagram for explaining functions of a multipoint controller 40. FIG. 2 is a diagram illustrating an example of a functional configuration of a sound data generation device 10. FIG. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen for setting a spatial characteristic. It is a figure for demonstrating the installation method of the sprinkler 150. FIG. It is a flowchart which shows the flow of an initial setting process. It is a flowchart which shows the flow of a sound data generation process. It is a figure which shows an example of the shape of a specific area | region. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor. It is a figure which shows an example of the screen of the monitor.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Sound data generation system, 10 ... Sound data generation apparatus, 11 ... Spatial characteristic control part, 12 ... Object control part, 13 ... Particle motion control part, 14 ... Specific area control part, 15 ... Waveform calculation part, 16 ... Image | video Control unit, 17 ... Sound data generation unit, 20 ... Mouse, 21 ... Main body, 22 ... Button, 23 ... Communication cable, 24 ... Movement detection means, 30 ... Monitor, 40 ... Multipoint controller, 41 ... Communication cable, 42 ... Touch panel, 100 ... virtual space, 101 ... control unit, 102 ... optical disc playback unit, 103 ... ROM, 104 ... RAM, 105 ... I / O unit, 109 ... bus, 150, 160 ... sprinkler, 200, 210, 220 ... virtual Particles 300 ... specific area 400 ... control panel.

Claims (10)

Virtual space setting means for setting a virtual space;
Specific area specifying means for specifying one or more areas as a specific area of a part or all of the virtual space set by the virtual space setting means;
Virtual particle emitting means for performing an operation of continuously discharging a plurality of virtual particles to the virtual space;
A trajectory computing means for computing the trajectory of each virtual particle emitted by the computation of the virtual particle emitting means, including the collision between the virtual particles;
Waveform calculating means for calculating a waveform according to the virtual particles in the specific area specified by the specific area specifying means according to the calculation result by the trajectory calculating means;
Sound data generating means for generating sound data corresponding to the waveform calculated by the waveform calculating means;
An output means for outputting the sound data generated by the sound data generation means. The waveform calculating unit calculates a waveform expressed by an arrangement mode of the virtual particles included in the specific region specified by the specific region specifying unit according to a calculation result by the trajectory calculating unit. Item 2. The sound data generation device according to Item 1. The sound data generation device according to claim 2, wherein the waveform calculation unit calculates a waveform that appears by connecting virtual particles adjacent to each other in a predetermined axial direction within the specific region. The sound data generation unit according to any one of claims 1 to 3, wherein the sound data generation unit generates sound data by repeating a plurality of times with the waveform calculated by the waveform calculation unit as one cycle. apparatus. Pitch data acquisition means for acquiring pitch data indicating the pitch;
5. The sound according to claim 1, wherein the sound data generation unit generates sound data based on a pitch indicated by the pitch data acquired by the pitch data acquisition unit. Data generator. The specific area specifying means specifies a part or all of the areas in the virtual space as specific areas,
6. The waveform calculation unit according to claim 1, wherein, when part or all of the plurality of specific regions overlap, the waveform calculation unit calculates the waveform for each of the specific regions by sharing the overlapping region. The sound data generation device according to claim 1. Correspondence storage means for storing a correspondence between a predetermined axial position and pitch in the specific area;
Position calculating means for calculating the predetermined axial position of the virtual particle in the specific area when the virtual particle passes through the specific area according to the calculation result by the trajectory calculating means;
A pitch specifying means for specifying a pitch corresponding to the position calculated by the position calculating means based on the correspondence stored in the storage means;
The sound data generation device according to claim 1, wherein the sound data generation unit generates sound data of a pitch specified by the pitch specification unit. Waveform arrangement means for arranging a waveform having a predetermined shape in the specific area specified by the specific area specifying means,
The sound data generating unit is configured to output a sound corresponding to the waveform when the waveform is read from a collision position between the virtual particle emitted by the virtual particle emitting unit and the waveform according to the calculation result by the orbit calculating unit. The sound data generation device according to claim 1, wherein data is generated. Virtual particle arrangement means for arranging a plurality of second virtual particles movable in the specific area in the specific area specified by the specific area specifying means;
According to the calculation result of the trajectory calculation means, the second virtual particle in the specific area is based on the interaction between the second virtual particles in the specific area and the virtual particles emitted by the virtual particle emission means. Position changing means for continuously changing the arrangement of particles,
The sound data generation device according to claim 1, wherein the waveform calculation unit calculates a waveform expressed by an arrangement mode of the second virtual particles in the specific region. Computer
Virtual space setting means for setting a virtual space;
Specific area specifying means for specifying one or more areas as a specific area of a part or all of the virtual space set by the virtual space setting means;
Virtual particle emitting means for performing an operation of continuously discharging a plurality of virtual particles to the virtual space;
A trajectory computing means for computing the trajectory of each virtual particle emitted by the computation of the virtual particle emitting means, including the collision between the virtual particles;
Waveform calculating means for calculating a waveform according to the virtual particles in the specific area specified by the specific area specifying means according to the calculation result by the trajectory calculating means;
Sound data generating means for generating sound data corresponding to the waveform calculated by the waveform calculating means;
A program that functions as output means for outputting sound data generated by the sound data generation means.

Images