JP6862953B2 - Devices and methods for generating object movement trajectories - Google Patents

Description

The present invention relates to an apparatus and a method for generating a movement locus of an object such as a virtual sound image.

A technique for generating a movement trajectory of an object such as a virtual sound source is provided. For example, in the technique disclosed in Patent Document 1, a plurality of types of two-dimensional change patterns of the position of a virtual sound source are prepared, and the user selects a desired change pattern, and the width, depth, and offset of the change pattern. It can be placed on a virtual plane by specifying its position. Then, in the technique disclosed in Patent Document 1, the virtual sound source is moved along the movement locus composed of the change patterns arranged on the virtual plane in this way, and the virtual sound source is localized at the position on the movement locus.

Patent No. 3525653

By the way, the technique disclosed in Patent Document 1 described above can generate a movement locus in a two-dimensional plane, but has a problem that it cannot generate a movement locus in a three-dimensional space.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technical means capable of generating a movement locus of an object in a three-dimensional space.

The present invention comprises a movement control unit that arranges an object on a plane according to an operation of an operator, controls the movement of the arranged object on the plane, and controls the movement of the plane in a three-dimensional space, and the movement. Provided is an object movement locus generation device including a locus generation unit that creates an object movement locus from the coordinates of the object output by the control unit.

According to the present invention, it is possible to move an object in a three-dimensional space and generate a movement locus of the object in the three-dimensional space according to the operation of the operator.

It is a block diagram which shows the structure of the movement locus generation apparatus which is 1st Embodiment of this invention. It is a figure which illustrates the locus information generated in the same embodiment. It is a figure which shows the display example of the display part in the same embodiment. It is a flowchart which shows the example of the movement locus generation program in the same embodiment. It is a figure which shows the display example of the display part of the movement locus generation apparatus which is 2nd Embodiment of this invention. It is a figure which shows the display example of the display part of the movement locus generation apparatus which is 3rd Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<First Embodiment>
FIG. 1 is a block diagram showing a configuration of a movement locus generator according to a first embodiment of the present invention. This movement locus generator has a function of generating and displaying the movement locus of the virtual sound source, and a function of performing localization processing for localizing the virtual sound source at the position while moving the position of the virtual sound source according to the movement locus. The movement locus generation device according to the present embodiment is formed by installing an application program (hereinafter, referred to as a movement locus generation program) for realizing the function as the movement locus generation device on a personal computer.

As shown in FIG. 1, the movement locus generation device according to the present embodiment has a CPU 1 which is a control center, an operation unit 2 including various controls such as a keyboard, a mouse, and a joystick, and a display unit 3 including a liquid crystal display and the like. A non-volatile storage unit 4 composed of a ROM, an HDD, or the like, a volatile storage unit 5 composed of a RAM, and I / Fs (interfaces) 6 and 7.

In FIG. 1, the non-volatile storage unit 4 stores the movement locus generation program. The CPU 1 transfers this movement locus generation program to the volatile storage unit 5 and executes it in response to the operation of the operation unit 2.

In the box showing the CPU 1, a movement control unit 11, a locus generation unit 12, a locus information file 13, a display control unit 14, and a localization processing unit 15 are shown. Of these, the movement control unit 11, the locus generation unit 12, the display control unit 14, and the localization processing unit 15 are functions realized by the CPU 1 executing the movement locus generation program. The locus information file 13 is a file generated by the locus generation unit 12.

The movement control unit 11 arranges a virtual sound source on a plane according to the operation of the operation unit 2, controls the movement of the arranged virtual sound source on the plane, and controls the movement of the plane in a three-dimensional space. It is a means to output the coordinate information of the virtual sound source in the dimensional space. The details of the function of the movement control unit 11 will be described later.

The locus generation unit 12 is a means for generating a locus information file 13 composed of locus information indicating the movement locus of the virtual sound source from the coordinate information of the virtual sound source output by the movement control unit 11. FIG. 2 is a diagram illustrating the content of this locus information. As illustrated in FIG. 2, the locus generation unit 12 has coordinate information x (i), y (i) and z (i) (i = 1, 2, 2, of the virtual sound source in the three-dimensional space from the movement control unit 11. 3, ...) Are sequentially acquired, and locus information is generated in which the coordinate information x (i), y (i), and z (i) are associated with the time information t (i) indicating the acquisition time. Then, the locus information file 13 composed of this locus information is stored in the volatile storage unit 5. Here, as will be described later, the coordinate information of the movement locus of the virtual sound source is output from the movement control unit 11 in the process of drawing the movement locus in the virtual three-dimensional space by the operation of the operation unit 2. In this case, the user draws a movement locus of the virtual sound source in consideration of the movement speed of the virtual sound source. Therefore, the time information t (i) in the locus information is such that the virtual sound source passes through a point on the moving locus specified by the coordinate information x (i), y (i) and z (i) associated with the time information t (i). It indicates the time.

The display control unit 14 is a means for performing control for displaying various information such as the movement locus of the virtual sound source indicated by the locus information file 13 on the display unit 3.

The I / F 6 is an I / F that mediates access to various sound source files 6a, may be an I / F that mediates access to the sound source file 6a stored in the storage medium, or is a sound source that mediates access to the sound source file 6a via the network. It may be an I / F that mediates access to the file 6a.

Here, the sound source file 6a is a file of a sound source signal which is a sample sequence of sound waves of various sounds such as musical instrument sounds, sound effects, and striking sounds. The localization processing unit 15 in FIG. 1 reads the sound source signal from the sound source file 6a via the I / F6, reads the locus information from the locus information file 13, and localizes the sound source signal to the virtual sound source position indicated by the locus information. It is a means for performing localization processing.

Specifically, when the timing corresponding to the time information t (i) of the trajectory information is reached, the localization processing unit 15 delays information of each channel for generating a sound signal to be supplied from the sound source signal to the speakers of a plurality of channels. Localization control parameters including gain information and gain information are generated based on the coordinate information x (i), y (i), and z (i) of the locus information. Then, the localization processing unit 15 applies signal processing (for example, delay processing and gain multiplication processing) using the localization control parameters to the sound source signal, so that the virtual sound source is localized at a position on the movement locus indicated by the locus information. It produces the sound signal of the channel. By repeating the above processing for each time information t (i), the localization processing unit 15 can localize the virtual sound source with the locus information set in the locus information file 13.

The I / F 7 is a means for supplying the sound signal obtained by the localization processing of the localization processing unit 15 to an external device such as a speaker or another personal computer. Further, the I / F7 can also supply the locus information file 13 generated by the locus generation unit 12 to an external device. Therefore, in the present embodiment, it is also possible for the external device to perform localization processing on the sound source signal by using the locus information file 13.

FIG. 3 is a diagram showing a display example of the display unit 3. Hereinafter, the function of the movement control unit 11 will be described with reference to FIG. The display control unit 14 is a perspective view of the xyz orthogonal coordinate space 33 in which the uv coordinate plane 31, the fader 32, and the uv coordinate plane 31 are arranged so that the user can specify each position on the movement locus in the three-dimensional space. The figure is displayed on the display unit 3.

Here, the xyz orthogonal coordinate space 33 has three coordinate axes including an x-axis, a y-axis, and a z-axis that are orthogonal to each other. The uv coordinate plane 31 has a u-axis parallel to the x-axis and a v-axis parallel to the y-axis, and is a plane orthogonal to the z-axis at the origin Q where the u-axis and the v-axis are orthogonal to each other. Further, the position of the listener is set to the origin P of the xyz orthogonal coordinate space 33.

In the present embodiment, the user can instruct the desired position on the uv coordinate plane 31 as the virtual sound source position S by a pointing device such as a mouse in the operation unit 2. Further, the user can instruct the position of the origin Q on the z-axis of the uv coordinate plane 31 (that is, the z-coordinate of the origin Q) by operating the fader 32.

The movement control unit 11 moves the uv coordinate plane 31 along the z axis in the xyz orthogonal coordinate space 33 in response to the operation of the fader 32, and moves the virtual sound source position S in the uv coordinate plane in response to the operation of the pointing device. Move within 31. Then, the movement control unit 11 moves the virtual sound source position S in this way, and obtains the coordinate information x (i), y (i), z (i) in the xyz orthogonal coordinate space 33 of the virtual sound source position S. Calculate and output. That is, the user can generate locus information that changes with time by repeating the process of moving the virtual sound source position S in the uv coordinate plane 31 and operating the fader 32.
The above is the configuration of this embodiment.

FIG. 4 is a flowchart showing an example of the movement locus generation program in the present embodiment. Hereinafter, the operation of the present embodiment will be described with reference to FIG.

When the CPU 1 starts executing the movement locus generation program according to the operation of the operation unit 2, it is in a state of waiting for an instruction from the user (step SA1). In this state, when the instruction to end the process is input, the CPU 1 ends the movement locus generation program. On the other hand, when an instruction other than the instruction for ending the process, that is, an instruction for executing some process is input, the process of the CPU 1 proceeds to step SA2. In this step SA2, the CPU 1 determines the type of the instructed process.

When the locus generation process is instructed, the process of the CPU 1 proceeds from step SA2 to step SA11. In step SA11, the CPU 1 executes the initial setting for setting the initial position of the virtual sound source. Specifically, the movement control unit 11 has u-coordinates and v-coordinates of the virtual sound source on the uv-coordinate plane 31 instructed by the operation of the pointing device, and the origin Q of the uv-coordinate plane 31 instructed by the operation of the fader 32. The x-coordinate, y-coordinate, and z-coordinate of the virtual sound source in the xyz orthogonal coordinate space 33 are calculated from the z-coordinate of, and set as the initial position of the virtual sound source.

Next, the CPU 1 determines whether or not the operation of the operation unit 2 instructing the start of locus generation has been performed (step SA12). If the determination result is "NO", the CPU 1 repeats the determination. Further, when this determination becomes "YES", the processing of the CPU 1 proceeds to step SA13.

In step SA13, the CPU 1 acquires the operation information of the operation unit 2. Next, in step SA14, it is determined whether or not the end of the movement locus generation process is instructed based on the operation information acquired in step SA13. If the determination result is "YES", the process of the CPU 1 returns to step SA1. On the other hand, if the determination result is "NO", the process of the CPU 1 proceeds to step SA15.

Next, when the process proceeds to step SA15, the movement control unit 11 calculates the coordinate information x (i), y (i), z (i) of the virtual sound source based on the operation information acquired in step SA13. Specifically, the movement control unit 11 obtains the u-coordinate and v-coordinate of the virtual sound source on the uv-coordinate plane 31 from the operation information of the pointing device, and the z-coordinate of the origin Q of the uv-coordinate plane 31 from the operation information of the fader 32. From the u-coordinate, v-coordinate, and z-coordinate, the coordinate information x (i) (= u-coordinate), y (i) (= v-coordinate) and z (i) (=) of the virtual sound source in the xyz orthogonal coordinate space 33. The z coordinate of the origin Q) is calculated.

Next, when the process proceeds to step SA16, the locus generation unit 12 starts the current time (or locus generation) with respect to the coordinate information x (i), y (i), and z (i) of the virtual sound source obtained in step SA15. The locus information is generated by adding the time information t (i) indicating the elapsed time from the time). The locus information is collected in this way and stored in the volatile storage unit 5 as the locus information file 13.

Next, in step SA17, the display control unit 14 controls to update the display in the uv coordinate plane 31, the xyz orthogonal coordinate space 33, and the fader 32 based on the locus information indicated by the locus information file 13. When the step SA17 is completed, the processing of the CPU 1 returns to the step SA13. Hereinafter, the processes of steps SA13 to SA17 are repeated in the same manner.

Then, when the end of the movement locus generation process is instructed and the determination result in step SA14 becomes "YES", the process of the CPU 1 returns to step SA1.

When the localization process is instructed in step SA2, the process of the CPU 1 proceeds to step SA21. In this step SA21, the CPU 1 reads a sound source signal for a predetermined time from the sound source file 6a. Next, the CPU 1 reads the locus information for a predetermined time from the locus information file 13 (step SA22). Next, the CPU 1 performs localization processing on the sound source signal read in step SA21 using the locus information read in step SA22 (step SA23). The sound signal obtained by this localization processing is output to, for example, a speaker via the I / F7, and is emitted from the speaker.

Next, the CPU 1 controls to display the movement locus indicated by the locus information file 13 on the display unit 3 (step SA24). In this display control, the current virtual sound source position on the movement locus may be displayed based on the locus information read in step SA22.

When step SA24 is completed, it is determined whether or not the processing end timing has been reached, specifically, whether or not at least one of the sound source file 6a and the locus information file 13 has been read (step SA25), and this determination result is obtained. If "NO", the processes of steps SA21 to SA24 are repeated. On the other hand, when the determination result of step SA25 is "YES", the processing of the CPU 1 returns to step SA1.
The above is the operation of this embodiment.

As described above, according to the present embodiment, it is possible to generate locus information indicating the movement locus of the virtual sound source in the three-dimensional space by a simple operation. Specifically, according to the present embodiment, for example, a localization process is performed in which a movement locus of a helicopter that turns above the listener's head is generated by a simple operation, and a virtual sound source that generates a helicopter sound is moved along the movement locus. It can be carried out. In this case, the user moves the uv coordinate plane 31 over the listener's head by operating the fader 32 in order to generate the movement locus. Then, the user may gradually move the virtual sound source position S in the uv coordinate plane 31 by the pointing device over time. Similarly, the user can generate a moving locus in which the rocket rises in the shape of a fir tree by a simple operation.

<Second Embodiment>
The configuration of the moving locus generator according to the second embodiment of the present invention is basically the same as that of the first embodiment (FIG. 1). This embodiment is an improvement of the movement control unit 11 of the first embodiment.

FIG. 5 is a diagram showing a display example of the display unit 3 in the present embodiment. In the present embodiment, the xyz orthogonal coordinate space 33 is provided with a w-axis that passes through the origin P. In the present embodiment, it is possible to adjust the tilt angle of the w-axis in the xyz orthogonal coordinate space 33 by, for example, operating the joystick. The uv coordinate plane 31 is orthogonal to the w axis at the origin Q. Then, in the present embodiment, the position of the origin Q of the uv coordinate plane 31 on the w-axis can be instructed by operating the fader 32.

Here, even if the inclination angle of the normal (in this case, the w-axis) of the uv coordinate plane 31 is determined, the u-axis and the v-axis orthogonal to such a normal can be considered infinitely. However, if the u-axis and the v-axis are not determined, the u-coordinate and v-coordinate of the virtual sound source on the uv coordinate plane 31 cannot be acquired. Therefore, it is necessary to set some restrictions on the u-axis and the v-axis so that the u-axis and the v-axis can be determined once the inclination angle of the normal (w-axis) is determined. The method of determining the u-axis and the v-axis from the inclination angle of this normal (w-axis) is arbitrary, but in this example, the axis orthogonal to the plane including the z-axis and the w-axis in the uv coordinate plane 31 is the v-axis. The axis orthogonal to the v-axis is the u-axis. Therefore, when the user tilts the w-axis with respect to the z-axis by operating the joystick, the v-axis is positioned so as to be orthogonal to the plane including the z-axis and the w-axis, and the w-axis is positioned with respect to the uv coordinate plane 31. The orientation of the uv coordinate plane 31 is adjusted so as to be orthogonal to each other.

In the present embodiment, the movement control unit 11 changes the tilt angle of the w-axis in the xyz orthogonal coordinate space 33 and makes the uv coordinate plane 31 orthogonal to the w-axis according to the operation of the joystick, so that the fader 32 The uv coordinate plane 31 is moved along the w axis in the xyz orthogonal coordinate space 33 according to the operation, and the virtual sound source position S is moved in the uv coordinate plane 31 according to the operation of the pointing device. Then, the movement control unit 11 calculates and outputs the coordinate information x (i), y (i), z (i) in the xyz orthogonal coordinate space 33 of the virtual sound source while moving the virtual sound source in this way. To do.
Other points are the same as those in the first embodiment.

Also in this embodiment, the same effect as that of the first embodiment can be obtained. Further, according to the present embodiment, in the xyz orthogonal coordinate space 33, the inclination angle of the w-axis orthogonal to the uv coordinate plane 31 can be changed by an operator such as a joystick, so that the shape is larger than that of the first embodiment. The effect of being able to generate a complicated and highly flexible movement trajectory can be obtained.

<Third Embodiment>
The configuration of the moving locus generator according to the third embodiment of the present invention is basically the same as that of the first embodiment (FIG. 1). This embodiment is an improvement of the movement control unit 11 of the first embodiment.

FIG. 6 is a diagram showing a display example of the display unit 3 in the present embodiment. Also in this embodiment, as in the second embodiment (FIG. 5), the origin Q of the uv coordinate plane 31 is located on the w-axis where the tilt angle can be adjusted. Further, the position of the origin Q of the uv coordinate plane 31 on the w-axis can be adjusted by operating the fader 32. The difference between this embodiment and the second embodiment is as follows. In the second embodiment, the uv coordinate plane 31 is adjusted to be orthogonal to the w-axis according to the inclination angle of the w-axis. On the other hand, in the present embodiment, as illustrated by reference numeral 31', the inclination angle of the normal line of the uv coordinate plane 31 with respect to the w-axis is adjusted by an operation such as a joystick.

In the present embodiment, the movement control unit 11 changes the tilt angle of the w-axis in the xyz orthogonal coordinate space 33 according to the operation of the joystick or the like, and the uv coordinate plane 31 with respect to the w-axis according to the operation of the joystick or the like. Change the tilt angle of the normal. When two joysticks are used, a complicated movement locus can be generated by controlling the inclination angle of the w-axis and the inclination angle of the normal of the uv coordinate plane 31 with each joystick.

Similar to the second embodiment, even if the inclination angle of the normal of the uv coordinate plane 31 is determined, if the u-axis and the v-axis are not determined, the u-coordinate and v-coordinate of the virtual sound source on the uv-coordinate plane 31 are acquired. Can not do it. Therefore, it is necessary to set some restrictions on the u-axis and the v-axis so that the u-axis and the v-axis can be determined once the inclination angle of the normal is determined. The method of determining the u-axis and the v-axis from the inclination angle of the normal is arbitrary, but in this example, the plane including the normal and the w-axis and the axis orthogonal to the uv coordinate plane 31 are defined as the v-axis. The axis orthogonal to the axis is defined as the u axis. Therefore, when the user tilts the normal of the uv coordinate plane 31 with respect to the w-axis by operating the joystick, the v-axis is positioned so as to be orthogonal to the normal of the uv coordinate plane 31 and the plane including the w-axis. The orientation of the coordinate plane 31 is adjusted.

Further, the movement control unit 11 moves the uv coordinate plane 31 along the w axis in the xyz orthogonal coordinate space 33 in response to the operation of the fader 32, and uv the position of the virtual sound source in response to the operation of the pointing device. Move within the coordinate plane 31. Then, the movement control unit 11 calculates and outputs the coordinate information x (i), y (i), z (i) in the xyz orthogonal coordinate space 33 of the virtual sound source while moving the virtual sound source in this way. To do.
Other points are the same as those in the first and second embodiments.

Also in this embodiment, the same effect as that of the first embodiment can be obtained. Further, according to the present embodiment, the inclination angle of the normal of the uv coordinate plane 31 with respect to the w-axis can be changed by operating a joystick or the like, so that the shape is more complicated and the degree of freedom is higher than that of the first and second embodiments. The effect of being able to generate a high movement locus is obtained.

<Other Embodiments>
Although the first to third embodiments of the present invention have been described above, other embodiments can be considered in the present invention. For example:

(1) In each of the above embodiments, the position of the listener is the origin P of the xyz orthogonal coordinate space 33, but the position away from the listener may be the origin P.

(2) In the above embodiment, the three-dimensional space in which the uv coordinate plane is arranged is a three-dimensional orthogonal coordinate space in which the three axes are orthogonal to each other. For example, the position in the three-dimensional space is the distance from the origin and the distance from the origin. The uv coordinate plane may be arranged in a three-dimensional space other than the three-dimensional orthogonal coordinate space, such as a polar coordinate space specified by two types of angles indicating the direction of the position (for example, an elevation angle and a lateral deviation angle). Further, a polar coordinate plane may be used instead of the orthogonal coordinate plane such as the uv coordinate plane.

(3) When the coordinate information of the movement locus is input by the operation of the operation unit 2, the movement locus may be affected by camera shake or the like at the time of input. Therefore, the locus generation unit 12 may interpolate the coordinate information and the time information of the movement locus to generate the locus information file 13 showing the smooth movement locus.

(4) According to the third embodiment, for example, one mouse and two joysticks can generate a three-dimensional movement locus. However, in the third embodiment, a three-dimensional movement locus may be generated by one mouse and one joystick. In this embodiment, a control means such as a switch is used to switch between tilting the w-axis with a joystick and tilting the normal of the uv coordinate plane, and tilting the w-axis with one joystick, or the method of the uv coordinate plane. It is possible to tilt the line. Further, in the third embodiment, it is also possible to generate a three-dimensional movement locus with one mouse. In this aspect, a three-dimensional movement locus is generated by one mouse by switching the control target with a control means such as a switch in the same manner as described above. Similarly, in the second embodiment, a three-dimensional movement locus can be generated by one mouse. Further, in each of the above embodiments, a three-dimensional movement locus can be generated by a keyboard operation or a touch operation by a touch panel instead of the mouse.

(5) In the above embodiment, a virtual sound source is used as an object, and a movement locus of this object is generated, displayed, and edited. However, the object is not limited to the virtual sound source. Another object such as an image object or a flying object in the animation may be targeted, and the movement trajectory thereof may be generated.

(6) The movement locus generation device may be composed of a movement control unit 11, a locus generation unit 12, and a display control unit 14. The localization processing unit 15 is outside, and the localization processing unit 15 may acquire the locus information file 13 output by the movement locus generator and perform the localization processing. It is also possible to place the movement locus generation device on the cloud, and each user operates the movement locus generation device via the network to acquire the locus information file 13.

1 ... CPU, 2 ... Operation unit, 3 ... Display unit, 4 ... Non-volatile storage unit, 5 ... Volatile storage unit, 6, 7 ... I / F, 6a ... Sound source file, 11 ... ... Movement control unit, 12 ... Trajectory generation unit, 13 ... Trajectory information file, 14 ... Display control unit, 15 ... Localization processing unit.

Claims (4)

A movement control unit that arranges an object on a plane and controls the movement of the arranged object on the plane and the movement of the plane in a three-dimensional space according to the operation of the operator.
It is provided with a locus generation unit that creates a movement locus of the object from the coordinates of the object output by the movement control unit.
The movement control unit moves the plane along an axis in the three-dimensional space according to the operation of the operator, and tilts the axis in the three-dimensional space according to the operation of the operator. A movement locus generator characterized by controlling an angle. The movement locus generation device according to claim 1, wherein the movement control unit controls an inclination angle of a normal vector of the plane with respect to the axis according to an operation of an operator. The movement locus generation device according to claim 1 or 2, wherein the locus generation unit assigns time information indicating a passing time of the object to each coordinate of the movement locus. A movement control process in which an object is placed on a plane and the placed object is moved on the plane and the plane is moved in a three-dimensional space according to the operation of the operator.
A locus generation process for creating a movement locus of an object from the coordinates of the object output by the movement control process.
With
In the movement control process, the plane is moved along the axis in the three-dimensional space according to the operation of the operator, and the tilt of the axis in the three-dimensional space is tilted according to the operation of the operator. A method of generating a movement trajectory of an object, which is characterized by controlling an angle.

Images