JP3712451B2 - Image composition method and image composition apparatus - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image synthesizing method and an image synthesizing apparatus, and more particularly, to an image synthesizing method and an image synthesizing apparatus that appropriately display joint motions of a plurality of models.
[0002]
[Background Art and Problems to be Solved by the Invention]
2. Description of the Related Art Conventionally, image synthesizing apparatuses that output images of display objects composed of combinations of a plurality of objects (parts) performing various operations in an object space constructed in a storage device have been widely popularized.
[0003]
By the way, in this type of image synthesizer, it is indispensable to display the movement of the display object in the object space smoothly in order to improve the quality of the display image of the image synthesizer, which complicates the necessary image processing. Therefore, there has been a demand for a technique for smoothing the image display of the joint portion of the display object without performing the above operation.
[0004]
The present invention has been made in view of such problems, and an object of the present invention is to provide an image composition method and an image composition apparatus that can favorably display an image of a joint portion of a display object.
[0005]
[Means for Solving the Problems]
The present invention is an image composition method for displaying a joint motion performed by a first object and a second object adjacent to each other among a plurality of objects arranged in an object space and combined with polygons specified by vertices in real time. The first object is formed to include a first joint surface specified by n vertices from the 0th vertex to the (n−1) vertex in the vicinity of the second object, A second object is formed in proximity to the first object so as to include a second joint surface identified by n vertices from the 0th vertex to the (n−1) th vertex, and the first and second A position information deriving step for deriving position information of the vertices of the polygons constituting the two objects before and after the joint movement for each given time, and the 0th vertex of the first object And (n-1) apex from the 0th apex of the second object to the (n-1) apex, and the first object and the second object during the joint movement. When a given twist occurs, the vertex shift number m, which is an integer that increases or decreases in accordance with the twist angle, and F (i) derived by the following equation are used, and the i-th vertex of the first object And a vertex circulation step in which F is the F (i) vertex of the second object.
[0006]
F (i) = mod (m + i, n)
(Here, mod (X, Y) represents the remainder when X is divided by Y.)
According to the present invention, the position information deriving step derives the position information of the vertexes of the polygons of the first object and the second object. In the object connection step, the (n−1) -th vertex from the 0-th vertex included in the first joint surface of the derived position information of the vertex of the first object is changed to the second joint of the second object. From the 0th vertex included in the surface to the (n-1) th vertex, both objects are connected with a common joint surface without a gap.
[0007]
Further, according to the present invention, when a twist occurs between the first object and the second object, the vertex circulation step converts the i-th vertex of the first object to the Fth ( i) As vertices, vertices included in the joint surface of the second object are circulated corresponding to the twist.
[0008]
For example, when the first object and the second object have a regular hexagonal joint surface specified by six vertices from the 0th vertex to the 5th vertex, the object connection step causes the first object The i-th vertex and the i-th vertex of the second object coincide with each other to compose an image (i = 0,..., 5). When a 120 ° twist occurs between the first object and the second object, for example, the vertex shift number m is set to m = 2, and the i th vertex of the first object is performed by the vertex circulation step. Is used as the F (i) vertex of the second object (i = 0,..., 5).
[0009]
In this case, in the expression representing F (i), the vertex shift number is m = 2 and the vertex number n is n = 6, so each F (i) is
F (0) = mod (2 + 0,6) = 2,
F (1) = mod (2 + 1,6) = 3,
F (2) = mod (2 + 2,6) = 4,
F (3) = mod (2 + 3,6) = 5,
F (4) = mod (2 + 4,6) = 0,
F (5) = mod (2 + 5,6) = 1,
And
The 0th vertex of the first object is the second vertex of the second object,
The first vertex of the first object is the third vertex of the second object;
The second vertex of the first object is the fourth vertex of the second object;
The third vertex of the first object is the fifth vertex of the second object;
The fourth vertex of the first object is the 0th vertex of the second object,
The fifth vertex of the first object is the first vertex of the second object;
Each is redefined in a circular fashion.
[0010]
In this way, the first object and the second object can be smoothly connected without tearing, and even when a twist occurs between the first object and the second object, a natural twist is achieved. Can be corrected.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
In the process of developing an image composition device, the inventor forms two objects (parts) adjacent to each other through a joint of a display object so as to form a fixed shape as shown in FIG. It was recognized that the image display in the vicinity of the joint 10 becomes unsightly when the joint 10 moves (hereinafter referred to as “joint movement”).
[0012]
That is, when two objects 12 and 14 adjacent to each other through the joint 10 have a fixed shape, a tear 16 is formed on the outside of the joint 10 as shown in FIG. There arises a problem that one end surface of any object is exposed and an image is displayed.
[0013]
Alternatively, as shown in FIG. 1C, in a joint motion mode in which two objects 12 and 14 adjacent to each other at a joint portion overlap each other, the side surfaces of both objects intersect at the joint 10. For this reason, depending on the method of the hidden surface processing, there is a problem that the displayed side surface is frequently changed and the image display flickers.
[0014]
As described above, in any case, the image display of the joint portion is unsightly and remarkably impairs the entertainment of the image composition device. In order to solve such a problem, the present inventor has reviewed the conventional technique in which a display object is configured by a combination of only a plurality of objects having a fixed shape, and displays an image of an object whose side surface expands and contracts at a joint portion. It came to create the invention of doing.
[0015]
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0016]
FIG. 2 is a diagram illustrating an image display of joint motion of two adjacent objects using the image composition device according to the present embodiment. The two objects A and B shown in the figure are formed in a hexagonal column shape by combining 12 polygons, and are smoothly connected so that the joint surfaces 18 are the same. Then, before and after the joint motion, six polygons (hereinafter referred to as “expandable polygons”) PB0... PB5 in contact with the object A in the object B expand and contract so that the object A and the object B are in contact with each other. Note that the stretchable polygons PB3... PB5 are not shown, and the stretchable polygons PB3, PB4, and PB5 are sequentially arranged at positions facing the stretchable polygons PB0, PB1, and PB2, respectively.
[0017]
As shown in the figure, when the adjacent end surfaces of two objects are made to coincide with each other to form the joint surface 18, no tears are generated outside the joint portion during the joint movement of these objects A and B. The end face of the joint part of the object is also exposed and no image is displayed. Further, since the side surfaces constituting the two objects do not intersect each other, the hidden surface removal processing of the joint portion can be suitably performed regardless of the hidden surface removal method. The stretchable polygons PB0... PB5 are defined by a partition line 22 provided between the joint surface 18 and the other end surface 20 of the object B and provided corresponding to the joint surface 18. The dividing line 22 is provided at an intermediate position between the joint surface 18 and the other end surface 20. In this way, it is possible to prevent the entire object B from being deformed during joint movement.
[0018]
By the way, when the image processing as described above is performed indefinitely, a problem occurs when the object A and the object B perform joint motion with twisting. That is, even when the object A and the object B are in a twisted positional relationship as shown in FIG. 3A, the stretchable polygons PB0... PB5 stretch and contract so as to connect the corresponding vertices. When the twist angle is a certain value or more, for example, when the twist angle is 180 degrees as shown in FIG. 3B, there is a problem that the object B becomes thin in the middle of the stretchable polygons PB0. For this reason, this image composition device includes means for redefining the vertices included in the joint surface among the vertices of the stretchable polygons PB0... PB5 when the object A and the object B perform joint motion with a certain twist. In such a case, a suitable image display can be obtained.
[0019]
FIG. 4 is a diagram showing a configuration of the present image synthesizing apparatus capable of obtaining such an image display. The image composition apparatus shown in the figure has a storage unit 30 in which information about each display object arranged in the object space is stored. The storage unit 30 is particularly provided with the object information storage unit 32 that stores the shape information of the contour lines of the two adjacent objects described above. Specifically, in the object information storage unit 32, a basic arrangement of a plurality of polygons constituting each object is stored as coordinate information based on a predetermined origin belonging to each object, and the basic information of the object is determined by the coordinate information. A shape is specified. The shape stored here is a “basic shape”, and deformation processing or the like is performed when an image is displayed.
[0020]
In order to store this basic shape, the object information storage unit 32 stores a polygon vertex list and a polygon attribute list corresponding to each object. 5 and 6 are diagrams showing a polygon vertex list of the object A and the object B, in which vertex coordinates of polygons constituting each object and names of the vertices are stored correspondingly. Here, the names of the vertices of each object are determined as shown in FIGS. 7 and 8, the object A is designated by 18 vertices from the vertices CA0 to CA5, A0 to A11, and the object B is the vertex CB0. ... specified by 18 vertices up to CB5, B0 ... B11. Here, vertices CA0... CA5 and CB0. Stored in In addition, vertices having the same numerals attached to the symbols, such as the vertex CA0 and the vertex CB0, represent vertices whose positions should coincide with each other.
[0021]
9A and 9B, each polygon name PA0... PA11, PB0... PB11 and four vertex loops specifying each polygon, and each polygon attribute information APA0... APA11, APB0 are included in the polygon attribute list. ... APB11 is stored correspondingly. The polygon attribute information APA0... APA11, APB0... APB11 includes information on textures to be attached to the polygons PA0... PA11, PB0.
[0022]
If the polygons are designated in this way, the arrangement of the polygons can be changed and the size and shape can be changed by changing the position coordinates of the vertices specifying each polygon.
[0023]
Information regarding the object A and the object B stored as described above is subjected to predetermined arithmetic processing by the processing unit 34 (see FIG. 4) and temporarily stored. The processing unit 34 includes a position information deriving unit 36, an object connecting unit 38, a temporary storage unit 40, an image composition unit 42, and a vertex circulation unit 44.
[0024]
The position information deriving unit 36 includes the shape information of each object stored in the object information storage unit 32, and the control program for controlling the movement of each object in the object space and the operation information of the display object stored in the storage unit 30. The position coordinate information in the object space is derived by performing three-dimensional arithmetic processing such as rotation and parallel movement of the object based on the above. These pieces of information are stored in the temporary storage unit 40. At this time, the object linking unit 38 replaces the information of the vertexes CB0... CB5 of the end surface adjacent to the object A side of the object B with the information of the vertexes CA0. By storing in the unit 40, the object A and the object B are connected. The image composition unit 42 outputs image information to the display unit 46 based on the stored contents of the temporary storage unit 40 thus stored.
[0025]
FIG. 10 is a flowchart showing the processing procedure of the processing unit 34. FIG. 11 is a conceptual diagram showing the storage contents of the temporary storage unit 40 in the same process, and shows how vertex coordinates are stored aligned in a storage area. Hereinafter, a specific procedure of processing for connecting the object A and the object B will be described with reference to these drawings.
[0026]
First, an area for storing and holding the count value i is secured in a work area (register) provided in the processing unit 34, and i = 0 is stored (S1). Next, the position information deriving unit 36 reads out one of the vertex coordinates from the polygon vertex list of the object A stored in the object information storage unit 32 (S2). Further, the position information deriving unit 36 derives the position coordinates after the joint movement in the object space using the read coordinates (S3), and stores them in the area (address) corresponding to the count value i of the temporary storage unit 40. (S4). Next, based on the value of the count value i, the processing unit 34 determines whether the vertex corresponding to the read coordinates is the final data (S5). In this example, the count value i = 18 represents the final data. If it is not final data, the count value i is incremented by 1 (S6), and the coordinates of the next vertex are read (S2). The above processing is repeated until the vertex data relating to the final data is performed (S5), and when all the vertex data of the object A is read, calculated, and stored, the image composition unit 42 stores the temporary storage unit 40. Read and output image information according to the information (S7). As shown in FIG. 11A, the temporary storage unit 40 at this time stores vertex coordinates belonging to the joint surface 18 of the object A in an area corresponding to the count value i = 0 to 5, and the count value i = 6 to 18 Other vertex coordinates are stored in the area corresponding to. The stored coordinate information is continuously stored in the temporary storage unit 40 even after the information is read out.
[0027]
Thereafter, the processing unit 34 derives the twist angle of the object B with respect to the object A (S8). In the present image synthesizing apparatus, instead of calculating the exact twist angle from the viewpoint of reducing the arithmetic processing, in the range where the degree of twist of the stretchable polygons PB0... PB5 displayed by the display unit 46 is not unsightly. The twist angle θ is obtained by a simplified calculation based on the motion information of the object B with respect to the object A stored in the storage unit 30.
[0028]
If θ <60 ° is satisfied, it is considered that the twist is small, and the process for twisting is omitted, and the process proceeds to the display process of the object B (S9). Here, 60 ° is an angle determined based on the number of vertices 6 of the joint surface 18, but is determined empirically based on the display image of the stretchable polygons PB0... PB5 displayed by the display unit 46. You can also
[0029]
Next, the processing unit 34 resets the count value i as i = 6 (S10), and the position information deriving unit 36 reads the coordinates of the vertex corresponding to the count value i from the polygon vertex list of the object B (S11). The position information deriving unit 36 derives the position coordinates after the joint movement in the object space using the read coordinates (S12), and stores them in the area of the temporary storage unit 40 corresponding to the count value i (S13, see FIG. 11B). . Next, it is determined whether the data is final data based on the count value i (S14). If it is not final data, the count value i is incremented by 1 (S15). Then, the next vertex of the object B is read (S11), and the same processing is repeated until the final data (S14). Then, all vertex data of the object B are calculated and temporarily stored. That is, the vertex coordinates CA0... CA5 stored in the temporary storage unit 40 are retained as they are, and only the vertex coordinates B0... B11 belonging only to the object B are stored as vertex coordinates A0. Overwrite the area that has been changed and store it. Thereafter, the image composition unit 42 reads the temporary storage unit 40 and outputs image information according to the information (S16).
[0030]
Further, in the above processing procedure, when the twist angle does not satisfy θ <60 ° (S9), processing for twist by the vertex circulation unit 44 is performed. FIG. 12 is a flowchart showing the processing procedure of the vertex circulation unit 44. FIG. 13 is a conceptual diagram showing the storage contents of the temporary storage unit 40 in the same processing. FIG. 13A shows a state in which the vertex coordinates of the object A are aligned and stored, and FIG. The state where the coordinate information of the vertices CA0... CA5 included in the surface 18 is sequentially replaced and stored is shown. In the following, the processing procedure for twisting will be described with reference to these drawings.
[0031]
First, a quotient obtained by dividing the twist angle θ by 60 ° is derived as the vertex shift number m (S21). Thereafter, the coordinate information of the vertices CA0... CA5 included in the joint surface 18 is read and stored in the work area provided in the temporary storage unit 40 (S22). Next, the count value i is initialized as i = 0 (S23), and among the coordinate information stored in the work area of the temporary storage unit 40, F (i) = mod (m + i, 6) is determined by F ( The information related to the vertex CA (F (i)) designated by i) is stored in the area corresponding to the count value i of the temporary storage unit 40 (S24). Here, m represents the vertex shift number described above. This process is repeated while incrementing i by 1 (S25) until i = 6 is satisfied (S26).
[0032]
In this way, the steps relating to the joint surface 18 among the vertex coordinates of the object A already stored in the temporary storage unit 40 as shown in FIG. 13A through the steps S1 to S6 in FIG. 10 are circulated. Can be replaced.
[0033]
Thereafter, if the processing for storing the vertex coordinates of the object B already described is performed in the temporary storage unit 40 (FIG. 10, S10 to S16), for example, if the processing by the vertex circulation unit 44 is not performed, the vertex loop is CB0. The stretchable polygon PB0 that should have been (CA0) -CB1 (CA1) -B1-B0 is redefined as the vertex loop of CA3-CA4-B1-B0, and the twist is preferably corrected.
[0034]
As described above, the present image compositing apparatus makes the joint surface 18 of the object A and the object B coincide with each other by expanding and contracting the expansion / contraction polygons PB0. We have succeeded in connecting both objects easily without tearing. Furthermore, even when a twist occurs between the object A and the object B, the problem associated with the twist is solved by a method with a relatively small image processing load in which the vertices included in the joint surface 18 are circulated and replaced. Has succeeded. Therefore, the present invention is particularly effective in that it is possible to perform simple image processing of a joint portion in an image composition device such as a three-dimensional game device in which high-speed image processing is required rather than realness of display image quality.
[0035]
The above embodiment can be modified in various ways. For example, even when three or more objects are connected to perform joint motion, it is possible to display an image so that the end faces coincide with each other by repeating the above-described processing.
[0036]
In addition, if the object A and the object B are subjected to smooth shading following the above-described processing in this image composition device, a more natural image can be obtained even when twisting occurs between the two objects.
[0037]
[Brief description of the drawings]
FIG. 1A, FIG. 1B, and FIG. 1C are diagrams showing problems in the development process of an image composition device according to the present invention.
FIG. 2 is a diagram illustrating an image display of joint motion of two adjacent objects using the image composition device according to the embodiment.
FIG. 3A and FIG. 3B are diagrams showing problems in the development process of the image composition device according to the present invention.
FIG. 4 is a diagram illustrating a configuration of an image composition device according to an embodiment.
FIG. 5 is a diagram showing a polygon vertex list of an object A.
6 is a diagram illustrating a polygon vertex list of an object B. FIG.
FIG. 7 is a diagram showing names of vertices of an object A.
FIG. 8 is a diagram showing names of vertices of an object B.
9A and 9B are diagrams showing polygon attribute lists of objects A and B. FIG.
FIG. 10 is a flowchart illustrating a processing procedure of the image composition device according to the embodiment.
FIGS. 11A and 11B are conceptual diagrams illustrating storage contents of a temporary storage unit of the image composition apparatus according to the embodiment.
FIG. 12 is a flowchart illustrating a processing procedure of the image composition device according to the embodiment.
13A and 13B are conceptual diagrams illustrating the contents stored in a temporary storage unit of the image composition apparatus according to the embodiment.
[Explanation of symbols]
Object A (first object)
Object B (second object)
18, 100 Joint surface 32 Object information storage unit (object information storage unit)
36 Location information deriving unit (location information deriving means)
38 Object connection part (object connection means)
44 Vertex circulation part (vertex circulation means)

Claims (2)

An image composition method for displaying a joint motion performed by a first object and a second object adjacent to each other among a plurality of objects formed by combining polygons specified by vertices arranged in an object space,
Forming the first object in proximity to the second object so as to include a first joint surface identified by n vertices from the 0th vertex to the (n-1) th vertex;
Forming the second object so as to include a second joint surface specified by n vertices from the 0th vertex to the (n-1) th vertex in the vicinity of the first object;
Position information deriving step for deriving position information of vertices of the polygons constituting the first and second objects before and after the joint movement;
An object connection step from the 0th vertex of the first object to the (n−1) th vertex, respectively, from the 0th vertex of the second object to the (n−1) th vertex;
When a given twist occurs in the first object and the second object during the joint movement, the vertex shift number m, which is an integer that increases or decreases according to the twist angle, is derived from the following equation: A vertex circulation step using F (i) to set the i th vertex of the first object as the F (i) vertex of the second object;
An image composition method comprising:
F (i) = mod (m + i, n) (where mod (X, Y) represents the remainder when X is divided by Y). An image composition device that displays a real-time image of joint movement performed by a first object and a second object adjacent to each other among a plurality of objects that are arranged in an object space and combined with a polygon specified by a vertex,
The first object includes a first joint surface specified by n vertices from the 0th vertex to the (n-1) th vertex in proximity to the second object,
The second object includes a second joint surface specified by n vertices from the 0th vertex to the (n−1) th vertex in proximity to the first object,
Position information deriving means for deriving position information of vertices of the polygons constituting the first and second objects before and after the joint movement;
Object connecting means for setting the (n−1) th vertex from the 0th vertex of the first object to the (n−1) th vertex from the 0th vertex of the second object;
When a given twist occurs in the first object and the second object during the joint movement, the vertex shift number m, which is an integer that increases or decreases according to the twist angle, is derived from the following equation: A vertex circulation means that uses F (i) to make the i th vertex of the first object the F (i) vertex of the second object;
An image composition apparatus comprising:
F (i) = mod (m + i, n) (where mod (X, Y) represents the remainder when X is divided by Y).

Images