JP6454671B2 - Image processing apparatus, image processing method, program, and recording medium - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, a program, and a recording medium, and more particularly to an image processing technique of 3DCG (Three-Dimensional Computer Graphics).

3DCG is used as a visualization expression method in various fields such as games and movies. 3DCG is produced by at least the following processes.
Modeling: Create object shapes in a virtual 3D space.
Scene layout setting: An object is placed in a virtual three-dimensional space.
Rendering: Calculates the shape and position of an object, how light strikes, etc., and generates a final image that should be captured by a virtual camera.

  Since production of such 3DCG is performed in collaboration with a huge number of CG artists, a production system that can efficiently perform the work is desired (for example, see Patent Document 1).

JP 2009-201111 A

  Conventionally, when 3DCG such as a mountain forest is produced, objects of basic materials such as terrain meshes and buildings are created and arranged, and then objects of detailed materials such as trees and detail textures are imported and arranged.

  For this reason, for example, when an imported tree object is arranged so as to overlap a building object, the tree object must be created so as to avoid the building object. In addition, when a change occurs in a building object, a tree object must be recreated, which requires a huge amount of work.

  The present invention solves the above-described problems in the prior art, and provides an image processing apparatus, an image processing method, a program, and a recording medium that can efficiently produce 3DCG.

In order to solve the above-described problem, an image processing apparatus according to the present invention includes an operation input unit that receives an input operation to a first object or a second object arranged in a virtual three-dimensional space , and a virtual three-dimensional space. An object processing unit that processes the first object or the second object disposed in the virtual object, an overlap detection unit that detects a collision between the first object and the second object in the virtual three-dimensional space, When a collision is detected by the overlap detection unit, an object deformation unit that deforms the first object so as to avoid a collision with the second object, and the first that is disposed in the virtual three-dimensional space. provided with an object and the second object and draws an, the overlap detection unit, every time the input operation in the operation input unit Each time the processing in fine the object processing unit, for detecting a collision between the second object and the first object.

The image processing method according to the present invention includes an operation input step for receiving an input operation to the first object or the second object arranged in the virtual three-dimensional space, and the first input arranged in the virtual three-dimensional space. an object processing step for processing the object or second object, the first object in the virtual three-dimensional space and the detection step overlap detecting a collision between the second object, the collision in the overlap detecting step If detected, an object deformation step for deforming the first object so as to avoid a collision with the second object ; the first object disposed in the virtual three-dimensional space; and the second object A drawing step of drawing an object, and in the overlap detection step, the operation input step Each of the processing in each case and the object processing step of the input operation in the flop, detects a collision between the second object and the first object.

  According to the present invention, 3DCG can be produced efficiently because real-time processing for instantly drawing collision avoidance of the first object can be performed.

FIG. 1 is a block diagram illustrating a functional configuration of the image processing apparatus according to the first embodiment. FIG. 2 is a block diagram illustrating a hardware configuration for demonstrating the functions of the image processing apparatus. FIG. 3A to FIG. 3I are diagrams illustrating examples of tree images. FIG. 4 is a flowchart for explaining the image processing shown as the first specific example. FIG. 5A is a diagram illustrating an example of a tree image, and FIG. 5B is a diagram illustrating an example of a tree image in which rocks are arranged in the vicinity of the tree. FIG. 6A is a diagram illustrating an example of a tree image, and FIG. 6B is a diagram illustrating an example of a tree image in which a tetrahedron is arranged above a tree. FIG. 7 is a block diagram illustrating a functional configuration of the image processing apparatus according to the second embodiment. FIG. 8 is a flowchart for explaining the image processing shown as the second specific example. FIG. 9A is a diagram showing an example of a pre-growth tree image arranged under the arch, and FIG. 9B is a diagram showing an example of a tree image after growth arranged under the arch. is there. FIG. 10A is a diagram illustrating an example of a tree image in which a chair having a suction force is disposed far away, and FIG. 10B illustrates an example of a tree image in which a chair having a suction force is disposed in the vicinity. FIG.

Hereinafter, embodiments of the present invention (hereinafter referred to as the present embodiment) will be described in detail in the following order with reference to the drawings. It should be noted that the present invention is not limited to the following embodiments, and various modifications can be made without departing from the scope of the present invention.
1. First Embodiment 2. FIG. Second embodiment

<1. First Embodiment>
[1.1 Functional configuration]
FIG. 1 is a block diagram illustrating a functional configuration of the image processing apparatus according to the first embodiment. The image processing apparatus 1 according to the first embodiment includes an operation input unit 11 that receives an input operation to a first object or a second object arranged in a virtual three-dimensional space, and a first in the virtual three-dimensional space. An overlap detection unit 12 that detects an overlap between the object and the second object, and an object deformation that deforms the first object so as to avoid the second object when the overlap detection unit 12 detects an overlap. Unit 13 and a drawing unit 14 for drawing the first object and the second object arranged in the virtual three-dimensional space. The overlap detection unit 12 performs the first operation every time an input operation is performed in the operation input unit 12. The overlap between the object and the second object is detected. As a result, real-time processing (real-time processing) can be performed in which an image in which the first object has avoided collision is immediately drawn, and 3DCG can be produced efficiently.

  The first object is preferably an object made of a detailed material such as a tree or a detail texture, and the second object is preferably an object of a basic model such as a terrain mesh or a building. Thereby, for example, a CG artist can easily perform arrangement of trees around a building.

  The operation input unit 11 reads 3D image data and receives an input operation to the first object or the second object arranged in the virtual three-dimensional space. As a method for expressing the three-dimensional image data, a polygon model, a point cloud model, a volumetric model, a parametric curved surface model, or the like can be used.

  The overlap detection unit 12 detects the overlap between the first object and the second object arranged in the virtual three-dimensional space each time an input operation is performed in the operation input unit 12. As a method for detecting the overlap between the first object and the second object in the overlap detection unit 12, detection is performed by a hit determination (collision determination) program for determining whether an object hits another object (collision). can do. For example, the coordinates of each object are analyzed to generate outline information of each object, and the overlap is detected by comparing the outline information of the first object and the outline information of the second object.

  When the overlap detector 12 detects an overlap, the object deforming unit 13 deforms the first object so as to avoid the second object. The deformation of the first object is performed according to the type of the first object. For example, when the first object is a tree model including a trunk and a branch, the object deforming unit 13 collides with the second object by deforming at least one of the trunk and the branch of the tree model. To avoid.

  The drawing unit 14 draws the first object and the second object arranged in the virtual three-dimensional space according to the position and direction information of the camera (viewpoint) corresponding to the display screen.

  According to the image processing apparatus 1 described above, for example, when an object of a detailed material such as a tree or a detail texture is arranged so as to overlap an object of a basic model such as a terrain mesh or a building, the object of the detailed material is the basic model. It is transformed to avoid collisions with other objects and rendered immediately. Therefore, it is not necessary to create a detailed material object that avoids collision as in the past, and it is not necessary to recreate the detailed material object when the basic model object changes. 3DCG can be produced.

[1.2 Hardware configuration]
FIG. 2 is a block diagram illustrating a hardware configuration for demonstrating the functions of the image processing apparatus. As illustrated in FIG. 2, the image processing apparatus 2 includes a CPU (Central Processing Unit) 21 that performs program execution processing, a GPU (Graphics Processing Unit) 22 that performs 3DCG arithmetic processing, and a program executed by the CPU 21. ROM (Read Only Memory) 23 for storing, RAM (Random Access Memory) 24 for developing programs and data, an operation input unit 25 for receiving various input operations by the user, and storage for permanently storing programs and data 26 and an input / output interface 27 for inputting / outputting data. That is, the image processing apparatus 2 shown in FIG. 2 is a so-called computer.

  The CPU 21 can perform processing of the overlap detection unit 12 and the object deformation unit 13 in the image processing apparatus 1 shown in FIG. 1, detects the overlap between the first object and the second object in the virtual three-dimensional space, The first object is deformed so as to avoid the second object.

  Further, the CPU 21 controls the operation of each block included in the image processing apparatus 2. Specifically, the CPU 21 controls the operation of each block by reading out an operation program for image processing recorded in, for example, the ROM 23, developing it in the RAM 24 and executing it.

  For example, the CPU 21 executes a game engine and sequentially generates a drawing command (t) at time t. Examples of the drawing command include a viewpoint setting command for a three-dimensional model of an object, a vertex calculation program, a pixel calculation program, and vertex data.

  The GPU 22 can perform the processing of the drawing unit 13 in the image processing apparatus 1 shown in FIG. 1, and the first object and the second object in the virtual three-dimensional space are displayed at the position of the camera (viewpoint) corresponding to the display screen. And drawing according to direction information. The GPU 22 has a video memory (VRAM) as a drawing area of the display screen, and draws an object in the VRAM according to a drawing command from the CPU 21. Specifically, the GPU 22 generates polygon rasterized data using the geometry data in accordance with the shader program, and stores the image data in the VRAM. Further, the GPU 22 maps the texture onto the polygon surface and stores the image data after the texture mapping in the VRAM. The GPU 22 can calculate and recalculate these drawing processes for each frame.

  The ROM 23 is a non-volatile memory that can only be read, for example. The ROM 24 stores information such as constants necessary for the operation of each block of the image processing apparatus 2 in addition to an operation program such as image processing.

  The RAM 24 is a volatile memory. The RAM 24 is used not only as an operation program development area, but also as a storage area for temporarily storing intermediate data output in the operation of each block of the image processing apparatus 2.

  The operation input unit 25 is a user interface that can process the operation input unit 11 in the image processing apparatus 1 shown in FIG. 1 and is used when performing an input operation on the image processing apparatus 2. The operation input unit 25 outputs an instruction to execute or stop image processing to the CPU 21 in accordance with a user input operation. Further, the operation input unit 25 can operate the main character that can be operated by the controller.

  The storage 26 records an operation program developed in the RAM 24, model data, texture data, setting parameters, and the like for an object drawn on the screen. As the storage 26, a hard disk drive (HDD), a solid state drive (SSD), an optical drive, or the like can be used.

  The input / output interface 27 can output an image generated by the GPU 22 to a display device.

  In such a hardware configuration, the functional blocks of the image processing apparatus 1 shown in FIG. 1 can be realized by cooperation of the CPU 21, GPU 22, ROM 23, RAM 24, and software executed by the CPU 21. Further, the above-described functional blocks can be realized only by hardware, only software, or a combination thereof. Further, the software program may be stored via a recording medium such as an optical disk or a semiconductor memory and distributed, or may be downloaded via the Internet or the like.

[1.3 Specific Example 1]
Hereinafter, a tree model composed of roots, trunks, branches, and leaves will be described as an example of the first object. The tree model includes a root extending downward from the ground, a trunk extending upward from the ground, a branch branched from the trunk, and a leaf attached to the branch. A branch structure that branches sequentially from a tree trunk to a branch and from a branch to another branch can be expressed by, for example, an algorithm of an L system (Lindenmayer system). The L system is an algorithm that can describe and express a tree growth process, and can express tree growth by repeatedly performing recursive processing.

  For example, the branch is generated based on the above-described L system by a vector operation using tree properties, tree characteristics, random numbers, and the like. The nature of the tree includes, for example, sunshine, branch death, dormancy breaking, apical dominance, and branch stemming. Hinata is a property in which the growth point of a branch bends toward sunlight. The withering of a branch is a property that a branch withers off. Dormancy breakage is the property of germinating dormant buds that have ceased activity. The top bud dominance is a property that the elongation of the top bud is larger than that of the side bud. Branch stemming is an antigravity tropism. The tree characteristics include, for example, branch thickness, branch length, branch length reduction rate, branch generation, branch reduction rate due to branch generation increase, branch strength, tree life. Parameters such as energy can be used. In addition, diversity can be given to trees by introducing random numbers into parameters such as the thickness of branches.

  In addition, for example, branch generation is performed by setting a permission area and a prohibition area with respect to the generation direction of the first generation of branches and determining the generation direction of branches after the second generation within the permission area. Done. The branch generation process can also be applied to a trunk generation process, a root generation process, and the like.

  FIG. 3A to FIG. 3I are diagrams illustrating examples of tree images. As shown in FIG. 3 (A) to FIG. 3 (I), by using the nature of the tree, the characteristics of the tree, random numbers, etc., setting the permission area and the prohibition area for the generation direction of the first generation of branches, etc. Can reproduce a variety of trees.

  FIG. 4 is a flowchart for explaining the image processing shown as the first specific example. The image processing shown as the specific example 1 can be provided as a plug-in function incorporated in 3DCG software executed by the CPU 21 of the image processing apparatus 2 described above, for example.

  First, in the operation input step S11, the operation input unit 25 receives an input operation to a tree object that is a first object arranged in the virtual three-dimensional space or another object that is a second object. Examples of the input operation include insertion and movement of an object. The other object may be a tree or a building other than a tree.

  In the overlap detection step S12, the CPU 21 detects an overlap between the tree object and another object in the virtual three-dimensional space. As an overlap detection method, it can be detected by a hit determination (collision determination) program for determining whether a tree object hits another object (collision). For example, it analyzes the coordinates of tree objects and other objects to generate outline information for each object, and detects overlap by comparing the outline information of tree objects with the outline information of other objects. .

  In the object deformation step S13, when the overlap is detected in the overlap detection step S12, the CPU 21 deforms the tree object so as to avoid other objects. As a method for transforming a tree object, for example, based on comparison information comparing the outline information of a tree object with the outline information of another object, a plurality of nodes composed of cylinders constituting the trunk of the tree can be used. You may change the angle. Also, for example, based on the comparison information comparing the outline information of the tree object and the outline information of other objects, the setting of the permitted area and the prohibited area is set for the generation direction of the first generation of branches. It is possible to generate a tree by determining the generation direction of branches after the second generation within the permitted area. Moreover, based on the comparison information comparing the outline information of the object of the tree and the outline information of the other object, a plurality of tree parameter sets in which the permitted area and the prohibited area are set in advance are recorded. You may select the parameter set of the tree in which the permission area | region and the prohibition area | region were set beforehand.

  In the drawing step S14, the GPU 22 draws the tree object and other objects arranged in the virtual three-dimensional space in accordance with the position and direction information of the camera (viewpoint) corresponding to the display screen. For example, the GPU 22 receives a drawing command including conditions necessary for avoiding other objects from the CPU 21, performs tree generation processing, and stores image data in which the tree objects avoid other objects in the video memory of the GPU 22. Store.

  FIG. 5A is a diagram illustrating an example of a tree image, and FIG. 5B is a diagram illustrating an example of a tree image in which rocks are arranged in the vicinity of the tree. Such a deformation of the tree object 51 is, for example, based on comparison information obtained by comparing the outline information of the tree object 51 and the outline information of the rock object 52, and a plurality of cylinders constituting the trunk of the tree. This can be realized by changing the angle with respect to the nodes.

  FIG. 6A is a diagram illustrating an example of a tree image, and FIG. 6B is a diagram illustrating an example of a tree image in which a tetrahedron is arranged above a tree. Such deformation of the tree object 61 is, for example, based on comparison information comparing the outline information of the tree object 61 and the outline information of the tetrahedral object 62, and the generation direction of the first generation of branches. On the other hand, it is possible to realize by setting a permission area and a prohibition area, determining a generation direction of branches after the second generation in the permission area, and generating a tree.

  As described above, by changing the shape of the tree according to the surrounding objects in real time, the burden on the CG artist can be reduced and the work efficiency of the CG artist can be improved.

  In the first embodiment, 3DCG production has been described as an example. However, the present invention is not limited to this, and can be applied to, for example, a 3DCG game. When applied to a 3DCG game, for example, by making the second object a hero's game character that can be operated by a controller, it is possible to render in real time a scene where the game character knocks down the tree that is the first object It becomes.

<2. Second Embodiment>
[2.1 Functional configuration]
FIG. 7 is a block diagram illustrating a functional configuration of the image processing apparatus according to the second embodiment. The image processing apparatus 3 according to the second embodiment is obtained by adding an object processing unit 15 to the image processing apparatus 1 according to the first embodiment. Note that the same components as those of the image processing apparatus according to the first embodiment are denoted by the same reference numerals, and description thereof is omitted here.

  As shown in FIG. 7, the image processing apparatus 3 includes an operation input unit 11 that receives an input operation to the first object or the second object arranged in the virtual three-dimensional space, and the virtual processing unit 3 arranged in the virtual three-dimensional space. The overlap is detected by the object processing unit 15 that processes the first object, the overlap detection unit 12 that detects the overlap between the first object and the second object in the virtual three-dimensional space, and the overlap detection unit 12 In this case, an object deforming unit 13 that deforms the first object so as to avoid the second object, and a drawing unit 14 that draws the first object and the second object arranged in the virtual three-dimensional space are provided. The overlap detection unit 12 detects an overlap between the first object and the second object every time the object processing unit 15 performs processing. Is shall. As a result, even when the first object or the second object is processed, real-time processing (real-time processing) in which an image in which the first object avoids collision can be immediately drawn can be performed, and 3DCG can be efficiently performed. Can be produced.

  The object processing unit 15 processes the first object or the second object arranged in the virtual three-dimensional space. Examples of the processing of the object include changing the size of the object and changing the vector direction.

  For example, as an example of changing the size of the object, when the first object is a tree model including a trunk and a branch, the object processing unit 15 can grow the tree model. As a result, it can be confirmed how the tree model avoids the second object and grows, and the working efficiency of the CG artist can be improved.

  Further, for example, as an example of changing the vector direction of an object, when the first object is a tree model including a trunk and a branch, the object processing unit 13 selects at least one of the trunk and the branch of the tree model. For example, a suction object to be sucked may be arranged. Thereby, for example, a scene in which a tree model is sucked into a cavity in a virtual three-dimensional space can be confirmed while avoiding the second object, and the working efficiency of the CG artist can be improved.

[2.2 Hardware configuration]
The hardware configuration for demonstrating the function of the above-described image processing apparatus 3 is the same as the block diagram shown in FIG. The functions of the object processing unit 15 in the image processing apparatus 3 illustrated in FIG. 7 are achieved by the CPU 21 and the GPU 22. For example, the GPU 22 draws the processing object in the VRAM in accordance with the processing command from the CPU 21. The other hardware configuration is the same as that of the block diagram shown in FIG.

[2.3 Specific Example 2]
Hereinafter, as the first object, a tree model composed of roots, trunks, branches, and leaves will be described as an example. Since the tree model is the same as in the first specific example, the description thereof is omitted here.

  FIG. 8 is a flowchart for explaining the image processing shown as the second specific example. The image processing shown as the specific example 2 can be provided as, for example, a plug-in function incorporated in 3DCG software executed by the CPU 21 of the image processing apparatus 2 described above.

  First, in the object processing step S21, the operation input unit 25 receives a processing operation for a tree object that is a first object arranged in the virtual three-dimensional space or another object that is a second object. Examples of the processing operation include changing the size of the tree object or the second object, changing the vector direction, and the like. The other object may be a tree or a building other than a tree.

  As an example of changing the size of the tree object, the tree object may be grown. The growth of a tree object can be controlled using, for example, a life energy parameter related to the growth rate. Thereby, it can be confirmed how the tree model avoids other objects and grows, and the working efficiency of the CG artist can be improved.

  As an example of changing the vector direction of a tree, a suction object that sucks a tree object may be arranged, and a vector of a tree branch may be directed to the suction object. Thereby, for example, a scene where a tree model is sucked into a cavity in a virtual three-dimensional space can be confirmed while avoiding other objects, and the working efficiency of the CG artist can be improved.

  Since the next overlap detection step S22, object deformation step S23, and drawing step S24 are the same as the above-described detection step S12, object deformation step S13, and drawing step S14, respectively, description thereof is omitted here.

  FIG. 9A is a diagram showing an example of a pre-growth tree image arranged under the arch, and FIG. 9B is a diagram showing an example of a tree image after growth arranged under the arch. is there. Even when the tree object 91 is grown in this way, the tree object 91 can avoid the arch 92, and thus how the tree object 91 avoids the arch 92 and grows. As a result, the working efficiency of the CG artist can be improved.

  FIG. 10A is a diagram illustrating an example of a tree image in which a chair having a suction force is arranged far away, and FIG. 10B is an example of a tree image in which a chair having a suction force is disposed in the vicinity. FIG. Thus, even when the chair object 102 having suction power is arranged in the vicinity of the tree object 101, it is possible to confirm the state in which the tree object 101 avoids the chair object 1010. Work efficiency can be improved.

  As described above, even when a tree object is processed, the tree object changes in real time while avoiding surrounding objects, so the burden on the CG artist is reduced and the work efficiency of the CG artist is improved. be able to.

  In the second embodiment, 3DCG production has been described as an example. However, the present invention is not limited to this, and can be applied to a 3DCG game, for example. For example, with the passage of time on the game, a more realistic world can be realized by growing tree objects while avoiding surrounding objects.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus, 2 Image treatment apparatus, 11 Operation input part, 12 Overlap detection part, 13 Object deformation | transformation part, 14 Drawing part, 15 Object processing part, 21 CPU, 22 GPU, 23 ROM, 24 RAM, 25 Operation input part , 26 storage, 27 I / O interface

Claims (7)

An operation input unit for receiving an input operation to the first object or the second object arranged in the virtual three-dimensional space;
An object processing unit that processes the first object or the second object arranged in the virtual three-dimensional space;
An overlap detection unit for detecting a collision between the first object and the second object in the virtual three-dimensional space;
An object deforming unit that deforms the first object so as to avoid a collision with the second object when a collision is detected by the overlap detection unit;
A drawing unit that draws the first object and the second object arranged in the virtual three-dimensional space;
An image processing apparatus in which the overlap detection unit detects a collision between the first object and the second object each time an input operation is performed in the operation input unit and each time processing is performed in the object processing unit. The first object is a tree model including a trunk and a branch;
The image processing apparatus according to claim 1, wherein the object deforming unit deforms at least one of a trunk and a branch of the tree model. The first object is a tree model including a trunk and a branch;
The object processing unit, an image processing apparatus according to claim 1, wherein for growing the tree model. The first object is a tree model including a trunk and a branch;
The object processing unit, an image processing apparatus according to claim 1 wherein placing a suction objects for sucking at least one of the stem and branches of the tree model. An operation input step for receiving an input operation to the first object or the second object arranged in the virtual three-dimensional space;
An object processing step of processing the first object or the second object arranged in the virtual three-dimensional space;
An overlap detection step of detecting a collision between the first object and the second object in the virtual three-dimensional space;
An object deformation step of deforming the first object so as to avoid a collision with the second object when a collision is detected in the overlap detection step;
A drawing step of drawing the first object and the second object arranged in the virtual three-dimensional space;
In the overlap detection step, an image processing method for detecting a collision between the first object and the second object each time an input operation is performed in the operation input step and each time processing is performed in the object processing step . An operation input step for receiving an input operation to the first object or the second object arranged in the virtual three-dimensional space;
An object processing step of processing the first object or the second object arranged in the virtual three-dimensional space;
An overlap detection step of detecting a collision between the first object and the second object in the virtual three-dimensional space;
An object deformation step of deforming the first object so as to avoid a collision with the second object when a collision is detected in the overlap detection step;
A drawing step of drawing the first object and the second object arranged in the virtual three-dimensional space;
In the overlap detection step, a program for causing a computer to execute image processing for detecting a collision between the first object and the second object each time an input operation is performed in the operation input step and each time processing is performed in the object processing step. . A recording medium on which the program according to claim 6 is recorded.