JP4637161B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention provides an image processing apparatus, an image processing method, and a computer that are suitable for presenting an expression of a specific character in an easy-to-see manner when generating an image of a character placed in a virtual space. Related to the program.

As a method for easily displaying the facial expressions of characters arranged in a virtual space, a method of cutting in an image corresponding to the character on the screen is known separately from the character displayed on the screen. In this method, a second virtual space different from the virtual space in which the character is arranged is provided, and a second character or the like is provided in the second virtual space, whereby an image on which the second character is displayed is displayed. Generate. Then, an image in which the character and the second character are displayed is generated by cutting in the image in which the second character is displayed on the image in which the character is displayed (for example, Patent Documents). 1).
JP 2006-263122 A

  In the configuration disclosed in Patent Document 1, it is necessary to newly provide a second virtual space or the like in order to generate an image used for cut-in. In addition, since a predetermined image generated by providing a second character or the like is used, the usage capacity of a VRAM (Video Random Access Memory) has increased. As a result, there are many cases where it cannot be used depending on the application and the performance of the apparatus. Accordingly, there is a need for a new method that is suitable for easily displaying a facial expression of a specific character when generating an image of a character placed in the virtual space.

  The present invention has been made in view of the above problems, and an image processing apparatus and an image suitable for presenting a facial expression of a specific character in an easy-to-see manner when generating an image of a character placed in a virtual space. An object of the present invention is to provide a processing method and a program for realizing the processing method on a computer.

  In order to achieve the above object, an image processing apparatus according to a first aspect of the present invention includes a storage unit, a generation arrangement unit, and an image generation unit.

  First, the storage unit stores the shape, position and orientation of the first character and the second character arranged in the virtual space, the position of the viewpoint arranged in the virtual space, and the direction of the coordinate axis fixed to the viewpoint. And memorize.

  The generating and arranging unit generates the second character by performing similarity conversion on the shape of the first character at a predetermined enlargement / reduction ratio, and the second character is set at a predetermined position on the coordinates defined by the coordinate axes. To place.

  The image generation unit generates an image in which the virtual space in which the first character and the second character are arranged is viewed in a predetermined direction from the viewpoint position.

  With these configurations, when an image of a character arranged in the virtual space is generated, an image that presents the facial expression of a specific character in an easy-to-see manner can be generated. For example, by generating and arranging the second character at a position between the first character and the viewpoint (camera), an image in which the first character and the second character are displayed can be generated. The second character is arranged closer to the viewpoint than the first character. Therefore, it is possible to present the facial expression of the second character in the image in an easy-to-see manner. Further, by enlarging the shape of the second character to be generated and arranged, it is possible to generate an image that presents the expression of the second character in an easy-to-see manner.

The generating and arranging unit may arrange the second character so that the orientation of the second character is a predetermined orientation on the coordinates defined by the coordinate axes.
With these configurations, the facial expression of the second character can be presented in an easy-to-see manner. For example, an image showing the front of the second character can be generated by placing the viewpoint at a position on the vector facing the front of the second character.

The storage unit is further disposed in the virtual space and further stores the position and orientation of the illumination that illuminates the first character and the second character,
The generation arrangement unit arranges the illumination at a position between the position of the viewpoint and the position of the second character,
The image generation unit may generate an image in which the illumination illuminates the first character and the second character.
With these configurations, an image in which the second character is illuminated from the first character can be generated, so that the facial expression of the second character can be presented in an easy-to-see manner.

The storage unit further stores the position, orientation, and luminous intensity of the first illumination and the second illumination,
The generation arrangement unit makes the luminous intensity of the first illumination higher than the luminous intensity of the second illumination, arranges the first illumination in a predetermined direction at a predetermined position, and places the second illumination on the viewpoint It is also possible to place the second character in a direction to illuminate the second character at a position between the position of the second character and the position of the second character.
With these configurations, since the second character with high luminous intensity illuminates the second character, the second character can be emphasized compared to the first character, so that the expression of the second character can be presented in an easy-to-see manner. Can do. For example, the entire virtual space, the first character, and the second character are emphasized by omnidirectional (nondirectional) first illumination. An image in which the second character is emphasized more than the first character by arranging the second illumination having directivity with a higher luminous intensity than the first illumination at a position around the second character and toward the character. Can be generated.

The storage unit further stores the positions of the first viewpoint and the second viewpoint arranged in the virtual space, and the direction of the coordinate axis fixed to the viewpoint,
The image generation unit may generate an image of a predetermined part of the second character from the position of the second viewpoint.
With these configurations, for example, by generating an image of the head (face part) of the second character, the facial expression of the second character can be presented in an easily viewable manner.

The image generation unit makes an image of the predetermined part of the second character smaller than the image of the first character, and the image of the first character and the image of the predetermined part of the second character It is also possible to synthesize.
With these configurations, for example, by combining an image displaying the entire first body (whole body) and an image displaying the head of the second character, it is easy to see the facial expression of the second character. Can be presented.

The generation arrangement unit arranges the second viewpoint and the second character at a position corresponding to a distance proportional to a distance between the position of the first viewpoint and the position of the first character,
The image generation unit may generate an image of a predetermined portion of the second character having a size corresponding to the distance between the position of the second viewpoint and the position of the second character.
With these configurations, for example, by increasing the size of the image on which the head of the second character is displayed as the distance between the position of the second viewpoint and the position of the second character is closer, Can be presented in an easy-to-see manner.

  In order to achieve the above object, an image processing method according to a second aspect of the present invention is an image processing method executed by an image processing apparatus having a storage unit, a generation arrangement unit, and an image generation unit. A generating and arranging step and an image generating step.

In the generating and arranging step, the shape of the first character is subjected to similarity conversion at a predetermined enlargement / reduction ratio to generate the second character, and the second character is set to a predetermined position on the coordinates defined by the coordinate axes. To place.
In the image generation step, an image is generated in which the virtual space in which the first character and the second character are arranged is viewed in a predetermined direction from the viewpoint position.

  In order to achieve the above object, a program according to a third aspect of the present invention is configured to cause a computer to function as the above image processing apparatus. A program according to the third aspect of the present invention is configured to cause a computer to execute the above-described image processing method.

  The program of the present invention can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory. The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  ADVANTAGE OF THE INVENTION According to this invention, when producing | generating the image of the character arrange | positioned in virtual space, it can show easily the facial expression etc. of a specific character.

(Embodiment 1)
FIG. 1 is a schematic diagram showing a schematic configuration of a typical game device in which an image processing device according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The game apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, a controller 105, an external memory 106, and a DVD (Digital Versatile Disk). ) -ROM drive 107, image processing unit 108, audio processing unit 109, and NIC (Network Interface Card) 110.

  Note that a DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 107 and the game apparatus 100 is turned on to execute the program, and the image processing apparatus of the present embodiment is Realized.

  The CPU 101 controls the overall operation of the game apparatus 100 and is connected to each component to exchange control signals and data.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on, and the CPU 101 reads the program recorded on the DVD-ROM into the RAM 103 and executes it. The ROM 102 stores an operating system program and various data necessary for operation control of the entire game apparatus 100, and the CPU 101 reads and executes these programs.

  The RAM 103 is for temporarily storing data and programs, and holds programs and data read from the DVD-ROM and other data necessary for the progress of the game.

  The controller 105 connected via the interface 104 receives an operation input performed when the user executes the game. For example, the controller 105 includes an A button, a B button, an X button, a Y button, direction buttons (direction keys) indicating four directions, and the like. When these buttons are pressed by the user, an operation input corresponding to the pressed button is accepted.

  In the external memory 106 detachably connected via the interface 104, data indicating the progress of the game, communication log (record) data, and the like are stored in a rewritable manner. The user can record these data in the external memory 106 as appropriate by inputting an instruction via the controller 105.

  A DVD-ROM mounted on the DVD-ROM drive 107 stores a program for realizing the game and image data and sound data associated with the game. Under the control of the CPU 101, the DVD-ROM drive 107 performs a reading process on the DVD-ROM loaded therein, reads out necessary programs and data, and these are temporarily stored in the RAM 103 or the like.

  The image processing unit 108 processes the data read from the DVD-ROM by the CPU 101 or an image arithmetic processor (not shown) included in the image processing unit 108, and then processes the processed data in a frame memory (see FIG. (Not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing and output to a monitor (not shown) connected to the image processing unit 108. Thereby, various image displays are possible.

The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed.
In addition, the polygon information arranged in the virtual three-dimensional space and added with various texture information is rendered by the Z buffer method, and a rendering image obtained by overlooking the polygon arranged in the virtual three-dimensional space from a predetermined viewpoint position is obtained. High speed execution of the obtained operation is also possible.

  In addition, the CPU 101 and the image arithmetic processor can cooperate to draw a character string as a two-dimensional image in a frame memory or draw on the surface of each polygon according to font information that defines the character shape. It is. The font information is recorded in the ROM 102, but dedicated font information recorded in the DVD-ROM can also be used.

  The audio processing unit 109 converts audio data read from the DVD-ROM into an analog audio signal, and outputs the analog audio signal from a speaker (not shown) connected thereto. In addition, under the control of the CPU 101, sound effects and music data to be generated during the progress of the game are generated, and the corresponding sound is output from the speaker.

  The NIC 110 is for connecting the game apparatus 100 to a computer communication network (not shown) such as the Internet, and conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Analog modems for connecting to the Internet using telephone lines, ISDN (Integrated Services Digital Network) modems, ADSL (Asymmetric Digital Subscriber Line) modems, cable modems for connecting to the Internet using cable television lines And an interface (not shown) that mediates between these and the CPU 101.

In addition, the game apparatus 100 is configured to perform the same function as a DVD-ROM or the like mounted on the ROM 102, RAM 103, external memory 106, DVD-ROM drive 107, using a large-capacity external storage device such as a hard disk. May be.
In addition, it is possible to adopt a form in which an input / output device such as a keyboard for receiving a character string editing input from a user and a mouse for receiving various position designations and selection inputs is connected.

  Further, instead of the game apparatus 100 of the present embodiment, a general computer (general-purpose personal computer or the like) can also be used as the image processing apparatus according to the present invention. For example, a general computer, like the game device 100, includes a CPU, RAM, ROM, DVD-ROM drive, and NIC, and includes an image processing unit that has simpler functions than the game device 100. In addition to having a hard disk as an external storage device, a flexible disk, a magneto-optical disk, a magnetic tape, and the like can be used. In addition, a keyboard, a mouse or the like is used as an input device instead of a controller. Then, after the game program is installed, when the program is executed, it can function as an image processing apparatus.

  Hereinafter, unless otherwise noted, the image processing apparatus 200 will be described using the game apparatus 100 illustrated in FIG. The image processing apparatus 200 can be appropriately replaced with general computer elements as necessary, and these embodiments are also included in the scope of the present invention.

(Configuration of image processing apparatus)
The image processing apparatus 200 according to the present embodiment takes into consideration the position and orientation of an object in the three-dimensional virtual space, the position and orientation of a virtual camera (viewpoint), etc. that change according to a user instruction or the passage of time. To display the object. In the present embodiment, as shown in FIG. 3B, a first character (first object) 300 is arranged in a virtual space, and the first character 300 is converted by similarity with a predetermined enlargement / reduction ratio. The generated second character (second object) 301 is placed in the virtual space. Then, the image processing apparatus 200 generates an image including the first character 300 and the second character 301 arranged in the virtual space, as shown in FIG.

  Next, a schematic configuration of the image processing apparatus 200 according to the present embodiment will be described with reference to FIG. The image processing apparatus 200 includes a storage unit 201, a generation / arrangement unit 202, and an image generation unit 203. Hereinafter, each component of the image processing apparatus 200 will be described.

  The storage unit 201 stores various information for expressing the inside of the three-dimensional virtual space. First, the storage unit 201 stores shape information of each element (also referred to as a character or an object) in the three-dimensional virtual space. Each object (including both the first character 300 and the second character 301) is a surface (surface) defined by a combination of minute polygons (for example, triangles and quadrangles) whose shape is called a polygon. Expressed. Here, the object constitutes a human shape including, for example, a head, a torso, a limb, and the like. The object is not limited to a human shape, and may be a shape such as an animal or a building.

  The storage unit 201 stores the position and orientation of each object in the virtual space. For example, the storage unit 201 stores a global coordinate system (world coordinate system) that represents the entire virtual space and a local coordinate system that is fixed for each object. Typically, the representative point of the object (for example, the center of gravity) is the origin of the local coordinate system, and the surface shape of the object (that is, the shape of the polygon constituting the object and the position where the polygon is arranged) is in the local coordinate system. Defined based on. On the other hand, the position of each object is defined based on the global coordinate system. The direction of the object is defined in global coordinates by a direction vector extending from the representative point of the object in the front direction of the object, for example.

  The position information may be defined using an orthogonal coordinate system, or may be represented by (r, θ, φ) using a polar coordinate system using one moving radius and two declinations.

  In addition, the storage unit 201 stores the position, orientation, and luminous intensity of the illumination (including the first illumination 310 and the second illumination 311) that illuminates the object in the three-dimensional virtual space, and the viewpoint position and line of sight. Remember the direction. Here, the viewpoint position is a position at which a virtual camera (including the first virtual 320 camera and the second virtual camera 321) views an object in the virtual space, and typically in a global coordinate system. Defined. On the other hand, the direction of the line of sight is the direction in which the viewpoint (virtual camera) looks at the virtual space. In addition, the storage unit 201 also stores lighting directivity, color scheme, and the like.

  Further, the storage unit 201 stores image data called texture that is pasted on the surface of each object. By pasting the texture information on the surface shape of the object, it is possible to express the texture of the object.

  Information stored in the storage unit 201 is stored in advance in, for example, a DVD-ROM, and the CPU 101 reads out the DVD-ROM loaded in the DVD-ROM drive 108 and temporarily stores it in the RAM 103. Alternatively, these pieces of information stored in the external memory 106 may be read out by the CPU 101 and temporarily stored in the RAM 103. Note that the CPU 101 can update the temporarily stored information as needed, for example, according to the progress of the game. As described above, the CPU 101, the RAM 103, the DVD-ROM drive 108, and the like work together to function as the storage unit 201.

  Next, the generation / arrangement unit 202 stores data based on an input or the like instructed by a user by operating the controller 105 connected via the interface 104, or based on an input or time elapsed instructed by a program or the like. A first character 300 that is an object stored in the unit 201 is generated. The generation arrangement unit 202 determines the position and orientation of the generated first character 300 based on the information stored in the storage unit 201, and arranges the first character 300 in the virtual space as shown in FIG. Next, the generating and arranging unit 202 generates the second character 301 by enlarging or reducing the shape of the first character 300 (including the same size), and as shown in FIG. Place in the virtual space. The expression of the second character 301 (the state of the face), the pose (the position of the limbs), and the like change in conjunction with changes in the expression, pose, etc. of the first character 300. The generating and arranging unit 202 can also create a second character 301 by duplicating only a part of the first character 300 (for example, the head or the torso) and arrange it in the virtual space. .

  In addition, the generation arrangement unit 202 arranges the first illumination 310 and the second illumination 311 that illuminate the virtual space or the object in the virtual space. Here, the first illumination 310 illuminates the entire virtual space, and the second illumination 311 is highly directional illumination such as a spotlight mainly illuminating the second character 301. The second illumination 311 is arranged in conjunction with the arrangement position of a second virtual camera 321 described later, and illuminates the second character 301. In addition, the luminous intensity, directivity, color, etc. of each illumination can be changed arbitrarily. Further, the user can arbitrarily change the position of each illumination by operating the controller 105.

  Further, the generation and arrangement unit 202 arranges the first virtual camera (viewpoint) 320 and the second virtual camera 321 for photographing an object in the virtual space. Here, the first virtual camera 320 is arranged at the position and orientation for photographing the entire first character 300, and the second virtual camera 321 mainly uses the head (face part) of the second character 301. It arrange | positions in the position and direction which image | photographs. Note that the shape of each character, the position of each illumination, the position of each virtual camera, and the like are stored in the storage unit 201. Then, an image generation unit 203 described later generates an image on which the first character 300 or the like is displayed. The CPU 101, the RAM 103, and the like operate in cooperation to function as the generation and placement unit 202.

  Based on the position and orientation of the object generated by the generation and placement unit 202, the position and orientation of the virtual camera (viewpoint), the position and orientation of illumination, and the like, the image generation unit 203 generates the 3D virtual image from the viewpoint. Each object in the space is projected (projected) to generate image data to be displayed on a display device such as a monitor. In the present embodiment, as shown in FIG. 4B, image data is generated by combining the images of the objects projected by the first virtual camera 320 and the second virtual camera 321. The CPU 101, the RAM 103, and the image processing unit 107 work together to function as the image generation unit 203.

(Operation of image processing device)
Next, the operation of the image processing apparatus 200 will be described with reference to the flowchart of FIG.

  When the image processing apparatus 200 is turned on and the startup process is started, the storage unit 201 stores necessary information (for example, the position and orientation of the virtual camera and the shape, position, and orientation of the object) from the DVD-ROM or the like. Etc.) is acquired and stored (step S11).

Next, based on the information stored in the storage unit 201, the generation / arrangement unit 202, as shown in FIG. 3A, the first character 300, the first illumination 310, and the first virtual camera 320. Are generated and arranged in the three-dimensional virtual space (step S12). The first virtual camera 320 is arranged at a position where the entire first character 300 (whole body) is photographed. When the first illumination 310 is omnidirectional (omnidirectional), the first illumination 310 is arranged at an arbitrary location in the virtual space. In addition, when the first illumination 310 has directivity, for example, the first character 300 or the like is illuminated in a position vertically upward with respect to the front-facing vector of the first character 300. The lighting 310 is arranged.
For the arranged first character 300 and the like, based on a control program recorded on the DVD-ROM, for example, an operation process such as moving a limb or changing an expression is performed. Further, the user can use the controller 105 to give an instruction to change parameters such as position and orientation. Further, the parameter may be changed to a predetermined value in association with the passage of time or may be changed randomly.

  Next, as shown in FIG. 4A, the image generation unit 203 generates (draws) a two-dimensional image of the virtual space including the object photographed by the first virtual camera 320, and displays the image on a monitor or the like. (Step S13). Thereby, the user can recognize the movement of the first character 300. In the present embodiment, for example, a two-dimensional image is generated by performing perspective projection with a one-point perspective method.

  First, the image generation unit 203 obtains the projection destination area of the first character 300. By projecting the first character 300 on the projection plane by a one-point perspective method, an object far from the viewpoint is small and an object near is projected large. Note that parallel projection may be employed instead of the one-point perspective method.

When the projection destination is obtained, the corresponding area of the corresponding texture is pasted (mapped) and drawn in each area of the projection destination. At this time, the image generation unit 203 uses, for example, a Z buffer method in order to perform hidden surface processing. That is, the image generation unit 203 paints the pixels with the color of the texture information corresponding to the polygon closest to the viewpoint (projection plane) for each pixel constituting the image data to be drawn.
Note that if the line-of-sight direction and the orientation of the polygon surface shape are the same, this means that the surface is facing away from the line-of-sight vector, so the image generation unit 203 may not render such a surface. .

  Further, when pasting the texture, the orientation of the polygons forming each object with respect to the illumination (light source) is considered. That is, the angle formed between the normal line of each polygon of the surface shape constituting the object and the light source vector is obtained, and the brightness of the texture is increased as the angle is closer to 0 degrees (that is, as the angle is closer). Conversely, the closer to a right angle, the lower the brightness. However, when the texture is changed by multiplying the lightness by the reflectance, the lightness is not completely zero even if the angle between the polygon normal and the light source vector is a right angle. By doing so, it is possible to express a texture (roughness, smoothness, etc.) even in a dark part. Note that instead of the angle itself, the cosine of the angle may be obtained from the inner product of the vectors, and the brightness may be increased as the value approaches 1. Further, glow shading, phone shading, or the like may be applied so that the difference in brightness is not noticeable at the boundary of the polygon.

  Next, the generating and arranging unit 202 determines whether or not a predetermined time has elapsed since the start process is started, or whether or not a predetermined condition is satisfied (step S14). Here, the predetermined time is determined by, for example, data stored in the storage unit 201. The predetermined condition is, for example, whether the result (score) obtained by the user by progressing the game satisfies the condition, whether the user has pressed the button of the controller 105, or the like.

  When the predetermined condition or the like is not satisfied (step S14; No), the process returns to step S12, and the image processing apparatus 200 continues the process of displaying the image of the first character 300.

When the predetermined condition or the like is satisfied (step S14; Yes), the generation arrangement unit 202 generates the second character 301, the second illumination 311, and the second virtual camera 321 as in step S12. As shown in FIG. 3B, it is arranged in the virtual space (step S15). The generation arrangement unit 202 arranges the second virtual camera 321 at a position on the front-facing vector of the second character 301 in a direction in which the second character 301 can be photographed. That is, as shown in FIG. 4B, the generation arrangement unit 202 displays the entire front surface of the head (face part) of the second character 301 in the image captured by the second virtual camera 321. In addition, the arrangement positions of the second character 301 and the second virtual camera 321 are adjusted. Note that the image generation unit 203 can also change the magnification of the image displayed by the second virtual camera 321 so that the entire head is displayed.
Further, the second character 301 is arranged so that the first character 300 and the second character 301 do not overlap each other when viewed from the line of sight of the first virtual camera 320. The second illumination 311 is arranged at a position that illuminates the second character 301 from the front in conjunction with the position and orientation of the second character 301. At this time, both the first character 300 and the second character 301 are illuminated by the first illumination 310 originally arranged in the virtual space.

  Next, the image generation unit 203 generates an image in which the second character 301 is captured by the second virtual camera 321 as in step S13 (step S16). Since the second virtual camera 321 is disposed in front of the second character 301, the image generation unit 203 captures an image obtained by photographing the second character 301 from the front as shown in FIG. Can be generated. In addition, since the second illumination 311 is arranged in conjunction with the second virtual camera 321, the second character 301 is illuminated by the second illumination 311. Therefore, it is possible to generate an image that emphasizes the second character 301 in an easy-to-view manner for the user.

  As illustrated in FIG. 4B, the image generation unit 203 combines (cuts in) the image captured by the second virtual camera 321 with the image captured by the first virtual camera 320 and combines the image with the monitor or the like. The image data is displayed (step S17), and the process returns to step S12.

  In the cut-in image shown in FIG. 4B, the head (face part) of the second character 301 is desirably displayed larger than the head of the first character 300. In addition, for an image taken of the second character 301, an image in which only the second character 301 from which the background portion is deleted is displayed can be generated, and the image can be cut in. The position where the image is cut in is arbitrary.

  In addition, the generation placement unit 202 places only the first virtual camera 320 without placing the second virtual camera 321, and places the second character between the first character 300 and the first virtual camera 320. 301 is generated and arranged. That is, the second character 301 having an enlarged or reduced shape is generated so that the entire head of the second character 301 is photographed by the first virtual camera 320. The generated second character 301 is arranged at a position viewed in the direction of the line of sight of the first virtual camera 320 and closer to the first virtual camera 320 than the first character 300. Accordingly, since the second character 301 is arranged closer to the first virtual camera 320 than the first character 300, an image that presents the second character 301 to the user in an easily viewable manner can be generated.

  With the above processing, when generating an image of a character (object) placed in the virtual space, the facial expression of the character can be presented to the user in an easy-to-view manner.

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation and application are possible.

  The number of characters, lights, and virtual cameras is not limited to two and can be expanded to n.

  In the three-dimensional virtual space, not only the first character 300 and the like but also other objects (for example, pillars, walls, and mountains) can be arranged. Further, as the lighting effect, the lighting can be blinked.

(Embodiment 2)
Next, an image processing apparatus according to the second embodiment of the present invention will be described with reference to FIG. In the second embodiment, the virtual wall surface 330 is arranged in the three-dimensional virtual space.

  The storage unit 201 stores the position, orientation, and color scheme (including transparency) of the virtual wall surface 330 arranged in the three-dimensional virtual space. The virtual wall surface 330 is formed of, for example, a polygon, and is defined based on the global coordinate system in the same manner as other objects (first character 300 and the like). The color scheme of the virtual wall surface 330 can be arbitrarily changed, for example, translucent. By making the virtual wall surface 330 translucent, the image portion corresponding to the background portion of the second character 301 captured by the second virtual camera 321 becomes translucent. Therefore, a composite image obtained by combining (cut-in) the image with an image on which the first character 300 is displayed is an image on which only the second character 301 is displayed when viewed from the user.

  As illustrated in FIG. 6, the generation placement unit 202 places the second character 301 at a position between the virtual wall surface 330 and the second virtual camera 321 in the virtual space. The generation arrangement unit 202 arranges the second virtual camera 321 at a position on the front-facing vector of the second character 301 in a direction in which the second character 301 can be photographed. The virtual wall surface 330 is arranged in conjunction with the position and orientation of the second virtual camera 321 (or the second character 301). For this reason, the direction vector of the second virtual camera 321 and the virtual wall surface 330 are orthogonal to each other.

  In addition, the generating and arranging unit 202 sets the second distance so that the distance R2 between the second virtual camera 321 and the second character 301 is proportional to the distance R1 between the first virtual camera 320 and the first character 300. A virtual camera 321 and a second character 301 are arranged. As a method of changing the distance R2, either the arrangement position of the second character 301 or the second virtual camera 321 may be changed. Further, the enlargement / reduction ratio at the time of generating the second character 301 may be changed. The arrangement position of the virtual wall surface 330 can be changed in conjunction with the change in the distance R2.

  Furthermore, as shown in FIG. 6, the generation arrangement unit 202 arranges the first virtual camera 320 on the side of the first character 200, so that the image generation unit 203 An image obtained by photographing one character 300 from the side can also be generated. In addition, the image is not limited to shooting from the side surface of the first character 300, and an image of the first character 300 can be generated from the upper surface side (head side), the lower surface side (leg side), or the like. . Furthermore, it is possible to generate an image in which not only the (whole) whole body of the first character 300 but also a part (upper body part, body part, etc.) of the first character 300 is captured.

  The image generation unit 203 can generate an image of the second character 301 captured by the second virtual camera 321 having a size (pixel) corresponding to (for example, proportional, inversely proportional) to the distance R2. The image generation unit 203 can also generate an image of a size that can accommodate the entire second character 301 (whole body) with respect to the image captured by the second virtual camera 321.

  With these configurations, when the distance R2 between the second virtual camera 321 and the second character 301 is short, an image in which the second character 301 is enlarged is generated, and an image with a larger size of the image is further generated. Since it is generated, it is possible to present the facial expression of the second character in an easy-to-see manner.

  As described above, according to the present invention, when generating an image of a character placed in a virtual space, an image processing device, an image processing method, and And the program for implement | achieving these with a computer can be provided.

It is a mimetic diagram showing an outline composition of a typical game device in which an image processing device etc. concerning an embodiment of the invention is realized. It is explanatory drawing which shows schematic structure of an image processing apparatus. It is a figure which shows the example of arrangement | positioning with the object (character) in the virtual space assumed by this Embodiment, illumination, and a virtual camera, (a) shows the state by which the 1st character was arrange | positioned. , (B) shows a state in which the second character, the second illumination, and the second virtual camera are arranged in addition to the first character. It is a figure which shows the example of a display screen which the image generation part produced | generated, (a) shows the image image | photographed with the 1st virtual camera, (b) shows the image image | photographed with the 1st virtual camera, The composite image which synthesize | combined the image image | photographed with the 2nd virtual camera is shown. It is a flowchart explaining operation | movement of an image processing apparatus. It is a figure which shows the example of arrangement | positioning with the object (character) in the virtual space which concerns on Embodiment 2, illumination, and a virtual camera. It is a figure which shows the example of a display screen which the image generation part which concerns on Embodiment 2 produced | generated.

Explanation of symbols

100 game device 101 CPU
102 ROM
103 RAM
104 Interface 105 Controller 106 External Memory 107 DVD-ROM Drive 108 Image Processing Unit 109 Audio Processing Unit 110 NIC
200 Image Processing Device 201 Storage Unit 202 Generation Arrangement Unit 203 Image Generation Unit 300 First Character 301 Second Character 310 First Illumination 311 Second Illumination 320 First Virtual Camera 321 Second Virtual Camera 330 Virtual Wall Surface

Claims (10)

The shape, position and orientation of the first character placed in the virtual space; the shape, position and orientation of the second character; the position and orientation of the first virtual camera placed in the virtual space; A storage unit for storing the position and direction of the second virtual camera arranged in the virtual space, and the position and orientation of the wall surface arranged in the virtual space;
The position of the wall surface is linked to the position of the second virtual camera, the direction of the wall surface is arranged in the virtual space so that the wall surface is orthogonal to the direction of the second virtual camera, and the first A generation arrangement unit that generates the second character by converting the shape of the character at a predetermined enlargement / reduction ratio and arranges the second character between the virtual wall surface and the second virtual camera; ,
A first image is generated by viewing the virtual space from the position of the first virtual camera in the direction of the first virtual camera, and the second virtual camera is generated from the position of the second virtual camera. An image generation unit that generates a second image viewed in the direction of the camera, and generates an image in which a predetermined part of the second image is combined with the first image;
Equipped with a,
The generating and arranging unit determines a position at which the wall surface is arranged so as to be linked to a first distance between the position of the first character and the position of the first virtual camera. Determining a position at which the second character is arranged such that a second distance between the position and the position of the second virtual camera is proportional to the first distance;
The image generation unit is characterized in that a size of a predetermined portion of the second image is set to a size associated with the second distance . The image processing apparatus according to claim 1,
The generating and arranging unit is
The second character is arranged so that the direction of the second character is a predetermined direction with respect to the direction of the second virtual camera.
An image processing apparatus. The image processing apparatus according to claim 1 , wherein:
The storage unit further stores the position, orientation, and luminous intensity of the first illumination and the second illumination,
The generation arrangement unit sets the intensity of the first illumination higher than the intensity of the second illumination, arranges the first illumination in a predetermined direction at a predetermined position, and arranges the second illumination in the first Arranged to illuminate the second character at a position between the position of the second virtual camera and the position of the second character,
An image processing apparatus. The position and direction of the main virtual camera arranged in the virtual space, the shape, position and orientation of the plurality of main characters arranged in the virtual space, and the virtual characters associated with each of the plurality of main characters, A memory that stores the shape, position, and orientation of the sub character arranged in the space, and the position and direction of the sub virtual camera that is associated with each of the plurality of sub characters and arranged in the virtual space. Part,
For each of the plurality of main characters, the shape of the main character is subjected to similarity conversion at a predetermined enlargement / reduction ratio to generate a sub character associated with the main character, and the position of the main character and the position of the main virtual camera The generated sub character so that the sub distance between the position of the generated sub character and the position of the sub virtual camera associated with the generated sub character is proportional to the main distance between And the position of the sub-virtual camera associated with the generated sub-character to determine the position of the generated sub-character and the sub-virtual camera associated with the generated sub-character in the virtual space. Generated placement unit to be placed in,
A main image in which the virtual space is viewed from the position of the main virtual camera in the direction of the main virtual camera is generated, and for each of the plurality of sub-characters, the virtual space is associated with the sub-character. An image generation unit configured to generate a sub-image viewed from the position in the direction of the sub-virtual camera, and generate an image obtained by combining the main image with a predetermined portion of each of the plurality of sub-images. Image processing device. The image processing apparatus according to claim 4 ,
For each of the plurality of sub-characters, the generating and arranging unit is configured so that the direction of the sub-virtual camera associated with the sub-character is front-facing to the direction of the sub-character, and the head of the sub-character mainly from the sub-virtual camera. An image processing apparatus, wherein the position and orientation of the sub-virtual camera are determined so that the portion can be seen. The image processing apparatus according to claim 5 ,
For each of the plurality of sub-characters, the image generation unit is proportional to the sub-distance for the sub-characters of the sub-image generated for the sub-characters, and the size of the portion combined with the main image. An image processing apparatus characterized by the following. An image processing method executed by an image processing apparatus having a storage unit, a generation arrangement unit, and an image generation unit,
In the storage unit, the shape, position and orientation of the first character arranged in the virtual space, the shape, position and orientation of the second character, and the first virtual camera arranged in the virtual space , The position and direction of the second virtual camera arranged in the virtual space, and the position and orientation of the wall surface arranged in the virtual space are stored,
The generating and arranging unit links the position of the wall surface to the position of the second virtual camera, and the direction of the wall surface is set in the virtual space so that the wall surface is orthogonal to the direction of the second virtual camera. The second character is generated by converting the shape of the first character at a predetermined enlargement / reduction ratio, and the second character is placed between the virtual wall surface and the second virtual camera. Generating and arranging steps to arrange;
The image generation unit generates a first image when the virtual space is viewed from the position of the first virtual camera in the direction of the first virtual camera, and the virtual space is positioned at the position of the second virtual camera. Generating a second image viewed in the direction of the second virtual camera, and generating an image obtained by combining the first image with a predetermined portion of the second image;
Equipped with a,
In the generating and arranging step, a position at which the wall surface is arranged to be interlocked with a first distance between the position of the first character and the position of the first virtual camera is determined, and the second character's Determining a position at which the second character is arranged such that a second distance between the position and the position of the second virtual camera is proportional to the first distance;
In the image generating step, the size of a predetermined portion of the second image is set to a size associated with the second distance . An image processing method executed by an image processing apparatus having a storage unit, a generation arrangement unit, and an image generation unit,
The storage unit stores the position and direction of the main virtual camera arranged in the virtual space, the shape, position, and orientation of the plurality of main characters arranged in the virtual space, and each of the plurality of main characters. The shape, position, and orientation of the sub-characters that are associated and arranged in the virtual space, and the positions and directions of the sub-virtual cameras that are associated with each of the plurality of sub-characters and arranged in the virtual space , Is remembered,
For each of the plurality of main characters, the generation / arrangement unit generates a sub-character associated with the main character by performing similarity conversion of the shape of the main character at a predetermined enlargement / reduction ratio, and the position of the main character The sub-distance between the position of the generated sub character and the position of the sub virtual camera associated with the generated sub character is proportional to the main distance between the position of the main virtual camera, By defining the position of the generated sub character and the position of the sub virtual camera associated with the generated sub character, the position of the generated sub character and the sub character associated with the generated sub character are determined. Generating and arranging step of arranging a virtual camera in the virtual space;
The image generation unit generates a main image when the virtual space is viewed from the position of the main virtual camera in the direction of the main virtual camera, and the virtual space corresponds to the sub character for each of the plurality of sub characters. An image generation step of generating a sub-image viewed in the direction of the sub-virtual camera from the position of the sub-virtual camera to be attached, and generating an image obtained by combining the main image with a predetermined portion of each of the plurality of sub-images. An image processing method comprising: Computer
The shape, position and orientation of the first character placed in the virtual space; the shape, position and orientation of the second character; the position and orientation of the first virtual camera placed in the virtual space; A storage unit for storing the position and direction of the second virtual camera arranged in the virtual space and the position and orientation of the wall surface arranged in the virtual space;
The position of the wall surface is linked to the position of the second virtual camera, the direction of the wall surface is arranged in the virtual space so that the wall surface is orthogonal to the direction of the second virtual camera, and the first A generation arrangement unit that generates the second character by converting the shape of the character at a predetermined enlargement / reduction ratio, and arranges the second character between the virtual wall surface and the second virtual camera;
A first image is generated by viewing the virtual space from the position of the first virtual camera in the direction of the first virtual camera, and the second virtual camera is generated from the position of the second virtual camera. Generating a second image viewed in the direction of the camera, and causing the first image to function as an image generation unit that generates an image obtained by combining a predetermined portion of the second image ;
The generating and arranging unit determines a position at which the wall surface is arranged so as to be linked to a first distance between the position of the first character and the position of the first virtual camera. Determining a position at which the second character is arranged such that a second distance between the position and the position of the second virtual camera is proportional to the first distance;
The image generation unit sets a size of a predetermined portion of the second image to a size associated with the second distance.
A program characterized by functioning as follows. Computer
The position and direction of the main virtual camera arranged in the virtual space, the shape, position and orientation of the plurality of main characters arranged in the virtual space, and the virtual characters associated with each of the plurality of main characters, A memory that stores the shape, position, and orientation of the sub character arranged in the space, and the position and direction of the sub virtual camera that is associated with each of the plurality of sub characters and arranged in the virtual space. Part,
For each of the plurality of main characters, the shape of the main character is subjected to similarity conversion at a predetermined enlargement / reduction ratio to generate a sub character associated with the main character, and the position of the main character and the position of the main virtual camera The generated sub character so that the sub distance between the position of the generated sub character and the position of the sub virtual camera associated with the generated sub character is proportional to the main distance between And the position of the sub-virtual camera associated with the generated sub-character to determine the position of the generated sub-character and the sub-virtual camera associated with the generated sub-character in the virtual space. Generated placement unit to be placed in,
A main image in which the virtual space is viewed from the position of the main virtual camera in the direction of the main virtual camera is generated, and for each of the plurality of sub characters, the virtual space is associated with the sub character. Generating a sub-image viewed from the position in the direction of the sub-virtual camera, and causing the main image to function as an image generating unit that generates an image obtained by combining each predetermined portion of the plurality of sub-images. Program to do.

Images