JP3927474B2 - Image generating apparatus, program, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image generation apparatus and a recording medium using a network.
[0002]
[Prior art]
Nowadays, computer hardware is improving rapidly. In particular, graphics hardware and network information transfer rates have made remarkable progress, and most inexpensive personal computers are equipped with high-performance hardware to enable high-speed drawing / communication. Further, a three-dimensional computer graphics (hereinafter referred to as 3DCG) technique for realistically rendering an object shape with a small amount of data has been developed.
[0003]
In recent years, a technique called Web3D that can distribute 3DCG data via a network, perform high-quality rendering on the user side, and operate it interactively has started to be used. This technology is used for 3DCG product catalogs and walk-through contents on the Web.
[0004]
[Problems to be solved by the invention]
However, 3DCG product catalogs and walk-through contents displayed with the conventional Web3D technology download 3DCG data each time they are accessed, and even when displaying the same 3DCG contents, it is necessary to wait while downloading the data. .
[0005]
In addition, in the conventional Web3D technology, the user cannot freely add arbitrary 3DCG data simply by performing desorption simulation of parts using 3DCG data prepared in advance, and lacks interactivity. .
Further, in the conventional Web3D technology, since the operation result could not be saved, an initial three-dimensional image was displayed every time access was made.
[0006]
The present invention has been made in view of the above points, and an object thereof is to provide an image generation apparatus capable of dynamically storing distributed data via a network.
[0007]
[Means for Solving the Problems]
In order to achieve the above-described object, the first invention is an image generation apparatus connected to a server via a network, and image data having shape information including object shape data, texture data, and texture data, and necessary Reading means for reading the latest image data of the object from the server in accordance with the at least one of the shape data, the texture data, and the texture data, which is the shape information of the object, according to the input processing instruction Processing means for processing one, changed data holding means for holding changed changed image data or changed portion data corresponding to a changed portion of the changed image data based on the processed shape information, and held changed image Data or modified part data is read, and in the case of the modified part data, the original image data Generate modified image data corrected based on the modified partial data Change data reading means, Modified image data read or generated by the modified data reading means; An image generation apparatus comprising: an image generation unit configured to generate an image of the object based on input viewpoint information.
[0008]
Also, The image data has version information indicating an update level, and the reading means updates the image data on the server side when the image data is not held or based on version information in the image data. Read and store the image data from the server It is desirable.
Also, Based on an input instruction that designates input image data to be additionally drawn, if the corresponding image data is not held, the image data is received from the server and held as additional image data, and held Additional data reading means for reading the added additional image data It is desirable to further comprise.
[0013]
The “server” is a server computer or the like and distributes three-dimensional CG data to the user side.
[0014]
The “image generation device” is a user computer or the like, and generates and displays a computer image.
[0015]
“Object shape information” is three-dimensional object information including shape data, texture data, texture data, and the like.
“Shape data” is vertex information and surface information defined using the vertex information.
“Texture data” defines the material properties of the object surface.
“Texture data” represents a wallpaper (texture) image that is pasted (mapped) onto shape data.
“Viewpoint information” includes a camera viewpoint, a gazing point, an upward vector, and the like.
“Instruction information” is identification information of image data, such as a data name.
“Version information” indicates the update level of image data by a numerical value (for example, a number starting from 1).
[0016]
In the first aspect of the invention, the operation result obtained by processing the user-specific shape information can be saved, and once the connection is disconnected, the user-specific operation result can be reflected in the original image data with respect to the latest image data. Thus, it is possible to obtain a high-quality three-dimensional CG image with higher interactivity. Furthermore, it is possible to save all data in which the operation result is reflected in the image data, or it is possible to save only the changed points that are the operation result of the user and reduce the data capacity.
[0017]
The second invention is a program for causing a computer to function as the image generating apparatus of the first invention.
A third invention is a recording medium on which a program for causing a computer to function as the image generating apparatus of the first invention is recorded.
[0019]
The above-mentioned program may be held and distributed on a recording medium such as a CD-ROM, or the program can be transmitted and received via a communication line.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of an image generation system 1 according to the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, the same reference numerals are given to components having substantially the same functional configuration, and redundant description will be omitted.
[0021]
FIG. 1 is a diagram showing a schematic configuration of an image generation system 1 according to the present embodiment. The image generation system 1 reads 3D computer graphics (hereinafter referred to as 3DCG) data via a network and displays the 3DCG data arbitrarily designated by the user or processed 3DCG data in a system that displays on the user side. To save.
[0022]
The 3DCG data is three-dimensional object information including shape data, texture data, texture data, and the like. The shape data is vertex information and surface information defined using the vertex information. The texture data defines material characteristics of the object surface. The texture data represents a wallpaper (texture) image pasted (mapped) on the shape data.
[0023]
As shown in FIG. 1, the image generation system 1 includes an image generation device 2, an external storage device 3, an external input device 4, an external output device 5, an image management server 6, an external storage device 7, a network 8, and the like. The image generation system 1 is configured by connecting an image generation device 2 and an image management server 6 via a network 8 such as the Internet.
[0024]
The image generation device 2 reads the edited 3DCG data from the external storage device 3, or reads it from the external storage device 7 via the network 8 and the image management server 6 and inputs the viewpoint information and data input from the external input device 4. In combination with the processing information, a realistic image is generated and output to the external storage device 3, the external output device 5, and the like.
Further, the image generation device 2 stores the data in the external storage device 7 via the external storage device 3 or the network 8. The data to be stored may be all 3DCG data or only changed data.
Note that the processing performed by the image generation apparatus 2 may be performed using another software (local application).
[0025]
The external storage device 3 includes 3DCG data acquired by the image generation device 2 via the network 8, data processed by the image generation device 2, images generated by the image generation device 2, and images processed by the image display device 6. For example, a hard disk or a CD-R (ROM).
[0026]
The external input device 4 is a device such as a mouse, a keyboard, and a tablet, and edits texture data such as embedding of colors, patterns, and characters, and edits shape data such as a three-dimensional position, size, and shape. Further, viewpoint information such as a position for observing the object shape is input or changed. In addition, it instructs to read 3DCG data.
[0027]
The external output device 5 is a device that displays or prints the CG image generated / processed by the image generation device 2, and is a CRT display, a liquid crystal display, an inkjet printer, a laser printer, a three-dimensional molding device, or the like.
[0028]
The image management server 6 transmits the 3DCG data stored in the external storage device 7 to the image generation device 2 on the user side.
[0029]
The external storage device 7 connected to the image management server 6 is a storage device that stores 3DCG data prepared on the image management server 6 side, and is connected to the image generation device 2 via the network 8.
[0030]
The image generation apparatus 2 includes a data input / output unit 10, a data comparison unit 11, a data input / output unit 12, a data storage unit 13, a data processing unit 14, a viewpoint information processing unit 15, a rendering unit 16, and the like. The image generation device 2 is composed of, for example, a single computer.
[0031]
In FIG. 1, when there is 3DCG data of an object in the external storage device 3, the data input / output unit 10 reads the 3DCG data therefrom and stores it in the data storage unit 13. When there is no 3DCG data in the external storage device 7, the data input / output unit 10 reads the 3DCG data from the external storage device 7 via the network 8 and stores it in the external storage device 3 and the data storage unit 13.
[0032]
The data comparison unit 11 determines whether or not the 3DCG data stored in the server-side external storage device 7 is already stored in the user-side external storage device 3. The 3DCG data in the storage device 7 and the 3DCG data in the user-side external storage device 3 are compared, and if the 3DCG data in the server-side external storage device 7 is newer, the image generating device 2 receives the 3DCG data, and the data The data is transferred to the storage unit 13. If not stored in the external storage device 3, the 3DCG data of the server-side external storage device 7 is received and transferred to the data storage unit 13.
[0033]
The data input / output instruction unit 12 instructs the data input / output unit 10 on 3DCG data to be passed to the data storage unit 13 based on the data input from the external input device 4. If the corresponding 3DCG data does not exist in the external storage device 3, it is read from the external storage device 7 on the server side.
[0034]
The data storage unit 13 stores 3DCG data read from the data input / output unit 10. Further, 3DCG data is newly added to the current 3DCG data and stored in accordance with an instruction from the data input / output instruction unit 12. The stored 3DCG data is passed to the rendering unit 16.
[0035]
The data processing unit 14 uses the read 3DCG data in accordance with an instruction such as a texture retouching operation (color or character embedding, etc.) or a shape deformation operation (position, size, shape, etc.) input from the external input device 4. Process and edit, and store in the data storage unit 13.
[0036]
The viewpoint information processing unit 15 calculates viewpoint information such as a camera viewpoint, a gazing point, and an upward vector of the line-of-sight direction from parameters input by the external input device 4, and is passed to the rendering unit 16.
[0037]
The rendering unit 16 receives the 3DCG data from the data storage unit 13 and the viewpoint information from the viewpoint information processing unit 15, performs a rendering process considering the lighting effect, and generates an image.
[0038]
Next, the data structure of the image data will be described in detail. FIG. 2 shows the data structure 20 of the image data.
[0039]
As shown in FIG. 2, the image data includes a basic image data group 21, a change / addition image data group 22, an operation history 23, and the like. The basic image data group 21 includes a plurality of image data 25 prepared in advance. The changed / added image data group 22 includes processed changed image data 26, arbitrary added image data 27 according to a user instruction, and the like. The operation history is composed of operation history information 28 in which only the data of the changed part of the changed / added image data is held in time series.
It should be noted that at least one of the changed image data 26 / added image data 27 of the changed / added image data group 22 and the operation history information 25 of the operation history 23 may be held and operated.
[0040]
The image data 25 is image data for each part constituting 3D content prepared in advance, and includes a data name 30, version information 31, update date and time 32, data 33, and the like. The image data 25 is data for each part such as bumpers and tires of the 3D content “automobile”, for example.
[0041]
The data name 30 is identification information of the image data 25 and is, for example, the data name “bumper 01”.
The version information 31 indicates the update level of the image data 25 with a numerical value (for example, a number starting from 1), and is, for example, version information 31 “1.0”.
The update date 32 is the date when the image data 25 was last updated.
The data 33 is 3DCG data including three-dimensional object information including shape data, texture data, texture data, and the like.
[0042]
The changed image data 26 / added image data 27 is image data changed by a user operation, arbitrarily added image data, and the like, and includes a data name 40, an update date 42, a changed data 43 / added data 44, and the like.
[0043]
The data name 40 is identification information of the changed image data 26 / added image data 27. In the case of the changed image data 26, the data name 40 is the data name 30 of the image data 25 of the basic image data group 21, and the original image data before the change. Is the data name. For example, the changed image data 26 with the data name 40 “bumper 01” is obtained by processing and holding the image data 23 with the data name 30 “bumper 01”.
The update date and time 42 is the date and time when the image data 24 is updated / added.
The change data 43 / additional data 44 is changed or added 3DCG data.
[0044]
The operation history 23 holds only the changed / added portion of the image data changed according to the operation result of the user or the arbitrarily added image data in time series, and includes the data name 40, the update date 42, the changed portion data. 45 mag.
[0045]
The changed part data 45 is data of only the changed part of the changed / added image data, for example, “color change: white → red” data.
[0046]
The change data 43 / additional data 44 of the change / additional image data group 22 may be image data change / additional partial data.
[0047]
Next, a processing flow of the image generation apparatus 2 in the image generation system 1 will be described. FIG. 3 is a flowchart showing a process flow of the image generation apparatus 2.
[0048]
As shown in FIG. 3, the data input / output unit 10 reads 3DCG data of an object from the external storage device 3 according to an instruction from the data comparison unit 11 and stores it in the data storage unit 13. When the 3DCG data does not exist in the external storage device 3, the 3DCG data is read from the external storage device 7 via the network 8 and the image management server 6 and stored in the data storage unit 13 (step 301).
[0049]
When there is a request for adding arbitrarily selected 3DCG data from the external input device 4 (step 302), the data input / output instruction unit 12 selects any 3DCG selected based on the data input from the external input device 4. The data input / output unit 10 is instructed to read data into the data storage unit 13 (step 303). The data input / output unit 10 reads the corresponding 3DCG data instructed from the data input / output instruction unit 12 from the external storage device 3, Store in the data storage unit 13. When the corresponding 3DCG data exists in the external storage device 3, the corresponding 3DCG data is read from the external storage device 7 via the network 8 and the image management server 6, and stored in the data storage unit 13 and the external storage device 3 (step). 304).
[0050]
When there is a data processing (editing) request for a shape, texture, etc. from the external input device 4 (step 305), the data processing unit 14 performs a data storage unit through a texture retouch operation or a shape deformation operation from the external input device 4. The shape data, texture data, texture data, light source data, and the like stored in 13 are processed, and the processed data is stored in the data storage unit 13 (step 306).
[0051]
The viewpoint information processing unit 15 calculates the camera viewpoint, the gazing point, the upward vector, and the like, which are the viewpoint information, from the parameters input by the external input device 4 (step 307).
[0052]
The rendering unit 16 performs an object rendering process from the 3DCG data of the object in the data storage unit 13 and the viewpoint information of the viewpoint information processing unit 15 in consideration of the illumination effect and the like, and generates an image (step 308). The rendering process can be performed by graphics hardware such as a video card or software.
[0053]
The image obtained in step 308 is output (displayed, printed, etc.) to the external output device 5 (step 309).
[0054]
By repeating the above steps 302 to 309, the 3D shape can be observed, edited, newly created, etc. interactively.
[0055]
Next, the processing procedure of the process of reading and storing the 3DCG data which is the process of step 301 will be described in detail. FIG. 4 is a flowchart showing the flow of processing for reading and storing 3DCG data.
[0056]
As shown in FIG. 4, the data input / output unit 10 determines whether the 3DCG data is stored in the external storage device 3 (step 401). When the 3DCG data is not stored in the external storage device 3 (No in step 401), the process proceeds to step 405, and processing for reading the 3DCG data from the server-side external storage device 7 is performed.
[0057]
When the 3DCG data is stored in the external storage device 3 (Yes in step 401), the data input / output unit 10 receives the 3DCG data (from the external storage device 7 via the network 8 and the image management server 6). Image data) version information 31 is received (step 402). The data comparison unit 11 compares the 3DCG data stored in the server-side external storage device 7 with the version information 31 of the 3DCG data stored in the user-side external storage device 3 (step 403).
[0058]
When the version information 31 of the 3DCG data stored in the server-side external storage device 7 is older or the same (in the case of No in step 403), the data input / output unit 10 receives the 3DCG from the external storage device 3. Data is read (step 404). When the version information 31 of the 3DCG data stored in the external storage device 7 on the server side is newer (in the case of Yes in step 403), the data input / output unit 10 passes through the network 8 and the image management server 6. The 3DCG data is received from the external storage device 7 (step 405).
[0059]
If the read 3DCG data is compressed data, the data input / output unit 10 decompresses the data and stores it in the data storage unit 13 (step 406).
[0060]
The data input / output unit 10 determines whether or not the reading of the image data is complete (step 407). While the image data is not finished (No in step 407), the processing from step 401 to step 406 is repeated.
[0061]
When the reading of the image data is completed (Yes in step 407), the data input / output unit 10 determines whether the changed / added image data 26 and 27 exist (step 408). When the changed / added image data 26 and 27 exist (Yes in step 408), the data input / output unit 10 stores the changed / added data in the data storage unit 13 (step 409). In the case of change data that holds only the changed part, the change data is corrected with respect to the corresponding original 3DCG data. If there is any change / additional image data, the processing of step 408 and step 409 is repeated.
[0062]
Next, the flow of additional drawing processing of 3DCG data selected by the user, which is the first feature of the embodiment of the present invention, will be described in detail. FIG. 5 shows a flow 50 of additional drawing processing of the selected 3DCG data.
[0063]
As shown in FIG. 5, the image generation device 2 displays a data addition instruction screen 51 including, for example, a 3D content screen 52 of a car and a menu for additionally specifying each part (bumper, tire, etc.), and the external input device 4, bumper additional instruction data (for example, bumpers A, B, and C) are input (steps 501 and 502).
[0064]
The data input / output instruction unit 12 instructs the data input / output unit 10 to read the corresponding 3DCG data to be added from the input 3DCG data instruction requests of the bumpers A, B, and C (step 503).
[0065]
The data input / output unit 10 reads the corresponding 3DCG data into the data storage unit 13 from the external storage device 3, or the external storage device 7 if it does not exist (step 504). For example, the corresponding 3DCG data does not exist in the external storage device 3 (step 505), and the data input / output unit 10 receives image data (bumper A) as the corresponding 3DCG data from the external storage device 7 via the network 8. , B, C) 25 is read into the data storage unit 13 (step 506). The data input / output unit 10 stores the image data (bumpers A, B, C) 25 read into the data storage unit 13 as the additional image data 27 of the changed / added image data group 22 in the external storage device 3 (step 507). ).
[0066]
The rendering unit 16 renders the object from the 3DCG data of the object (bumpers A, B, and C) in the data storage unit 13 and the viewpoint information of the viewpoint information processing unit 15 in consideration of the illumination effect, and generates an image. Are output (step 508). For example, an additional component screen 53 for drawing bumpers A, B, and C is displayed on the external output device 5 (step 509).
[0067]
Next, the processing flow of storing and reproducing processed 3DCG data, which is the second feature of the embodiment of the present invention, will be described in detail. FIG. 6 shows the flow of processing and storing of processed 3DCG data.
[0068]
As shown in FIG. 6, for example, the data processing unit 14 designates a processed part (for example, a bumper) with a mouse or the like from the 3D content screen 61 of automobile drawing (step 601), and selects the selected part (for example, a bumper). ) And a data processing screen 62 composed of processing tools (step 602), and input bumper processing instructions (for example, texture editing, bumper color change (white-> red) from the external input device 4 (step 602). 603).
[0069]
The data processing unit 14 processes the 3DCG data in accordance with the input instruction that is the operation result of the user, and stores the processed data in the data storage unit 13 (step 604). The data input / output unit 10 stores the processed data transferred to the data storage unit 13 in the external storage device 3 as the changed image data 26 (step 605). For example, when the processed image data has the data name “bumper 02”, the changed / added image data group 22 includes the changed image data 26 (bumper 02) including the data name 40 “bumper 02”, the update date / time 42, the changed data 43, and the like. All the 3DCG data including the color change (white-> red) and the changed texture data) are held. Further, as operation history, operation history information 28 including a data name 40 “bumper 02”, update date and time 42, changed portion data 45 (bumper color change (white-> red)), which is data of only changed points, and the like is retained. To do.
[0070]
Once the connection is disconnected, the next access is made, and when 3D content including the processed data is requested to be displayed, the data input / output unit 10 changes the changed image from the changed / added data group 22 to the image data 25 of the basic image data group 21. The data 26 is read into the data storage unit 13 (step 606), and the rendering unit 13 generates and displays an image reflecting the previous operation result from the image data in the data storage unit 13 (step 607). For example, the bumper color (red) 3D content screen 63 is displayed (step 608).
[0071]
As described above, according to the present embodiment of the present invention, the data input / output unit 10 reads 3DCG data from the external storage device 3 or the external storage device 7 according to an instruction from the data comparison unit 11, and stores the data. Store in the unit 13.
When adding the selected 3DCG data, the data input / output instruction unit 12 instructs the data input / output unit 10 to read the corresponding 3DCG data into the data storage unit 13 based on the data input from the external input device 4. The data input / output unit 10 reads the corresponding 3DCG data instructed from the data input / output instruction unit 12 from the external storage device 3 or the external storage device 7, and the data storage unit 13 and the external storage device 3. To remember.
When processing data such as shape and texture, the data processing unit 14 processes data in the data storage unit 13 by a texture retouching operation or shape deformation operation from the external input device 4, and stores the processed data in the data storage Store in the unit 13.
The rendering unit 16 performs an object rendering process from the 3DCG data in the data storage unit 13 and the viewpoint information in consideration of an illumination effect and the like, generates an image, and outputs the image.
[0072]
As a result, 3DCG data arbitrarily selected by the user is added to the 3DCG data used in the Web3D content and stored in the user's personal computer, thereby obtaining a high-quality 3D CG image with higher interactivity. Is possible.
Also, by saving the user operation results, the previous operation results can be reflected even if the connection is once disconnected. Furthermore, all the data reflecting the operation result in the 3DCG data can be saved, or only the changed point that is the user's operation result can be saved to reduce the data capacity. Moreover, it is also possible to obtain an operation history by storing user operation results in time series.
[0073]
Note that the program for performing the processing shown in FIGS. 3 and 4 may be distributed on a recording medium such as a CD-ROM, or the program may be transmitted and received via a communication line.
[0074]
The preferred embodiments of the image generation system and the like according to the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes or modifications can be conceived within the scope of the technical idea disclosed in the present application, and these are naturally within the technical scope of the present invention. Understood.
[0075]
【The invention's effect】
As described above in detail, according to the present invention, it is possible to provide an image generation apparatus capable of dynamically storing distributed data via a network.
[Brief description of the drawings]
FIG. 1 is a diagram showing a schematic configuration of an image generation system 1 according to the present embodiment.
FIG. 2 is a diagram showing a data structure 20 of image data.
FIG. 3 is a flowchart showing a process flow of the image generation apparatus 2;
FIG. 4 is a flowchart showing a flow of processing for reading and storing 3DCG data.
FIG. 5 is a diagram showing a flow 50 of additional drawing processing of selected 3DCG data.
FIG. 6 is a diagram showing a processing flow 60 for storing and reproducing processed 3DCG data.
[Explanation of symbols]
1 ... Image generation system
2 ... Image generation device
3, 7, ... External storage device
4 ... External input device
5 .... External output device
6 ……… Screen management server
8: Network

Claims (5)

An image generation apparatus connected to a server via a network,
Image data having shape information consisting of object shape data, texture data, texture data;
Reading means for reading the latest image data of the object from the server as needed,
Processing means for processing at least one of the shape data, the texture data, and the texture data, which is shape information of the object, in accordance with an input processing instruction;
Based on the processed shape information, changed data holding means for holding changed changed image data or changed portion data corresponding to the changed portion of the changed image data;
Changed data reading means for reading the changed image data or changed part data held and, in the case of the changed part data, generating changed image data corrected based on the changed part data with respect to the original image data;
Based on the changed image data read or generated by the changed data reading means and the input viewpoint information, image generating means for generating an image of the object,
An image generation apparatus comprising: Version information representing an update level in the image data;
The reading means includes
When the image data is not held, or when the image data is updated on the server side based on version information in the image data, the image data is read from the server and held. The image generation apparatus according to claim 1. If the corresponding image data is not held based on the input instruction that designates the input additional image data to be drawn, the additional data holding means for receiving the image data from the server and holding it as additional image data;
Additional data reading means for reading the stored additional image data;
The image generating apparatus according to claim 1, further comprising:   A program that causes a computer to function as the image generation apparatus according to claim 1.   A recording medium recording a program that causes a computer to function as the image generation apparatus according to claim 1.

Images