JP4270906B2 - Content distribution system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a content distribution system that distributes three-dimensional CG content to terminal devices having different performances connected via a network.
[0002]
[Prior art]
Conventionally, systems for distributing various contents via a network have been proposed and put into practical use. Among these, the performance of networks and terminal devices (hereinafter abbreviated as “terminals” as appropriate) is not sufficient, and it is possible to distribute enormous amounts of data, such as three-dimensional (3D) computer graphic (CG) data. There are cases where it is impossible. In order to cope with such a problem, there are some which reduce the weight of data by converting the format of 3DCG data and reduce the weight of data by converting the 3DCG data into two-dimensional image data (for example, there are those that are distributed) Patent Document 1).
[0003]
[Patent Document 1]
JP 2001-306449 A
[0004]
[Problems to be solved by the invention]
In the above-described conventional content distribution system, content that has a smaller file size compared to 3DCG content, such as 2D image data or animation data associated with a 2D image, to a terminal that cannot directly distribute 3DCG content. It was converted and delivered. Therefore, the amount of data that can be distributed is smaller than the amount of data required by the 3DCG content, and the content that can be distributed is limited, for example, only image data from a certain direction can be distributed.
[0005]
In addition, 3DCG content can be obtained with a great effect by freely changing the viewpoint by the user's operation, but in the conventional content distribution system described above, for example, 3DCG content is converted into a two-dimensional image animation. In the case of distribution, the animation is generated only from the viewpoint set by the system and the data is distributed, and the user cannot browse the content by specifying the viewpoint that the user wants to see.
[0006]
The present invention has been made to solve the above-described problems, and generates and distributes CG moving image content in which the moving image encoding method and bit rate are changed in accordance with the performance of the terminal device and the network speed. It is an object of the present invention to provide a content distribution system that can be used, and a content distribution system that can select a viewpoint of 3DCG content by user operation.
[0007]
[Means for Solving the Problems]
The content distribution system according to the present invention includes: 3DCG content is registered together with one or more content browsing terminals and a plurality of camera path information that is movement information of a plurality of camera viewpoints, and the camera line of sight is rotated forward and backward from the 3DCG content based on the plurality of camera path information. A CG moving image generation unit that generates CG moving image data that is moving image information when moved from both directions of rotation, and the CG moving image data that can be reproduced by the content browsing terminal and can be reproduced by the content browsing terminal A CG video encoding unit for encoding at a different bit rate, storage means for storing the encoded CG video data, a connection network of the content browsing terminal and terminal performance, and the 3DCG Deliver content, or stream delivery by selecting the CG video content That a content distributor, accumulated CG moving image data each was was a viewpoint position selection means for selecting a viewpoint position by viewer manipulation during delivery of CG video content Is.
[0008]
DETAILED DESCRIPTION OF THE INVENTION
An embodiment of the content distribution system according to the present invention will be described below.
Embodiment 1 FIG.
First, the first embodiment will be described with reference to FIGS. FIG. 1 is a block diagram showing the basic configuration of the content distribution system according to the first embodiment. 2 is a flowchart showing a flow of content generation, FIG. 3 is a diagram showing a configuration example of content generation condition data, FIG. 4 is a flowchart showing a flow of content distribution, and FIG. 5 is a content flow. It is a figure which shows the delivery content information data in which a name, a content browsing terminal, a network classification, and a content position are registered.
[0009]
The content distribution system shown in FIG. 1 includes a server, a terminal, and a network that connects the server and the terminal.
[0010]
The server 1 includes a moving image generation unit 4 that generates CG moving image data from a 3DCG data source, a CG moving image encoding unit 5 that encodes the generated CG moving image data, and a 3DCG data conversion unit 6 that converts the 3DCG data source to 3DCG data. A CG video content generation unit 7 that generates CG video content based on the encoded CG video data, a 3DCG content generation unit 8 that generates 3DCG content based on the converted 3DCG data, a content distribution unit 9 that distributes content, CG video content D / B (data base) 10 for storing CG video content, 3DCG content D / B12 for storing 3DCG content, distribution content condition D / B13 for storing distribution content conditions, and content generation conditions Content generation condition D / Comprising a 17,3DCG content registration unit 18 for storing the data source, CG moving image data display unit 20 to display the main menu D / B19, CG video recording content name stored in the content registration unit 18.
[0011]
The terminals include, for example, a content browsing terminal A (wireless connection) 14, a content browsing terminal B (wireless connection) 15, and a content browsing terminal B (wired connection) 16. Further, the network 21, the network 21, and each content browsing terminal It comprises a wireless network A24 and a wired network A25.
[0012]
Next, the content generation process will be described with reference to the flowchart of FIG. The content creator uses a commercially available 3DCG production tool or the like to generate a 3DCG data source. The 3DCG data source basically includes 3D model data, motion data, and a camera path. However, there are cases where the motion data and camera path are not set.
[0013]
In the case of a 3DCG data source in which motion data is set, the three-dimensional model operates according to the set motion data. The camera path is camera viewpoint movement information. When a moving image is generated from 3DCG by rendering, a moving image whose viewpoint is moved based on the camera path is generated. The 3DCG data used in the content distribution system according to the present invention has at least one of motion data and camera path information.
[0014]
The content creator inputs a 3DCG data source from the content registration unit 18 (step ST101). The content registration unit 18 registers the content name in the main menu D / B 19 (step ST102), inputs the input 3DCG data source to the CG moving image generation unit 4 (step ST103), and also enters the 3DCG data conversion unit 6 Is also input (step ST108).
[0015]
The main menu recorded in the main menu D / B 19 is composed of HTML of a list of content names and ASP (Active Server Page) and Servlet programs set as link destinations of the respective content names. When a content is selected from the content name list on the terminal and clicked, the content name is transferred to the program on the linked server, and the content reproducible on the terminal is identified. Details of content reproduction will be described later.
[0016]
The CG moving image generation unit 4 reads the 3DCG data source, performs rendering processing, and generates CG moving image data (step ST104). In the case of a 3DCG data source having motion data and no camera path, CG moving image data in which the motion of the 3D model is rendered from the default viewpoint is generated. On the other hand, in the case of a 3DCG data source that does not have motion data and has a camera path, the three-dimensional model is rendered as CG moving image data in which the camera moves based on the camera path. In the case of a 3DCG data source having both motion data and a camera path, CG moving image data is generated by rendering 3D model data that operates from the camera line of sight set in the camera path. The generated CG moving image data is uncompressed video data that is not encoded.
[0017]
Next, the CG moving image data is input to the CG moving image encoding unit 5. The CG moving image encoding unit 5 encodes and compresses the input CG moving image data (step ST105). The encoding method is assumed to be encoded by a standard encoding method such as MPEG-4 Visual, for example. The CG moving image encoding unit 5 generates CG moving image data encoded under a plurality of conditions so that one piece of input CG moving image data can be distributed by a network having different performance or can be reproduced by a terminal. The encoding bit rate and encoding method to be created are set in the content generation condition D / B17.
[0018]
A configuration example of the content generation condition D / B 17 is shown in FIG. As can be seen from FIG. 3, the content generation condition D / B 17 stores data of content type, storage location, network type, content browsing terminal, and content generation condition, and the CG video encoding unit 5 stores the content generation condition D / B. A CG moving image is searched from the content type of B17, and encoding is performed according to each content generation condition.
[0019]
Each CG moving image data encoded according to the content generation conditions as described above is input to the CG moving image content generation unit 7. The CG moving image content generation unit 7 adds related information for displaying the encoded CG moving image data, and accumulates the information in the CG moving image content D / B 10 (step ST106). For example, when browsing on a Web browser, HTML for displaying the CG moving image data encoded by the CG moving image encoding unit 5 is generated by the CG moving image content generation unit 7.
[0020]
The content browsing terminal A14 and the content browsing terminals B15 and 16 download the CG video data display unit 20 stored in the server 1 and display the CG video data. The CG moving image data display unit 20 is a Java (registered trademark) applet, an ActiveX control, or the like, and HTML for display on a Web browser is generated in the CG moving image content generation unit 7 by using this. If the CG moving image data can be reproduced independently without any other information, the CG moving image content generation unit 7 is not necessary, and the CG moving image data agrees with the CG moving image content of the CG moving image content D / B10. After generating the CG moving image content, the CG moving image content generation unit 7 generates a content file under the directory registered in the storage location of the content generation condition D / B 17 (step ST107).
[0021]
When the CG moving image content generation unit 7 finishes generating the content, the information on the generated content is registered in the distribution content condition D / B 13. In this way, CG video content for a plurality of types of content browsing terminals connected via different networks is generated.
[0022]
On the other hand, 3DCG data itself is received via a network, and 3DCG content in a format that can be distributed over the Internet is prepared for a high-performance terminal connected to a high-speed network that can be displayed. The 3DCG data source input to the 3DCG data converter 6 in step ST108 is converted into 3DCG data that can be displayed on the Web (step ST109). At the time of conversion, 3DCG content conditions registered in the content generation condition D / B 17 are searched and converted to 3DCG data that matches the content generation conditions. If the 3DCG data source is a format that can be displayed on the Web browser in the same format, the 3DCG data conversion unit 6 is not particularly required.
[0023]
The converted 3DCG data is input to the 3DCG content generation unit 8. If the 3DCG data is data displayed by Java (registered trademark) applet or ActiveX control, the 3DCG content generation unit 8 generates content by adding an HTML sentence when displayed by a Web browser (step ST110). If the 3DCG data itself can be reproduced, the 3DCG content generation unit 8 is not particularly necessary. When generating the 3DCG content, the 3DCG content generation unit 8 generates a content file under the directory of the storage location registered in the content generation condition D / B 17 (step ST111).
[0024]
When the CG content generation unit 8 finishes generating the content, it registers the generated content information in the distribution content condition data D / B 17. Here, even in the 3DCG content, if a plurality of conditions are described in the content generation condition D / B 17, a plurality of contents can be generated in accordance with the conditions.
[0025]
Next, the content distribution process operation will be described with reference to FIG. The user browses the content from the content browsing terminal. In the present embodiment, a case will be described in which 3DCG content is browsed by the content browsing terminal A14, the content browsing terminal B15, and the content browsing terminal B16 connected by the wired network A25.
[0026]
Here, the content browsing terminal A14 is a mobile terminal, and the 3DCG content stored in the 3DCG content D / B 12 cannot be played back, but the CG video content stored in the CG video content D / B 10 can be played back. And Further, it is assumed that the content browsing terminal B (15, 16) is a terminal capable of reproducing the 3DCG content stored in the 3DCG content D / B12.
[0027]
The wireless network A24 can transmit the CG moving image content stored in the low bit rate CG moving image content D / B10, but is sufficient to transmit the 3DCG content stored in the 3DCG content D / B12. On the other hand, it is assumed that the wired network A25 has a bandwidth capable of transmitting 3DCG content and high bit rate CG moving image content.
[0028]
In the present embodiment, a case where content is browsed by the content browsing terminal A14 will be described. The browser accesses the content registered in the main menu D / B 19 to the server 1 from the browser of the content browsing terminal A14 (step ST201). A list of content names currently registered in the server 1 is stored in the main menu D / B 19. A content name to be browsed is selected from the list of content names in the main menu D / B 19, and a request is transmitted to the server 1 (step ST202).
[0029]
The content distribution unit 9 receives a request from the content browsing terminal A14 and recognizes the type of the terminal from the user agent information in HTTP.
useragent is, for example,
Mozilla / 2.0 (compatible; MSIE 3.02; Windows® CE; 240x320)
Is recognized as a PDA equipped with a Windows (registered trademark) OS.
For example, regarding the connected network, the network type is recognized from the address included in the gateway information or remote host information in HTTP (step ST203).
[0030]
The content distribution unit 9 accesses the distribution content condition D / B 13 using the recognized information. FIG. 5 shows data recorded in the distribution content condition D / B 13, and the content name, content browsing terminal type, network type, and content position are registered as shown in FIG. The content distribution unit 9 searches the distribution content condition D / B 13 and obtains the content type and content location where the content is stored using the requested content name, content browsing terminal type, and network type as keys (step ST204). ) The searched content is transmitted to the content browsing terminal A14 (step ST205). The received content is displayed on the content browsing terminal A12 (step ST206).
[0031]
In FIG. 5, when content A is requested from the content browsing terminal A14 through the wireless network 24, CG video data in the CG video content D / B 10 is shown.
http: //hostA/CGM/A1/index.html
Is transmitted to the content browsing terminal A14. The actual CG video data includes an address in the html file and is streamed to the viewing terminal. In this way, the requested content can be distributed in conformity with the performance of the requesting content browsing terminal and the connection.
[0032]
Embodiment 2. FIG.
Next, the content distribution system according to the second embodiment will be described with reference to FIG. FIG. 6 is a block diagram showing the configuration of the content distribution system according to the second embodiment. Embodiment 2 is a configuration of a content distribution system capable of inputting a 3DCG data source from a terminal via a network. In Embodiment 1 shown in FIG. 1, a 3DCG data source is input to the content distribution system via a network. For this purpose, a content registration terminal 200 and a registered content receiving unit 201 are further provided.
[0033]
The content creator transmits the 3DCG data source to the server 1 side using the content registration terminal 200 connected to the server 1 via the network 21. A method for transmitting a file via a network can be realized by, for example, using Microsoft network file sharing of Microsoft Corporation and periodically monitoring whether a new file is transmitted on the server 1 side. On the server 1 side, the registered content receiving unit 201 receives the 3DCG data source and inputs it to the CG moving image generating unit 4 and the 3DCG data converting unit 6. Subsequent processing is the same as that of the content distribution system of Embodiment 1, and the description thereof is omitted.
[0034]
As described above, the 3DCG data source created by the content creator from a remote location can be registered in the server 1. Note that the content registration unit 18 may be provided together with the registered content reception unit 201 in the server 1 as in the first embodiment.
[0035]
Embodiment 3 FIG.
Next, a content distribution system according to the third embodiment will be described with reference to FIGS. 7 is a block diagram showing a system configuration in 3DCG content distribution having a plurality of camera paths according to the third embodiment, FIG. 8 is a diagram regarding setting of camera paths in 3DCG, and FIG. 9 is a camera path. FIG. FIG. 10 is a diagram showing an example of interactive CG video content, FIG. 11 is a diagram showing an example of interactive CG video content when a content template is not used, and FIG. 12 shows an operation in the CG video display unit. It is a figure which shows an example of a possible interactive CG moving image content.
[0036]
As shown in FIG. 7, the content distribution system according to the present embodiment includes a CG video generation unit 100 that generates a CG video, a CG video encoding unit 101 that encodes the generated CG video, and an encoded CG video. List of camera paths set in interactive CG video content generation unit 102 that generates interactive CG video content from data, CG video content D / B 104 that stores CG video data generated by a plurality of camera paths, and 3DCG data source Content registration D / B 105 storing content templates, content templates D / B 107 storing templates of interactive content, CG video data display unit 108 displaying CG video data, and content registration for registering 3DCG content having a plurality of camera paths Part 109 is provided. Other configurations are the same as those described in the first embodiment, and a description thereof will be omitted.
[0037]
FIG. 8 shows a 3DCG camera path setting. A 3DCG model 310, a vertical rotation camera path (forward rotation, backward rotation) 311, and a horizontal camera path (clockwise rotation, counterclockwise rotation) 312 can be set. FIG. 9 shows the details of the camera path list. As shown in the figure, the camera path distinction is set by the camera path identifier.
[0038]
FIG. 10 shows an example of interactive CG video content when a content template is used. In the interactive CG video content 300, a button 301 for displaying CG video data in the vertical upper front direction and CG video data in the horizontal clockwise direction are displayed. A button 302 for displaying CG moving image data in a vertically downward direction, a button 304 for displaying CG moving image data in a counterclockwise horizontal direction, a CG moving image data display unit 305, and the like. By operating these buttons 301, 302, 303, and 304, the 3DCG viewpoint can be set.
[0039]
FIG. 11 shows an example of interactive CG moving image content when a content template is not used. The interactive CG moving image content 320 includes a CG moving image data display unit 321, a CG moving image data switching menu 322, and the like. A 3DCG viewpoint can be set by operating the CG moving image data switching menu 322.
[0040]
Next, the operation of the third embodiment will be described with reference to FIG.
The 3DCG data source input from the content registration unit 109 has a plurality of camera paths. FIG. 8 is a diagram showing an example of content having a plurality of camera paths. In this figure, four camera paths are rotated around the 3DCG model 310 in the forward direction in the vertical direction 311, the reverse direction, and the forward direction in the horizontal direction 312 and the reverse direction. Is set.
[0041]
A 3DCG content distribution method having a plurality of camera paths will be described. The content creator inputs the 3DCG data source and the camera path list from the content registration unit 109 to the CG moving image generation unit 100, while inputting the 3DCG data source to the 3DCG data conversion unit 6. The camera path list recorded in the camera path D / B 105 includes a camera path name and a camera path identifier as shown in FIG. 9, and the camera path name is used when the CG content is finally generated. The path identifier is an identifier for uniquely associating with the camera path set in the 3DCG data source.
[0042]
The CG moving image generation unit 100 renders 3DCG data based on the camera paths described in the input camera path list. For this reason, the CG moving image data generated by the CG moving image generating unit 100 is generated by the number of camera paths described in the camera path list for one 3DCG data source. The generated CG moving image data is encoded by the CG moving image encoding unit 101 one file at a time. Except for encoding a plurality of CG moving image data, it is the same as the encoding process in the first embodiment, and a description thereof will be omitted.
[0043]
The plurality of encoded CG moving image data is input to the interactive CG moving image content generation unit 102. The interactive CG moving image content generation unit 102 calls an interactive content template from the content template D / B 107. The content template stored in the content template D / B 107 is a template of interactive content created by the system. In this embodiment, the appearance of the three-dimensional model is set in four horizontal and vertical directions as shown in FIG. It is defined that CG moving image data is generated by a camera path. Therefore, if a camera path name is determined in advance, interactive CG moving image content can be generated.
[0044]
The content template includes a basic content configuration, and the interactive CG video content generation unit 102 replaces the link destination of each button of the content template with the file name of the CG video data generated using the name of the camera path. Accordingly, it is possible to generate the CG moving image content to be stored in the interactive CG moving image content D / B 104 that can be intuitively operated by the viewer as shown in FIG.
[0045]
When the content template is not used, the name as shown in FIG. 11 can be generated by displaying the name of the camera path in the content and setting the corresponding CG video data as the link destination. The viewer can switch the CG video data by selecting the camera path in the direction desired to be browsed from the CG video data switching menu 322.
[0046]
As described above, by making it possible to switch CG moving image data generated by a plurality of camera paths by a viewer's operation, a terminal that cannot view 3DCG data in the 3DCG content D / B 12 due to its performance. 3D, the 3DCG content can be browsed in a pseudo manner.
[0047]
FIG. 12 shows an example of interactive CG moving image content that can be operated in the CG moving image display unit. The interactive CG moving image content 400, the operation area 401 for displaying the vertically upward CG moving image data, and the horizontally clockwise CG moving image data are shown. An operation area 402 for displaying, an operation area 403 for displaying vertically downward CG moving image data, an operation area 404 for displaying horizontally counterclockwise CG moving image data, and a CG moving image data display unit 405 are provided.
[0048]
Also, as shown in FIG. 10, by downloading the CG moving image data display unit 108 having the functions of the buttons 301 to 304 for selecting CG moving image data, the mouse path in the CG moving image data display unit 108 can be changed with different camera paths. It is possible to switch the generated CG video content. In this case, the interactive CG video content generation unit 102 describes the file path of the CG video data to be switched to the operation zone as a parameter to be passed to the CG video data display unit 108 in the HTML of the CG video content to be generated, and defines the operation zone. I do. In this way, the corresponding CG moving image data is displayed by clicking the mouse in the operation areas 401 to 404 for displaying the CG moving image data of FIG.
[0049]
As described above, it is possible to provide a pseudo browsing environment closer to the user interface of 3DCG content by enabling switching of CG video data generated by a plurality of camera paths by a mouse operation in the CG video display unit. It becomes.
[0050]
【The invention's effect】
As described above, according to the present invention, the requested content can be distributed in accordance with the performance of the content browsing terminal that is the request source and the performance of the connected and network, and the user can receive a huge amount of data, for example, three-dimensional Even if it is the computer graphic data etc., there is an effect that the distribution can be received.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a content distribution system according to a first embodiment.
FIG. 2 is a flowchart showing a flow of content generation.
FIG. 3 is a diagram illustrating a configuration example of content generation condition data.
FIG. 4 is a flowchart showing a flow of content distribution.
FIG. 5 is a diagram showing distribution content information data in which a content name, a content browsing terminal, a network type, and a content position are registered.
6 is a block diagram showing a configuration of a content distribution system according to Embodiment 2. FIG.
7 is a block diagram showing a configuration of a content distribution system according to Embodiment 3. FIG.
FIG. 8 is a diagram related to setting of a camera path in 3DCG.
FIG. 9 is a diagram illustrating a relationship between a camera path name and a camera path identifier.
FIG. 10 is a diagram illustrating an example of interactive CG moving image content.
FIG. 11 is a diagram illustrating an example of interactive CG moving image content when a content template is not used.
FIG. 12 is a diagram illustrating an example of interactive CG moving image content that can be operated in a CG moving image display unit.
[Explanation of symbols]
1 server (server system), 4,100 CG moving image generation unit, 5,101 CG moving image encoding unit, 6 3DCG data conversion unit, 7 CG moving image content generation unit, 8 3DCG content generation unit, 9 content distribution unit, 10, 104 CG video content D / B, 12 3DCG content D / B, 13 distribution content condition D / B, 14 content browsing terminal A, 15, 16 content browsing terminal B, 17 content condition D / B, 18, 109 content registration unit 19 Main menu D / B, 20, 108, 305, 321, 405 CG movie data display unit, 21 network, 24 wireless network A, 25 wired network A, 102 interactive CG movie content generation unit, 105 camera path D / B 107 Content template D / B, 200 content registration terminal, 201 registered content reception unit, 300, 320, 400 interactive CG video content, 301, 302, 303, 304 display button, 310 3DCG model, 311 vertical camera path, 312 horizontal camera path, 322 CG video data switching menu, 401, 402, 403, 404 operation area.

Claims (1)

One or more content browsing terminals;
When 3DCG content is registered together with a plurality of camera path information, which is movement information of a plurality of camera viewpoints, and the camera line of sight is moved from each of the 3DCG contents in both forward and reverse directions based on the plurality of camera path information. A CG video generation unit that generates CG video data that is video information of
A CG video encoding unit that encodes the CG video data for encoding at a bit rate that can be played back by a content browsing terminal and a video encoding method that can be played back by the content browsing terminal;
Storage means for storing each of the encoded CG video data;
A content distribution unit that identifies a connection network and terminal performance of the content browsing terminal and distributes the 3DCG content, or selects and streams the CG video content;
Each of the stored CG moving image data includes a viewpoint position selection unit that can select a viewpoint position by a viewer's operation when distributing CG moving image content.

Images