JP4496661B2 - How to create an edit list - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an edit list creation method, and more particularly to an edit list creation method for forming content using a plurality of video and / or audio materials.
[0002]
[Prior art]
Moving picture editing began with movie film splicer + cement, but in video editing, the era of electronic editing by dubbing has continued for a long time after Dermat + scissors + splicing tape.
[0003]
The non-linear editor that has become popular over the last decade is also an extension of that. In other words, while observing images obtained from the media, they are mainly connected by dubbing, subjected to image processing as necessary, and the edited results are stored in the media again. The year has been followed.
[0004]
However, this traditional method has the following problems.
First, image quality degradation occurs due to repeated data compression and decompression. In the era of analog editing, image quality degradation also occurred in electronic editing due to repeated dubbing, but in the baseband digital era, it should have been almost completely eliminated. However, with the recent spread of image compression technology, the image quality problem has been rekindled. The cause is repeated data compression and decompression. As countermeasures, compromises such as reducing the compression rate or shortening the compression unit are taken, but it is uneconomical in many aspects such as media cost and communication time, and image quality degradation is completely eliminated. There is no reason. Even when data compression is not performed, image quality degradation and uneconomical effects are brought about by repeated processing of so-called special effects such as image enlargement / reduction, pixel shift, and composition.
[0005]
The next problem is that conventional editing can only handle a single image format. NTSC and other image formats were devised and unified with the focus on receivers and radio wave allocation. However, it is rather common that multiple image formats such as HDVS and windows on a PC are used together in recent years. The fact that only a single format can be handled has been a major nuisance both in collecting materials and providing complete packages. Moreover, especially on a computer, the user can create a window with arbitrary specifications, so the method of selecting from the prepared formats is not enough.
[0006]
The next problem is that in conventional editing, the material has to be collected and used. At the time of editing, a time code is used to specify the target image, but it only indicates the position in one volume, and it is basically impossible to specify the media. A method of identifying media by reel number is also used, but it is limited to the local operation range. Therefore, the material must be stored in hand before use, which requires labor and cost. Similarly, special effects, title insertion, and the like are model-dependent, and processing that is not supported by the device at hand is impossible, so the edited result must be recorded on the medium at hand.
[0007]
Not all of the above problems are solved, but recently, a system has been adopted in which an EDL (Edit Decision List) is created as an edit list and electronic editing is automatically performed according to a program described in the EDL. Yes.
[0008]
By the way, in the EDL, incompatible items such as special effects are described, and the system is limited. There are also tape replacements, and many people rely on human hands. From the point of view that flexibility is difficult, it is troublesome to correct a complete packet. For example, even if only one frame is inserted before the first frame, re-editing or dubbing of the entire program is required.
[0009]
As described above, the current editing system has many aspects that are uneconomical and inefficient at the present time, but more than that, there is one aspect that the advantages of the network cannot be enjoyed. If you stick to the current situation, there is a high risk of becoming a backward system left behind in the times. Since each problem is organically entangled, even if partial countermeasures are taken, new problems will be caused, and the complexity will increase in a chain, so it will eventually not be used with the current editing system It can happen.
[0010]
[Problems to be solved by the invention]
The present invention has been made in view of the above-described circumstances, and can be compatible with multi-format data while preventing deterioration of data quality, and further compatibility of processing without temporarily storing and using the material on hand. An object of the present invention is to provide an edit list creation method for creating an edit list capable of forming content.
[0011]
[Means for Solving the Problems]
  An edit list creation method according to the present invention provides an edit list creation method for creating an edit list for forming content using a plurality of video and / or audio materials in order to solve the above-described problem.An edit list is created by executing a desired operation using compressed data obtained by compressing a plurality of video and / or audio materials input from an input unit connected to a network. The edit control signal is generated based on the edit list.Identify input materialInput materialIdentification informationOutput identification information for identifying output by editing, image format of input material and / or image of edited outputA format declaration statement that identifies the format andImage processing identification information representing an image processing method applied to the input material, the input material is acquired from the storage location specified by the input material identification information via the network, and is specified by the image processing identification information. An image processing method applied to the input material is acquired from the storage location via the network.
[0012]
By providing each of the steps as described above, the edit list creating method according to the present invention first defines edit contents using at least identification information for identifying an output by editing and a format declaration statement for specifying a format, and The input material is defined using at least the identification information for identifying the input material and the format declaration statement for specifying the format of the input material, and further the processing to be performed on the input material is defined.
[0013]
Here, since the output identification information and the input material identification information are globally unique identification codes of the same system, the output and the input material can be specified.
[0014]
Further, since the processing method applied to the input material is described by a globally unique identification code of the same system, the processing method can be specified.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of an edit list creation method according to the present invention will be described below with reference to the drawings. In this embodiment, as shown in FIG. 1, an EPL creation unit 10 that creates an edit procedure list (EPL), which is a kind of edit list, based on the edit list creation method of the present invention. This is a content forming apparatus 1 that is built in and forms content.
[0016]
In addition to the EPL creation unit 10, the content formation device 1 includes an edit control unit 20 that generates an edit control signal based on the EPL, and a content formation unit 30 that forms content in a predetermined format.
[0017]
The content forming apparatus 1 is input with a material composed of a plurality of videos and / or sounds. Here, for convenience of explanation, it is assumed that the material is stored in a database connected to a network such as a local area network (LAN) or the Internet. This material is supplied to the EPL creation unit 10 and the content formation unit 30 via the input terminal IN.
[0018]
The EPL creation unit 10 decodes the above-mentioned material by the decoder 11, thins it out by the down converter 12, for example, and compresses it by a predetermined compression method such as JPEG (Joint Photographic Experts Group; JPEG) method by the encoder 13. Are stored in the sub-material server 14. The sub-material server 14 is an AV server having a recording / reproducing unit having a disk array configuration. The sub-material server 14 sequentially takes in high-compressed sub-materials to be input, converts them into a file, and stores them at designated address positions in the recording / reproducing unit.
[0019]
The high-compression sub-material of each file stored in the sub-material server 14 is supplied to a plurality of (in this case, three) editing terminals 15, 16, and 17 connected to the sub-material server 14. , Used to create EPLs.
[0020]
The editing terminals 15, 16, and 17 are the main part of the EPL creation unit 10, and read and decode the highly compressed sub-material, and display the video based on the obtained material data on the monitor. At this time, the operator controls the sub-material server 14 via the editing terminal, and visually checks the video displayed on the monitor while causing the sub-material server 14 to perform a desired operation (playback, rewind, fast-forward, etc.). Confirm and create an EPL. The EPL has identification information for specifying a material used for editing, and a format declaration statement that defines the format of at least a part of the material.
[0021]
Hereinafter, the EPL created by the EPL creation unit 10 will be described. In the EPL, identification information for specifying a material used for editing is described. The material identification information is a globally unique identification code and is referred to as a material identification code (Material ID; UMID). In addition, an identification code for identifying a material processing method, that is, an identification code representing an image processing method is defined in the EPL in accordance with the above identification code system. The identification code for identifying the material processing method is also a globally unique identification code, which is called a process ID or a unique transformID (UTID). The process such as fade, mix, and super can be identified by the UTID. In addition, in this EPL, metadata about output is also described. This is the ID of the editing result by EPL, and includes the UMID. In addition, in this EPL, for example, a time code (TC) indicating the start point and end point of editing in time is also described.
[0022]
Further, the EPL describes a format declaration statement that defines the format of at least a part of the material. This format declaration statement includes the image format of the input video material and / or the image format of the edited output. For this reason, the content formed by the content forming apparatus 1 has the format declared by the format declaration statement. If the format is declared by the format declaration statement, the contents of any format can be formed.
[0023]
The range of time described in one EPL file is the minimum frame and the maximum is infinite. The order of description follows the process, and it can be described so that a plurality of processes are executed simultaneously. This is similar to the “verilog” language that can describe parallel processing, so it can be thought of as a base. However, since there is no concept of link, global, and struct in verilog, diversion is impossible.
[0024]
EPL basically has no variables. There are no arithmetic operations or function statements, but only command statements (processing and control). The delivery of image data is not specified in the syntax. The output from the top line will only be entered below.
[0025]
A specific example of EPL will be described below. The external SD image (525i image) is made black and white, inserted into the enclosed image as a reminiscence scene, and edited for adding a title. 2 and 3 show EPL description examples. 2 and 3 show the same EPL description example, FIG. 2 is simplified, and FIG. 3 is detailed. FIG. 4 shows an image diagram of EPL execution. FIG. 5 schematically shows an image that can be created after editing.
[0026]
First, the EPL description example of FIGS. 2 and 3 will be described.
“Epl” in the underlined portion (1-1) in the first row indicates that the unit of EPL is shown in () that follows, and defines an image to be output. The underlined part (1-2) in the same row, that is, “umid” is identification information of the output image, and is a globally unique identification code UMID. Specifically, as shown in FIG. 3, it is a long code such as “02232203_824504F1_0800468A92000201” and is truly globally unique. Underlined portions (1-3) and (1-4) in the same row indicate the start point and end point of editing. Here, the time code of the start frame and the time code of the end frame are described. It specifies that the start point is “00: 00: 00.00” and the end point is “00: 01: 00.02”. The underlined portion (1-5) in the same row is a scan format scan_format, which is a kind of the format declaration sentence described above. Here, the output video format is shown. “# 1080i” is a video format of an HD image. The underlined portion (1-6) in the same row, that is, “} {”, is combined with “}” in the underlined portion (23-1) on the 23rd row to enumerate the image processing within the range surrounded by {}. , Indicates that. The image processing here follows the signal flow.
[0027]
The underlined part (2-1) in the second row, that is, “source” means a designation process in which an input material is designated within () that follows. Umid in the accompanying underlined part (2-2) in () is an image ID, specifically a long code such as “22083102_95440497_0800468A62000232” shown in FIG. That is, the material is specified using the globally unique UMID. The underlined part (2-3) in the same row indicates the time code of the start frame. When it is omitted as in FIG. 2, it indicates from the beginning. “# Embedded.mpg” in the underlined portion (2-4) in the same row indicates a material acquisition destination, that is, a location where the material is stored. “# 1080i” in the underlined portion (2-5) is a scan format scan_format, which is a kind of the above-described format declaration statement. Here, the video format of the input material is shown. Therefore, the image format of the input material can be specified. With the description of the underlined portions (2-1) to (2-5) in the second row, the input material can be read from the material storage unit 40 of FIG. 4 connected to the network.
[0028]
Next, “fork” in the underlined portion (3-1) in the third row in FIG. 2 is paired with “join” in the underlined portion (22-1) in the 22nd row. The output indicates that the data is added together by join. In FIG. 4, the processing is performed in a range sandwiched between the sign 41 and the adder 42, and a plurality of inputs 1 from the material storage unit 40 are processed in parallel and added together by the adder 42. Show. The contents of the processing are as shown in the fourth and fifth lines.
[0029]
The “@” in the underlined part (4-1) in the fourth row indicates that the clipping position is designated on the time axis on the input side by the number in () that follows. And the starting point is shown in the accompanying underline part (4-2) in (). Here, “02: 10: 00.00” on the time axis on the input side is shown. “Put” in the underlined portion (4-3) of the same line designates the pasting position of the portion cut out from the input material in the following () on the time axis on the output side. Here, as shown in the underlined parts (4-4) and (4-5) in (), it is pasted from “00: 05.00” to “00: 25.00” on the output side. In this process, the input material 43 (shown in FIG. 4) from the clipping position designated on the time axis on the input side is pasted as “main cut 1” from “00: 05.00” to “00: 25.00” on the output side.
[0030]
The “@” in the underlined part (5-1) in the fifth row also indicates that the cutout position is designated on the time axis on the input side by the number in () that follows. The underlined part (5-2) in () indicates “02: 10: 20.00” on the time axis on the input side. “Put” in the underlined portion (5-3) of the same line also indicates that the pasting position of the portion cut out from the input material is designated on the time axis on the output side in the following (). Here, as shown in the underlined parts (5-4) and (5-5), it indicates that the output side is pasted from “00: 35.00” to “01: 00.02”. In this process, the input material 44 (shown in FIG. 4) from the clipping position designated on the time axis on the input side is pasted as “main cut 2” from “00: 35.00” to “01: 00.02” on the output side.
[0031]
Next, “{” in the underlined part (6-1) in the sixth row is paired with “}” in the underlined part (11-1) in the eleventh row. Indicates that a plurality of processes are sequentially executed from the upper line. This corresponds to the process 45 shown in FIG.
[0032]
Next, the input material is specified in the following parentheses by “source” in the underlined portion (7-1) on the seventh row. The umid of the accompanying underlined part (7-2) in () is a long code such as “22083102_95440497_0800468A62000232” shown in FIG. “06: 54: 32.10” in the underlined portion (7-3) of the same row indicates the time code of the start frame. “Url” in the underlined portion (7-4) of the row indicates a material acquisition destination, that is, a location where the material is stored. Specifically, as shown in FIG. 3, it is “ftp://43.14.61.62/source/”. “# 525i” in the underlined portion (7-5) is a scan format scan_format, which is a kind of the above-described format declaration statement. The video format of the input material is shown. Therefore, the image format of the input material can be designated. According to the description of the underlined portions (7-1) to (7-5) in the seventh row, the input material having the video format “# 525i” in the processing 45 shown in FIG. The processing to be read and stored in the material storage unit 47 of FIG. 4 can be specified. The accompanying underline (7-6) indicates what scene this source is used for. Here, it is “// recollect”, and it is specified that it is a recollection scene.
[0033]
Next, “transform” in the underlined part (8-1) on the eighth line indicates that image processing is designated within the parentheses that follow. “Utid” in the underlined portion (8-2) of the row is a processing ID, and describes a globally unique image processing code (Transform ID; UTID). Specifically, it is “12000000000090001” as shown in FIG. “Url” in the underlined portion (8-3) in the same row indicates the acquisition destination of the processing method, that is, the location where the processing method is stored. Specifically, as shown in FIG. 3, it is described as “ftp://43.14.61.62/exec/”. "" Upconv525to1080 "" in the accompanying underlined part (8-4) is a common name for processing, and when it cannot be obtained from the acquisition source, it enables alternative processing. Here, processing for up-converting the video format from 525 lines to 1080 lines is shown. “# 1080i” in the underlined portion (8-5) is a scan format scan_format, which is a kind of the above-described format declaration statement. The output video format is shown. Therefore, the output image format can be specified. If it is the same as the input video format, it can be omitted. According to the description of the underlined portions (8-1) to (8-5) in the eighth row, the video format stored in the material storage unit 47 in FIG. 4 in the process 45 shown in FIG. 4 is “# 525i”. Can be specified for the up-conversion unit 48 to up-convert the input material into the video format “# 1080i”.
[0034]
Next, image processing is designated in parentheses by “transform” in the underlined part (9-1) on the ninth line. As a specific example of “utid” in the underlined portion (9-2) of the same line, there is “120000000001F0001” as shown in FIG. “Url” in the underlined portion (9-3) of the same row indicates a location where the processing method is stored. Specifically, as shown in FIG. 3, it is described as “ftp://43.14.61.62/exec/”. "" Monochrome "" in the underlined portion (9-4) is a common name for processing. Here, the process of making the image up-converted to 1080 lines black and white is shown. Here, the description of “# 1080i” in the previous underlined portion (8-5) is omitted. It can be omitted if it is the same as the input. According to the description of the underlined portions (9-1) to (9-4) in the ninth row, the image up-converted to the video format “# 1080i” in the processing 45 shown in FIG. The monochrome processing unit 49 converts the image into a monochrome image.
[0035]
Next, in “put” in the underlined part (10-1) of the 10th row, the pasting position of the black and white image is specified on the time axis on the output side in () that follows. The process of pasting from “00: 25.00” to “00: 35.00” on the output side is specified in the underlined portions (10-2) and (10-3) in (). It is pasting of the recollection scene shown in FIG.
[0036]
Next, “{” in the underlined portion (12-1) of the 12th row is paired with “}” in the underlined portion (21-1) of the 21st row. Indicates that a plurality of processes are sequentially executed from the upper line. This corresponds to the processing 51 shown in FIG.
[0037]
Next, the input material is specified in the following parentheses by “source” in the underlined portion (13-1) on the 13th row. The umid in the accompanying underlined part (13-2) in () is a long code such as “00000000_8244041D_0800468A940000522” shown in FIG. “00: 00: 00.00” in the underlined portion (13-3) of the same row indicates the time code of the start frame. “Url” in the underlined portion (13-4) of the accompanying line is an image acquisition destination, and specifically “ftp://43.14.61.62/source/*.jpg” as shown in FIG. “# 1080i” in the underlined portion (13-5) indicates the video format of the input material. Therefore, the image format of the input material can be designated. According to the description of the underlined portions (13-1) to (13-5) in the thirteenth row, the input material having the video format “# 1080i” in the processing 51 shown in FIG. The processing to be read and stored in the material storage unit 53 in FIG. 4 can be specified. The accompanying underlined portion (13-6) indicates to which scene this source is used. Here, it is “// title” and specifies that it is used for the title.
[0038]
Next, “fork” in the underlined portion (14-1) in the 14th row is paired with “join” in the underlined portion (20-1) in the 20th row, and a plurality of inputs 1 are processed in parallel and output. Indicates that they are added together by join. In FIG. 4, the material read from the material storage unit 53 is processed in two systems and is added by the adder 57. The contents of processing in the two systems are as follows.
[0039]
First, in “put” in the underlined part (15-1) on the 15th line, the pasting position of the title material 54 read from the material storage unit 53 is specified on the time axis on the output side in (). To do. The process of pasting from “00: 00.00” to “00: 04.00” on the output side is specified in the underlined portions (15-2) and (15-3) in ().
[0040]
Next, “{” in the underlined part (16-1) of the 16th line is paired with “}” in the underlined part (19-1) of the 19th line. Indicates that a plurality of processes are sequentially executed from the upper line. This corresponds to the upper half of the process 51 shown in FIG.
[0041]
“Transform” in the underlined portion (17-1) on the 17th row designates image processing within the following (). Specifically, “utid” of the underlined portion (17-2) is “1200000000080001” as shown in FIG. Specifically, “url” in the underlined portion (17-3) of the row is “ftp://43.14.61.62/exec/” as shown in FIG. "" Fadeout "" in the underlined portion (17-4) of the same line represents a fade-out process. In the accompanying underlined portion (17-5), the output video format is omitted. Since it is the same as the input video format, it can be omitted. “1.0” in the underlined portion (17-6) is a unique factor, and lists the unique set values required for the processing. According to the description of the underlined parts (17-1) to (17-6) on the 17th line, the input material “# 1080i” supplied from the material storage unit 53 in the processing 51 shown in FIG. The processing for fading out by the processing unit 55 can be specified.
[0042]
Next, in “put” in the underlined part (18-1) on the 18th line, the pasting position of the processing output 56 from the fade-out processing unit 55 is specified on the time axis on the output side in () that follows. In the accompanying underlined portions (18-2) and (18-3) in (), the pasting process is specified from “00: 04.00” to “00: 05.00” on the output side.
[0043]
Then, the adder 57 adds the title material 54 + the fade-out processing output 56 and supplies the added output to the adder 42. As shown in FIG. 5, the adder 42 puts the main cut 1 after the title to be faded out, and outputs the editing result with the main cut 2 inserted between the black and white recollection scenes.
[0044]
Next, the lower syntax of FIG. 3 will be described. “Format” in the underlined portion (25-1) designates an image format by {} that follows. "1001/60000" in the underlined part (25-2), "Capturing interval (long / long) [s]" (parameter) in the underlined part (25-3), or "" in the underlined part (26-1) "1080 / 59.94i" "and" // Name of format (char) "in the underlined part (26-2) designate the image format.
[0045]
In addition, “format” in the underlined portion (27-1) also designates the image format with {} that follows. "1001/60000" in the underlined portion (27-2), "Capturing interval (long / long) [s]" (parameter) in the underlined portion (27-3), or "" in the underlined portion (28-1) The image format is specified by “480 / 59.94i” ”and“ // Name of format (char) ”in the underlined part (28-2) as described above.
[0046]
The EPL in FIG. 3 defines the details of the enclosed image data by “image” in the underlined part (29-1). The underlined part (29-2) in () indicates the number of bytes in the binary part. Here, (bit + 7) * 8/8. The underlined part (29-3) is a name in the file, and is “embedded” here. "Binary data ..." in the underlined part (29-4) specifies the data body.
[0047]
The specific example of EPL has been described above.
The EPL is usually processed by an interpreter as a character string. Editing etc. is performed with the character string as it is. When compiling, etc., it is code specific to the device, so it is not defined in this format. Use normal lossless compression (zip, lha huffman, etc.) when compressing for storage.
[0048]
The UMID is SMPTE330M basic UMID 32 Bytes. Universal level (Instanceal label) and instance (Instance) etc. are omitted, and only material number (Material number) 16Bytes is sufficient. The output image is generated in the execution process, but is regarded as material generation in the EPL generation and added there.
[0049]
The notation is hexadecimal (hexadecimal), and an underscore (underscore '_') can be inserted arbitrarily for visual inspection. When enclosed in parentheses (), it indicates the processed image, not the material itself. The acquisition source (argument of source and transform) is distinguished at the beginning of the string. If the UMID is registered in the database in advance, the acquisition source can be omitted.
[0050]
The time code TC is a general hour: minute: second.Frame, and unnecessary high-order digits can be omitted. Only the IN point TC is described on the input side, and both IN / OUT TCs are described on the output side. On the output side, the insertion position is described with put ().
The input side describes the cutout position using the argument in source () or @ (). When performing cut editing, it is necessary to describe both TCs for both input and output. The TC on the input side can be omitted if it is not necessary to specify the effect only.
[0051]
The image data passed from top to bottom is R / G / B / tl or Y / Pb / Pr / tl. For example, if Y color difference is 4: 2: 2, Y tl Pb Pr Y tl is repeated from the upper left pixel. Also, when passing a path narrower than the total bit width specified by format {}, it is packed with LSB first.
[0052]
The transmissivity tl (translucent) is attached to each Y, and the value is 0 (opaque) for normal images. This tl is only used in the middle, not in the normal epl () execution output.
[0053]
The data format of the input image is determined by the file extension. It can be omitted. For example, epl indicates an EPL file. Eiv represents EPLL Intermediate Video. Ybr represents Y / Pb / Pr. Moreover, rgb shows Red / Green / Blue. Jpg indicates JPEGwp. Mpg represents MPEG1.
[0054]
As described above, there are various data formats of the input image, but the above-mentioned and all MPEG2 profiles are supported as standard. For non-standard compression, describe decompression processing with transfrom () immediately after source ().
The above eiv is a non-compressed format {} header including up to tl. This eiv occurs when plug () is executed without optimization. Normally, the server manages it according to the UMID standard, and the file name is not written on the EPL. Therefore, use wild card '*' to describe the extension.
[0055]
Since the output image is supplied only to the monitor and the broadcast encoder (encode), it is only uncompressed. However, compression can be defined by describing transform () in the last line of epl () {}.
[0056]
Next, the format of the video scan format (video scan format) placed on the EPL will be described.
[0057]
Describe detailed specifications one by one, considering future and versatility. In other words, 720x480, 60 / 1.001, colorimetry, ... are listed together with the common name "NTSC".
[0058]
However, even in the future, it is a raster, and the concept of pixels and frames is retained. In other words, the video format of the present invention is a generalized representation of a raster video format.
[0059]
When it is put in the format {} statement on the EPL, it is described with an ASCII character string as shown in the following example. When loading the video signal, the specified data type binary 128 bytes is inserted for each clip.
・ Capturing interval: Indicates the time of one frame at the time of shooting. long / long [s]
・ Shutter speed… Shows the shutter speed when shooting. float [s]
・ Shutter timing… Indicates the time when the shutter was opened. float [s]
・ Display interval: Indicates the time of one frame at the time of display. long / long [s]
・ RGB on chromaticity: Indicates coordinates on the chromaticity diagram of the three primary colors RGB and white. fixed x 2 x 4
・ Matrix coefficients: Indicates the conversion matrix to Y / Pb / Pr. fixed x 9
・ Gamma code: Indicates the gamma conversion symbol. char
・ Interlace code: Indicates the interlace code. char
・ Padding… Byte count adjustment. char x 4
・ Picture size… Indicates the number of effective pixels vertically and horizontally. short * short
・ Active size: Indicates the range excluding black solids. short * short
-Clean aperture: Shows the range that guarantees image quality. short * short
・ Pixel aspect ratio: Indicates the aspect ratio of each pixel. float
・ Luminance offset: Indicates the position where luminance starts. float x 2
・ Chrominance offset: Indicates the position where the color difference starts. float x 2
・ Luminance pitch: Indicates thinning out of luminance pixels. char x 2
・ Chrominance pitch: Indicates pixel thinning for color difference. char x 2
・ Bit width ... Indicates the data bit width of Y / Pb / Pr / tl. char x 4
• Y range: Shows luminance values of 100% white and 0% black. short x 2
・ Other range: Indicates the maximum and minimum values other than luminance. short x 2
・ Name of format… The common name of the format. char x 16
Here, long is an unsigned integer of 4 bytes, short is 2 bytes, and char is 1 byte. fixed is a 2bytes fixed point and is assumed to be 0x7fff = 1. 0x0001 ≒ 0.00003. In addition, float is only positive in all items as a value, but it is a normal 4bytes IBM floating point.
[0060]
The transmittance tl is only used for intermediate processing and is not included in the normal epl () execution output signal. Gamma can be expressed with coefficients (0.018, 4.5, 1.099, 0.45, 0.099) just like others, but the actual operation is a conversion table. The color difference can be either 2's comp or offset binary, and is expressed in the range range.
[0061]
FIG. 6 shows a specific example. This relates to (1080 / 59.95i). Detailed description is omitted.
[0062]
Returning now to FIG. The EPL created by the editing terminals 15, 16 and 17 is stored in the EPL storage unit 18. The EPL stored in the EPL storage unit 18 is read by the editing control unit 20. The edit control unit 20 generates an edit control signal based on the EPL and supplies the edit control signal to the content forming unit 30.
[0063]
The content forming unit 30 forms content in a predetermined format from the material based on the edit control signal supplied from the edit control unit 20. As described above, the input material is supplied to the content forming unit 30 via the input terminal IN.
[0064]
The content forming unit 30 stores the input material in the raw material server 31. The raw material server 31 is composed of a recording / playback unit having a disk array configuration and an AV server, and simultaneously takes in a plurality of specified video / audio data from each of the supplied raw materials, and converts them into files for recording / playback. Store at the specified address in the department.
[0065]
The raw material server 31 reads the stored raw material of each file based on the editing control signal supplied from the editing control unit 20 and supplies it to the editing execution unit 32 connected to the raw material server 31.
[0066]
The editing execution unit 32 includes a plurality (two in this case) of decoders 33 and 34, a switcher & effector 35 that is a main part of the editing execution unit 32, and an encoder 36. The raw material decoded by each of the decoders 33 and 34 is subjected to an editing process by the switcher & effector 35 based on the editing control signal supplied from the editing control unit 20 and then supplied to the encoder 36. The encoder 36 performs an encoding process on the edited data subjected to the editing process in a format based on the edit control signal supplied from the edit control unit 20 and then supplies the edit data to the output terminal OUT.
[0067]
In the editing execution unit 32, the switcher & effector 35, when two raw material outputs are simultaneously given from the decoders 33 and 34, A / B roll editing, that is, switching editing and insertion editing using two signals, Alternatively, when performing overlay editing or the like, editing processing is performed in real time using the input two raw material outputs. Further, when one raw material output is given from the decoder 33 or 34, the switcher & effector 35 reads two necessary raw materials in order in time when performing A / B roll editing, and inputs them first. The original material is temporarily stored in an internal buffer, and the editing process is performed in non-real time using the subsequently input raw material and the previously stored raw material.
[0068]
As described above, the content forming apparatus 1 shown in FIG. 1 uses the UMID for specifying the material and output used for editing, the UTID for specifying the processing method, the input material, and the output material. A scan format for specifying the format is described in the EPL. For this reason, at the time of editing execution, since the material can be acquired by ID, it is possible to operate without transmitting heavy image data. In addition, copyright protection and billing are possible by acquiring the material each time. Moreover, since the processing method can be cited by ID, the editing environment (equipment capability) can be selected. Also, copyright protection and billing of the processing method itself can be performed. You can also choose the input material. In addition, outputs in multiple formats can be obtained simultaneously. Also, the work of creating an EPL can be performed with low image quality, so there is no need to select a location or environment.
[0069]
The EPL creation unit 10 in the content forming apparatus 1 creates an EPL according to the editing list creation method of the present invention, so that it can cope with multi-format image data while preventing deterioration of image data quality. In addition, an edit list for creating contents is created so that the processing can be further interchanged without temporarily storing and using the material.
[0070]
Next, a description will be given of a content forming system in which EPLs are distributed and created by a plurality of groups existing at several locations and content is edited. In the editing work using EPL, since the material is not processed directly, it is possible to proceed with the work distributed among a plurality of groups existing in several places.
[0071]
FIG. 7 shows an overall configuration diagram of the content forming system 60. The material editing group 66, the editing result storage / retrieval group 74, and the editing result utilization group 82 each constitute a LAN, and these LANs are connected to form a first editing group section. The computer graphic processing group 93, the closed caption processing group 102, and the local station 111 also constitute a LAN, and connect these LANs to form a second editing group section.
[0072]
In this system, a material file 64 composed of video and / or audio recorded by a video camera 61 is supplied to a material editing group 66 of a first editing group section via an external network 63 such as the Internet. .
[0073]
First, the material editing group 66 that constitutes the first editing group section will be described. The material editing group 66 is in the gate 65 and the gates 89 and 73, and includes two computer terminals 67 and 68, a material server (O) 69, a decoder / encoder (D) 70, and an intra frame for offline editing. A server (I) 71 and an EPL server (E) 72 are included. The intraframe server corresponds to the sub-material server 14 shown in FIG.
[0074]
The operator of the material editing group 66 uses the computer terminal 67 or 68 to download the material file 64 from the storage location or from the video camera 61 via the external network 63 and stores it in the material server 69 and the intraframe server 71. .
[0075]
In the intraframe server 71, as described above, it is stored as a highly compressed sub-material. That is, the material stored in the material file 64 is decoded by the decoder / encoder 70 and then subjected to thinning processing, etc., further encoded into a highly compressed sub material, and this sub material is stored in the intra frame server 71. .
[0076]
The two computer terminals 67 and 68 also function as the editing terminal shown in FIG. 1, read out the sub-material from the intra frame server 71, decodes it, and display the video based on the obtained video data on the monitor. . At this time, the operator controls the intra-frame server 71 via the computer terminal and visually confirms the video displayed on the monitor while causing the intra-frame server 71 to execute a desired operation (playback, rewind, fast-forward, etc.). To create an EPL. As described above, the EPL includes identification information for specifying a material used for editing and an output, and a format declaration statement that defines a format of at least a part of the material.
Here, the created EPL is stored in the EPL server 72. The EPL stored in the EPL server 72 is read for division of labor by other groups constituting the first editing group part and each group constituting the second editing group part.
[0077]
Next, the edit result storage search group 74 will be described. This edit result storage / retrieval group 74 is located in the gate 73 and the gate 81, and includes two computer terminals 75 and 76, a material server (O) 77, a decoder / encoder (D) 78, and an intra for offline editing. It consists of a frame server (I) 79 and an EPL server (E) 80.
[0078]
The edit result storage / retrieval group 74 takes out the EPL from the EPL server 72 and stores it in the EPL server 80, performs editing based on the stored EPL, and creates and stores temporary content. As a result, the content forming system 60 can store necessary editing results as materials. Also, EPL and editing results can be searched.
[0079]
Next, the edit result usage group 82 will be described. This editing result use group 82 is on the sending side from the gate 81, and includes two computer terminals 83 and 84, a material server (O) 85, an EPL server (E) 86, a sending decoder / switcher / effector 87, and so on. , A media decoder / switcher / effector 88.
[0080]
Then, the editing result utilization group 82 takes out the EPL from the EPL server 72 and stores it in the EPL server 86. The content based on the stored EPL is stored in the computer terminal 83 corresponding to the editing control unit 20 in FIG. 1 and 84, and is created using the material stored in the material server 85, and the transmission decoder / switcher / effector 87 or the media decoder / switcher / effector 88 corresponding to the editing execution unit 32 of FIG. To send or distribute as media.
[0081]
The second editing group part will be described. The second editing group unit is connected to the first editing group unit via the external network 90 connected to the gates 89 and 92, and the EPL can be transmitted bidirectionally in the form of the program folder 91. it can.
[0082]
The computer graphic processing group 93, the closed caption processing group 102, and the local station 111 constituting the second editing group section are groups that perform EPL creation in a distributed manner.
[0083]
First, the computer graphic processing group 93 will be described. The computer graphic processing group 93 includes two computer terminals 94 and 95, a material server (O) 96, a decoder / encoder (D) 97, an intraframe server (I) 98 for offline editing, and an EPL server (E ) 99 and a computer graphic server (CG) 100. The intra frame server 98 corresponds to the sub material server 14 shown in FIG.
[0084]
The operator of the computer graphic processing group 93 stores the EPL in the program folder from the EPL server 72 of the material editing group 66, downloads it, and stores it in the EPL server 99. In the intraframe server 98, the material used when performing the computer graphic processing is stored as a highly compressed material by the decoder / encoder 97. Then, the computer terminal 94 or 95 uses the computer graphic server (CG) 100 to display the EPL on the monitor while editing the sub-material read from the intra-frame server 98 by performing CG processing. Here, the created EPL is stored in the EPL server 99 and simultaneously stored in the program folder and sent to the EPL server 72 of the material editing group 66.
[0085]
Next, the closed caption processing group 102 will be described. The closed caption processing group 102 includes two computer terminals 103 and 104, a material server (O) 105, a decoder / encoder (D) 106, an intraframe server (I) 107 for offline editing, and an EPL server (E ) 108 and a closed caption server (CC) 109.
[0086]
The operator of the closed caption processing group 102 stores the EPL in the program folder from the EPL server 72 of the material editing group 66, downloads it, and stores it in the EPL server 108. In the intra frame server 107, the material used when the closed caption processing is performed is stored as a highly compressed material by the decoder / encoder 105. Then, the computer terminal 103 or 104 uses the closed caption server (CC) 109 to display the EPL on the monitor while performing editing by performing CC processing on the sub-material read from the intra-frame server 107. Here, the created EPL is stored in the EPL server 108 and simultaneously stored in the program folder and sent to the EPL server 72 of the material editing group 66.
[0087]
Next, the local station 111 will be described. The local station 111 includes two computer terminals 112 and 113, a material server (O) 114, a decoder / encoder (D) 115, an intraframe server (I) 116 for offline editing, and an EPL server (E) 117. And a local unique information (DI) server 118.
[0088]
The operator of the local station 111 stores the EPL in the program folder from the EPL server 72 of the material editing group 66, downloads it, and stores it in the EPL server 117. In the intraframe server 116, the material used for editing of the local station is stored as a highly compressed material by the decoder / encoder 115. Then, the computer terminal 112 or 113 uses the local unique information (DI) server 118 to display the EPL on the monitor while performing original editing on the sub-material read from the intra-frame server 116. Here, the created EPL is stored in the EPL server 118 and simultaneously stored in the program folder and sent to the EPL server 72 of the material editing group 66.
[0089]
Finally, the material editing group 66 manages each EPL in the EPL server 72, and integrates and optimizes each EPL. The editing result storage / retrieval group 74 and the editing result utilization group 82 use the EPL integrated and optimized in the material editing group 66.
[0090]
As described above, the content forming system shown in FIG. 7 has the UMID for specifying the material and output image used for editing, the UTID for specifying the processing method, the input material, and the output. A scan format for specifying an image format is described in EPL. For this reason, at the time of editing execution, since the material can be acquired by ID, it is possible to operate without transmitting heavy image data. In addition, copyright protection and billing are possible by acquiring the material each time. Moreover, since the processing method can be cited by ID, the editing environment (equipment capability) can be selected. Also, copyright protection and billing of the processing method itself can be performed. You can also choose the input material. In addition, outputs in multiple formats can be obtained simultaneously. Also, the work of creating an EPL can be performed with low image quality, so there is no need to select a location or environment. In addition, in the editing work, since the material is not directly processed, the work can be simultaneously performed by the divided group by the distributed group.
[0091]
Next, specific examples of EPL editing work division of labor will be described with reference to FIGS. After roughly editing the raw material recorded in the interview and creating EPL (1), EPL (2-a) for cut editing, EPL (2-b) for mosaic editing, EPL (2-c) for Japanese subtitles, English translation It is assumed that subtitle EPL (2-d) is created in parallel, and finally EPL (3) optimized together is created and then executed (output of a complete packet video signal). In this example, format {} and individual processing with similar expressions are omitted.
[0092]
FIG. 8 is a functional block diagram of the content forming system 120 that divides EPL editing work. An EPL (1) is created by roughly editing a material composed of video and / or audio captured by the video camera 121 by a logging unit (coarse editing unit) 122. Using this EPL (1), the cutting editing unit 123, the mosaic editing unit 124, the subtitle Japanese editing unit 125, and the subtitle English editing unit 126 proceed with the editing in parallel, and the cut editing EPL (2-a ), EPL (2-b) for mosaic editing, EPL (2-c) for Japanese subtitles, and EPL (2-d) for English subtitles. Of course, the coarse editing unit 122, the cutting editing unit 123, the mosaic editing unit 124, the subtitle Japanese editing unit 125, and the subtitle English editing unit 126 have the same configuration and functions as the EPL creation unit 10 shown in FIG. Yes.
[0093]
The Japanese and English integration / optimization unit 127 and the like integrate and optimize EPLs (2-a), (2-b), (2-c), and (2-d) from each editing unit, EPL (3) is generated. The Japanese and English integration / optimization unit 127 and the like also have the function of the editing control unit 20 shown in FIG. The EPL (3) is sent to the editing execution unit 128 that actually performs editing.
[0094]
The editing execution unit 128 has the same configuration function as the content forming unit 30 shown in FIG. 1 and stores the material from the video camera 121 in the internal server, so that the EPL (3) is stored. Can be used to edit.
[0095]
FIG. 9 shows a coarse editing EPL (1) created by the coarse editing unit 122. The output is specified by the UMID “12345608_23450467_0800468A88000021”. Then, the start point and end point of editing are described by the time code of the start frame and the time code of the end frame. Here, the start point is “00: 00: 00.00” and the end point is “00: 01: 03.12”. The video format of this output can be specified by the description “# 1080i”.
[0096]
Next, the input material is identified by the UMID “29543202_234504C0_0800468A72000098”, and it is specified that the input material of the video format “# 1080i” is read from the storage location “file: //43.14.61.62/source/”.
[0097]
Next, five parallel processes are performed on the input 1 by a pair of “fork” and “join”, and the outputs are collectively added by join. First, the first process is to paste the material together with the interviewer from the time axis “10: 00: 00.12” on the input side from the time axis “00: 00.00” to “00: 03.00” on the output side. It is. The second process is to paste the material from the time axis “10: 01: 05.23” on the input side from the time axis “00: 03.00” to “00: 20.13” on the output side. is there. The third process is to paste the material from the time axis “10: 02: 54.11” on the input side from the time axis “00: 20.13” to “00: 40.09” on the output side. is there. The fourth process is to paste the background image of the speaker's head from the time axis “10: 05: 18.19” on the input side from the time axis “00: 40.09” to “00: 43.10” on the output side. is there. The fifth process is to paste the material from the time axis “10: 07: 33.03” on the input side from the time axis “00: 43.10” to “01: 03.12” on the output side. is there.
[0098]
FIG. 10 shows an EPL (2-a) for cut editing created by the cutting editing unit 123. In UMID “00521209_234504A3_0800468A89000128”, the output is specified, and the start point and end point of editing are specified as “00: 00: 00.00” and “00: 00: 45.00”. The output video format can also be specified by the description “# 1080i”.
[0099]
Next, the UMID “12345608_23450467_0800468A88000021” specifies that the input material of the video format “# 1080i” is to be taken out from the storage location “file: //43.14.61.62/source/”.
[0100]
Then, the following five cut edits are performed using the input material. First, in the first process, the material from the time axis “00: 00: 00.07” on the input side is pasted from the time axis “00: 00.00” to “00: 23.04” on the output side. In the second process, the material from the time axis “00: 00: 32.23” on the input side is pasted from the time axis “00: 23.04” to “00: 28.17” on the output side. In the third process, the material from the time axis “00: 00: 40.09” on the input side is pasted from the time axis “00: 28.17” to “00: 31.18” on the output side. In the fourth process, the material from the time axis “00: 00: 44.12” on the input side is pasted from the time axis “00: 31.18” to “00: 37.29” on the output side. In the fifth process, the material from the time axis “00: 00: 52.21” on the input side is pasted from the time axis “00: 37.29” to “00: 45.00” on the output side. These five cut edits are added together.
[0101]
After the descriptions of “fork” and “join” that wrap up the above five processes, there are descriptions of “jack (mosaic)” and “jack (super)”. “Jack” indicates a reception position from “child EPL” at the time of optimization in the integration / optimization unit 127. (Mosaic) and (super) are temporary IDs given arbitrarily by the user. Here, (mosaic) is used because it indicates the position where the EPL created by the mosaic editing performed by the mosaic editing unit 124 is received. Further, (super) is used because it indicates the position to receive the EPL created by the Japanese subtitle editing performed by the subtitle Japanese editing unit 125. After optimization, the descriptions “jack (mosaic)” and “jack (super)” disappear.
[0102]
FIG. 11 shows an EPL (2-b) for mosaic editing created by the mosaic editing unit 124. In UMID “21341109_23450411_0800468A9B000032”, the output is specified, and the start point and end point of editing are specified as “00: 00: 00.00” and “00: 01: 03.12”. The video format of the output video can also be specified by the description “# 1080i”.
[0103]
Next, the UMID “12345608_23450467_0800468A88000021” specifies that the input material of the video format “# 1080i” is to be taken out from the storage location “file: //43.14.61.62/source/”.
[0104]
Then, the following two mosaic edits are performed using the input material. First, the first mosaic editing uses the image processing specified by the processing ID (UTID) “12000000000C0004” stored in the storage location “ftp://43.14.61.62/exec/” and the input material and The same video format “# 1080i” is used with a setting value “= 384 × 232 + 880 + 128”. The editing result obtained by this mosaic editing is pasted from the start point “00: 03.00” to the end point “00: 40.09”. The second mosaic edit is the same as the input material using the image processing specified by the processing ID (UTID) “12000000000C0004” stored in the storage location “ftp://43.14.61.62/exec/” The video format is “# 1080i” and the setting value is “= 400x256 + 864 + 96”. The editing result obtained by this mosaic editing is pasted from the start point “00: 43.00” to the end point “01: 03.12”. These two mosaic edits are added together.
[0105]
There is a description “plug (mosaic)” after the description “fork” and “join” that summarize the above two processes. “Plug” indicates a delivery position to “parent EPL” at the time of optimization in the integration / optimization unit 127. “(Mosaic)” is a temporary ID given arbitrarily by the user. After optimization, the description “plug (mosaic)” disappears.
[0106]
FIG. 12 shows an EPL (2-c) for editing Japanese subtitles created by the subtitle Japanese editing unit 125. The output is specified by the UMID “12221109_234504FB_0800468AC1000341”, and the start and end points of editing are specified as “00: 00: 00.00” and “00: 01: 03.12”. The output video format can also be specified by the description “# 1080i”.
[0107]
Next, the UMID “12345608_23450467_0800468A88000021” specifies that the input material of the video format “# 1080i” is to be taken out from the storage location “file: //43.14.61.62/source/”.
[0108]
Then, the following editing is performed using the input material. First, using the processing method specified by the processing ID (UTID) “1200000000130081” stored in the storage location “ftp://43.14.61.62/exec/”, a video format “#” similar to the input material is used. Create a subtitle "1080p" and "Man on the plane". The result of this subtitle creation is pasted from the start point “00: 00.00” to the end point “00: 10.00”. Next, using the processing method specified by the processing ID (UTID) “1200000000120081” stored in the storage location “ftp://43.14.61.62/exec/”, a video format “ In # 1080i, superimpose (paste) the Japanese subtitle “I lost my mind as soon as I took off” from the start point “00: 01.00” to the end point “00: 04.02”. Next, using the same processing method stored in the same storage location, with the same video format, the Japanese subtitle “Wake up on the south island” was started from the starting point “00: 04.12” Superimpose to end point "00: 07.29". Then, paste some Japanese subtitles into the image, and finally, using the same processing method stored in the same storage location, with the same video format, Superimpose the Japanese subtitles from the start point “01: 00.12” to the end point “01: 03.12”. These edits are added together.
[0109]
As described above, “plug (super)” described after the description of “fork” and “join” that wraps the above processing is changed to “parent EPL” at the time of optimization by the integration / optimization unit 127. This indicates the delivery position.
[0110]
FIG. 13 shows an EPL (2-d) of English translation subtitle editing created by the subtitle English editing unit 126. This EPL is an English version of the EPL for Japanese subtitle editing described with reference to FIG. Although the subtitle and the ID of the translation process are different, the contents are substantially the same, and the description is omitted here.
[0111]
In FIG. 14, the EPL (2-a), (2-b), and (2-c) from the editing unit is integrated and optimized by the Japanese integration / optimization unit 127. 3) is shown. This is an EPL obtained by integrating and optimizing cut editing, mosaic editing, and Japanese subtitle editing described with reference to FIGS. Detailed description is omitted.
[0112]
In addition, a similar English version can be generated by integrating and optimizing EPLs (2-a), (2-b), and (2-d) in the English integration / optimization unit 128. Omitted.
[0113]
In the above example, two-stage cut editing has been performed, and since there are places where the temporary editing seams are not rejoined in the main editing but are utilized as they are, there are many editing points when the two are integrated.
[0114]
Here, the material, titler, and effector are all obtained from the same server. Moreover, although not specified, it is placed on the same LAN as the device that executes the editing. Although it is a safe method for operation, it is expected that more information will be obtained from a remote server.
[0115]
For reference, an example of converting integration / optimization for NTSC is shown in FIG. The video format of the input source of the material is “# 1080i”, but since the conversion is for NTSC, the processing and output format is “# 525ii”. Therefore, when these are integrated, an EPL (3) with “down converter” added at the end is generated. When the processing order is clear, connection by plug () and jack () is unnecessary.
[0116]
In this way, the content forming system 120 whose configuration is shown in FIG. 8 can divide EPL editing work. This is because the editing work does not process the material directly, so the work can be carried out simultaneously in a division of labor system. In addition, the input material and the format of the output video are specified by the scan format in the EPL created by each editing unit. For this reason, the input material can be freely selected. In addition, output videos in a plurality of formats can be obtained simultaneously.
[0117]
As a specific example of editing work at a remote place, in addition to the system shown in FIG. 7, a content forming system 130 as shown in FIG. 16 can be configured. A material composed of video and / or audio captured by the video camera 131 is compressed by the low-rate encoder 132 and sent to the editing unit 135 via the mobile phone 133 or the Internet 134 as a sub material. The editing unit 135 creates an EPL by visually confirming the video displayed on the monitor while executing the sub material in a desired operation (reproduction, rewind, fast forward, etc.). The EPL has identification information for specifying a material used for editing and an output image, and a format declaration statement that defines the format of at least a part of the material. Then, the generated EPL is sent to the editing execution unit 140 via the mobile phone 136 or the Internet 137. The material from the video camera 131 is also sent to the editing execution unit 140 by hand carry of the video tape 138 or the Internet 139. And since the edit execution part 140 has stored the said raw material in the internal server, it can edit using the said EPL.
[0118]
In the above description, the UMID for specifying the material used for editing and the output, the UTID for specifying the processing method, and the scan format for specifying the format of the input material and the output video are described in the EPL. We explained that the problem could be solved by doing.
[0119]
However, as a conventional problem, there has been a problem related to degradation of image quality. For example, data can be compressed from cut editing that connects several cuts (video scenes) to video recorded with a video camera and telop editing that superimposes telop characters, and then broadcasting the completed video. Repeatedly, the image quality deteriorates. A specific example will be described with reference to the process transition diagram of FIG. First, a video shot by the video camera 150 is compressed by a bit rate reduction (BRR) encoding (enc) process 151 and recorded as video material 152 on a video tape. When cut editing is performed on the video material 152, the compressed video material is once expanded by the decoding (dec) processing 153 and then cut editing by the editing processing (Edit 1) 154. The video material subjected to the cut editing is compressed again by the encoding process 155 and then recorded on the video tape as the video material 156. Next, when performing telop editing on the video material 156, the compressed video material is also expanded by the decoding (dec) processing 157, and then the telop is superimposed by the editing processing (Edit2) 158. To do. The video material subjected to the telop editing is compressed again by the encoding process 159 and then recorded on the video tape as the video material 160. Since the video material 160 is converted into a broadcast NTSC format in accordance with the broadcast date, the video material 160 is first subjected to a decoding process 161 and then an NTSC encoding process 152, for example, from a terrestrial antenna 163 to a television. It is sent out as a broadcast wave. In this series of processing, the video material is compressed four times. The decompression process is performed three times. Here, image quality degradation occurs.
[0120]
The content forming apparatus is also effective in solving the problem of image quality degradation. FIG. 18 shows a specific example. In this specific example, a material composed of video and / or audio captured by a video camera 170 is compressed by a bit rate reduction (BRR) encoding (enc) processing 171 and the video material is recorded on a video tape. Recorded as 172. This video material 172 is sent to the EPL creation process 173.
[0121]
The EPL creation processing 173 performs cut editing and telop editing by generating an EPL. When cut editing is performed on the video material 172, the compressed video material is temporarily expanded by the decoding (dec) processing 174, and then cut editing is performed by the editing processing (Edit1) 175. This cut editing is performed by creating an EPL. The telop editing is performed by the telop editing process 177 using the EPL created by the cut editing process 175. Specifically, the telop editing process 177 creates an EPL for telop editing while monitoring the material decoded by the decoder 176.
[0122]
The EPL created in the EPL creation process 173 is sent to the edit execution process 179. The material decoded by the decoding process 178 is also supplied to the edit execution process 179. Then, the edit execution processing 179 performs cut editing and telop editing on the material according to the EPL, and sends the editing result to the NTSC encoding processing 180. Then, the NTSC encoding process 180 transmits the data in the NTSC format as, for example, a television broadcast wave from the terrestrial antenna 181. In this series of processes, only the compression process is performed twice on the video material. Also, the decoding process is practically performed only once.
[0123]
Therefore, the content forming system shown in FIG. 18 can suppress deterioration in image quality more than the conventional method shown in FIG. In other words, the image quality can be maintained because compression / decompression is not repeated as in the middle of editing.
[0124]
In addition, the content forming apparatus can maintain the image quality even when, for example, a common program is broadcast in two systems with different formats in a simulcast. Simulcast broadcasting will be described with reference to FIGS. 19 and 20.
[0125]
FIG. 19 shows a conventional system for simulcast broadcasting in both the NTSC format and the high-definition format. The simulcast broadcasting system 190 includes a video of “1080i” read from the video tape 191 and a video of “1080i” obtained from the NTSC format “525i” read from the video tape 192 by the up-conversion unit 193. The editing process 194 is performed using. The editing process 194 is performed in the “1080i” format, and generates an output video in the high-definition format. Then, one is transmitted as a broadcast wave from the antenna 195 for high vision. On the other hand, for NTSC, an image converted to 525i by down conversion 196 is transmitted as a broadcast wave from the antenna 197.
[0126]
Therefore, in this system 190, the NTSC format video of “525i” is once up-converted to “1080i”, then edited with “1080i”, the “1080i” output is down-converted again to “525i”, and NTSC It is for use. NTSC video is also edited at “1080i” and “525i” before broadcasting.
[0127]
On the other hand, according to the simulcast broadcasting system 200 shown in FIG. 20 to which the content forming apparatus is applied, the image quality of NTSC video is not deteriorated. That is, when the editing execution unit 203 and the editing execution unit 204 execute editing based on the EPL created by the EPL creating unit 10 shown in FIG. 1 (not shown), the system 200 performs the NTSC video after editing. (“525i”) can be generated without repeating up-conversion and down-conversion.
[0128]
The video format conversion from the HD image (1080i) to the SD image (525i) and from the SD image to the HD image performed by the editing execution unit 203 or 204 of the system 200 will be described with reference to FIG.
[0129]
In FIG. 21, the input video signal is stored in the field memory 211 and the field memory 212 in order. The motion detection unit 210 detects motion from the field image to which the difference on the time axis is given by the two field memories 211 and 212. The result of motion detection by the motion detection unit 210, that is, the frame / field tap selection signal indicating that there is motion in the frame image / motion in the field image is supplied to the transversal type vertical filter 213. Is done. The transversal type vertical filter 213 performs vertical filter processing on the field image given the time difference by the two field memories 211 and 212 based on the frame / field tap selection signal. The filter output of the vertical filter 213 is supplied to a transversal type horizontal filter 214. The horizontal filter 214 performs horizontal filter processing on the vertical filter output. The horizontal filter output of the horizontal filter 214 is supplied to the image enhancement unit 215.
[0130]
The image enhancement unit 215 emphasizes the high frequency component of the horizontal filter output. The enhancement output from the image enhancement unit 215 is supplied to the image signal conversion unit 216. The image signal converter 216 converts the Y / Pb / Pr signal into an RGB signal. This RGB signal is supplied to the inverse gamma correction unit 217 and subjected to inverse gamma correction. This inverse gamma correction output is supplied to a color conversion unit (color metric conversion unit) 218. The color metric conversion unit 218 performs color conversion processing on the inverse gamma correction output. This color conversion processing output is supplied to the gamma correction unit 219.
[0131]
The gamma correction unit 219 performs gamma correction processing on the color conversion processing output and supplies it to the image signal conversion unit 220. The image signal converter 220 converts the RGB signal into a Y / Pb / Pr signal. This Y / Pb / Pr signal becomes the output video signal.
[0132]
Therefore, in the configuration shown in FIG. 21, down conversion processing or up conversion processing can be handled by changing the conversion processing in the image quality conversion processing unit 216 or the image quality conversion processing unit 220.
[0133]
【The invention's effect】
As described above, the edit list creation method according to the present invention defines the editing content using at least the identification information for identifying the output by editing and the format declaration statement for specifying the format, and the identification information for identifying the input material and the input material Since the input material is defined using at least the format declaration statement that identifies the format of the file, and the processing applied to the input material is further defined, the data quality is prevented from degrading and multi-format data is supported. It is possible to create an edit list that can form content without further collecting and using the material at hand, and further enabling processing compatibility.
[0134]
In addition, identification information for identifying the material used for editing and editing output, identification information for identifying the processing method, and format declaration statements for identifying the format of the input material and output video are displayed in the edit list. Since it is described, the material can be acquired by ID when editing is performed, so that it is possible to operate without transmitting heavy image data. In addition, copyright protection and billing are possible by acquiring the material each time. Moreover, since the processing method can be cited by ID, the editing environment (equipment capability) can be selected. Also, copyright protection and billing of the processing method itself can be performed. You can also choose the input material. In addition, outputs in multiple formats can be obtained simultaneously. Also, the work of creating an EPL can be performed with low image quality, so there is no need to select a location or environment. In addition, in the editing work, since the material is not directly processed, the work can be simultaneously performed by the divided group by the distributed group.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of a content forming apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a description example of EPL.
FIG. 3 is a diagram illustrating a description example of EPL.
FIG. 4 is a diagram illustrating an execution image of EPL.
FIG. 5 is a diagram schematically showing an image created after editing using EPL.
FIG. 6 is a diagram illustrating a specific example of a video scan format.
FIG. 7 is a diagram showing an overall configuration of a content forming system.
FIG. 8 is a diagram showing a content forming system that performs division of editing by EPL.
9 is a diagram showing a coarse editing EPL (1) created by the coarse editing unit of the content forming system of FIG.
10 is a diagram showing a cut editing EPL (2-a) created by the cut editing unit of the content forming system shown in FIG. 8; FIG.
11 is a diagram showing a mosaic editing EPL (2-b) created by the mosaic editing unit of the content forming system shown in FIG.
12 is a diagram showing Japanese subtitle editing EPL (2-c) created by the Japanese subtitle editing unit of the content forming system of FIG. 8; FIG.
13 is a diagram showing an English subtitle editing EPL (2-d) created by an English subtitle editing unit of the content forming system of FIG.
14 is a diagram showing an optimized EPL (3) created by the Japanese language integration / optimization unit of the content formation system of FIG.
FIG. 15 is a diagram showing an EPL obtained by converting integration / optimization for NTSC.
FIG. 16 is a diagram showing another specific example in which editing work is performed at a remote place.
FIG. 17 is a diagram for explaining a problem of image quality degradation that occurs from recording to broadcasting.
FIG. 18 is a diagram illustrating a specific example of a content forming apparatus and method of the present invention that solves the above-described image quality degradation.
FIG. 19 is a configuration diagram of a conventional system that performs simulcast broadcasting in both the NTSC format and the high-definition format.
FIG. 20 is a configuration diagram of a simulcast broadcasting system to which the content forming apparatus and method of the present invention are applied.
FIG. 21 is a diagram for explaining video format conversion;
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Content formation apparatus, 10 EPL production part, 20 Edit control part, 30 Content formation part

Claims (6)

In an edit list creation method for creating an edit list for forming content using a plurality of video and / or audio materials,
Create an edit list by executing a desired operation using compressed data obtained by compressing a plurality of video and / or audio materials input from an input unit connected to a network,
Generate an edit control signal based on the above edit list,
The edit list above is
Input material identification information for identifying input material , output identification information for identifying output by editing, a format declaration statement for specifying an image format of the input material and / or an image format of the edited output, and an image processing method applied to the input material Image processing identification information representing
An image processing method for obtaining the input material from the storage location specified by the input material identification information via the network and applying the input material to the input material from the storage location specified by the image processing identification information. How to create edit list to get . The input material identification information and the output identification information, edit list creation process of Ah Ru claim 1, wherein an identification code of the global unique identity scheme. Edit list creation method according to claim 1, wherein that describes the processing method to be performed on the input material in the identification code of the global unique identity scheme. The image format is one frame time at the time of shooting, the number of effective pixels of the horizontal and vertical image, the edit list creation method according to claim 1, wherein Ru scan format der containing at least the items of the aspect ratio of each pixel. A plurality of video and / or audio materials input from the input unit connected to the network are compressed into high-compression sub-materials, stored in the sub-material server, and read from the sub-material server. The edit list creation method according to claim 1, wherein the edit list is created by executing the desired operation using a material. A plurality of video and / or audio materials input from an input unit connected to the network are decoded by a decoder, down-converted by a down converter, and compressed by a predetermined compression method by an encoder, so that the high compression sub The edit list creation method according to claim 5, wherein the edit list is used as a material.

Images